Human-centric predictive model of task difficulty for human-in-the-loop control tasks

PubMed Central

Majewicz Fey, Ann

2018-01-01

Quantitatively measuring the difficulty of a manipulation task in human-in-the-loop control systems is ill-defined. Currently, systems are typically evaluated through task-specific performance measures and post-experiment user surveys; however, these methods do not capture the real-time experience of human users. In this study, we propose to analyze and predict the difficulty of a bivariate pointing task, with a haptic device interface, using human-centric measurement data in terms of cognition, physical effort, and motion kinematics. Noninvasive sensors were used to record the multimodal response of human user for 14 subjects performing the task. A data-driven approach for predicting task difficulty was implemented based on several task-independent metrics. We compare four possible models for predicting task difficulty to evaluated the roles of the various types of metrics, including: (I) a movement time model, (II) a fusion model using both physiological and kinematic metrics, (III) a model only with kinematic metrics, and (IV) a model only with physiological metrics. The results show significant correlation between task difficulty and the user sensorimotor response. The fusion model, integrating user physiology and motion kinematics, provided the best estimate of task difficulty (R2 = 0.927), followed by a model using only kinematic metrics (R2 = 0.921). Both models were better predictors of task difficulty than the movement time model (R2 = 0.847), derived from Fitt’s law, a well studied difficulty model for human psychomotor control. PMID:29621301

Comparison of task-based exposure metrics for an epidemiologic study of isocyanate inhalation exposures among autobody shop workers.

PubMed

Woskie, Susan R; Bello, Dhimiter; Gore, Rebecca J; Stowe, Meredith H; Eisen, Ellen A; Liu, Youcheng; Sparer, Judy A; Redlich, Carrie A; Cullen, Mark R

2008-09-01

Because many occupational epidemiologic studies use exposure surrogates rather than quantitative exposure metrics, the UMass Lowell and Yale study of autobody shop workers provided an opportunity to evaluate the relative utility of surrogates and quantitative exposure metrics in an exposure response analysis of cross-week change in respiratory function. A task-based exposure assessment was used to develop several metrics of inhalation exposure to isocyanates. The metrics included the surrogates, job title, counts of spray painting events during the day, counts of spray and bystander exposure events, and a quantitative exposure metric that incorporated exposure determinant models based on task sampling and a personal workplace protection factor for respirator use, combined with a daily task checklist. The result of the quantitative exposure algorithm was an estimate of the daily time-weighted average respirator-corrected total NCO exposure (microg/m(3)). In general, these four metrics were found to be variable in agreement using measures such as weighted kappa and Spearman correlation. A logistic model for 10% drop in FEV(1) from Monday morning to Thursday morning was used to evaluate the utility of each exposure metric. The quantitative exposure metric was the most favorable, producing the best model fit, as well as the greatest strength and magnitude of association. This finding supports the reports of others that reducing exposure misclassification can improve risk estimates that otherwise would be biased toward the null. Although detailed and quantitative exposure assessment can be more time consuming and costly, it can improve exposure-disease evaluations and is more useful for risk assessment purposes. The task-based exposure modeling method successfully produced estimates of daily time-weighted average exposures in the complex and changing autobody shop work environment. The ambient TWA exposures of all of the office workers and technicians and 57% of the

Validation of the updated ArthroS simulator: face and construct validity of a passive haptic virtual reality simulator with novel performance metrics.

PubMed

Garfjeld Roberts, Patrick; Guyver, Paul; Baldwin, Mathew; Akhtar, Kash; Alvand, Abtin; Price, Andrew J; Rees, Jonathan L

2017-02-01

To assess the construct and face validity of ArthroS, a passive haptic VR simulator. A secondary aim was to evaluate the novel performance metrics produced by this simulator. Two groups of 30 participants, each divided into novice, intermediate or expert based on arthroscopic experience, completed three separate tasks on either the knee or shoulder module of the simulator. Performance was recorded using 12 automatically generated performance metrics and video footage of the arthroscopic procedures. The videos were blindly assessed using a validated global rating scale (GRS). Participants completed a survey about the simulator's realism and training utility. This new simulator demonstrated construct validity of its tasks when evaluated against a GRS (p ≤ 0.003 in all cases). Regarding it's automatically generated performance metrics, established outputs such as time taken (p ≤ 0.001) and instrument path length (p ≤ 0.007) also demonstrated good construct validity. However, two-thirds of the proposed 'novel metrics' the simulator reports could not distinguish participants based on arthroscopic experience. Face validity assessment rated the simulator as a realistic and useful tool for trainees, but the passive haptic feedback (a key feature of this simulator) is rated as less realistic. The ArthroS simulator has good task construct validity based on established objective outputs, but some of the novel performance metrics could not distinguish between surgical experience. The passive haptic feedback of the simulator also needs improvement. If simulators could offer automated and validated performance feedback, this would facilitate improvements in the delivery of training by allowing trainees to practise and self-assess.

Performance Metrics, Error Modeling, and Uncertainty Quantification

NASA Technical Reports Server (NTRS)

Tian, Yudong; Nearing, Grey S.; Peters-Lidard, Christa D.; Harrison, Kenneth W.; Tang, Ling

2016-01-01

A common set of statistical metrics has been used to summarize the performance of models or measurements-­ the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying un­certainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling meth­odology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.

New paradigm for task switching strategies while performing multiple tasks: entropy and symbolic dynamics analysis of voluntary patterns.

PubMed

Guastello, Stephen J; Gorin, Hillary; Huschen, Samuel; Peters, Natalie E; Fabisch, Megan; Poston, Kirsten

2012-10-01

It has become well established in laboratory experiments that switching tasks, perhaps due to interruptions at work, incur costs in response time to complete the next task. Conditions are also known that exaggerate or lessen the switching costs. Although switching costs can contribute to fatigue, task switching can also be an adaptive response to fatigue. The present study introduces a new research paradigm for studying the emergence of voluntary task switching regimes, self-organizing processes therein, and the possibly conflicting roles of switching costs and minimum entropy. Fifty-four undergraduates performed 7 different computer-based cognitive tasks producing sets of 49 responses under instructional conditions requiring task quotas or no quotas. The sequences of task choices were analyzed using orbital decomposition to extract pattern types and lengths, which were then classified and compared with regard to Shannon entropy, topological entropy, number of task switches involved, and overall performance. Results indicated that similar but different patterns were generated under the two instructional conditions, and better performance was associated with lower topological entropy. Both entropy metrics were associated with the amount of voluntary task switching. Future research should explore conditions affecting the trade-off between switching costs and entropy, levels of automaticity between task elements, and the role of voluntary switching regimes on fatigue.

Evaluation of eye metrics as a detector of fatigue.

PubMed

McKinley, R Andy; McIntire, Lindsey K; Schmidt, Regina; Repperger, Daniel W; Caldwell, John A

2011-08-01

This study evaluated oculometrics as a detector of fatigue in Air Force-relevant tasks after sleep deprivation. Using the metrics of total eye closure duration (PERCLOS) and approximate entropy (ApEn), the relation between these eye metrics and fatigue-induced performance decrements was investigated. One damaging effect to the successful outcome of operational military missions is that attributed to sleep deprivation-induced fatigue. Consequently, there is interest in the development of reliable monitoring devices that can assess when an operator is overly fatigued. Ten civilian participants volunteered to serve in this study. Each was trained on three performance tasks: target identification, unmanned aerial vehicle landing, and the psychomotor vigilance task (PVT). Experimental testing began after 14 hr awake and continued every 2 hr until 28 hr of sleep deprivation was reached. Performance on the PVT and target identification tasks declined significantly as the level of sleep deprivation increased.These performance declines were paralleled more closely by changes in the ApEn compared to the PERCLOS measure. The results provide evidence that the ApEn eye metric can be used to detect fatigue in relevant military aviation tasks. Military and commercial operators could benefit from an alertness monitoring device.

Adaptive distance metric learning for diffusion tensor image segmentation.

PubMed

Kong, Youyong; Wang, Defeng; Shi, Lin; Hui, Steve C N; Chu, Winnie C W

2014-01-01

High quality segmentation of diffusion tensor images (DTI) is of key interest in biomedical research and clinical application. In previous studies, most efforts have been made to construct predefined metrics for different DTI segmentation tasks. These methods require adequate prior knowledge and tuning parameters. To overcome these disadvantages, we proposed to automatically learn an adaptive distance metric by a graph based semi-supervised learning model for DTI segmentation. An original discriminative distance vector was first formulated by combining both geometry and orientation distances derived from diffusion tensors. The kernel metric over the original distance and labels of all voxels were then simultaneously optimized in a graph based semi-supervised learning approach. Finally, the optimization task was efficiently solved with an iterative gradient descent method to achieve the optimal solution. With our approach, an adaptive distance metric could be available for each specific segmentation task. Experiments on synthetic and real brain DTI datasets were performed to demonstrate the effectiveness and robustness of the proposed distance metric learning approach. The performance of our approach was compared with three classical metrics in the graph based semi-supervised learning framework.

Adaptive Distance Metric Learning for Diffusion Tensor Image Segmentation

PubMed Central

Kong, Youyong; Wang, Defeng; Shi, Lin; Hui, Steve C. N.; Chu, Winnie C. W.

2014-01-01

High quality segmentation of diffusion tensor images (DTI) is of key interest in biomedical research and clinical application. In previous studies, most efforts have been made to construct predefined metrics for different DTI segmentation tasks. These methods require adequate prior knowledge and tuning parameters. To overcome these disadvantages, we proposed to automatically learn an adaptive distance metric by a graph based semi-supervised learning model for DTI segmentation. An original discriminative distance vector was first formulated by combining both geometry and orientation distances derived from diffusion tensors. The kernel metric over the original distance and labels of all voxels were then simultaneously optimized in a graph based semi-supervised learning approach. Finally, the optimization task was efficiently solved with an iterative gradient descent method to achieve the optimal solution. With our approach, an adaptive distance metric could be available for each specific segmentation task. Experiments on synthetic and real brain DTI datasets were performed to demonstrate the effectiveness and robustness of the proposed distance metric learning approach. The performance of our approach was compared with three classical metrics in the graph based semi-supervised learning framework. PMID:24651858

Gaze entropy reflects surgical task load.

PubMed

Di Stasi, Leandro L; Diaz-Piedra, Carolina; Rieiro, Héctor; Sánchez Carrión, José M; Martin Berrido, Mercedes; Olivares, Gonzalo; Catena, Andrés

2016-11-01

Task (over-)load imposed on surgeons is a main contributing factor to surgical errors. Recent research has shown that gaze metrics represent a valid and objective index to asses operator task load in non-surgical scenarios. Thus, gaze metrics have the potential to improve workplace safety by providing accurate measurements of task load variations. However, the direct relationship between gaze metrics and surgical task load has not been investigated yet. We studied the effects of surgical task complexity on the gaze metrics of surgical trainees. We recorded the eye movements of 18 surgical residents, using a mobile eye tracker system, during the performance of three high-fidelity virtual simulations of laparoscopic exercises of increasing complexity level: Clip Applying exercise, Cutting Big exercise, and Translocation of Objects exercise. We also measured performance accuracy and subjective rating of complexity. Gaze entropy and velocity linearly increased with increased task complexity: Visual exploration pattern became less stereotyped (i.e., more random) and faster during the more complex exercises. Residents performed better the Clip Applying exercise and the Cutting Big exercise than the Translocation of Objects exercise and their perceived task complexity differed accordingly. Our data show that gaze metrics are a valid and reliable surgical task load index. These findings have potential impacts to improve patient safety by providing accurate measurements of surgeon task (over-)load and might provide future indices to assess residents' learning curves, independently of expensive virtual simulators or time-consuming expert evaluation.

Predicting dual-task performance with the Multiple Resources Questionnaire (MRQ).

PubMed

Boles, David B; Bursk, Jonathan H; Phillips, Jeffrey B; Perdelwitz, Jason R

2007-02-01

The objective was to assess the validity of the Multiple Resources Questionnaire (MRQ) in predicting dual-task interference. Subjective workload measures such as the Subjective Workload Assessment Technique (SWAT) and NASA Task Load Index are sensitive to single-task parameters and dual-task loads but have not attempted to measure workload in particular mental processes. An alternative is the MRQ. In Experiment 1, participants completed simple laboratory tasks and the MRQ after each. Interference between tasks was then correlated to three different task similarity metrics: profile similarity, based on r(2) between ratings; overlap similarity, based on summed minima; and overall demand, based on summed ratings. Experiment 2 used similar methods but more complex computer-based games. In Experiment 1 the MRQ moderately predicted interference (r = +.37), with no significant difference between metrics. In Experiment 2 the metric effect was significant, with overlap similarity excelling in predicting interference (r = +.83). Mean ratings showed high diagnosticity in identifying specific mental processing bottlenecks. The MRQ shows considerable promise as a cognitive-process-sensitive workload measure. Potential applications of the MRQ include the identification of dual-processing bottlenecks as well as process overloads in single tasks, preparatory to redesign in areas such as air traffic management, advanced flight displays, and medical imaging.

The correlation between fundamental characteristics and first-time performance in laparoscopic tasks.

PubMed

Harrington, Cuan M; Bresler, Richard; Ryan, Donncha; Dicker, Patrick; Traynor, Oscar; Kavanagh, Dara O

2018-04-01

The ability of characteristics to predict first time performance in laparoscopic tasks is not well described. Videogame experience predicts positive performance in laparoscopic experiences but its mechanism and confounding-association with aptitude remains to be elucidated. This study sought to evaluate for innate predictors of laparoscopic performance in surgically naive individuals with minimal videogame exposure. Participants with no prior laparoscopic exposure and minimal videogaming experience were recruited consecutively from preclinical years at a medical university. Participants completed four visuospatial, one psychomotor aptitude test and an electronic survey, followed by four laparoscopic tasks on a validated Virtual Reality simulator (LAP Mentor™). Twenty eligible individuals participated with a mean age of 20.8 (±3.8) years. Significant intra-aptitude performance correlations were present amongst 75% of the visuospatial tests. These visuospatial aptitudes correlated significantly with multiple laparoscopic task metrics: number of movements of a dominant instrument (r s  ≥ -0.46), accuracy rate of clip placement (r s  ≥ 0.50) and time taken (r s  ≥ -0.47) (p < 0.05). Musical Instrument experience predicted higher average speed of instruments (r s  ≥ 0.47) (p < 0.05). Participant's revised competitive index level predicted lower proficiency in laparoscopic metrics including: pathlength, economy and number of movements of dominant instrument (r s  ≥ 0.46) (p < 0.05). Multiple visuospatial aptitudes and innate competitive level influenced baseline laparoscopic performances across several tasks in surgically naïve individuals. Copyright © 2017 Elsevier Inc. All rights reserved.

Metrics for Offline Evaluation of Prognostic Performance

NASA Technical Reports Server (NTRS)

Saxena, Abhinav; Celaya, Jose; Saha, Bhaskar; Saha, Sankalita; Goebel, Kai

2010-01-01

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Metrics for Performance Evaluation of Patient Exercises during Physical Therapy.

PubMed

Vakanski, Aleksandar; Ferguson, Jake M; Lee, Stephen

2017-06-01

The article proposes a set of metrics for evaluation of patient performance in physical therapy exercises. Taxonomy is employed that classifies the metrics into quantitative and qualitative categories, based on the level of abstraction of the captured motion sequences. Further, the quantitative metrics are classified into model-less and model-based metrics, in reference to whether the evaluation employs the raw measurements of patient performed motions, or whether the evaluation is based on a mathematical model of the motions. The reviewed metrics include root-mean square distance, Kullback Leibler divergence, log-likelihood, heuristic consistency, Fugl-Meyer Assessment, and similar. The metrics are evaluated for a set of five human motions captured with a Kinect sensor. The metrics can potentially be integrated into a system that employs machine learning for modelling and assessment of the consistency of patient performance in home-based therapy setting. Automated performance evaluation can overcome the inherent subjectivity in human performed therapy assessment, and it can increase the adherence to prescribed therapy plans, and reduce healthcare costs.

75 FR 7581 - RTO/ISO Performance Metrics; Notice Requesting Comments on RTO/ISO Performance Metrics

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-22

... performance communicate about the benefits of RTOs and, where appropriate, (2) changes that need to be made to... of staff from all the jurisdictional ISOs/RTOs to develop a set of performance metrics that the ISOs/RTOs will use to report annually to the Commission. Commission staff and representatives from the ISOs...

A Classification Scheme for Smart Manufacturing Systems’ Performance Metrics

PubMed Central

Lee, Y. Tina; Kumaraguru, Senthilkumaran; Jain, Sanjay; Robinson, Stefanie; Helu, Moneer; Hatim, Qais Y.; Rachuri, Sudarsan; Dornfeld, David; Saldana, Christopher J.; Kumara, Soundar

2017-01-01

This paper proposes a classification scheme for performance metrics for smart manufacturing systems. The discussion focuses on three such metrics: agility, asset utilization, and sustainability. For each of these metrics, we discuss classification themes, which we then use to develop a generalized classification scheme. In addition to the themes, we discuss a conceptual model that may form the basis for the information necessary for performance evaluations. Finally, we present future challenges in developing robust, performance-measurement systems for real-time, data-intensive enterprises. PMID:28785744

Determining GPS average performance metrics

NASA Technical Reports Server (NTRS)

Moore, G. V.

1995-01-01

Analytic and semi-analytic methods are used to show that users of the GPS constellation can expect performance variations based on their location. Specifically, performance is shown to be a function of both altitude and latitude. These results stem from the fact that the GPS constellation is itself non-uniform. For example, GPS satellites are over four times as likely to be directly over Tierra del Fuego than over Hawaii or Singapore. Inevitable performance variations due to user location occur for ground, sea, air and space GPS users. These performance variations can be studied in an average relative sense. A semi-analytic tool which symmetrically allocates GPS satellite latitude belt dwell times among longitude points is used to compute average performance metrics. These metrics include average number of GPS vehicles visible, relative average accuracies in the radial, intrack and crosstrack (or radial, north/south, east/west) directions, and relative average PDOP or GDOP. The tool can be quickly changed to incorporate various user antenna obscuration models and various GPS constellation designs. Among other applications, tool results can be used in studies to: predict locations and geometries of best/worst case performance, design GPS constellations, determine optimal user antenna location and understand performance trends among various users.

Evaluation of image deblurring methods via a classification metric

NASA Astrophysics Data System (ADS)

Perrone, Daniele; Humphreys, David; Lamb, Robert A.; Favaro, Paolo

2012-09-01

The performance of single image deblurring algorithms is typically evaluated via a certain discrepancy measure between the reconstructed image and the ideal sharp image. The choice of metric, however, has been a source of debate and has also led to alternative metrics based on human visual perception. While fixed metrics may fail to capture some small but visible artifacts, perception-based metrics may favor reconstructions with artifacts that are visually pleasant. To overcome these limitations, we propose to assess the quality of reconstructed images via a task-driven metric. In this paper we consider object classification as the task and therefore use the rate of classification as the metric to measure deblurring performance. In our evaluation we use data with different types of blur in two cases: Optical Character Recognition (OCR), where the goal is to recognise characters in a black and white image, and object classification with no restrictions on pose, illumination and orientation. Finally, we show how off-the-shelf classification algorithms benefit from working with deblurred images.

Metric Learning for Hyperspectral Image Segmentation

NASA Technical Reports Server (NTRS)

Bue, Brian D.; Thompson, David R.; Gilmore, Martha S.; Castano, Rebecca

2011-01-01

We present a metric learning approach to improve the performance of unsupervised hyperspectral image segmentation. Unsupervised spatial segmentation can assist both user visualization and automatic recognition of surface features. Analysts can use spatially-continuous segments to decrease noise levels and/or localize feature boundaries. However, existing segmentation methods use tasks-agnostic measures of similarity. Here we learn task-specific similarity measures from training data, improving segment fidelity to classes of interest. Multiclass Linear Discriminate Analysis produces a linear transform that optimally separates a labeled set of training classes. The defines a distance metric that generalized to a new scenes, enabling graph-based segmentation that emphasizes key spectral features. We describe tests based on data from the Compact Reconnaissance Imaging Spectrometer (CRISM) in which learned metrics improve segment homogeneity with respect to mineralogical classes.

The importance of metrics for evaluating scientific performance

NASA Astrophysics Data System (ADS)

Miyakawa, Tsuyoshi

Evaluation of scientific performance is a major factor that determines the behavior of both individual researchers and the academic institutes to which they belong. Because the number of researchers heavily outweighs the number of available research posts, and the competitive funding accounts for an ever-increasing proportion of research budget, some objective indicators of research performance have gained recognition for increasing transparency and openness. It is common practice to use metrics and indices to evaluate a researcher's performance or the quality of their grant applications. Such measures include the number of publications, the number of times these papers are cited and, more recently, the h-index, which measures the number of highly-cited papers the researcher has written. However, academic institutions and funding agencies in Japan have been rather slow to adopt such metrics. In this article, I will outline some of the currently available metrics, and discuss why we need to use such objective indicators of research performance more often in Japan. I will also discuss how to promote the use of metrics and what we should keep in mind when using them, as well as their potential impact on the research community in Japan.

The influence of time management skill on the curvilinear relationship between organizational citizenship behavior and task performance.

PubMed

Rapp, Adam A; Bachrach, Daniel G; Rapp, Tammy L

2013-07-01

In this research we integrate resource allocation and social exchange perspectives to build and test theory focusing on the moderating role of time management skill in the nonmonotonic relationship between organizational citizenship behavior (OCB) and task performance. Results from matching survey data collected from 212 employees and 41 supervisors and from task performance metrics collected several months later indicate that the curvilinear association between OCB and task performance is significantly moderated by employees' time management skill. Implications for theory and practice are discussed. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Assessing colonoscopic inspection skill using a virtual withdrawal simulation: a preliminary validation of performance metrics.

PubMed

Zupanc, Christine M; Wallis, Guy M; Hill, Andrew; Burgess-Limerick, Robin; Riek, Stephan; Plooy, Annaliese M; Horswill, Mark S; Watson, Marcus O; de Visser, Hans; Conlan, David; Hewett, David G

2017-07-12

The effectiveness of colonoscopy for diagnosing and preventing colon cancer is largely dependent on the ability of endoscopists to fully inspect the colonic mucosa, which they achieve primarily through skilled manipulation of the colonoscope during withdrawal. Performance assessment during live procedures is problematic. However, a virtual withdrawal simulation can help identify and parameterise actions linked to successful inspection, and offer standardised assessments for trainees. Eleven experienced endoscopists and 18 endoscopy novices (medical students) completed a mucosal inspection task during three simulated colonoscopic withdrawals. The two groups were compared on 10 performance metrics to preliminarily assess the validity of these measures to describe inspection quality. Four metrics were related to aspects of polyp detection: percentage of polyp markers found; number of polyp markers found per minute; percentage of the mucosal surface illuminated by the colonoscope (≥0.5 s); and percentage of polyp markers illuminated (≥2.5 s) but not identified. A further six metrics described the movement of the colonoscope: withdrawal time; linear distance travelled by the colonoscope tip; total distance travelled by the colonoscope tip; and distance travelled by the colonoscope tip due to movement of the up/down angulation control, movement of the left/right angulation control, and axial shaft rotation. Statistically significant experienced-novice differences were found for 8 of the 10 performance metrics (p's < .005). Compared with novices, experienced endoscopists inspected more of the mucosa and detected more polyp markers, at a faster rate. Despite completing the withdrawals more quickly than the novices, the experienced endoscopists also moved the colonoscope more in terms of linear distance travelled and overall tip movement, with greater use of both the up/down angulation control and axial shaft rotation. However, the groups did not differ in the

Evaluating Algorithm Performance Metrics Tailored for Prognostics

NASA Technical Reports Server (NTRS)

Saxena, Abhinav; Celaya, Jose; Saha, Bhaskar; Saha, Sankalita; Goebel, Kai

2009-01-01

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Metric-driven harm: an exploration of unintended consequences of performance measurement.

PubMed

Rambur, Betty; Vallett, Carol; Cohen, Judith A; Tarule, Jill Mattuck

2013-11-01

Performance measurement is an increasingly common element of the US health care system. Typically a proxy for high quality outcomes, there has been little systematic investigation of the potential negative unintended consequences of performance metrics, including metric-driven harm. This case study details an incidence of post-surgical metric-driven harm and offers Smith's 1995 work and a patient centered, context sensitive metric model for potential adoption by nurse researchers and clinicians. Implications for further research are discussed. © 2013.

Metrics for building performance assurance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Koles, G.; Hitchcock, R.; Sherman, M.

This report documents part of the work performed in phase I of a Laboratory Directors Research and Development (LDRD) funded project entitled Building Performance Assurances (BPA). The focus of the BPA effort is to transform the way buildings are built and operated in order to improve building performance by facilitating or providing tools, infrastructure, and information. The efforts described herein focus on the development of metrics with which to evaluate building performance and for which information and optimization tools need to be developed. The classes of building performance metrics reviewed are (1) Building Services (2) First Costs, (3) Operating Costs,more » (4) Maintenance Costs, and (5) Energy and Environmental Factors. The first category defines the direct benefits associated with buildings; the next three are different kinds of costs associated with providing those benefits; the last category includes concerns that are broader than direct costs and benefits to the building owner and building occupants. The level of detail of the various issues reflect the current state of knowledge in those scientific areas and the ability of the to determine that state of knowledge, rather than directly reflecting the importance of these issues; it intentionally does not specifically focus on energy issues. The report describes work in progress and is intended as a resource and can be used to indicate the areas needing more investigation. Other reports on BPA activities are also available.« less

Snow removal performance metrics : final report.

DOT National Transportation Integrated Search

2017-05-01

This document is the final report for the Clear Roads project entitled Snow Removal Performance Metrics. The project team was led by researchers at Washington State University on behalf of Clear Roads, an ongoing pooled fund research effort focused o...

Evaluating hydrological model performance using information theory-based metrics

USDA-ARS?s Scientific Manuscript database

The accuracy-based model performance metrics not necessarily reflect the qualitative correspondence between simulated and measured streamflow time series. The objective of this work was to use the information theory-based metrics to see whether they can be used as complementary tool for hydrologic m...

Performance Metrics for Soil Moisture Retrievals and Applications Requirements

USDA-ARS?s Scientific Manuscript database

Quadratic performance metrics such as root-mean-square error (RMSE) and time series correlation are often used to assess the accuracy of geophysical retrievals and true fields. These metrics are generally related; nevertheless each has advantages and disadvantages. In this study we explore the relat...

A probability metric for identifying high-performing facilities: an application for pay-for-performance programs.

PubMed

Shwartz, Michael; Peköz, Erol A; Burgess, James F; Christiansen, Cindy L; Rosen, Amy K; Berlowitz, Dan

2014-12-01

Two approaches are commonly used for identifying high-performing facilities on a performance measure: one, that the facility is in a top quantile (eg, quintile or quartile); and two, that a confidence interval is below (or above) the average of the measure for all facilities. This type of yes/no designation often does not do well in distinguishing high-performing from average-performing facilities. To illustrate an alternative continuous-valued metric for profiling facilities--the probability a facility is in a top quantile--and show the implications of using this metric for profiling and pay-for-performance. We created a composite measure of quality from fiscal year 2007 data based on 28 quality indicators from 112 Veterans Health Administration nursing homes. A Bayesian hierarchical multivariate normal-binomial model was used to estimate shrunken rates of the 28 quality indicators, which were combined into a composite measure using opportunity-based weights. Rates were estimated using Markov Chain Monte Carlo methods as implemented in WinBUGS. The probability metric was calculated from the simulation replications. Our probability metric allowed better discrimination of high performers than the point or interval estimate of the composite score. In a pay-for-performance program, a smaller top quantile (eg, a quintile) resulted in more resources being allocated to the highest performers, whereas a larger top quantile (eg, being above the median) distinguished less among high performers and allocated more resources to average performers. The probability metric has potential but needs to be evaluated by stakeholders in different types of delivery systems.

Viewpoint matters: objective performance metrics for surgeon endoscope control during robot-assisted surgery.

PubMed

Jarc, Anthony M; Curet, Myriam J

2017-03-01

Effective visualization of the operative field is vital to surgical safety and education. However, additional metrics for visualization are needed to complement other common measures of surgeon proficiency, such as time or errors. Unlike other surgical modalities, robot-assisted minimally invasive surgery (RAMIS) enables data-driven feedback to trainees through measurement of camera adjustments. The purpose of this study was to validate and quantify the importance of novel camera metrics during RAMIS. New (n = 18), intermediate (n = 8), and experienced (n = 13) surgeons completed 25 virtual reality simulation exercises on the da Vinci Surgical System. Three camera metrics were computed for all exercises and compared to conventional efficiency measures. Both camera metrics and efficiency metrics showed construct validity (p < 0.05) across most exercises (camera movement frequency 23/25, camera movement duration 22/25, camera movement interval 19/25, overall score 24/25, completion time 25/25). Camera metrics differentiated new and experienced surgeons across all tasks as well as efficiency metrics. Finally, camera metrics significantly (p < 0.05) correlated with completion time (camera movement frequency 21/25, camera movement duration 21/25, camera movement interval 20/25) and overall score (camera movement frequency 20/25, camera movement duration 19/25, camera movement interval 20/25) for most exercises. We demonstrate construct validity of novel camera metrics and correlation between camera metrics and efficiency metrics across many simulation exercises. We believe camera metrics could be used to improve RAMIS proficiency-based curricula.

Performance metrics used by freight transport providers.

DOT National Transportation Integrated Search

2008-09-30

The newly-established National Cooperative Freight Research Program (NCFRP) has allocated $300,000 in funding to a project entitled Performance Metrics for Freight Transportation (NCFRP 03). The project is scheduled for completion in September ...

Towards New Metrics for High-Performance Computing Resilience

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hukerikar, Saurabh; Ashraf, Rizwan A; Engelmann, Christian

Ensuring the reliability of applications is becoming an increasingly important challenge as high-performance computing (HPC) systems experience an ever-growing number of faults, errors and failures. While the HPC community has made substantial progress in developing various resilience solutions, it continues to rely on platform-based metrics to quantify application resiliency improvements. The resilience of an HPC application is concerned with the reliability of the application outcome as well as the fault handling efficiency. To understand the scope of impact, effective coverage and performance efficiency of existing and emerging resilience solutions, there is a need for new metrics. In this paper, wemore » develop new ways to quantify resilience that consider both the reliability and the performance characteristics of the solutions from the perspective of HPC applications. As HPC systems continue to evolve in terms of scale and complexity, it is expected that applications will experience various types of faults, errors and failures, which will require applications to apply multiple resilience solutions across the system stack. The proposed metrics are intended to be useful for understanding the combined impact of these solutions on an application's ability to produce correct results and to evaluate their overall impact on an application's performance in the presence of various modes of faults.« less

Performance Metrics for Liquid Chromatography-Tandem Mass Spectrometry Systems in Proteomics Analyses*

PubMed Central

Rudnick, Paul A.; Clauser, Karl R.; Kilpatrick, Lisa E.; Tchekhovskoi, Dmitrii V.; Neta, Pedatsur; Blonder, Nikša; Billheimer, Dean D.; Blackman, Ronald K.; Bunk, David M.; Cardasis, Helene L.; Ham, Amy-Joan L.; Jaffe, Jacob D.; Kinsinger, Christopher R.; Mesri, Mehdi; Neubert, Thomas A.; Schilling, Birgit; Tabb, David L.; Tegeler, Tony J.; Vega-Montoto, Lorenzo; Variyath, Asokan Mulayath; Wang, Mu; Wang, Pei; Whiteaker, Jeffrey R.; Zimmerman, Lisa J.; Carr, Steven A.; Fisher, Susan J.; Gibson, Bradford W.; Paulovich, Amanda G.; Regnier, Fred E.; Rodriguez, Henry; Spiegelman, Cliff; Tempst, Paul; Liebler, Daniel C.; Stein, Stephen E.

2010-01-01

A major unmet need in LC-MS/MS-based proteomics analyses is a set of tools for quantitative assessment of system performance and evaluation of technical variability. Here we describe 46 system performance metrics for monitoring chromatographic performance, electrospray source stability, MS1 and MS2 signals, dynamic sampling of ions for MS/MS, and peptide identification. Applied to data sets from replicate LC-MS/MS analyses, these metrics displayed consistent, reasonable responses to controlled perturbations. The metrics typically displayed variations less than 10% and thus can reveal even subtle differences in performance of system components. Analyses of data from interlaboratory studies conducted under a common standard operating procedure identified outlier data and provided clues to specific causes. Moreover, interlaboratory variation reflected by the metrics indicates which system components vary the most between laboratories. Application of these metrics enables rational, quantitative quality assessment for proteomics and other LC-MS/MS analytical applications. PMID:19837981

Decomposition-based transfer distance metric learning for image classification.

PubMed

Luo, Yong; Liu, Tongliang; Tao, Dacheng; Xu, Chao

2014-09-01

Distance metric learning (DML) is a critical factor for image analysis and pattern recognition. To learn a robust distance metric for a target task, we need abundant side information (i.e., the similarity/dissimilarity pairwise constraints over the labeled data), which is usually unavailable in practice due to the high labeling cost. This paper considers the transfer learning setting by exploiting the large quantity of side information from certain related, but different source tasks to help with target metric learning (with only a little side information). The state-of-the-art metric learning algorithms usually fail in this setting because the data distributions of the source task and target task are often quite different. We address this problem by assuming that the target distance metric lies in the space spanned by the eigenvectors of the source metrics (or other randomly generated bases). The target metric is represented as a combination of the base metrics, which are computed using the decomposed components of the source metrics (or simply a set of random bases); we call the proposed method, decomposition-based transfer DML (DTDML). In particular, DTDML learns a sparse combination of the base metrics to construct the target metric by forcing the target metric to be close to an integration of the source metrics. The main advantage of the proposed method compared with existing transfer metric learning approaches is that we directly learn the base metric coefficients instead of the target metric. To this end, far fewer variables need to be learned. We therefore obtain more reliable solutions given the limited side information and the optimization tends to be faster. Experiments on the popular handwritten image (digit, letter) classification and challenge natural image annotation tasks demonstrate the effectiveness of the proposed method.

On the correlation between reservoir metrics and performance for time series classification under the influence of synaptic plasticity.

PubMed

Chrol-Cannon, Joseph; Jin, Yaochu

2014-01-01

Reservoir computing provides a simpler paradigm of training recurrent networks by initialising and adapting the recurrent connections separately to a supervised linear readout. This creates a problem, though. As the recurrent weights and topology are now separated from adapting to the task, there is a burden on the reservoir designer to construct an effective network that happens to produce state vectors that can be mapped linearly into the desired outputs. Guidance in forming a reservoir can be through the use of some established metrics which link a number of theoretical properties of the reservoir computing paradigm to quantitative measures that can be used to evaluate the effectiveness of a given design. We provide a comprehensive empirical study of four metrics; class separation, kernel quality, Lyapunov's exponent and spectral radius. These metrics are each compared over a number of repeated runs, for different reservoir computing set-ups that include three types of network topology and three mechanisms of weight adaptation through synaptic plasticity. Each combination of these methods is tested on two time-series classification problems. We find that the two metrics that correlate most strongly with the classification performance are Lyapunov's exponent and kernel quality. It is also evident in the comparisons that these two metrics both measure a similar property of the reservoir dynamics. We also find that class separation and spectral radius are both less reliable and less effective in predicting performance.

Climate Classification is an Important Factor in ­Assessing Hospital Performance Metrics

NASA Astrophysics Data System (ADS)

Boland, M. R.; Parhi, P.; Gentine, P.; Tatonetti, N. P.

2017-12-01

Context/Purpose: Climate is a known modulator of disease, but its impact on hospital performance metrics remains unstudied. Methods: We assess the relationship between Köppen-Geiger climate classification and hospital performance metrics, specifically 30-day mortality, as reported in Hospital Compare, and collected for the period July 2013 through June 2014 (7/1/2013 - 06/30/2014). A hospital-level multivariate linear regression analysis was performed while controlling for known socioeconomic factors to explore the relationship between all-cause mortality and climate. Hospital performance scores were obtained from 4,524 hospitals belonging to 15 distinct Köppen-Geiger climates and 2,373 unique counties. Results: Model results revealed that hospital performance metrics for mortality showed significant climate dependence (p<0.001) after adjusting for socioeconomic factors. Interpretation: Currently, hospitals are reimbursed by Governmental agencies using 30-day mortality rates along with 30-day readmission rates. These metrics allow Government agencies to rank hospitals according to their `performance' along these metrics. Various socioeconomic factors are taken into consideration when determining individual hospitals performance. However, no climate-based adjustment is made within the existing framework. Our results indicate that climate-based variability in 30-day mortality rates does exist even after socioeconomic confounder adjustment. Use of standardized high-level climate classification systems (such as Koppen-Geiger) would be useful to incorporate in future metrics. Conclusion: Climate is a significant factor in evaluating hospital 30-day mortality rates. These results demonstrate that climate classification is an important factor when comparing hospital performance across the United States.

Toward a better understanding of task demands, workload, and performance during physician-computer interactions.

PubMed

Mazur, Lukasz M; Mosaly, Prithima R; Moore, Carlton; Comitz, Elizabeth; Yu, Fei; Falchook, Aaron D; Eblan, Michael J; Hoyle, Lesley M; Tracton, Gregg; Chera, Bhishamjit S; Marks, Lawrence B

2016-11-01

To assess the relationship between (1) task demands and workload, (2) task demands and performance, and (3) workload and performance, all during physician-computer interactions in a simulated environment. Two experiments were performed in 2 different electronic medical record (EMR) environments: WebCIS (n = 12) and Epic (n = 17). Each participant was instructed to complete a set of prespecified tasks on 3 routine clinical EMR-based scenarios: urinary tract infection (UTI), pneumonia (PN), and heart failure (HF). Task demands were quantified using behavioral responses (click and time analysis). At the end of each scenario, subjective workload was measured using the NASA-Task-Load Index (NASA-TLX). Physiological workload was measured using pupillary dilation and electroencephalography (EEG) data collected throughout the scenarios. Performance was quantified based on the maximum severity of omission errors. Data analysis indicated that the PN and HF scenarios were significantly more demanding than the UTI scenario for participants using WebCIS (P < .01), and that the PN scenario was significantly more demanding than the UTI and HF scenarios for participants using Epic (P < .01). In both experiments, the regression analysis indicated a significant relationship only between task demands and performance (P < .01). Results suggest that task demands as experienced by participants are related to participants' performance. Future work may support the notion that task demands could be used as a quality metric that is likely representative of performance, and perhaps patient outcomes. The present study is a reasonable next step in a systematic assessment of how task demands and workload are related to performance in EMR-evolving environments. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Sleep restriction and cognitive load affect performance on a simulated marksmanship task.

PubMed

Smith, Carl D; Cooper, Adam D; Merullo, Donna J; Cohen, Bruce S; Heaton, Kristin J; Claro, Pedro J; Smith, Tracey

2017-11-24

Sleep restriction degrades cognitive and motor performance, which can adversely impact job performance and increase the risk of accidents. Military personnel are prone to operating under sleep restriction, and previous work suggests that military marksmanship may be negatively affected under such conditions. Results of these studies, however, are mixed and have often incorporated additional stressors (e.g. energy restriction) beyond sleep restriction. Moreover, few studies have investigated how the degree of difficulty of a marksmanship task impacts performance following sleep restriction. The purpose of the current experiment was to study the effects of sleep restriction on marksmanship while minimizing the potential influence of other forms of stress. A friend-foe discrimination challenge with greater or lesser degrees of complexity (high versus low load) was used as the primary marksmanship task. Active duty Soldiers were recruited, and allowed 2 h of sleep every 24 h over a 72-h testing period. Marksmanship tasks, cognitive assessment metrics and the NASA-Task Load Index were administered daily. Results indicated that reaction times to shoot foe targets and signal friendly targets slowed over time. In addition, the ability to correctly discriminate between friend and foe targets significantly decreased in the high-cognitive-load condition over time despite shot accuracy remaining stable. The NASA-Task Load Index revealed that, although marksmanship performance degraded, participants believed their performance did not change over time. These results further characterize the consequences of sleep restriction on marksmanship performance and the perception of performance, and reinforce the importance of adequate sleep among service members when feasible. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

Orbit design and optimization based on global telecommunication performance metrics

NASA Technical Reports Server (NTRS)

Lee, Seungwon; Lee, Charles H.; Kerridge, Stuart; Cheung, Kar-Ming; Edwards, Charles D.

2006-01-01

The orbit selection of telecommunications orbiters is one of the critical design processes and should be guided by global telecom performance metrics and mission-specific constraints. In order to aid the orbit selection, we have coupled the Telecom Orbit Analysis and Simulation Tool (TOAST) with genetic optimization algorithms. As a demonstration, we have applied the developed tool to select an optimal orbit for general Mars telecommunications orbiters with the constraint of being a frozen orbit. While a typical optimization goal is to minimize tele-communications down time, several relevant performance metrics are examined: 1) area-weighted average gap time, 2) global maximum of local maximum gap time, 3) global maximum of local minimum gap time. Optimal solutions are found with each of the metrics. Common and different features among the optimal solutions as well as the advantage and disadvantage of each metric are presented. The optimal solutions are compared with several candidate orbits that were considered during the development of Mars Telecommunications Orbiter.

Energy-Based Metrics for Arthroscopic Skills Assessment.

PubMed

Poursartip, Behnaz; LeBel, Marie-Eve; McCracken, Laura C; Escoto, Abelardo; Patel, Rajni V; Naish, Michael D; Trejos, Ana Luisa

2017-08-05

Minimally invasive skills assessment methods are essential in developing efficient surgical simulators and implementing consistent skills evaluation. Although numerous methods have been investigated in the literature, there is still a need to further improve the accuracy of surgical skills assessment. Energy expenditure can be an indication of motor skills proficiency. The goals of this study are to develop objective metrics based on energy expenditure, normalize these metrics, and investigate classifying trainees using these metrics. To this end, different forms of energy consisting of mechanical energy and work were considered and their values were divided by the related value of an ideal performance to develop normalized metrics. These metrics were used as inputs for various machine learning algorithms including support vector machines (SVM) and neural networks (NNs) for classification. The accuracy of the combination of the normalized energy-based metrics with these classifiers was evaluated through a leave-one-subject-out cross-validation. The proposed method was validated using 26 subjects at two experience levels (novices and experts) in three arthroscopic tasks. The results showed that there are statistically significant differences between novices and experts for almost all of the normalized energy-based metrics. The accuracy of classification using SVM and NN methods was between 70% and 95% for the various tasks. The results show that the normalized energy-based metrics and their combination with SVM and NN classifiers are capable of providing accurate classification of trainees. The assessment method proposed in this study can enhance surgical training by providing appropriate feedback to trainees about their level of expertise and can be used in the evaluation of proficiency.

Ranking streamflow model performance based on Information theory metrics

NASA Astrophysics Data System (ADS)

Martinez, Gonzalo; Pachepsky, Yakov; Pan, Feng; Wagener, Thorsten; Nicholson, Thomas

2016-04-01

The accuracy-based model performance metrics not necessarily reflect the qualitative correspondence between simulated and measured streamflow time series. The objective of this work was to use the information theory-based metrics to see whether they can be used as complementary tool for hydrologic model evaluation and selection. We simulated 10-year streamflow time series in five watersheds located in Texas, North Carolina, Mississippi, and West Virginia. Eight model of different complexity were applied. The information-theory based metrics were obtained after representing the time series as strings of symbols where different symbols corresponded to different quantiles of the probability distribution of streamflow. The symbol alphabet was used. Three metrics were computed for those strings - mean information gain that measures the randomness of the signal, effective measure complexity that characterizes predictability and fluctuation complexity that characterizes the presence of a pattern in the signal. The observed streamflow time series has smaller information content and larger complexity metrics than the precipitation time series. Watersheds served as information filters and and streamflow time series were less random and more complex than the ones of precipitation. This is reflected the fact that the watershed acts as the information filter in the hydrologic conversion process from precipitation to streamflow. The Nash Sutcliffe efficiency metric increased as the complexity of models increased, but in many cases several model had this efficiency values not statistically significant from each other. In such cases, ranking models by the closeness of the information-theory based parameters in simulated and measured streamflow time series can provide an additional criterion for the evaluation of hydrologic model performance.

Metrics for evaluating performance and uncertainty of Bayesian network models

Treesearch

Bruce G. Marcot

2012-01-01

This paper presents a selected set of existing and new metrics for gauging Bayesian network model performance and uncertainty. Selected existing and new metrics are discussed for conducting model sensitivity analysis (variance reduction, entropy reduction, case file simulation); evaluating scenarios (influence analysis); depicting model complexity (numbers of model...

Up Periscope! Designing a New Perceptual Metric for Imaging System Performance

NASA Technical Reports Server (NTRS)

Watson, Andrew B.

2016-01-01

Modern electronic imaging systems include optics, sensors, sampling, noise, processing, compression, transmission and display elements, and are viewed by the human eye. Many of these elements cannot be assessed by traditional imaging system metrics such as the MTF. More complex metrics such as NVTherm do address these elements, but do so largely through parametric adjustment of an MTF-like metric. The parameters are adjusted through subjective testing of human observers identifying specific targets in a set of standard images. We have designed a new metric that is based on a model of human visual pattern classification. In contrast to previous metrics, ours simulates the human observer identifying the standard targets. One application of this metric is to quantify performance of modern electronic periscope systems on submarines.

Promising high monetary rewards for future task performance increases intermediate task performance.

PubMed

Zedelius, Claire M; Veling, Harm; Bijleveld, Erik; Aarts, Henk

2012-01-01

In everyday life contexts and work settings, monetary rewards are often contingent on future performance. Based on research showing that the anticipation of rewards causes improved task performance through enhanced task preparation, the present study tested the hypothesis that the promise of monetary rewards for future performance would not only increase future performance, but also performance on an unrewarded intermediate task. Participants performed an auditory Simon task in which they responded to two consecutive tones. While participants could earn high vs. low monetary rewards for fast responses to every second tone, their responses to the first tone were not rewarded. Moreover, we compared performance under conditions in which reward information could prompt strategic performance adjustments (i.e., when reward information was presented for a relatively long duration) to conditions preventing strategic performance adjustments (i.e., when reward information was presented very briefly). Results showed that high (vs. low) rewards sped up both rewarded and intermediate, unrewarded responses, and the effect was independent of the duration of reward presentation. Moreover, long presentation led to a speed-accuracy trade-off for both rewarded and unrewarded tones, whereas short presentation sped up responses to rewarded and unrewarded tones without this trade-off. These results suggest that high rewards for future performance boost intermediate performance due to enhanced task preparation, and they do so regardless whether people respond to rewards in a strategic or non-strategic manner.

Promising High Monetary Rewards for Future Task Performance Increases Intermediate Task Performance

PubMed Central

Zedelius, Claire M.; Veling, Harm; Bijleveld, Erik; Aarts, Henk

2012-01-01

In everyday life contexts and work settings, monetary rewards are often contingent on future performance. Based on research showing that the anticipation of rewards causes improved task performance through enhanced task preparation, the present study tested the hypothesis that the promise of monetary rewards for future performance would not only increase future performance, but also performance on an unrewarded intermediate task. Participants performed an auditory Simon task in which they responded to two consecutive tones. While participants could earn high vs. low monetary rewards for fast responses to every second tone, their responses to the first tone were not rewarded. Moreover, we compared performance under conditions in which reward information could prompt strategic performance adjustments (i.e., when reward information was presented for a relatively long duration) to conditions preventing strategic performance adjustments (i.e., when reward information was presented very briefly). Results showed that high (vs. low) rewards sped up both rewarded and intermediate, unrewarded responses, and the effect was independent of the duration of reward presentation. Moreover, long presentation led to a speed-accuracy trade-off for both rewarded and unrewarded tones, whereas short presentation sped up responses to rewarded and unrewarded tones without this trade-off. These results suggest that high rewards for future performance boost intermediate performance due to enhanced task preparation, and they do so regardless whether people respond to rewards in a strategic or non-strategic manner. PMID:22905145

Constrained Metric Learning by Permutation Inducing Isometries.

PubMed

Bosveld, Joel; Mahmood, Arif; Huynh, Du Q; Noakes, Lyle

2016-01-01

The choice of metric critically affects the performance of classification and clustering algorithms. Metric learning algorithms attempt to improve performance, by learning a more appropriate metric. Unfortunately, most of the current algorithms learn a distance function which is not invariant to rigid transformations of images. Therefore, the distances between two images and their rigidly transformed pair may differ, leading to inconsistent classification or clustering results. We propose to constrain the learned metric to be invariant to the geometry preserving transformations of images that induce permutations in the feature space. The constraint that these transformations are isometries of the metric ensures consistent results and improves accuracy. Our second contribution is a dimension reduction technique that is consistent with the isometry constraints. Our third contribution is the formulation of the isometry constrained logistic discriminant metric learning (IC-LDML) algorithm, by incorporating the isometry constraints within the objective function of the LDML algorithm. The proposed algorithm is compared with the existing techniques on the publicly available labeled faces in the wild, viewpoint-invariant pedestrian recognition, and Toy Cars data sets. The IC-LDML algorithm has outperformed existing techniques for the tasks of face recognition, person identification, and object classification by a significant margin.

Analysis of Subjects' Vulnerability in a Touch Screen Game Using Behavioral Metrics.

PubMed

Parsinejad, Payam; Sipahi, Rifat

2017-12-01

In this article, we report results on an experimental study conducted with volunteer subjects playing a touch-screen game with two unique difficulty levels. Subjects have knowledge about the rules of both game levels, but only sufficient playing experience with the easy level of the game, making them vulnerable with the difficult level. Several behavioral metrics associated with subjects' playing the game are studied in order to assess subjects' mental-workload changes induced by their vulnerability. Specifically, these metrics are calculated based on subjects' finger kinematics and decision making times, which are then compared with baseline metrics, namely, performance metrics pertaining to how well the game is played and a physiological metric called pnn50 extracted from heart rate measurements. In balanced experiments and supported by comparisons with baseline metrics, it is found that some of the studied behavioral metrics have the potential to be used to infer subjects' mental workload changes through different levels of the game. These metrics, which are decoupled from task specifics, relate to subjects' ability to develop strategies to play the game, and hence have the advantage of offering insight into subjects' task-load and vulnerability assessment across various experimental settings.

Working Memory Training Improves Dual-Task Performance on Motor Tasks.

PubMed

Kimura, Takehide; Kaneko, Fuminari; Nagahata, Keita; Shibata, Eriko; Aoki, Nobuhiro

2017-01-01

The authors investigated whether working memory training improves motor-motor dual-task performance consisted of upper and lower limb tasks. The upper limb task was a simple reaction task and the lower limb task was an isometric knee extension task. 45 participants (age = 21.8 ± 1.6 years) were classified into a working memory training group (WM-TRG), dual-task training group, or control group. The training duration was 2 weeks (15 min, 4 times/week). Our results indicated that working memory capacity increased significantly only in the WM-TRG. Dual-task performance improved in the WM-TRG and dual-task training group. Our study provides the novel insight that working memory training improves dual-task performance without specific training on the target motor task.

Stability and Performance Metrics for Adaptive Flight Control

NASA Technical Reports Server (NTRS)

Stepanyan, Vahram; Krishnakumar, Kalmanje; Nguyen, Nhan; VanEykeren, Luarens

2009-01-01

This paper addresses the problem of verifying adaptive control techniques for enabling safe flight in the presence of adverse conditions. Since the adaptive systems are non-linear by design, the existing control verification metrics are not applicable to adaptive controllers. Moreover, these systems are in general highly uncertain. Hence, the system's characteristics cannot be evaluated by relying on the available dynamical models. This necessitates the development of control verification metrics based on the system's input-output information. For this point of view, a set of metrics is introduced that compares the uncertain aircraft's input-output behavior under the action of an adaptive controller to that of a closed-loop linear reference model to be followed by the aircraft. This reference model is constructed for each specific maneuver using the exact aerodynamic and mass properties of the aircraft to meet the stability and performance requirements commonly accepted in flight control. The proposed metrics are unified in the sense that they are model independent and not restricted to any specific adaptive control methods. As an example, we present simulation results for a wing damaged generic transport aircraft with several existing adaptive controllers.

Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty

PubMed Central

Swihart, Robert K.; Sundaram, Mekala; Höök, Tomas O.; DeWoody, J. Andrew; Kellner, Kenneth F.

2016-01-01

Research productivity and impact are often considered in professional evaluations of academics, and performance metrics based on publications and citations increasingly are used in such evaluations. To promote evidence-based and informed use of these metrics, we collected publication and citation data for 437 tenure-track faculty members at 33 research-extensive universities in the United States belonging to the National Association of University Fisheries and Wildlife Programs. For each faculty member, we computed 8 commonly used performance metrics based on numbers of publications and citations, and recorded covariates including academic age (time since Ph.D.), sex, percentage of appointment devoted to research, and the sub-disciplinary research focus. Standardized deviance residuals from regression models were used to compare faculty after accounting for variation in performance due to these covariates. We also aggregated residuals to enable comparison across universities. Finally, we tested for temporal trends in citation practices to assess whether the “law of constant ratios”, used to enable comparison of performance metrics between disciplines that differ in citation and publication practices, applied to fisheries and wildlife sub-disciplines when mapped to Web of Science Journal Citation Report categories. Our regression models reduced deviance by ¼ to ½. Standardized residuals for each faculty member, when combined across metrics as a simple average or weighted via factor analysis, produced similar results in terms of performance based on percentile rankings. Significant variation was observed in scholarly performance across universities, after accounting for the influence of covariates. In contrast to findings for other disciplines, normalized citation ratios for fisheries and wildlife sub-disciplines increased across years. Increases were comparable for all sub-disciplines except ecology. We discuss the advantages and limitations of our methods

Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty.

PubMed

Swihart, Robert K; Sundaram, Mekala; Höök, Tomas O; DeWoody, J Andrew; Kellner, Kenneth F

2016-01-01

Research productivity and impact are often considered in professional evaluations of academics, and performance metrics based on publications and citations increasingly are used in such evaluations. To promote evidence-based and informed use of these metrics, we collected publication and citation data for 437 tenure-track faculty members at 33 research-extensive universities in the United States belonging to the National Association of University Fisheries and Wildlife Programs. For each faculty member, we computed 8 commonly used performance metrics based on numbers of publications and citations, and recorded covariates including academic age (time since Ph.D.), sex, percentage of appointment devoted to research, and the sub-disciplinary research focus. Standardized deviance residuals from regression models were used to compare faculty after accounting for variation in performance due to these covariates. We also aggregated residuals to enable comparison across universities. Finally, we tested for temporal trends in citation practices to assess whether the "law of constant ratios", used to enable comparison of performance metrics between disciplines that differ in citation and publication practices, applied to fisheries and wildlife sub-disciplines when mapped to Web of Science Journal Citation Report categories. Our regression models reduced deviance by ¼ to ½. Standardized residuals for each faculty member, when combined across metrics as a simple average or weighted via factor analysis, produced similar results in terms of performance based on percentile rankings. Significant variation was observed in scholarly performance across universities, after accounting for the influence of covariates. In contrast to findings for other disciplines, normalized citation ratios for fisheries and wildlife sub-disciplines increased across years. Increases were comparable for all sub-disciplines except ecology. We discuss the advantages and limitations of our methods

Colonoscopy Quality: Metrics and Implementation

PubMed Central

Calderwood, Audrey H.; Jacobson, Brian C.

2013-01-01

Synopsis Colonoscopy is an excellent area for quality improvement 1 because it is high volume, has significant associated risk and expense, and there is evidence that variability in its performance affects outcomes. The best endpoint for validation of quality metrics in colonoscopy is colorectal cancer incidence and mortality, but because of feasibility issues, a more readily accessible metric is the adenoma detection rate (ADR). Fourteen quality metrics were proposed by the joint American Society of Gastrointestinal Endoscopy/American College of Gastroenterology Task Force on “Quality Indicators for Colonoscopy” in 2006, which are described in further detail below. Use of electronic health records and quality-oriented registries will facilitate quality measurement and reporting. Unlike traditional clinical research, implementation of quality improvement initiatives involves rapid assessments and changes on an iterative basis, and can be done at the individual, group, or facility level. PMID:23931862

Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

PubMed

Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

2016-11-01

To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

GPS Device Testing Based on User Performance Metrics

DOT National Transportation Integrated Search

2015-10-02

1. Rationale for a Test Program Based on User Performance Metrics ; 2. Roberson and Associates Test Program ; 3. Status of, and Revisions to, the Roberson and Associates Test Program ; 4. Comparison of Roberson and DOT/Volpe Programs

Metrics help rural hospitals achieve world-class performance.

PubMed

Goodspeed, Scott W

2006-01-01

This article describes the emerging trend of using metrics in rural hospitals to achieve world-class performance. This trend is a response to the fact that rural hospitals have small patient volumes yet must maintain a profit margin in order to fulfill their mission to the community. The conceptual idea for this article is based largely on Robert Kaplan and David Norton's Balanced Scorecard articles in the Harvard Business Review. The ideas also come from the experiences of the 60-plus rural hospitals that are using the Balanced Scorecard and their implementation of metrics to influence performance and behavior. It is indeed possible for rural hospitals to meet and exceed the unique needs of patients and physicians (customers), to achieve healthy profit margins, and to be the rural hospital of choice that employees are proud to work for.

Grading the Metrics: Performance-Based Funding in the Florida State University System

ERIC Educational Resources Information Center

Cornelius, Luke M.; Cavanaugh, Terence W.

2016-01-01

A policy analysis of Florida's 10-factor Performance-Based Funding system for state universities. The focus of the article is on the system of performance metrics developed by the state Board of Governors and their impact on institutions and their missions. The paper also discusses problems and issues with the metrics, their ongoing evolution, and…

Impact of Different Economic Performance Metrics on the Perceived Value of Solar Photovoltaics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Drury, E.; Denholm, P.; Margolis, R.

2011-10-01

Photovoltaic (PV) systems are installed by several types of market participants, ranging from residential customers to large-scale project developers and utilities. Each type of market participant frequently uses a different economic performance metric to characterize PV value because they are looking for different types of returns from a PV investment. This report finds that different economic performance metrics frequently show different price thresholds for when a PV investment becomes profitable or attractive. Several project parameters, such as financing terms, can have a significant impact on some metrics [e.g., internal rate of return (IRR), net present value (NPV), and benefit-to-cost (B/C)more » ratio] while having a minimal impact on other metrics (e.g., simple payback time). As such, the choice of economic performance metric by different customer types can significantly shape each customer's perception of PV investment value and ultimately their adoption decision.« less

Performance evaluation of objective quality metrics for HDR image compression

NASA Astrophysics Data System (ADS)

Valenzise, Giuseppe; De Simone, Francesca; Lauga, Paul; Dufaux, Frederic

2014-09-01

Due to the much larger luminance and contrast characteristics of high dynamic range (HDR) images, well-known objective quality metrics, widely used for the assessment of low dynamic range (LDR) content, cannot be directly applied to HDR images in order to predict their perceptual fidelity. To overcome this limitation, advanced fidelity metrics, such as the HDR-VDP, have been proposed to accurately predict visually significant differences. However, their complex calibration may make them difficult to use in practice. A simpler approach consists in computing arithmetic or structural fidelity metrics, such as PSNR and SSIM, on perceptually encoded luminance values but the performance of quality prediction in this case has not been clearly studied. In this paper, we aim at providing a better comprehension of the limits and the potentialities of this approach, by means of a subjective study. We compare the performance of HDR-VDP to that of PSNR and SSIM computed on perceptually encoded luminance values, when considering compressed HDR images. Our results show that these simpler metrics can be effectively employed to assess image fidelity for applications such as HDR image compression.

Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing.

PubMed

Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Oropesa, Ignacio; Enciso, Silvia; Gómez, Enrique J

2017-02-01

The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing. A group of novice ([Formula: see text] laparoscopic procedures), intermediate (11-100 laparoscopic procedures) and experienced ([Formula: see text] laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments' position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task. Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ([Formula: see text]), travelled less distance using both laparoscopic instruments ([Formula: see text]) and made more efficient use of the work space ([Formula: see text]) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ([Formula: see text] and [Formula: see text], [Formula: see text]). The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing

A novel spatial performance metric for robust pattern optimization of distributed hydrological models

NASA Astrophysics Data System (ADS)

Stisen, S.; Demirel, C.; Koch, J.

2017-12-01

Evaluation of performance is an integral part of model development and calibration as well as it is of paramount importance when communicating modelling results to stakeholders and the scientific community. There exists a comprehensive and well tested toolbox of metrics to assess temporal model performance in the hydrological modelling community. On the contrary, the experience to evaluate spatial performance is not corresponding to the grand availability of spatial observations readily available and to the sophisticate model codes simulating the spatial variability of complex hydrological processes. This study aims at making a contribution towards advancing spatial pattern oriented model evaluation for distributed hydrological models. This is achieved by introducing a novel spatial performance metric which provides robust pattern performance during model calibration. The promoted SPAtial EFficiency (spaef) metric reflects three equally weighted components: correlation, coefficient of variation and histogram overlap. This multi-component approach is necessary in order to adequately compare spatial patterns. spaef, its three components individually and two alternative spatial performance metrics, i.e. connectivity analysis and fractions skill score, are tested in a spatial pattern oriented model calibration of a catchment model in Denmark. The calibration is constrained by a remote sensing based spatial pattern of evapotranspiration and discharge timeseries at two stations. Our results stress that stand-alone metrics tend to fail to provide holistic pattern information to the optimizer which underlines the importance of multi-component metrics. The three spaef components are independent which allows them to complement each other in a meaningful way. This study promotes the use of bias insensitive metrics which allow comparing variables which are related but may differ in unit in order to optimally exploit spatial observations made available by remote sensing

Metrics for measuring performance of market transformation initiatives

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gordon, F.; Schlegel, J.; Grabner, K.

1998-07-01

Regulators have traditionally rewarded utility efficiency programs based on energy and demand savings. Now, many regulators are encouraging utilities and other program administrators to save energy by transforming markets. Prior to achieving sustainable market transformation, the program administrators often must take actions to understand the markets, establish baselines for success, reduce market barriers, build alliances, and build market momentum. Because these activities often precede savings, year-by-year measurement of savings can be an inappropriate measure of near-term success. Because ultimate success in transforming markets is defined in terms of sustainable changes in market structure and practice, traditional measures of success canmore » also be misleading as initiatives reach maturity. This paper reviews early efforts in Massachusetts to develop metrics, or yardsticks, to gauge regulatory rewards for utility market transformation initiatives. From experience in multiparty negotiations, the authors review options for metrics based alternatively on market effects, outcomes, and good faith implementation. Additionally, alternative approaches are explored, based on end-results, interim results, and initial results. The political and practical constraints are described which have thus far led to a preference for one-year metrics, based primarily on good faith implementation. Strategies are offered for developing useful metrics which might be acceptable to regulators, advocates, and program administrators. Finally, they emphasize that the use of market transformation performance metrics is in its infancy. Both regulators and program administrators are encouraged to advance into this area with an experimental mind-set; don't put all the money on one horse until there's more of a track record.« less

Resilience-based performance metrics for water resources management under uncertainty

NASA Astrophysics Data System (ADS)

Roach, Tom; Kapelan, Zoran; Ledbetter, Ralph

2018-06-01

This paper aims to develop new, resilience type metrics for long-term water resources management under uncertain climate change and population growth. Resilience is defined here as the ability of a water resources management system to 'bounce back', i.e. absorb and then recover from a water deficit event, restoring the normal system operation. Ten alternative metrics are proposed and analysed addressing a range of different resilience aspects including duration, magnitude, frequency and volume of related water deficit events. The metrics were analysed on a real-world case study of the Bristol Water supply system in the UK and compared with current practice. The analyses included an examination of metrics' sensitivity and correlation, as well as a detailed examination into the behaviour of metrics during water deficit periods. The results obtained suggest that multiple metrics which cover different aspects of resilience should be used simultaneously when assessing the resilience of a water resources management system, leading to a more complete understanding of resilience compared with current practice approaches. It was also observed that calculating the total duration of a water deficit period provided a clearer and more consistent indication of system performance compared to splitting the deficit periods into the time to reach and time to recover from the worst deficit events.

Pre-task music improves swimming performance.

PubMed

Smirmaul, B P; Dos Santos, R V; Da Silva Neto, L V

2015-12-01

The purpose of this study was to investigate the effects of pre-task music on swimming performance and other psychological variables. A randomized counterbalanced within-subjects (experimental and control condition) design was employed. Eighteen regional level male swimmers performed two 200-m freestyle swimming time trials. Participants were exposed to either 5 minutes of self-selected music (pre-task music condition) or 5 minutes of silence (control condition) and, after 1 minute, performed the swimming task. Swimming time was significantly shorter (-1.44%) in the pre-task music condition. Listening to pre-task music increased motivation to perform the swimming task, while arousal remained unchanged. While fatigue increased after the swimming task in both conditions, vigor, ratings of perceived exertion and affective valence were unaltered. It is concluded, for the first time, that pre-task music improves swimming performance.

Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol.

PubMed

Kasturi, Rangachar; Goldgof, Dmitry; Soundararajan, Padmanabhan; Manohar, Vasant; Garofolo, John; Bowers, Rachel; Boonstra, Matthew; Korzhova, Valentina; Zhang, Jing

2009-02-01

Common benchmark data sets, standardized performance metrics, and baseline algorithms have demonstrated considerable impact on research and development in a variety of application domains. These resources provide both consumers and developers of technology with a common framework to objectively compare the performance of different algorithms and algorithmic improvements. In this paper, we present such a framework for evaluating object detection and tracking in video: specifically for face, text, and vehicle objects. This framework includes the source video data, ground-truth annotations (along with guidelines for annotation), performance metrics, evaluation protocols, and tools including scoring software and baseline algorithms. For each detection and tracking task and supported domain, we developed a 50-clip training set and a 50-clip test set. Each data clip is approximately 2.5 minutes long and has been completely spatially/temporally annotated at the I-frame level. Each task/domain, therefore, has an associated annotated corpus of approximately 450,000 frames. The scope of such annotation is unprecedented and was designed to begin to support the necessary quantities of data for robust machine learning approaches, as well as a statistically significant comparison of the performance of algorithms. The goal of this work was to systematically address the challenges of object detection and tracking through a common evaluation framework that permits a meaningful objective comparison of techniques, provides the research community with sufficient data for the exploration of automatic modeling techniques, encourages the incorporation of objective evaluation into the development process, and contributes useful lasting resources of a scale and magnitude that will prove to be extremely useful to the computer vision research community for years to come.

Low-dose cone-beam CT via raw counts domain low-signal correction schemes: Performance assessment and task-based parameter optimization (Part II. Task-based parameter optimization).

PubMed

Gomez-Cardona, Daniel; Hayes, John W; Zhang, Ran; Li, Ke; Cruz-Bastida, Juan Pablo; Chen, Guang-Hong

2018-05-01

and an anterior ROI, located further from the noise streaks region. Optimal results derived from the task-based detectability index metric were compared to other operating points in the parameter space with different noise and spatial resolution trade-offs. The optimal operating points determined through the d' metric depended on the interplay between the major spatial frequency components of each imaging task and the highly shift-variant and anisotropic noise and spatial resolution properties associated with each operating point in the LSC parameter space. This interplay influenced imaging performance the most when the major spatial frequency component of a given imaging task coincided with the direction of spatial resolution loss or with the dominant noise spatial frequency component; this was the case of imaging task II. The performance of imaging tasks I and III was influenced by this interplay in a smaller scale than imaging task II, since the major frequency component of task I was perpendicular to imaging task II, and because imaging task III did not have strong directional dependence. For both LSC methods, there was a strong dependence of the overall d' magnitude and shape of the contours on the spatial location within the phantom, particularly for imaging tasks II and III. The d' value obtained at the optimal operating point for each spatial location and imaging task was similar when comparing the LSC methods studied in this work. A local task-based detectability framework to optimize the selection of parameters for LSC methods was developed. The framework takes into account the potential shift-variant and anisotropic spatial resolution and noise properties to maximize the imaging performance of the CT system. Optimal parameters for a given LSC method depend strongly on the spatial location within the image object. © 2018 American Association of Physicists in Medicine.

National Quality Forum Colon Cancer Quality Metric Performance: How Are Hospitals Measuring Up?

PubMed

Mason, Meredith C; Chang, George J; Petersen, Laura A; Sada, Yvonne H; Tran Cao, Hop S; Chai, Christy; Berger, David H; Massarweh, Nader N

2017-12-01

To evaluate the impact of care at high-performing hospitals on the National Quality Forum (NQF) colon cancer metrics. The NQF endorses evaluating ≥12 lymph nodes (LNs), adjuvant chemotherapy (AC) for stage III patients, and AC within 4 months of diagnosis as colon cancer quality indicators. Data on hospital-level metric performance and the association with survival are unclear. Retrospective cohort study of 218,186 patients with resected stage I to III colon cancer in the National Cancer Data Base (2004-2012). High-performing hospitals (>75% achievement) were identified by the proportion of patients achieving each measure. The association between hospital performance and survival was evaluated using Cox shared frailty modeling. Only hospital LN performance improved (15.8% in 2004 vs 80.7% in 2012; trend test, P < 0.001), with 45.9% of hospitals performing well on all 3 measures concurrently in the most recent study year. Overall, 5-year survival was 75.0%, 72.3%, 72.5%, and 69.5% for those treated at hospitals with high performance on 3, 2, 1, and 0 metrics, respectively (log-rank, P < 0.001). Care at hospitals with high metric performance was associated with lower risk of death in a dose-response fashion [0 metrics, reference; 1, hazard ratio (HR) 0.96 (0.89-1.03); 2, HR 0.92 (0.87-0.98); 3, HR 0.85 (0.80-0.90); 2 vs 1, HR 0.96 (0.91-1.01); 3 vs 1, HR 0.89 (0.84-0.93); 3 vs 2, HR 0.95 (0.89-0.95)]. Performance on metrics in combination was associated with lower risk of death [LN + AC, HR 0.86 (0.78-0.95); AC + timely AC, HR 0.92 (0.87-0.98); LN + AC + timely AC, HR 0.85 (0.80-0.90)], whereas individual measures were not [LN, HR 0.95 (0.88-1.04); AC, HR 0.95 (0.87-1.05)]. Less than half of hospitals perform well on these NQF colon cancer metrics concurrently, and high performance on individual measures is not associated with improved survival. Quality improvement efforts should shift focus from individual measures to defining composite measures

Performance Enhancements Under Dual-task Conditions

NASA Technical Reports Server (NTRS)

Kramer, A. F.; Wickens, C. D.; Donchin, E.

1984-01-01

Research on dual-task performance has been concerned with delineating the antecedent conditions which lead to dual-task decrements. Capacity models of attention, which propose that a hypothetical resource structure underlies performance, have been employed as predictive devices. These models predict that tasks which require different processing resources can be more successfully time shared than tasks which require common resources. The conditions under which such dual-task integrality can be fostered were assessed in a study in which three factors likely to influence the integrality between tasks were manipulated: inter-task redundancy, the physical proximity of tasks and the task relevant objects. Twelve subjects participated in three experimental sessions in which they performed both single and dual-tasks. The primary task was a pursuit step tracking task. The secondary tasks required the discrimination between different intensities or different spatial positions of a stimulus. The results are discussed in terms of a model of dual-task integrality.

Surgical simulation tasks challenge visual working memory and visual-spatial ability differently.

PubMed

Schlickum, Marcus; Hedman, Leif; Enochsson, Lars; Henningsohn, Lars; Kjellin, Ann; Felländer-Tsai, Li

2011-04-01

New strategies for selection and training of physicians are emerging. Previous studies have demonstrated a correlation between visual-spatial ability and visual working memory with surgical simulator performance. The aim of this study was to perform a detailed analysis on how these abilities are associated with metrics in simulator performance with different task content. The hypothesis is that the importance of visual-spatial ability and visual working memory varies with different task contents. Twenty-five medical students participated in the study that involved testing visual-spatial ability using the MRT-A test and visual working memory using the RoboMemo computer program. Subjects were also trained and tested for performance in three different surgical simulators. The scores from the psychometric tests and the performance metrics were then correlated using multivariate analysis. MRT-A score correlated significantly with the performance metrics Efficiency of screening (p = 0.006) and Total time (p = 0.01) in the GI Mentor II task and Total score (p = 0.02) in the MIST-VR simulator task. In the Uro Mentor task, both the MRT-A score and the visual working memory 3-D cube test score as presented in the RoboMemo program (p = 0.02) correlated with Total score (p = 0.004). In this study we have shown that some differences exist regarding the impact of visual abilities and task content on simulator performance. When designing future cognitive training programs and testing regimes, one might have to consider that the design must be adjusted in accordance with the specific surgical task to be trained in mind.

On Railroad Tank Car Puncture Performance: Part I - Considering Metrics

DOT National Transportation Integrated Search

2016-04-12

This paper is the first in a two-part series on the puncture performance of railroad tank cars carrying hazardous materials in the event of an accident. Various metrics are often mentioned in the open literature to characterize the structural perform...

What Do Eye Gaze Metrics Tell Us about Motor Imagery?

PubMed

Poiroux, Elodie; Cavaro-Ménard, Christine; Leruez, Stéphanie; Lemée, Jean Michel; Richard, Isabelle; Dinomais, Mickael

2015-01-01

Many of the brain structures involved in performing real movements also have increased activity during imagined movements or during motor observation, and this could be the neural substrate underlying the effects of motor imagery in motor learning or motor rehabilitation. In the absence of any objective physiological method of measurement, it is currently impossible to be sure that the patient is indeed performing the task as instructed. Eye gaze recording during a motor imagery task could be a possible way to "spy" on the activity an individual is really engaged in. The aim of the present study was to compare the pattern of eye movement metrics during motor observation, visual and kinesthetic motor imagery (VI, KI), target fixation, and mental calculation. Twenty-two healthy subjects (16 females and 6 males), were required to perform tests in five conditions using imagery in the Box and Block Test tasks following the procedure described by Liepert et al. Eye movements were analysed by a non-invasive oculometric measure (SMI RED250 system). Two parameters describing gaze pattern were calculated: the index of ocular mobility (saccade duration over saccade + fixation duration) and the number of midline crossings (i.e. the number of times the subjects gaze crossed the midline of the screen when performing the different tasks). Both parameters were significantly different between visual imagery and kinesthesic imagery, visual imagery and mental calculation, and visual imagery and target fixation. For the first time we were able to show that eye movement patterns are different during VI and KI tasks. Our results suggest gaze metric parameters could be used as an objective unobtrusive approach to assess engagement in a motor imagery task. Further studies should define how oculomotor parameters could be used as an indicator of the rehabilitation task a patient is engaged in.

Metrics Handbook (Air Force Systems Command)

NASA Astrophysics Data System (ADS)

1991-08-01

The handbook is designed to help one develop and use good metrics. It is intended to provide sufficient information to begin developing metrics for objectives, processes, and tasks, and to steer one toward appropriate actions based on the data one collects. It should be viewed as a road map to assist one in arriving at meaningful metrics and to assist in continuous process improvement.

Achievement Goals in a Presentation Task: Performance Expectancy, Achievement Goals, State Anxiety, and Task Performance

ERIC Educational Resources Information Center

Tanaka, Ayumi; Takehara, Takuma; Yamauchi, Hirotsugu

2006-01-01

The aims of the study were to test the linkages between achievement goals to task performance, as mediated by state anxiety arousal. Performance expectancy was also examined as antecedents of achievement goals. A presentation task in a computer practice class was used as achievement task. Fifty-three undergraduates (37 females and 16 males) were…

Task-Driven Comparison of Topic Models.

PubMed

Alexander, Eric; Gleicher, Michael

2016-01-01

Topic modeling, a method of statistically extracting thematic content from a large collection of texts, is used for a wide variety of tasks within text analysis. Though there are a growing number of tools and techniques for exploring single models, comparisons between models are generally reduced to a small set of numerical metrics. These metrics may or may not reflect a model's performance on the analyst's intended task, and can therefore be insufficient to diagnose what causes differences between models. In this paper, we explore task-centric topic model comparison, considering how we can both provide detail for a more nuanced understanding of differences and address the wealth of tasks for which topic models are used. We derive comparison tasks from single-model uses of topic models, which predominantly fall into the categories of understanding topics, understanding similarity, and understanding change. Finally, we provide several visualization techniques that facilitate these tasks, including buddy plots, which combine color and position encodings to allow analysts to readily view changes in document similarity.

Common Metrics for Human-Robot Interaction

NASA Technical Reports Server (NTRS)

Steinfeld, Aaron; Lewis, Michael; Fong, Terrence; Scholtz, Jean; Schultz, Alan; Kaber, David; Goodrich, Michael

2006-01-01

This paper describes an effort to identify common metrics for task-oriented human-robot interaction (HRI). We begin by discussing the need for a toolkit of HRI metrics. We then describe the framework of our work and identify important biasing factors that must be taken into consideration. Finally, we present suggested common metrics for standardization and a case study. Preparation of a larger, more detailed toolkit is in progress.

A GPS Phase-Locked Loop Performance Metric Based on the Phase Discriminator Output

PubMed Central

Stevanovic, Stefan; Pervan, Boris

2018-01-01

We propose a novel GPS phase-lock loop (PLL) performance metric based on the standard deviation of tracking error (defined as the discriminator’s estimate of the true phase error), and explain its advantages over the popular phase jitter metric using theory, numerical simulation, and experimental results. We derive an augmented GPS phase-lock loop (PLL) linear model, which includes the effect of coherent averaging, to be used in conjunction with this proposed metric. The augmented linear model allows more accurate calculation of tracking error standard deviation in the presence of additive white Gaussian noise (AWGN) as compared to traditional linear models. The standard deviation of tracking error, with a threshold corresponding to half of the arctangent discriminator pull-in region, is shown to be a more reliable/robust measure of PLL performance under interference conditions than the phase jitter metric. In addition, the augmented linear model is shown to be valid up until this threshold, which facilitates efficient performance prediction, so that time-consuming direct simulations and costly experimental testing can be reserved for PLL designs that are much more likely to be successful. The effect of varying receiver reference oscillator quality on the tracking error metric is also considered. PMID:29351250

A Practical Method for Collecting Social Media Campaign Metrics

ERIC Educational Resources Information Center

Gharis, Laurie W.; Hightower, Mary F.

2017-01-01

Today's Extension professionals are tasked with more work and fewer resources. Integrating social media campaigns into outreach efforts can be an efficient way to meet work demands. If resources go toward social media, a practical method for collecting metrics is needed. Collecting metrics adds one more task to the workloads of Extension…

Greenroads : a sustainability performance metric for roadway design and construction.

DOT National Transportation Integrated Search

2009-11-01

Greenroads is a performance metric for quantifying sustainable practices associated with roadway design and construction. Sustainability is defined as having seven key components: ecology, equity, economy, extent, expectations, experience and exposur...

Effects of Selected Task Performance Criteria at Initiating Adaptive Task Real locations

NASA Technical Reports Server (NTRS)

Montgomery, Demaris A.

2001-01-01

In the current report various performance assessment methods used to initiate mode transfers between manual control and automation for adaptive task reallocation were tested. Participants monitored two secondary tasks for critical events while actively controlling a process in a fictional system. One of the secondary monitoring tasks could be automated whenever operators' performance was below acceptable levels. Automation of the secondary task and transfer of the secondary task back to manual control were either human- or machine-initiated. Human-initiated transfers were based on the operator's assessment of the current task demands while machine-initiated transfers were based on the operators' performance. Different performance assessment methods were tested in two separate experiments.

Metrics for TRUST in Integrated Circuits

DTIC Science & Technology

2008-06-01

metrics; Trojan ; detection Introduction In the Defense Science Board report, “DSB Task Force on High Performance Microchip Supply” [1] several...BETAINV C m M m= − + − + Where Ptd | lower is a lower bound on Ptd with confidence C, m is the number of detected Trojan transistors, and M is the...total number of Trojan transistors. From this relationship, in order to establish Ptd = 90% at 90% confidence on a single test article, we must

Development of Management Metrics for Research and Technology

NASA Technical Reports Server (NTRS)

Sheskin, Theodore J.

2003-01-01

Professor Ted Sheskin from CSU will be tasked to research and investigate metrics that can be used to determine the technical progress for advanced development and research tasks. These metrics will be implemented in a software environment that hosts engineering design, analysis and management tools to be used to support power system and component research work at GRC. Professor Sheskin is an Industrial Engineer and has been involved in issues related to management of engineering tasks and will use his knowledge from this area to allow extrapolation into the research and technology management area. Over the course of the summer, Professor Sheskin will develop a bibliography of management papers covering current management methods that may be applicable to research management. At the completion of the summer work we expect to have him recommend a metric system to be reviewed prior to implementation in the software environment. This task has been discussed with Professor Sheskin and some review material has already been given to him.

Comparing masked target transform volume (MTTV) clutter metric to human observer evaluation of visual clutter

NASA Astrophysics Data System (ADS)

Camp, H. A.; Moyer, Steven; Moore, Richard K.

2010-04-01

The Night Vision and Electronic Sensors Directorate's current time-limited search (TLS) model, which makes use of the targeting task performance (TTP) metric to describe image quality, does not explicitly account for the effects of visual clutter on observer performance. The TLS model is currently based on empirical fits to describe human performance for a time of day, spectrum and environment. Incorporating a clutter metric into the TLS model may reduce the number of these empirical fits needed. The masked target transform volume (MTTV) clutter metric has been previously presented and compared to other clutter metrics. Using real infrared imagery of rural images with varying levels of clutter, NVESD is currently evaluating the appropriateness of the MTTV metric. NVESD had twenty subject matter experts (SME) rank the amount of clutter in each scene in a series of pair-wise comparisons. MTTV metric values were calculated and then compared to the SME observers rankings. The MTTV metric ranked the clutter in a similar manner to the SME evaluation, suggesting that the MTTV metric may emulate SME response. This paper is a first step in quantifying clutter and measuring the agreement to subjective human evaluation.

Monitoring supports performance in a dual-task paradigm involving a risky decision-making task and a working memory task

PubMed Central

Gathmann, Bettina; Schiebener, Johannes; Wolf, Oliver T.; Brand, Matthias

2015-01-01

Performing two cognitively demanding tasks at the same time is known to decrease performance. The current study investigates the underlying executive functions of a dual-tasking situation involving the simultaneous performance of decision making under explicit risk and a working memory task. It is suggested that making a decision and performing a working memory task at the same time should particularly require monitoring—an executive control process supervising behavior and the state of processing on two tasks. To test the role of a supervisory/monitoring function in such a dual-tasking situation we investigated 122 participants with the Game of Dice Task plus 2-back task (GDT plus 2-back task). This dual task requires participants to make decisions under risk and to perform a 2-back working memory task at the same time. Furthermore, a task measuring a set of several executive functions gathered in the term concept formation (Modified Card Sorting Test, MCST) and the newly developed Balanced Switching Task (BST), measuring monitoring in particular, were used. The results demonstrate that concept formation and monitoring are involved in the simultaneous performance of decision making under risk and a working memory task. In particular, the mediation analysis revealed that BST performance partially mediates the influence of MCST performance on the GDT plus 2-back task. These findings suggest that monitoring is one important subfunction for superior performance in a dual-tasking situation including decision making under risk and a working memory task. PMID:25741308

Survey of Quantitative Research Metrics to Assess Pilot Performance in Upset Recovery

NASA Technical Reports Server (NTRS)

Le Vie, Lisa R.

2016-01-01

Accidents attributable to in-flight loss of control are the primary cause for fatal commercial jet accidents worldwide. The National Aeronautics and Space Administration (NASA) conducted a literature review to determine and identify the quantitative standards for assessing upset recovery performance. This review contains current recovery procedures for both military and commercial aviation and includes the metrics researchers use to assess aircraft recovery performance. Metrics include time to first input, recognition time and recovery time and whether that input was correct or incorrect. Other metrics included are: the state of the autopilot and autothrottle, control wheel/sidestick movement resulting in pitch and roll, and inputs to the throttle and rudder. In addition, airplane state measures, such as roll reversals, altitude loss/gain, maximum vertical speed, maximum/minimum air speed, maximum bank angle and maximum g loading are reviewed as well.

Effect of Spatial Titration on Task Performance

ERIC Educational Resources Information Center

Glowacki, Lawrence

1976-01-01

A reinforcement schedule and spatial titration method were used to determine task-reinforcement area separation most preferred and effective in two third-grade boys. Errors in task performance decreased task-reinforcement area separation, while correct responses in task performance increased task-reinforcement area separation. (Author)

Impact of Immediate Interpretation of Screening Tomosynthesis Mammography on Performance Metrics.

PubMed

Winkler, Nicole S; Freer, Phoebe; Anzai, Yoshimi; Hu, Nan; Stein, Matthew

2018-05-07

This study aimed to compare performance metrics for immediate and delayed batch interpretation of screening tomosynthesis mammograms. This HIPAA compliant study was approved by institutional review board with a waiver of consent. A retrospective analysis of screening performance metrics for tomosynthesis mammograms interpreted in 2015 when mammograms were read immediately was compared to historical controls from 2013 to 2014 when mammograms were batch interpreted after the patient had departed. A total of 5518 screening tomosynthesis mammograms (n = 1212 for batch interpretation and n = 4306 for immediate interpretation) were evaluated. The larger sample size for the latter group reflects a group practice shift to performing tomosynthesis for the majority of patients. Age, breast density, comparison examinations, and high-risk status were compared. An asymptotic proportion test and multivariable analysis were used to compare performance metrics. There was no statistically significant difference in recall or cancer detection rates for the batch interpretation group compared to immediate interpretation group with respective recall rate of 6.5% vs 5.3% = +1.2% (95% confidence interval -0.3 to 2.7%; P = .101) and cancer detection rate of 6.6 vs 7.2 per thousand = -0.6 (95% confidence interval -5.9 to 4.6; P = .825). There was no statistically significant difference in positive predictive values (PPVs) including PPV1 (screening recall), PPV2 (biopsy recommendation), or PPV 3 (biopsy performed) with batch interpretation (10.1%, 42.1%, and 40.0%, respectively) and immediate interpretation (13.6%, 39.2%, and 39.7%, respectively). After adjusting for age, breast density, high-risk status, and comparison mammogram, there was no difference in the odds of being recalled or cancer detection between the two groups. There is no statistically significant difference in interpretation performance metrics for screening tomosynthesis mammograms interpreted

Product evaluation based in the association between intuition and tasks.

PubMed

Almeida e Silva, Caio Márcio; Okimoto, Maria Lúcia L R; Albertazzi, Deise; Calixto, Cyntia; Costa, Humberto

2012-01-01

This paper explores the importance of researching the intuitiveness in the product use. It approaches the intuitiveness influence for users that already had a visual experience of the product. Finally, it is suggested the use of a table that relates the tasks performed while using a product, the features for an intuitive use and the performance metric "task success".

The Task Is Not Enough: Processing Approaches to Task-Based Performance

ERIC Educational Resources Information Center

Skehan, Peter; Xiaoyue, Bei; Qian, Li; Wang, Zhan

2012-01-01

This article reports on three research studies, all of which concern second language task performance. The first focuses on planning, and compares on-line and strategic planning as well as task repetition. The second study examines the role of familiarity on task performance, and compares this with conventional strategic planning. The third study…

Implementing the Data Center Energy Productivity Metric in a High Performance Computing Data Center

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sego, Landon H.; Marquez, Andres; Rawson, Andrew

2013-06-30

As data centers proliferate in size and number, the improvement of their energy efficiency and productivity has become an economic and environmental imperative. Making these improvements requires metrics that are robust, interpretable, and practical. We discuss the properties of a number of the proposed metrics of energy efficiency and productivity. In particular, we focus on the Data Center Energy Productivity (DCeP) metric, which is the ratio of useful work produced by the data center to the energy consumed performing that work. We describe our approach for using DCeP as the principal outcome of a designed experiment using a highly instrumented,more » high-performance computing data center. We found that DCeP was successful in clearly distinguishing different operational states in the data center, thereby validating its utility as a metric for identifying configurations of hardware and software that would improve energy productivity. We also discuss some of the challenges and benefits associated with implementing the DCeP metric, and we examine the efficacy of the metric in making comparisons within a data center and between data centers.« less

Predictive performance models and multiple task performance

NASA Technical Reports Server (NTRS)

Wickens, Christopher D.; Larish, Inge; Contorer, Aaron

1989-01-01

Five models that predict how performance of multiple tasks will interact in complex task scenarios are discussed. The models are shown in terms of the assumptions they make about human operator divided attention. The different assumptions about attention are then empirically validated in a multitask helicopter flight simulation. It is concluded from this simulation that the most important assumption relates to the coding of demand level of different component tasks.

Planning and task management in Parkinson's disease: differential emphasis in dual-task performance.

PubMed

Bialystok, Ellen; Craik, Fergus I M; Stefurak, Taresa

2008-03-01

Seventeen patients diagnosed with Parkinson's disease completed a complex computer-based task that involved planning and management while also performing an attention-demanding secondary task. The tasks were performed concurrently, but it was necessary to switch from one to the other. Performance was compared to a group of healthy age-matched control participants and a group of young participants. Parkinson's patients performed better than the age-matched controls on almost all measures and as well as the young controls in many cases. However, the Parkinson's patients achieved this by paying relatively less attention to the secondary task and focusing attention more on the primary task. Thus, Parkinson's patients can apparently improve their performance on some aspects of a multidimensional task by simplifying task demands. This benefit may occur as a consequence of their inflexible exaggerated attention to some aspects of a complex task to the relative neglect of other aspects.

Video-Based Method of Quantifying Performance and Instrument Motion During Simulated Phonosurgery

PubMed Central

Conroy, Ellen; Surender, Ketan; Geng, Zhixian; Chen, Ting; Dailey, Seth; Jiang, Jack

2015-01-01

Objectives/Hypothesis To investigate the use of the Video-Based Phonomicrosurgery Instrument Tracking System to collect instrument position data during simulated phonomicrosurgery and calculate motion metrics using these data. We used this system to determine if novice subject motion metrics improved over 1 week of training. Study Design Prospective cohort study. Methods Ten subjects performed simulated surgical tasks once per day for 5 days. Instrument position data were collected and used to compute motion metrics (path length, depth perception, and motion smoothness). Data were analyzed to determine if motion metrics improved with practice time. Task outcome was also determined each day, and relationships between task outcome and motion metrics were used to evaluate the validity of motion metrics as indicators of surgical performance. Results Significant decreases over time were observed for path length (P <.001), depth perception (P <.001), and task outcome (P <.001). No significant change was observed for motion smoothness. Significant relationships were observed between task outcome and path length (P <.001), depth perception (P <.001), and motion smoothness (P <.001). Conclusions Our system can estimate instrument trajectory and provide quantitative descriptions of surgical performance. It may be useful for evaluating phonomicrosurgery performance. Path length and depth perception may be particularly useful indicators. PMID:24737286

Performance evaluation of no-reference image quality metrics for face biometric images

NASA Astrophysics Data System (ADS)

Liu, Xinwei; Pedersen, Marius; Charrier, Christophe; Bours, Patrick

2018-03-01

The accuracy of face recognition systems is significantly affected by the quality of face sample images. The recent established standardization proposed several important aspects for the assessment of face sample quality. There are many existing no-reference image quality metrics (IQMs) that are able to assess natural image quality by taking into account similar image-based quality attributes as introduced in the standardization. However, whether such metrics can assess face sample quality is rarely considered. We evaluate the performance of 13 selected no-reference IQMs on face biometrics. The experimental results show that several of them can assess face sample quality according to the system performance. We also analyze the strengths and weaknesses of different IQMs as well as why some of them failed to assess face sample quality. Retraining an original IQM by using face database can improve the performance of such a metric. In addition, the contribution of this paper can be used for the evaluation of IQMs on other biometric modalities; furthermore, it can be used for the development of multimodality biometric IQMs.

Mental workload and cognitive task automaticity: an evaluation of subjective and time estimation metrics.

PubMed

Liu, Y; Wickens, C D

1994-11-01

The evaluation of mental workload is becoming increasingly important in system design and analysis. The present study examined the structure and assessment of mental workload in performing decision and monitoring tasks by focusing on two mental workload measurements: subjective assessment and time estimation. The task required the assignment of a series of incoming customers to the shortest of three parallel service lines displayed on a computer monitor. The subject was either in charge of the customer assignment (manual mode) or was monitoring an automated system performing the same task (automatic mode). In both cases, the subjects were required to detect the non-optimal assignments that they or the computer had made. Time pressure was manipulated by the experimenter to create fast and slow conditions. The results revealed a multi-dimensional structure of mental workload and a multi-step process of subjective workload assessment. The results also indicated that subjective workload was more influenced by the subject's participatory mode than by the factor of task speed. The time estimation intervals produced while performing the decision and monitoring tasks had significantly greater length and larger variability than those produced while either performing no other tasks or performing a well practised customer assignment task. This result seemed to indicate that time estimation was sensitive to the presence of perceptual/cognitive demands, but not to response related activities to which behavioural automaticity has developed.

Task complexity, student perceptions of vocabulary learning in EFL, and task performance.

PubMed

Wu, Xiaoli; Lowyck, Joost; Sercu, Lies; Elen, Jan

2013-03-01

The study deepened our understanding of how students' self-efficacy beliefs contribute to the context of teaching English as a foreign language in the framework of cognitive mediational paradigm at a fine-tuned task-specific level. The aim was to examine the relationship among task complexity, self-efficacy beliefs, domain-related prior knowledge, learning strategy use, and task performance as they were applied to English vocabulary learning from reading tasks. Participants were 120 second-year university students (mean age 21) from a Chinese university. This experiment had two conditions (simple/complex). A vocabulary level test was first conducted to measure participants' prior knowledge of English vocabulary. Participants were then randomly assigned to one of the learning tasks. Participants were administered task booklets together with the self-efficacy scales, measures of learning strategy use, and post-tests. Data obtained were submitted to multivariate analysis of variance (MANOVA) and path analysis. Results from the MANOVA model showed a significant effect of vocabulary level on self-efficacy beliefs, learning strategy use, and task performance. Task complexity showed no significant effect; however, an interaction effect between vocabulary level and task complexity emerged. Results from the path analysis showed self-efficacy beliefs had an indirect effect on performance. Our results highlighted the mediating role of self-efficacy beliefs and learning strategy use. Our findings indicate that students' prior knowledge plays a crucial role on both self-efficacy beliefs and task performance, and the predictive power of self-efficacy on task performance may lie in its association with learning strategy use. © 2011 The British Psychological Society.

Performance metrics for the assessment of satellite data products: an ocean color case study

EPA Science Inventory

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coeffic...

On Railroad Tank Car Puncture Performance: Part II - Estimating Metrics

DOT National Transportation Integrated Search

2016-04-12

This paper is the second in a two-part series on the puncture performance of railroad tank cars carrying hazardous materials in the event of an accident. Various metrics are often mentioned in the open literature to characterize the structural perfor...

Accounting for the phase, spatial frequency and orientation demands of the task improves metrics based on the visual Strehl ratio.

PubMed

Young, Laura K; Love, Gordon D; Smithson, Hannah E

2013-09-20

Advances in ophthalmic instrumentation have allowed high order aberrations to be measured in vivo. These measurements describe the distortions to a plane wavefront entering the eye, but not the effect they have on visual performance. One metric for predicting visual performance from a wavefront measurement uses the visual Strehl ratio, calculated in the optical transfer function (OTF) domain (VSOTF) (Thibos et al., 2004). We considered how well such a metric captures empirical measurements of the effects of defocus, coma and secondary astigmatism on letter identification and on reading. We show that predictions using the visual Strehl ratio can be significantly improved by weighting the OTF by the spatial frequency band that mediates letter identification and further improved by considering the orientation of phase and contrast changes imposed by the aberration. We additionally showed that these altered metrics compare well to a cross-correlation-based metric. We suggest a version of the visual Strehl ratio, VScombined, that incorporates primarily those phase disruptions and contrast changes that have been shown independently to affect object recognition processes. This metric compared well to VSOTF for letter identification and was the best predictor of reading performance, having a higher correlation with the data than either the VSOTF or cross-correlation-based metric. Copyright © 2013 The Authors. Published by Elsevier Ltd.. All rights reserved.

Automatic intersection map generation task 10 report.

DOT National Transportation Integrated Search

2016-02-29

This report describes the work conducted in Task 10 of the V2I Safety Applications Development Project. The work was performed by the University of Michigan Transportation Research Institute (UMTRI) under contract to the Crash Avoidance Metrics Partn...

Short-term memory and dual task performance

NASA Technical Reports Server (NTRS)

Regan, J. E.

1982-01-01

Two hypotheses concerning the way in which short-term memory interacts with another task in a dual task situation are considered. It is noted that when two tasks are combined, the activity of controlling and organizing performance on both tasks simultaneously may compete with either task for a resource; this resource may be space in a central mechanism or general processing capacity or it may be some task-specific resource. If a special relationship exists between short-term memory and control, especially if there is an identity relationship between short-term and a central controlling mechanism, then short-term memory performance should show a decrement in a dual task situation. Even if short-term memory does not have any particular identity with a controlling mechanism, but both tasks draw on some common resource or resources, then a tradeoff between the two tasks in allocating resources is possible and could be reflected in performance. The persistent concurrence cost in memory performance in these experiments suggests that short-term memory may have a unique status in the information processing system.

Children's construction task performance and spatial ability: controlling task complexity and predicting mathematics performance.

PubMed

Richardson, Miles; Hunt, Thomas E; Richardson, Cassandra

2014-12-01

This paper presents a methodology to control construction task complexity and examined the relationships between construction performance and spatial and mathematical abilities in children. The study included three groups of children (N = 96); ages 7-8, 10-11, and 13-14 years. Each group constructed seven pre-specified objects. The study replicated and extended previous findings that indicated that the extent of component symmetry and variety, and the number of components for each object and available for selection, significantly predicted construction task difficulty. Results showed that this methodology is a valid and reliable technique for assessing and predicting construction play task difficulty. Furthermore, construction play performance predicted mathematical attainment independently of spatial ability.

Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

PubMed

Shackelford, Stacy; Garofalo, Evan; Shalin, Valerie; Pugh, Kristy; Chen, Hegang; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin F

2015-07-01

Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular

Measuring Distribution Performance? Benchmarking Warrants Your Attention

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ericson, Sean J; Alvarez, Paul

Identifying, designing, and measuring performance metrics is critical to securing customer value, but can be a difficult task. This article examines the use of benchmarks based on publicly available performance data to set challenging, yet fair, metrics and targets.

Person Re-Identification via Distance Metric Learning With Latent Variables.

PubMed

Sun, Chong; Wang, Dong; Lu, Huchuan

2017-01-01

In this paper, we propose an effective person re-identification method with latent variables, which represents a pedestrian as the mixture of a holistic model and a number of flexible models. Three types of latent variables are introduced to model uncertain factors in the re-identification problem, including vertical misalignments, horizontal misalignments and leg posture variations. The distance between two pedestrians can be determined by minimizing a given distance function with respect to latent variables, and then be used to conduct the re-identification task. In addition, we develop a latent metric learning method for learning the effective metric matrix, which can be solved via an iterative manner: once latent information is specified, the metric matrix can be obtained based on some typical metric learning methods; with the computed metric matrix, the latent variables can be determined by searching the state space exhaustively. Finally, extensive experiments are conducted on seven databases to evaluate the proposed method. The experimental results demonstrate that our method achieves better performance than other competing algorithms.

Metrics for Operator Situation Awareness, Workload, and Performance in Automated Separation Assurance Systems

NASA Technical Reports Server (NTRS)

Strybel, Thomas Z.; Vu, Kim-Phuong L.; Battiste, Vernol; Dao, Arik-Quang; Dwyer, John P.; Landry, Steven; Johnson, Walter; Ho, Nhut

2011-01-01

A research consortium of scientists and engineers from California State University Long Beach (CSULB), San Jose State University Foundation (SJSUF), California State University Northridge (CSUN), Purdue University, and The Boeing Company was assembled to evaluate the impact of changes in roles and responsibilities and new automated technologies, being introduced in the Next Generation Air Transportation System (NextGen), on operator situation awareness (SA) and workload. To meet these goals, consortium members performed systems analyses of NextGen concepts and airspace scenarios, and concurrently evaluated SA, workload, and performance measures to assess their appropriateness for evaluations of NextGen concepts and tools. The following activities and accomplishments were supported by the NRA: a distributed simulation, metric development, systems analysis, part-task simulations, and large-scale simulations. As a result of this NRA, we have gained a greater understanding of situation awareness and its measurement, and have shared our knowledge with the scientific community. This network provides a mechanism for consortium members, colleagues, and students to pursue research on other topics in air traffic management and aviation, thus enabling them to make greater contributions to the field

The predictive value of general movement tasks in assessing occupational task performance.

PubMed

Frost, David M; Beach, Tyson A C; McGill, Stuart M; Callaghan, Jack P

2015-01-01

Within the context of evaluating individuals' movement behavior it is generally assumed that the tasks chosen will predict their competency to perform activities relevant to their occupation. This study sought to examine whether a battery of general tasks could be used to predict the movement patterns employed by firefighters to perform select job-specific skills. Fifty-two firefighters performed a battery of general and occupation-specific tasks that simulated the demands of firefighting. Participants' peak lumbar spine and frontal plane knee motion were compared across tasks. During 85% of all comparisons, the magnitude of spine and knee motion was greater during the general movement tasks than observed during the firefighting skills. Certain features of a worker's movement behavior may be exhibited across a range of tasks. Therefore, provided that a movement screen's tasks expose the motions of relevance for the population being tested, general evaluations could offer valuable insight into workers' movement competency or facilitate an opportunity to establish an evidence-informed intervention.

Comparison of oral surgery task performance in a virtual reality surgical simulator and an animal model using objective measures.

PubMed

Ioannou, Ioanna; Kazmierczak, Edmund; Stern, Linda

2015-01-01

The use of virtual reality (VR) simulation for surgical training has gathered much interest in recent years. Despite increasing popularity and usage, limited work has been carried out in the use of automated objective measures to quantify the extent to which performance in a simulator resembles performance in the operating theatre, and the effects of simulator training on real world performance. To this end, we present a study exploring the effects of VR training on the performance of dentistry students learning a novel oral surgery task. We compare the performance of trainees in a VR simulator and in a physical setting involving ovine jaws, using a range of automated metrics derived by motion analysis. Our results suggest that simulator training improved the motion economy of trainees without adverse effects on task outcome. Comparison of surgical technique on the simulator with the ovine setting indicates that simulator technique is similar, but not identical to real world technique.

Performance metrics for the assessment of satellite data products: an ocean color case study

PubMed Central

Seegers, Bridget N.; Stumpf, Richard P.; Schaeffer, Blake A.; Loftin, Keith A.; Werdell, P. Jeremy

2018-01-01

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multi-metric and user-dependent approach that can be applied within science, modeling, and resource management communities. PMID:29609296

Effect of quality metric monitoring and colonoscopy performance.

PubMed

Razzak, Anthony; Smith, Dineen; Zahid, Maliha; Papachristou, Georgios; Khalid, Asif

2016-10-01

Background and aims: Adenoma detection rate (ADR) and cecal withdrawal time (CWT) have been identified as measures of colonoscopy quality. This study evaluates the impact of monitoring these measures on provider performance. Methods: Six blinded gastroenterologists practicing at a Veterans Affairs Medical Center were prospectively monitored over 9 months. Data for screening, adenoma surveillance, and fecal occult blood test positive (FOBT +) indicated colonoscopies were obtained, including exam preparation quality, cecal intubation rate, CWT, ADR, adenomas per colonoscopy (APC), and adverse events. Metrics were continuously monitored after a period of informed CWT monitoring and informed CWT + ADR monitoring. The primary outcome was impact on ADR and APC. Results: A total of 1671 colonoscopies were performed during the study period with 540 before informed monitoring, 528 during informed CWT monitoring, and 603 during informed CWT + ADR monitoring. No statistically significant impact on ADR was noted across each study phase. Multivariate regression revealed a trend towards fewer adenomas removed during the CWT monitoring phase (OR = 0.79; 95 %CI 0.62 - 1.02, P  = 0.065) and a trend towards more adenomas removed during the CWT + ADR monitoring phase when compared to baseline (OR = 1.26; 95 %CI 0.99 - 1.61, P  = 0.062). Indication for examination and provider were significant predictors for higher APC. Provider-specific data demonstrated a direct relationship between high ADR performers and increased CWT. Conclusions: Monitoring quality metrics did not significantly alter colonoscopy performance across a small heterogeneous group of providers. Non-significant trends towards higher APC were noted with CWT + ADR monitoring. Providers with a longer CWT had a higher ADR. Further studies are needed to determine the impact of monitoring on colonoscopy performance.

Irregular large-scale computed tomography on multiple graphics processors improves energy-efficiency metrics for industrial applications

NASA Astrophysics Data System (ADS)

Jimenez, Edward S.; Goodman, Eric L.; Park, Ryeojin; Orr, Laurel J.; Thompson, Kyle R.

2014-09-01

This paper will investigate energy-efficiency for various real-world industrial computed-tomography reconstruction algorithms, both CPU- and GPU-based implementations. This work shows that the energy required for a given reconstruction is based on performance and problem size. There are many ways to describe performance and energy efficiency, thus this work will investigate multiple metrics including performance-per-watt, energy-delay product, and energy consumption. This work found that irregular GPU-based approaches1 realized tremendous savings in energy consumption when compared to CPU implementations while also significantly improving the performance-per- watt and energy-delay product metrics. Additional energy savings and other metric improvement was realized on the GPU-based reconstructions by improving storage I/O by implementing a parallel MIMD-like modularization of the compute and I/O tasks.

Effects of a no-go Task 2 on Task 1 performance in dual - tasking: From benefits to costs.

PubMed

Janczyk, Markus; Huestegge, Lynn

2017-04-01

When two tasks are combined in a dual-task experiment, characteristics of Task 2 can influence Task 1 performance, a phenomenon termed the backward crosstalk effect (BCE). Besides instances depending on the (spatial) compatibility of both responses, a particularly interesting example was introduced by Miller (2006): If Task 2 was a no-go task (i.e., one not requiring any action at all), responses were slowed in Task 1. Subsequent work, however, also reported the opposite result-that is, faster Task 1 responses in cases of no-go Task 2 trials. We report three experiments aiming to more precisely identify the conditions under which a no-go Task 2 facilitates or impedes Task 1 performance. The results suggest that an adverse no-go BCE is only observed when the Task 2 response(s) are sufficiently prepared in advance, yielding strong inhibitory control demands for Task 2 that eventually hamper Task 1 processing as well (i.e., inhibitory costs). If this is not the case, encountering a no-go Task 2 trial facilitates Task 1 performance, suggesting that the underlying task representation is reduced to a single - task. These results are discussed in the context of other recent work on BCEs and of recently suggested accounts of the no-go BCE.

Characterization of task-free and task-performance brain states via functional connectome patterns.

PubMed

Zhang, Xin; Guo, Lei; Li, Xiang; Zhang, Tuo; Zhu, Dajiang; Li, Kaiming; Chen, Hanbo; Lv, Jinglei; Jin, Changfeng; Zhao, Qun; Li, Lingjiang; Liu, Tianming

2013-12-01

Both resting state fMRI (R-fMRI) and task-based fMRI (T-fMRI) have been widely used to study the functional activities of the human brain during task-free and task-performance periods, respectively. However, due to the difficulty in strictly controlling the participating subject's mental status and their cognitive behaviors during R-fMRI/T-fMRI scans, it has been challenging to ascertain whether or not an R-fMRI/T-fMRI scan truly reflects the participant's functional brain states during task-free/task-performance periods. This paper presents a novel computational approach to characterizing and differentiating the brain's functional status into task-free or task-performance states, by which the functional brain activities can be effectively understood and differentiated. Briefly, the brain's functional state is represented by a whole-brain quasi-stable connectome pattern (WQCP) of R-fMRI or T-fMRI data based on 358 consistent cortical landmarks across individuals, and then an effective sparse representation method was applied to learn the atomic connectome patterns (ACPs) of both task-free and task-performance states. Experimental results demonstrated that the learned ACPs for R-fMRI and T-fMRI datasets are substantially different, as expected. A certain portion of ACPs from R-fMRI and T-fMRI data were overlapped, suggesting some subjects with overlapping ACPs were not in the expected task-free/task-performance brain states. Besides, potential outliers in the T-fMRI dataset were further investigated via functional activation detections in different groups, and our results revealed unexpected task-performances of some subjects. This work offers novel insights into the functional architectures of the brain. Copyright © 2013 Elsevier B.V. All rights reserved.

Characterization of Task-free and Task-performance Brain States via Functional Connectome Patterns

PubMed Central

Zhang, Xin; Guo, Lei; Li, Xiang; Zhang, Tuo; Zhu, Dajiang; Li, Kaiming; Chen, Hanbo; Lv, Jinglei; Jin, Changfeng; Zhao, Qun; Li, Lingjiang; Liu, Tianming

2014-01-01

Both resting state fMRI (R-fMRI) and task-based fMRI (T-fMRI) have been widely used to study the functional activities of the human brain during task-free and task-performance periods, respectively. However, due to the difficulty in strictly controlling the participating subject's mental status and their cognitive behaviors during R-fMRI/T-fMRI scans, it has been challenging to ascertain whether or not an R-fMRI/T-fMRI scan truly reflects the participant's functional brain states during task-free/task-performance periods. This paper presents a novel computational approach to characterizing and differentiating the brain's functional status into task-free or task-performance states, by which the functional brain activities can be effectively understood and differentiated. Briefly, the brain's functional state is represented by a whole-brain quasi-stable connectome pattern (WQCP) of R-fMRI or T-fMRI data based on 358 consistent cortical landmarks across individuals, and then an effective sparse representation method was applied to learn the atomic connectome patterns (ACP) of both task-free and task-performance states. Experimental results demonstrated that the learned ACPs for R-fMRI and T-fMRI datasets are substantially different, as expected. A certain portion of ACPs from R-fMRI and T-fMRI data were overlapped, suggesting some subjects with overlapping ACPs were not in the expected task-free/task-performance brain states. Besides, potential outliers in the T-fMRI dataset were further investigated via functional activation detections in different groups, and our results revealed unexpected task-performances of some subjects. This work offers novel insights into the functional architectures of the brain. PMID:23938590

Using cognitive task analysis to develop simulation-based training for medical tasks.

PubMed

Cannon-Bowers, Jan; Bowers, Clint; Stout, Renee; Ricci, Katrina; Hildabrand, Annette

2013-10-01

Pressures to increase the efficacy and effectiveness of medical training are causing the Department of Defense to investigate the use of simulation technologies. This article describes a comprehensive cognitive task analysis technique that can be used to simultaneously generate training requirements, performance metrics, scenario requirements, and simulator/simulation requirements for medical tasks. On the basis of a variety of existing techniques, we developed a scenario-based approach that asks experts to perform the targeted task multiple times, with each pass probing a different dimension of the training development process. In contrast to many cognitive task analysis approaches, we argue that our technique can be highly cost effective because it is designed to accomplish multiple goals. The technique was pilot tested with expert instructors from a large military medical training command. These instructors were employed to generate requirements for two selected combat casualty care tasks-cricothyroidotomy and hemorrhage control. Results indicated that the technique is feasible to use and generates usable data to inform simulation-based training system design. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

Asymptotically Optimal Motion Planning for Learned Tasks Using Time-Dependent Cost Maps

PubMed Central

Bowen, Chris; Ye, Gu; Alterovitz, Ron

2015-01-01

In unstructured environments in people’s homes and workspaces, robots executing a task may need to avoid obstacles while satisfying task motion constraints, e.g., keeping a plate of food level to avoid spills or properly orienting a finger to push a button. We introduce a sampling-based method for computing motion plans that are collision-free and minimize a cost metric that encodes task motion constraints. Our time-dependent cost metric, learned from a set of demonstrations, encodes features of a task’s motion that are consistent across the demonstrations and, hence, are likely required to successfully execute the task. Our sampling-based motion planner uses the learned cost metric to compute plans that simultaneously avoid obstacles and satisfy task constraints. The motion planner is asymptotically optimal and minimizes the Mahalanobis distance between the planned trajectory and the distribution of demonstrations in a feature space parameterized by the locations of task-relevant objects. The motion planner also leverages the distribution of the demonstrations to significantly reduce plan computation time. We demonstrate the method’s effectiveness and speed using a small humanoid robot performing tasks requiring both obstacle avoidance and satisfaction of learned task constraints. Note to Practitioners Motivated by the desire to enable robots to autonomously operate in cluttered home and workplace environments, this paper presents an approach for intuitively training a robot in a manner that enables it to repeat the task in novel scenarios and in the presence of unforeseen obstacles in the environment. Based on user-provided demonstrations of the task, our method learns features of the task that are consistent across the demonstrations and that we expect should be repeated by the robot when performing the task. We next present an efficient algorithm for planning robot motions to perform the task based on the learned features while avoiding obstacles. We

Single-task and dual-task tandem gait test performance after concussion.

PubMed

Howell, David R; Osternig, Louis R; Chou, Li-Shan

2017-07-01

To compare single-task and dual-task tandem gait test performance between athletes after concussion with controls on observer-timed, spatio-temporal, and center-of-mass (COM) balance control measurements. Ten participants (19.0±5.5years) were prospectively identified and completed a tandem gait test protocol within 72h of concussion and again 1 week, 2 weeks, 1 month, and 2 months post-injury. Seven uninjured controls (20.0±4.5years) completed the same protocol in similar time increments. Tandem gait test trials were performed with (dual-task) and without (single-task) concurrently performing a cognitive test as whole-body motion analysis was performed. Outcome variables included test completion time, average tandem gait velocity, cadence, and whole-body COM frontal plane displacement. Concussion participants took significantly longer to complete the dual-task tandem gait test than controls throughout the first 2 weeks post-injury (mean time=16.4 [95% CI: 13.4-19.4] vs. 10.1 [95% CI: 6.4-13.7] seconds; p=0.03). Single-task tandem gait times were significantly lower 72h post-injury (p=0.04). Dual-task cadence was significantly lower for concussion participants than controls (89.5 [95% CI: 68.6-110.4] vs. 127.0 [95% CI: 97.4-156.6] steps/minute; p=0.04). Moderately-high to high correlations between tandem gait test time and whole-body COM medial-lateral displacement were detected at each time point during dual-task gait (r s =0.70-0.93; p=0.03-0.001). Adding a cognitive task during the tandem gait test resulted in longer detectable deficits post-concussion compared to the traditional single-task tandem gait test. As a clinical tool to assess dynamic motor function, tandem gait may assist with return to sport decisions after concussion. Copyright © 2017 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Proposed Performance-Based Metrics for the Future Funding of Graduate Medical Education: Starting the Conversation.

PubMed

Caverzagie, Kelly J; Lane, Susan W; Sharma, Niraj; Donnelly, John; Jaeger, Jeffrey R; Laird-Fick, Heather; Moriarty, John P; Moyer, Darilyn V; Wallach, Sara L; Wardrop, Richard M; Steinmann, Alwin F

2017-12-12

Graduate medical education (GME) in the United States is financed by contributions from both federal and state entities that total over $15 billion annually. Within institutions, these funds are distributed with limited transparency to achieve ill-defined outcomes. To address this, the Institute of Medicine convened a committee on the governance and financing of GME to recommend finance reform that would promote a physician training system that meets society's current and future needs. The resulting report provided several recommendations regarding the oversight and mechanisms of GME funding, including implementation of performance-based GME payments, but did not provide specific details about the content and development of metrics for these payments. To initiate a national conversation about performance-based GME funding, the authors asked: What should GME be held accountable for in exchange for public funding? In answer to this question, the authors propose 17 potential performance-based metrics for GME funding that could inform future funding decisions. Eight of the metrics are described as exemplars to add context and to help readers obtain a deeper understanding of the inherent complexities of performance-based GME funding. The authors also describe considerations and precautions for metric implementation.

Closed-loop, pilot/vehicle analysis of the approach and landing task

NASA Technical Reports Server (NTRS)

Anderson, M. R.; Schmidt, D. K.

1986-01-01

In the case of approach and landing, it is universally accepted that the pilot uses more than one vehicle response, or output, to close his control loops. Therefore, to model this task, a multi-loop analysis technique is required. The analysis problem has been in obtaining reasonable analytic estimates of the describing functions representing the pilot's loop compensation. Once these pilot describing functions are obtained, appropriate performance and workload metrics must then be developed for the landing task. The optimal control approach provides a powerful technique for obtaining the necessary describing functions, once the appropriate task objective is defined in terms of a quadratic objective function. An approach is presented through the use of a simple, reasonable objective function and model-based metrics to evaluate loop performance and pilot workload. The results of an analysis of the LAHOS (Landing and Approach of Higher Order Systems) study performed by R.E. Smith is also presented.

Individual Differences in Dual Task Performance.

DTIC Science & Technology

1981-06-10

SJCURITY CLASSIFICATION OF THIS PAGE("en Data Entered) second experimental series, we compared ability to detect visual and audi- tory targets in single...used performance on a simple secondary task executed during an easy primary task to predict performance on a more diffi- cult’version of the same...process concepts developed b’j cognitive ps:choloqists°’ In this laborators, we adapted a number of experimental tasks to 4ield individual measures of the

Different motor tasks impact differently on cognitive performance of older persons during dual task tests.

PubMed

Simoni, David; Rubbieri, Gaia; Baccini, Marco; Rinaldi, Lucio; Becheri, Dimitri; Forconi, Tatiana; Mossello, Enrico; Zanieri, Samanta; Marchionni, Niccolò; Di Bari, Mauro

2013-07-01

Dual task paradigm states that the introduction of a second task during a cognitive or motor performance results in a decreased performance in either task. Treadmill walk, often used in clinical applications of dual task testing, has never been compared to overground walk, to ascertain its susceptibility to interference from a second task. We compared the effects of overground and treadmill gait on dual task performance. Gait kinematic parameters and cognitive performance were obtained in 29 healthy older adults (mean age 75 years, 14 females) when they were walking freely on a sensorized carpet or during treadmill walking with an optoelectronic system, in single task or dual task conditions, using alternate repetition of letters as a cognitive verbal task. During overground walking, speed, cadence, step length stride length, and double support time (all with P value<0.001) and cognitive performance (number of correct words, P<0.001) decreased substantially from single to dual task testing. When subjects walked at a fixed speed on the treadmill, cadence decreased significantly (P=0.005), whereas cognitive performance remained unaffected. Both motor and cognitive performances decline during dual task testing with overground walking. Conversely, cognitive performance remains unaffected in dual task testing on the treadmill. In the light of current dual task paradigm, these findings may have relevant implication for our understanding of motor control, as they suggest that treadmill walk does not involve brain areas susceptible to interference from the introduction of a cognitive task. Copyright © 2013 Elsevier Ltd. All rights reserved.

Performance assessment of geospatial simulation models of land-use change--a landscape metric-based approach.

PubMed

Sakieh, Yousef; Salmanmahiny, Abdolrassoul

2016-03-01

Performance evaluation is a critical step when developing land-use and cover change (LUCC) models. The present study proposes a spatially explicit model performance evaluation method, adopting a landscape metric-based approach. To quantify GEOMOD model performance, a set of composition- and configuration-based landscape metrics including number of patches, edge density, mean Euclidean nearest neighbor distance, largest patch index, class area, landscape shape index, and splitting index were employed. The model takes advantage of three decision rules including neighborhood effect, persistence of change direction, and urbanization suitability values. According to the results, while class area, largest patch index, and splitting indices demonstrated insignificant differences between spatial pattern of ground truth and simulated layers, there was a considerable inconsistency between simulation results and real dataset in terms of the remaining metrics. Specifically, simulation outputs were simplistic and the model tended to underestimate number of developed patches by producing a more compact landscape. Landscape-metric-based performance evaluation produces more detailed information (compared to conventional indices such as the Kappa index and overall accuracy) on the model's behavior in replicating spatial heterogeneity features of a landscape such as frequency, fragmentation, isolation, and density. Finally, as the main characteristic of the proposed method, landscape metrics employ the maximum potential of observed and simulated layers for a performance evaluation procedure, provide a basis for more robust interpretation of a calibration process, and also deepen modeler insight into the main strengths and pitfalls of a specific land-use change model when simulating a spatiotemporal phenomenon.

Musical expertise has minimal impact on dual task performance.

PubMed

Cocchini, Gianna; Filardi, Maria Serena; Crhonkova, Marcela; Halpern, Andrea R

2017-05-01

Studies investigating effect of practice on dual task performance have yielded conflicting findings, thus supporting different theoretical accounts about the organisation of attentional resources when tasks are performed simultaneously. Because practice has been proven to reduce the demand of attention for the trained task, the impact of long-lasting training on one task is an ideal way to better understand the mechanisms underlying dual task decline in performance. Our study compared performance during dual task execution in expert musicians compared to controls with little if any musical experience. Participants performed a music recognition task and a visuo-spatial task separately (single task) or simultaneously (dual task). Both groups showed a significant but similar performance decline during dual tasks. In addition, the two groups showed a similar decline of dual task performance during encoding and retrieval of the musical information, mainly attributed to a decline in sensitivity. Our results suggest that attention during dual tasks is similarly distributed by expert and non-experts. These findings are in line with previous studies showing a lack of sensitivity to difficulty and lack of practice effect during dual tasks, supporting the idea that different tasks may rely on different and not-sharable attentional resources.

Mood states determine the degree of task shielding in dual-task performance.

PubMed

Zwosta, Katharina; Hommel, Bernhard; Goschke, Thomas; Fischer, Rico

2013-01-01

Current models of multitasking assume that dual-task performance and the degree of multitasking are affected by cognitive control strategies. In particular, cognitive control is assumed to regulate the amount of shielding of the prioritised task from crosstalk from the secondary task. We investigated whether and how task shielding is influenced by mood states. Participants were exposed to two short film clips, one inducing high and one inducing low arousal, of either negative or positive content. Negative mood led to stronger shielding of the prioritised task (i.e., less crosstalk) than positive mood, irrespective of arousal. These findings support the assumption that emotional states determine the parameters of cognitive control and play an important role in regulating dual-task performance.

Sleep Deprivation and Time-on-Task Performance Decrement in the Rat Psychomotor Vigilance Task

PubMed Central

Oonk, Marcella; Davis, Christopher J.; Krueger, James M.; Wisor, Jonathan P.; Van Dongen, Hans P.A.

2015-01-01

Study Objectives: The rat psychomotor vigilance task (rPVT) was developed as a rodent analog of the human psychomotor vigilance task (hPVT). We examined whether rPVT performance displays time-on-task effects similar to those observed on the hPVT. Design: The rPVT requires rats to respond to a randomly presented light stimulus to obtain a water reward. Rats were water deprived for 22 h prior to each 30-min rPVT session to motivate performance. We analyzed rPVT performance over time on task and as a function of the response-stimulus interval, at baseline and after sleep deprivation. Setting: The study was conducted in an academic research vivarium. Participants: Male Long-Evans rats were trained to respond to a 0.5 sec stimulus light within 3 sec of stimulus onset. Complete data were available for n = 20 rats. Interventions: Rats performed the rPVT for 30 min at baseline and after 24 h total sleep deprivation by gentle handling. Measurements and Results: Compared to baseline, sleep deprived rats displayed increased performance lapses and premature responses, similar to hPVT lapses of attention and false starts. However, in contrast to hPVT performance, the time-on-task performance decrement was not significantly enhanced by sleep deprivation. Moreover, following sleep deprivation, rPVT response times were not consistently increased after short response-stimulus intervals. Conclusions: The rat psychomotor vigilance task manifests similarities to the human psychomotor vigilance task in global performance outcomes, but not in post-sleep deprivation effects of time on task and response-stimulus interval. Citation: Oonk M, Davis CJ, Krueger JM, Wisor JP, Van Dongen HPA. Sleep deprivation and time-on-task performance decrement in the rat psychomotor vigilance task. SLEEP 2015;38(3):445–451. PMID:25515099

Performance of a normalized energy metric without jammer state information for an FH/MFSK system in worst case partial band jamming

NASA Technical Reports Server (NTRS)

Lee, P. J.

1985-01-01

For a frequency-hopped noncoherent MFSK communication system without jammer state information (JSI) in a worst case partial band jamming environment, it is well known that the use of a conventional unquantized metric results in very poor performance. In this paper, a 'normalized' unquantized energy metric is suggested for such a system. It is shown that with this metric, one can save 2-3 dB in required signal energy over the system with hard decision metric without JSI for the same desired performance. When this very robust metric is compared to the conventional unquantized energy metric with JSI, the loss in required signal energy is shown to be small. Thus, the use of this normalized metric provides performance comparable to systems for which JSI is known. Cutoff rate and bit error rate with dual-k coding are used for the performance measures.

Task performance in astronomical adaptive optics

NASA Astrophysics Data System (ADS)

Barrett, Harrison H.; Myers, Kyle J.; Devaney, Nicholas; Dainty, J. C.; Caucci, Luca

2006-06-01

In objective or task-based assessment of image quality, figures of merit are defined by the performance of some specific observer on some task of scientific interest. This methodology is well established in medical imaging but is just beginning to be applied in astronomy. In this paper we survey the theory needed to understand the performance of ideal or ideal-linear (Hotelling) observers on detection tasks with adaptive-optical data. The theory is illustrated by discussing its application to detection of exoplanets from a sequence of short-exposure images.

Specification and implementation of IFC based performance metrics to support building life cycle assessment of hybrid energy systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morrissey, Elmer; O'Donnell, James; Keane, Marcus

2004-03-29

Minimizing building life cycle energy consumption is becoming of paramount importance. Performance metrics tracking offers a clear and concise manner of relating design intent in a quantitative form. A methodology is discussed for storage and utilization of these performance metrics through an Industry Foundation Classes (IFC) instantiated Building Information Model (BIM). The paper focuses on storage of three sets of performance data from three distinct sources. An example of a performance metrics programming hierarchy is displayed for a heat pump and a solar array. Utilizing the sets of performance data, two discrete performance effectiveness ratios may be computed, thus offeringmore » an accurate method of quantitatively assessing building performance.« less

The effects of stimulus modality and task integrality: Predicting dual-task performance and workload from single-task levels

NASA Technical Reports Server (NTRS)

Hart, S. G.; Shively, R. J.; Vidulich, M. A.; Miller, R. C.

1986-01-01

The influence of stimulus modality and task difficulty on workload and performance was investigated. The goal was to quantify the cost (in terms of response time and experienced workload) incurred when essentially serial task components shared common elements (e.g., the response to one initiated the other) which could be accomplished in parallel. The experimental tasks were based on the Fittsberg paradigm; the solution to a SternBERG-type memory task determines which of two identical FITTS targets are acquired. Previous research suggested that such functionally integrated dual tasks are performed with substantially less workload and faster response times than would be predicted by suming single-task components when both are presented in the same stimulus modality (visual). The physical integration of task elements was varied (although their functional relationship remained the same) to determine whether dual-task facilitation would persist if task components were presented in different sensory modalities. Again, it was found that the cost of performing the two-stage task was considerably less than the sum of component single-task levels when both were presented visually. Less facilitation was found when task elements were presented in different sensory modalities. These results suggest the importance of distinguishing between concurrent tasks that complete for limited resources from those that beneficially share common resources when selecting the stimulus modalities for information displays.

Metrics in method engineering

NASA Astrophysics Data System (ADS)

Brinkkemper, S.; Rossi, M.

1994-12-01

As customizable computer aided software engineering (CASE) tools, or CASE shells, have been introduced in academia and industry, there has been a growing interest into the systematic construction of methods and their support environments, i.e. method engineering. To aid the method developers and method selectors in their tasks, we propose two sets of metrics, which measure the complexity of diagrammatic specification techniques on the one hand, and of complete systems development methods on the other hand. Proposed metrics provide a relatively fast and simple way to analyze the technique (or method) properties, and when accompanied with other selection criteria, can be used for estimating the cost of learning the technique and the relative complexity of a technique compared to others. To demonstrate the applicability of the proposed metrics, we have applied them to 34 techniques and 15 methods.

Human performance on the temporal bisection task.

PubMed

Kopec, Charles D; Brody, Carlos D

2010-12-01

The perception and processing of temporal information are tasks the brain must continuously perform. These include measuring the duration of stimuli, storing duration information in memory, recalling such memories, and comparing two durations. How the brain accomplishes these tasks, however, is still open for debate. The temporal bisection task, which requires subjects to compare temporal stimuli to durations held in memory, is perfectly suited to address these questions. Here we perform a meta-analysis of human performance on the temporal bisection task collected from 148 experiments spread across 18 independent studies. With this expanded data set we are able to show that human performance on this task contains a number of significant peculiarities, which in total no single model yet proposed has been able to explain. Here we present a simple 2-step decision model that is capable of explaining all the idiosyncrasies seen in the data. Copyright © 2010 Elsevier Inc. All rights reserved.

Event-related potentials and secondary task performance during simulated driving.

PubMed

Wester, A E; Böcker, K B E; Volkerts, E R; Verster, J C; Kenemans, J L

2008-01-01

Inattention and distraction account for a substantial number of traffic accidents. Therefore, we examined the impact of secondary task performance (an auditory oddball task) on a primary driving task (lane keeping). Twenty healthy participants performed two 20-min tests in the Divided Attention Steering Simulator (DASS). The visual secondary task of the DASS was replaced by an auditory oddball task to allow recording of brain activity. The driving task and the secondary (distracting) oddball task were presented in isolation and simultaneously, to assess their mutual interference. In addition to performance measures (lane keeping in the primary driving task and reaction speed in the secondary oddball task), brain activity, i.e. event-related potentials (ERPs), was recorded. Performance parameters on the driving test and the secondary oddball task did not differ between performance in isolation and simultaneous performance. However, when both tasks were performed simultaneously, reaction time variability increased in the secondary oddball task. Analysis of brain activity indicated that ERP amplitude (P3a amplitude) related to the secondary task, was significantly reduced when the task was performed simultaneously with the driving test. This study shows that when performing a simple secondary task during driving, performance of the driving task and this secondary task are both unaffected. However, analysis of brain activity shows reduced cortical processing of irrelevant, potentially distracting stimuli from the secondary task during driving.

Degraded visual environment image/video quality metrics

NASA Astrophysics Data System (ADS)

Baumgartner, Dustin D.; Brown, Jeremy B.; Jacobs, Eddie L.; Schachter, Bruce J.

2014-06-01

A number of image quality metrics (IQMs) and video quality metrics (VQMs) have been proposed in the literature for evaluating techniques and systems for mitigating degraded visual environments. Some require both pristine and corrupted imagery. Others require patterned target boards in the scene. None of these metrics relates well to the task of landing a helicopter in conditions such as a brownout dust cloud. We have developed and used a variety of IQMs and VQMs related to the pilot's ability to detect hazards in the scene and to maintain situational awareness. Some of these metrics can be made agnostic to sensor type. Not only are the metrics suitable for evaluating algorithm and sensor variation, they are also suitable for choosing the most cost effective solution to improve operating conditions in degraded visual environments.

Saccadic eye movement metrics reflect surgical residents' fatigue.

PubMed

Di Stasi, Leandro L; McCamy, Michael B; Macknik, Stephen L; Mankin, James A; Hooft, Nicole; Catena, Andrés; Martinez-Conde, Susana

2014-04-01

Little is known about the effects of surgical residents' fatigue on patient safety. We monitored surgical residents' fatigue levels during their call day using (1) eye movement metrics, (2) objective measures of laparoscopic surgical performance, and (3) subjective reports based on standardized questionnaires. Prior attempts to investigate the effects of fatigue on surgical performance have suffered from methodological limitations, including inconsistent definitions and lack of objective measures of fatigue, and nonstandardized measures of surgical performance. Recent research has shown that fatigue can affect the characteristics of saccadic (fast ballistic) eye movements in nonsurgical scenarios. Here we asked whether fatigue induced by time-on-duty (~24 hours) might affect saccadic metrics in surgical residents. Because saccadic velocity is not under voluntary control, a fatigue index based on saccadic velocity has the potential to provide an accurate and unbiased measure of the resident's fatigue level. We measured the eye movements of members of the general surgery resident team at St. Joseph's Hospital and Medical Center (Phoenix, AZ) (6 males and 6 females), using a head-mounted video eye tracker (similar configuration to a surgical headlight), during the performance of 3 tasks: 2 simulated laparoscopic surgery tasks (peg transfer and precision cutting) and a guided saccade task, before and after their call day. Residents rated their perceived fatigue level every 3 hours throughout their 24-hour shift, using a standardized scale. Time-on-duty decreased saccadic velocity and increased subjective fatigue but did not affect laparoscopic performance. These results support the hypothesis that saccadic indices reflect graded changes in fatigue. They also indicate that fatigue due to prolonged time-on-duty does not result necessarily in medical error, highlighting the complicated relationship among continuity of care, patient safety, and fatigued providers. Our data

Preferential processing of task-irrelevant beloved-related information and task performance: Two event-related potential studies.

PubMed

Langeslag, Sandra J E; van Strien, Jan W

2017-09-18

People who are in love have better attention for beloved-related information, but report having trouble focusing on other tasks, such as (home)work. So, romantic love can both improve and hurt cognition. Emotional information is preferentially processed, which improves task performance when the information is task-relevant, but hurts task performance when it is task-irrelevant. Because beloved-related information is highly emotional, the effects of romantic love on cognition may resemble these effects of emotion on cognition. We examined whether beloved-related information is preferentially processed even when it is task-irrelevant and whether this hurts task performance. In two event-related potential studies, participants who had recently fallen in love performed a visuospatial short-term memory task. Task-irrelevant beloved, friend, and stranger faces were presented during maintenance (Study 1), or encoding (Study 2). The Early Posterior Negativity (EPN) reflecting early automatic attentional capturing and the Late Positive Potential (LPP) reflecting sustained motivated attention were largest for beloved pictures. Thus, beloved pictures are preferentially processed even when they are task-irrelevant. Task performance and reaction times did not differ between beloved, friend, and stranger conditions. Nevertheless, self-reported obsessive thinking about the beloved tended to correlate negatively with task performance, and positively with reaction times, across conditions. So, although task-irrelevant beloved-related information does not impact task performance, more obsessive thinking about the beloved might relate to poorer and slower overall task performance. More research is needed to clarify why people experience trouble focusing on beloved-unrelated tasks and how this negative effect of love on cognition could be reduced. Copyright © 2017 Elsevier Ltd. All rights reserved.

C3 generic workstation: Performance metrics and applications

NASA Technical Reports Server (NTRS)

Eddy, Douglas R.

1988-01-01

The large number of integrated dependent measures available on a command, control, and communications (C3) generic workstation under development are described. In this system, embedded communications tasks will manipulate workload to assess the effects of performance-enhancing drugs (sleep aids and decongestants), work/rest cycles, biocybernetics, and decision support systems on performance. Task performance accuracy and latency will be event coded for correlation with other measures of voice stress and physiological functioning. Sessions will be videotaped to score non-verbal communications. Physiological recordings include spectral analysis of EEG, ECG, vagal tone, and EOG. Subjective measurements include SWAT, fatigue, POMS and specialized self-report scales. The system will be used primarily to evaluate the effects on performance of drugs, work/rest cycles, and biocybernetic concepts. Performance assessment algorithms will also be developed, including those used with small teams. This system provides a tool for integrating and synchronizing behavioral and psychophysiological measures in a complex decision-making environment.

Investigating Perfect Timesharing: The Relationship between IM-Compatible Tasks and Dual-Task Performance

ERIC Educational Resources Information Center

Halvorson, Kimberly M.; Ebner, Herschel; Hazeltine, Eliot

2013-01-01

Why are dual-task costs reduced with ideomotor (IM) compatible tasks (Greenwald & Shulman, 1973; Lien, Proctor & Allen, 2002)? In the present experiments, we first examine three different measures of single-task performance (pure single-task blocks, mixed blocks, and long stimulus onset asynchrony [SOA] trials in dual-task blocks) and two…

New Performance Metrics for Quantitative Polymerase Chain Reaction-Based Microbial Source Tracking Methods

EPA Science Inventory

Binary sensitivity and specificity metrics are not adequate to describe the performance of quantitative microbial source tracking methods because the estimates depend on the amount of material tested and limit of detection. We introduce a new framework to compare the performance ...

Task-relevant cognitive and motor functions are prioritized during prolonged speed-accuracy motor task performance.

PubMed

Solianik, Rima; Satas, Andrius; Mickeviciene, Dalia; Cekanauskaite, Agne; Valanciene, Dovile; Majauskiene, Daiva; Skurvydas, Albertas

2018-06-01

This study aimed to explore the effect of prolonged speed-accuracy motor task on the indicators of psychological, cognitive, psychomotor and motor function. Ten young men aged 21.1 ± 1.0 years performed a fast- and accurate-reaching movement task and a control task. Both tasks were performed for 2 h. Despite decreased motivation, and increased perception of effort as well as subjective feeling of fatigue, speed-accuracy motor task performance improved during the whole period of task execution. After the motor task, the increased working memory function and prefrontal cortex oxygenation at rest and during conflict detection, and the decreased efficiency of incorrect response inhibition and visuomotor tracking were observed. The speed-accuracy motor task increased the amplitude of motor-evoked potentials, while grip strength was not affected. These findings demonstrate that to sustain the performance of 2-h speed-accuracy task under conditions of self-reported fatigue, task-relevant functions are maintained or even improved, whereas less critical functions are impaired.

The prestimulus default mode network state predicts cognitive task performance levels on a mental rotation task.

PubMed

Kamp, Tabea; Sorger, Bettina; Benjamins, Caroline; Hausfeld, Lars; Goebel, Rainer

2018-06-22

Linking individual task performance to preceding, regional brain activation is an ongoing goal of neuroscientific research. Recently, it could be shown that the activation and connectivity within large-scale brain networks prior to task onset influence performance levels. More specifically, prestimulus default mode network (DMN) effects have been linked to performance levels in sensory near-threshold tasks, as well as cognitive tasks. However, it still remains uncertain how the DMN state preceding cognitive tasks affects performance levels when the period between task trials is long and flexible, allowing participants to engage in different cognitive states. We here investigated whether the prestimulus activation and within-network connectivity of the DMN are predictive of the correctness and speed of task performance levels on a cognitive (match-to-sample) mental rotation task, employing a sparse event-related functional magnetic resonance imaging (fMRI) design. We found that prestimulus activation in the DMN predicted the speed of correct trials, with a higher amplitude preceding correct fast response trials compared to correct slow response trials. Moreover, we found higher connectivity within the DMN before incorrect trials compared to correct trials. These results indicate that pre-existing activation and connectivity states within the DMN influence task performance on cognitive tasks, both effecting the correctness and speed of task execution. The findings support existing theories and empirical work on relating mind-wandering and cognitive task performance to the DMN and expand these by establishing a relationship between the prestimulus DMN state and the speed of cognitive task performance. © 2018 The Authors. Brain and Behavior published by Wiley Periodicals, Inc.

The Role of Task Complexity, Modality, and Aptitude in Narrative Task Performance

ERIC Educational Resources Information Center

Kormos, Judit; Trebits, Anna

2012-01-01

The study reported in this paper investigated the relationship between components of aptitude and the fluency, lexical variety, syntactic complexity, and accuracy of performance in two types of written and spoken narrative tasks. We also addressed the question of how narrative performance varies in tasks of different cognitive complexity in the…

Noisy EEG signals classification based on entropy metrics. Performance assessment using first and second generation statistics.

PubMed

Cuesta-Frau, David; Miró-Martínez, Pau; Jordán Núñez, Jorge; Oltra-Crespo, Sandra; Molina Picó, Antonio

2017-08-01

This paper evaluates the performance of first generation entropy metrics, featured by the well known and widely used Approximate Entropy (ApEn) and Sample Entropy (SampEn) metrics, and what can be considered an evolution from these, Fuzzy Entropy (FuzzyEn), in the Electroencephalogram (EEG) signal classification context. The study uses the commonest artifacts found in real EEGs, such as white noise, and muscular, cardiac, and ocular artifacts. Using two different sets of publicly available EEG records, and a realistic range of amplitudes for interfering artifacts, this work optimises and assesses the robustness of these metrics against artifacts in class segmentation terms probability. The results show that the qualitative behaviour of the two datasets is similar, with SampEn and FuzzyEn performing the best, and the noise and muscular artifacts are the most confounding factors. On the contrary, there is a wide variability as regards initialization parameters. The poor performance achieved by ApEn suggests that this metric should not be used in these contexts. Copyright © 2017 Elsevier Ltd. All rights reserved.

Performance tasks for operator-skills research.

DOT National Transportation Integrated Search

1966-06-01

The selection, development, and operation of several tasks for use in skilled-operator-performance research are described. The tasks are intended, collectively, to sample a broad spectrum of abilities required by complex operator systems; individuall...

Implicit and Explicit Knowledge Both Improve Dual Task Performance in a Continuous Pursuit Tracking Task.

PubMed

Ewolds, Harald E; Bröker, Laura; de Oliveira, Rita F; Raab, Markus; Künzell, Stefan

2017-01-01

The goal of this study was to investigate the effect of predictability on dual-task performance in a continuous tracking task. Participants practiced either informed (explicit group) or uninformed (implicit group) about a repeated segment in the curves they had to track. In Experiment 1 participants practices the tracking task only, dual-task performance was assessed after by combining the tracking task with an auditory reaction time task. Results showed both groups learned equally well and tracking performance on a predictable segment in the dual-task condition was better than on random segments. However, reaction times did not benefit from a predictable tracking segment. To investigate the effect of learning under dual-task situation participants in Experiment 2 practiced the tracking task while simultaneously performing the auditory reaction time task. No learning of the repeated segment could be demonstrated for either group during the training blocks, in contrast to the test-block and retention test, where participants performed better on the repeated segment in both dual-task and single-task conditions. Only the explicit group improved from test-block to retention test. As in Experiment 1, reaction times while tracking a predictable segment were no better than reaction times while tracking a random segment. We concluded that predictability has a positive effect only on the predictable task itself possibly because of a task-shielding mechanism. For dual-task training there seems to be an initial negative effect of explicit instructions, possibly because of fatigue, but the advantage of explicit instructions was demonstrated in a retention test. This might be due to the explicit memory system informing or aiding the implicit memory system.

Implicit and Explicit Knowledge Both Improve Dual Task Performance in a Continuous Pursuit Tracking Task

PubMed Central

Ewolds, Harald E.; Bröker, Laura; de Oliveira, Rita F.; Raab, Markus; Künzell, Stefan

2017-01-01

The goal of this study was to investigate the effect of predictability on dual-task performance in a continuous tracking task. Participants practiced either informed (explicit group) or uninformed (implicit group) about a repeated segment in the curves they had to track. In Experiment 1 participants practices the tracking task only, dual-task performance was assessed after by combining the tracking task with an auditory reaction time task. Results showed both groups learned equally well and tracking performance on a predictable segment in the dual-task condition was better than on random segments. However, reaction times did not benefit from a predictable tracking segment. To investigate the effect of learning under dual-task situation participants in Experiment 2 practiced the tracking task while simultaneously performing the auditory reaction time task. No learning of the repeated segment could be demonstrated for either group during the training blocks, in contrast to the test-block and retention test, where participants performed better on the repeated segment in both dual-task and single-task conditions. Only the explicit group improved from test-block to retention test. As in Experiment 1, reaction times while tracking a predictable segment were no better than reaction times while tracking a random segment. We concluded that predictability has a positive effect only on the predictable task itself possibly because of a task-shielding mechanism. For dual-task training there seems to be an initial negative effect of explicit instructions, possibly because of fatigue, but the advantage of explicit instructions was demonstrated in a retention test. This might be due to the explicit memory system informing or aiding the implicit memory system. PMID:29312083

Virtual Reality Robotic Surgery Warm-Up Improves Task Performance in a Dry Lab Environment: A Prospective Randomized Controlled Study

PubMed Central

Lendvay, Thomas S.; Brand, Timothy C.; White, Lee; Kowalewski, Timothy; Jonnadula, Saikiran; Mercer, Laina; Khorsand, Derek; Andros, Justin; Hannaford, Blake; Satava, Richard M.

2014-01-01

Background Pre-operative simulation “warm-up” has been shown to improve performance and reduce errors in novice and experienced surgeons, yet existing studies have only investigated conventional laparoscopy. We hypothesized a brief virtual reality (VR) robotic warm-up would enhance robotic task performance and reduce errors. Study Design In a two-center randomized trial, fifty-one residents and experienced minimally invasive surgery faculty in General Surgery, Urology, and Gynecology underwent a validated robotic surgery proficiency curriculum on a VR robotic simulator and on the da Vinci surgical robot. Once successfully achieving performance benchmarks, surgeons were randomized to either receive a 3-5 minute VR simulator warm-up or read a leisure book for 10 minutes prior to performing similar and dissimilar (intracorporeal suturing) robotic surgery tasks. The primary outcomes compared were task time, tool path length, economy of motion, technical and cognitive errors. Results Task time (-29.29sec, p=0.001, 95%CI-47.03,-11.56), path length (-79.87mm, p=0.014, 95%CI -144.48,-15.25), and cognitive errors were reduced in the warm-up group compared to the control group for similar tasks. Global technical errors in intracorporeal suturing (0.32, p=0.020, 95%CI 0.06,0.59) were reduced after the dissimilar VR task. When surgeons were stratified by prior robotic and laparoscopic clinical experience, the more experienced surgeons(n=17) demonstrated significant improvements from warm-up in task time (-53.5sec, p=0.001, 95%CI -83.9,-23.0) and economy of motion (0.63mm/sec, p=0.007, 95%CI 0.18,1.09), whereas improvement in these metrics was not statistically significantly appreciated in the less experienced cohort(n=34). Conclusions We observed a significant performance improvement and error reduction rate among surgeons of varying experience after VR warm-up for basic robotic surgery tasks. In addition, the VR warm-up reduced errors on a more complex task (robotic

EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks.

PubMed

Berka, Chris; Levendowski, Daniel J; Lumicao, Michelle N; Yau, Alan; Davis, Gene; Zivkovic, Vladimir T; Olmstead, Richard E; Tremoulet, Patrice D; Craven, Patrick L

2007-05-01

The ability to continuously and unobtrusively monitor levels of task engagement and mental workload in an operational environment could be useful in identifying more accurate and efficient methods for humans to interact with technology. This information could also be used to optimize the design of safer, more efficient work environments that increase motivation and productivity. The present study explored the feasibility of monitoring electroencephalo-graphic (EEG) indices of engagement and workload acquired unobtrusively and quantified during performance of cognitive tests. EEG was acquired from 80 healthy participants with a wireless sensor headset (F3-F4,C3-C4,Cz-POz,F3-Cz,Fz-C3,Fz-POz) during tasks including: multi-level forward/backward-digit-span, grid-recall, trails, mental-addition, 20-min 3-Choice Vigilance, and image-learning and memory tests. EEG metrics for engagement and workload were calculated for each 1 -s of EEG. Across participants, engagement but not workload decreased over the 20-min vigilance test. Engagement and workload were significantly increased during the encoding period of verbal and image-learning and memory tests when compared with the recognition/ recall period. Workload but not engagement increased linearly as level of difficulty increased in forward and backward-digit-span, grid-recall, and mental-addition tests. EEG measures correlated with both subjective and objective performance metrics. These data in combination with previous studies suggest that EEG engagement reflects information-gathering, visual processing, and allocation of attention. EEG workload increases with increasing working memory load and during problem solving, integration of information, analytical reasoning, and may be more reflective of executive functions. Inspection of EEG on a second-by-second timescale revealed associations between workload and engagement levels when aligned with specific task events providing preliminary evidence that second

Design and Implementation of Performance Metrics for Evaluation of Assessments Data

ERIC Educational Resources Information Center

Ahmed, Irfan; Bhatti, Arif

2016-01-01

Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though…

Bayesian performance metrics and small system integration in recent homeland security and defense applications

NASA Astrophysics Data System (ADS)

Jannson, Tomasz; Kostrzewski, Andrew; Patton, Edward; Pradhan, Ranjit; Shih, Min-Yi; Walter, Kevin; Savant, Gajendra; Shie, Rick; Forrester, Thomas

2010-04-01

In this paper, Bayesian inference is applied to performance metrics definition of the important class of recent Homeland Security and defense systems called binary sensors, including both (internal) system performance and (external) CONOPS. The medical analogy is used to define the PPV (Positive Predictive Value), the basic Bayesian metrics parameter of the binary sensors. Also, Small System Integration (SSI) is discussed in the context of recent Homeland Security and defense applications, emphasizing a highly multi-technological approach, within the broad range of clusters ("nexus") of electronics, optics, X-ray physics, γ-ray physics, and other disciplines.

Interference effects of vocalization on dual task performance

NASA Astrophysics Data System (ADS)

Owens, J. M.; Goodman, L. S.; Pianka, M. J.

1984-09-01

Voice command and control systems have been proposed as a potential means of off-loading the typically overburdened visual information processing system. However, prior to introducing novel human-machine interfacing technologies in high workload environments, consideration must be given to the integration of the new technologists within existing task structures to ensure that no new sources of workload or interference are systematically introduced. This study examined the use of voice interactive systems technology in the joint performance of two cognitive information processing tasks requiring continuous memory and choice reaction wherein a basis for intertask interference might be expected. Stimuli for the continuous memory task were presented aurally and either voice or keyboard responding was required in the choice reaction task. Performance was significantly degraded in each task when voice responding was required in the choice reaction time task. Performance degradation was evident in higher error scores for both the choice reaction and continuous memory tasks. Performance decrements observed under conditions of high intertask stimulus similarity were not statistically significant. The results signal the need to consider further the task requirements for verbal short-term memory when applying speech technology in multitask environments.

Surgical task analysis of simulated laparoscopic cholecystectomy with a navigation system.

PubMed

Sugino, T; Kawahira, H; Nakamura, R

2014-09-01

   Advanced surgical procedures, which have become complex and difficult, increase the burden of surgeons. Quantitative analysis of surgical procedures can improve training, reduce variability, and enable optimization of surgical procedures. To this end, a surgical task analysis system was developed that uses only surgical navigation information.    Division of the surgical procedure, task progress analysis, and task efficiency analysis were done. First, the procedure was divided into five stages. Second, the operating time and progress rate were recorded to document task progress during specific stages, including the dissecting task. Third, the speed of the surgical instrument motion (mean velocity and acceleration), as well as the size and overlap ratio of the approximate ellipse of the location log data distribution, was computed to estimate the task efficiency during each stage. These analysis methods were evaluated based on experimental validation with two groups of surgeons, i.e., skilled and "other" surgeons. The performance metrics and analytical parameters included incidents during the operation, the surgical environment, and the surgeon's skills or habits.    Comparison of groups revealed that skilled surgeons tended to perform the procedure in less time and involved smaller regions; they also manipulated the surgical instruments more gently.    Surgical task analysis developed for quantitative assessment of surgical procedures and surgical performance may provide practical methods and metrics for objective evaluation of surgical expertise.

Neural decoding with kernel-based metric learning.

PubMed

Brockmeier, Austin J; Choi, John S; Kriminger, Evan G; Francis, Joseph T; Principe, Jose C

2014-06-01

In studies of the nervous system, the choice of metric for the neural responses is a pivotal assumption. For instance, a well-suited distance metric enables us to gauge the similarity of neural responses to various stimuli and assess the variability of responses to a repeated stimulus-exploratory steps in understanding how the stimuli are encoded neurally. Here we introduce an approach where the metric is tuned for a particular neural decoding task. Neural spike train metrics have been used to quantify the information content carried by the timing of action potentials. While a number of metrics for individual neurons exist, a method to optimally combine single-neuron metrics into multineuron, or population-based, metrics is lacking. We pose the problem of optimizing multineuron metrics and other metrics using centered alignment, a kernel-based dependence measure. The approach is demonstrated on invasively recorded neural data consisting of both spike trains and local field potentials. The experimental paradigm consists of decoding the location of tactile stimulation on the forepaws of anesthetized rats. We show that the optimized metrics highlight the distinguishing dimensions of the neural response, significantly increase the decoding accuracy, and improve nonlinear dimensionality reduction methods for exploratory neural analysis.

On the importance of Task 1 and error performance measures in PRP dual-task studies.

PubMed

Strobach, Tilo; Schütz, Anja; Schubert, Torsten

2015-01-01

The psychological refractory period (PRP) paradigm is a dominant research tool in the literature on dual-task performance. In this paradigm a first and second component task (i.e., Task 1 and Task 2) are presented with variable stimulus onset asynchronies (SOAs) and priority to perform Task 1. The main indicator of dual-task impairment in PRP situations is an increasing Task 2-RT with decreasing SOAs. This impairment is typically explained with some task components being processed strictly sequentially in the context of the prominent central bottleneck theory. This assumption could implicitly suggest that processes of Task 1 are unaffected by Task 2 and bottleneck processing, i.e., decreasing SOAs do not increase reaction times (RTs) and error rates of the first task. The aim of the present review is to assess whether PRP dual-task studies included both RT and error data presentations and statistical analyses and whether studies including both data types (i.e., RTs and error rates) show data consistent with this assumption (i.e., decreasing SOAs and unaffected RTs and/or error rates in Task 1). This review demonstrates that, in contrast to RT presentations and analyses, error data is underrepresented in a substantial number of studies. Furthermore, a substantial number of studies with RT and error data showed a statistically significant impairment of Task 1 performance with decreasing SOA. Thus, these studies produced data that is not primarily consistent with the strong assumption that processes of Task 1 are unaffected by Task 2 and bottleneck processing in the context of PRP dual-task situations; this calls for a more careful report and analysis of Task 1 performance in PRP studies and for a more careful consideration of theories proposing additions to the bottleneck assumption, which are sufficiently general to explain Task 1 and Task 2 effects.

On the importance of Task 1 and error performance measures in PRP dual-task studies

PubMed Central

Strobach, Tilo; Schütz, Anja; Schubert, Torsten

2015-01-01

The psychological refractory period (PRP) paradigm is a dominant research tool in the literature on dual-task performance. In this paradigm a first and second component task (i.e., Task 1 and Task 2) are presented with variable stimulus onset asynchronies (SOAs) and priority to perform Task 1. The main indicator of dual-task impairment in PRP situations is an increasing Task 2-RT with decreasing SOAs. This impairment is typically explained with some task components being processed strictly sequentially in the context of the prominent central bottleneck theory. This assumption could implicitly suggest that processes of Task 1 are unaffected by Task 2 and bottleneck processing, i.e., decreasing SOAs do not increase reaction times (RTs) and error rates of the first task. The aim of the present review is to assess whether PRP dual-task studies included both RT and error data presentations and statistical analyses and whether studies including both data types (i.e., RTs and error rates) show data consistent with this assumption (i.e., decreasing SOAs and unaffected RTs and/or error rates in Task 1). This review demonstrates that, in contrast to RT presentations and analyses, error data is underrepresented in a substantial number of studies. Furthermore, a substantial number of studies with RT and error data showed a statistically significant impairment of Task 1 performance with decreasing SOA. Thus, these studies produced data that is not primarily consistent with the strong assumption that processes of Task 1 are unaffected by Task 2 and bottleneck processing in the context of PRP dual-task situations; this calls for a more careful report and analysis of Task 1 performance in PRP studies and for a more careful consideration of theories proposing additions to the bottleneck assumption, which are sufficiently general to explain Task 1 and Task 2 effects. PMID:25904890

The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort

PubMed Central

Steigerwald, Sarah N.; Park, Jason; Hardy, Krista M.; Gillman, Lawrence; Vergis, Ashley S.

2015-01-01

Background Considerable resources have been invested in both low- and high-fidelity simulators in surgical training. The purpose of this study was to investigate if the Fundamentals of Laparoscopic Surgery (FLS, low-fidelity box trainer) and LapVR (high-fidelity virtual reality) training systems correlate with operative performance on the Global Operative Assessment of Laparoscopic Skills (GOALS) global rating scale using a porcine cholecystectomy model in a novice surgical group with minimal laparoscopic experience. Methods Fourteen postgraduate year 1 surgical residents with minimal laparoscopic experience performed tasks from the FLS program and the LapVR simulator as well as a live porcine laparoscopic cholecystectomy. Performance was evaluated using standardized FLS metrics, automatic computer evaluations, and a validated global rating scale. Results Overall, FLS score did not show an association with GOALS global rating scale score on the porcine cholecystectomy. None of the five LapVR task scores were significantly associated with GOALS score on the porcine cholecystectomy. Conclusions Neither the low-fidelity box trainer or the high-fidelity virtual simulator demonstrated significant correlation with GOALS operative scores. These findings offer caution against the use of these modalities for brief assessments of novice surgical trainees, especially for predictive or selection purposes. PMID:26641071

Early Warning Look Ahead Metrics: The Percent Milestone Backlog Metric

NASA Technical Reports Server (NTRS)

Shinn, Stephen A.; Anderson, Timothy P.

2017-01-01

All complex development projects experience delays and corresponding backlogs of their project control milestones during their acquisition lifecycles. NASA Goddard Space Flight Center (GSFC) Flight Projects Directorate (FPD) teamed with The Aerospace Corporation (Aerospace) to develop a collection of Early Warning Look Ahead metrics that would provide GSFC leadership with some independent indication of the programmatic health of GSFC flight projects. As part of the collection of Early Warning Look Ahead metrics, the Percent Milestone Backlog metric is particularly revealing, and has utility as a stand-alone execution performance monitoring tool. This paper describes the purpose, development methodology, and utility of the Percent Milestone Backlog metric. The other four Early Warning Look Ahead metrics are also briefly discussed. Finally, an example of the use of the Percent Milestone Backlog metric in providing actionable insight is described, along with examples of its potential use in other commodities.

The Effects of Sensor Performance as Modeled by Signal Detection Theory on the Performance of Reinforcement Learning in a Target Acquisition Task

NASA Astrophysics Data System (ADS)

Quirion, Nate

Unmanned Aerial Systems (UASs) today are fulfilling more roles than ever before. There is a general push to have these systems feature more advanced autonomous capabilities in the near future. To achieve autonomous behavior requires some unique approaches to control and decision making. More advanced versions of these approaches are able to adapt their own behavior and examine their past experiences to increase their future mission performance. To achieve adaptive behavior and decision making capabilities this study used Reinforcement Learning algorithms. In this research the effects of sensor performance, as modeled through Signal Detection Theory (SDT), on the ability of RL algorithms to accomplish a target localization task are examined. Three levels of sensor sensitivity are simulated and compared to the results of the same system using a perfect sensor. To accomplish the target localization task, a hierarchical architecture used two distinct agents. A simulated human operator is assumed to be a perfect decision maker, and is used in the system feedback. An evaluation of the system is performed using multiple metrics, including episodic reward curves and the time taken to locate all targets. Statistical analyses are employed to detect significant differences in the comparison of steady-state behavior of different systems.

Lucid Dreaming and Ventromedial versus Dorsolateral Prefrontal Task Performance

PubMed Central

Neider, Michelle; Pace-Schott, Edward F.; Forselius, Erica; Pittman, Brian; Morgan, Peter T.

2010-01-01

Activity in the prefrontal cortex may distinguish the meta-awareness experienced during lucid dreams from its absence in normal dreams. To examine a possible relationship between dream lucidity and prefrontal task performance, we carried out a prospective study in 28 high school students. Participants performed the Wisconsin Card Sort and Iowa Gambling tasks, then for one week kept dream journals and reported sleep quality and lucidity-related dream characteristics. Participants who exhibited a greater degree of lucidity performed significantly better on the task that engages the ventromedial prefrontal cortex (the Iowa Gambling Task), but degree of lucidity achieved did not distinguish performance on the task that engages the dorsolateral prefrontal cortex (the Wisconsin Card Sort Task), nor did it distinguish self-reported sleep quality or baseline characteristics. The association between performance on the Iowa Gambling Task and lucidity suggests a connection between lucid dreaming and ventromedial prefrontal function. PMID:20829072

Impact of task design on task performance and injury risk: case study of a simulated drilling task.

PubMed

Alabdulkarim, Saad; Nussbaum, Maury A; Rashedi, Ehsan; Kim, Sunwook; Agnew, Michael; Gardner, Richard

2017-06-01

Existing evidence is limited regarding the influence of task design on performance and ergonomic risk, or the association between these two outcomes. In a controlled experiment, we constructed a mock fuselage to simulate a drilling task common in aircraft manufacturing, and examined the effect of three levels of workstation adjustability on performance as measured by productivity (e.g. fuselage completion time) and quality (e.g. fuselage defective holes), and ergonomic risk as quantified using two common methods (rapid upper limb assessment and the strain index). The primary finding was that both productivity and quality significantly improved with increased adjustability, yet this occurred only when that adjustability succeeded in reducing ergonomic risk. Supporting the inverse association between ergonomic risk and performance, the condition with highest adjustability created the lowest ergonomic risk and the best performance while there was not a substantial difference in ergonomic risk between the other two conditions, in which performance was also comparable. Practitioner Summary: Findings of this study supported a causal relationship between task design and both ergonomic risk and performance, and that ergonomic risk and performance are inversely associated. While future work is needed under more realistic conditions and a broader population, these results may be useful for task (re)design and to help cost-justify some ergonomic interventions.

Cognitive Styles, Demographic Attributes, Task Performance and Affective Experiences: An Empirical Investigation into Astrophysics Data System (ADS) Core Users

NASA Astrophysics Data System (ADS)

Tong, Rong

As a primary digital library portal for astrophysics researchers, SAO/NASA ADS (Astrophysics Data System) 2.0 interface features several visualization tools such as Author Network and Metrics. This research study involves 20 ADS long term users who participated in a usability and eye tracking research session. Participants first completed a cognitive test, and then performed five tasks in ADS 2.0 where they explored its multiple visualization tools. Results show that over half of the participants were Imagers and half of the participants were Analytic. Cognitive styles were found to have significant impacts on several efficiency-based measures. Analytic-oriented participants were observed to spent shorter time on web pages and apps, made fewer web page changes than less-Analytic-driving participants in performing common tasks, whereas AI (Analytic-Imagery) participants also completed their five tasks faster than non-AI participants. Meanwhile, self-identified Imagery participants were found to be more efficient in their task completion through multiple measures including total time on task, number of mouse clicks, and number of query revisions made. Imagery scores were negatively associated with frequency of confusion and the observed counts of being surprised. Compared to those who did not claimed to be a visual person, self-identified Imagery participants were observed to have significantly less frequency in frustration and hesitation during their task performance. Both demographic variables and past user experiences were found to correlate with task performance; query revision also correlated with multiple time-based measurements. Considered as an indicator of efficiency, query revisions were found to correlate negatively with the rate of complete with ease, and positively with several time-based efficiency measures, rate of complete with some difficulty, and the frequency of frustration. These results provide rich insights into the cognitive styles of ADS' core

Pleasantness of Creative Tasks and Creative Performance

ERIC Educational Resources Information Center

Zenasni, Franck; Lubart, Todd

2011-01-01

To examine the impact of emotion on creative potential, experimental studies have typically focused on the impact of induced or spontaneous mood states on creative performance. In this report the relationship between the perceived pleasantness of tasks (using divergent thinking and story writing tasks) and creative performance was examined.…

Neuroimaging explanations of age-related differences in task performance.

PubMed

Steffener, Jason; Barulli, Daniel; Habeck, Christian; Stern, Yaakov

2014-01-01

Advancing age affects both cognitive performance and functional brain activity and interpretation of these effects has led to a variety of conceptual research models without always explicitly linking the two effects. However, to best understand the multifaceted effects of advancing age, age differences in functional brain activity need to be explicitly tied to the cognitive task performance. This work hypothesized that age-related differences in task performance are partially explained by age-related differences in functional brain activity and formally tested these causal relationships. Functional MRI data was from groups of young and old adults engaged in an executive task-switching experiment. Analyses were voxel-wise testing of moderated-mediation and simple mediation statistical path models to determine whether age group, brain activity and their interaction explained task performance in regions demonstrating an effect of age group. Results identified brain regions whose age-related differences in functional brain activity significantly explained age-related differences in task performance. In all identified locations, significant moderated-mediation relationships resulted from increasing brain activity predicting worse (slower) task performance in older but not younger adults. Findings suggest that advancing age links task performance to the level of brain activity. The overall message of this work is that in order to understand the role of functional brain activity on cognitive performance, analysis methods should respect theoretical relationships. Namely, that age affects brain activity and brain activity is related to task performance.

A novel patient-centered "intention-to-treat" metric of U.S. lung transplant center performance.

PubMed

Maldonado, Dawn A; RoyChoudhury, Arindam; Lederer, David J

2018-01-01

Despite the importance of pretransplantation outcomes, 1-year posttransplantation survival is typically considered the primary metric of lung transplant center performance in the United States. We designed a novel lung transplant center performance metric that incorporates both pre- and posttransplantation survival time. We performed an ecologic study of 12 187 lung transplant candidates listed at 56 U.S. lung transplant centers between 2006 and 2012. We calculated an "intention-to-treat" survival (ITTS) metric as the percentage of waiting list candidates surviving at least 1 year after transplantation. The median center-level 1-year posttransplantation survival rate was 84.1%, and the median center-level ITTS was 66.9% (mean absolute difference 19.6%, 95% limits of agreement 4.3 to 35.1%). All but 10 centers had ITTS values that were significantly lower than 1-year posttransplantation survival rates. Observed ITTS was significantly lower than expected ITTS for 7 centers. These data show that one third of lung transplant candidates do not survive 1 year after transplantation, and that 12% of centers have lower than expected ITTS. An "intention-to-treat" survival metric may provide a more realistic expectation of patient outcomes at transplant centers and may be of value to transplant centers and policymakers. © 2017 The American Society of Transplantation and the American Society of Transplant Surgeons.

Performation Metrics Development Analysis for Information and Communications Technology Outsourcing: A Case Study

ERIC Educational Resources Information Center

Travis, James L., III

2014-01-01

This study investigated how and to what extent the development and use of the OV-5a operational architecture decomposition tree (OADT) from the Department of Defense (DoD) Architecture Framework (DoDAF) affects requirements analysis with respect to complete performance metrics for performance-based services acquisition of ICT under rigid…

Spectrum splitting metrics and effect of filter characteristics on photovoltaic system performance.

PubMed

Russo, Juan M; Zhang, Deming; Gordon, Michael; Vorndran, Shelby; Wu, Yuechen; Kostuk, Raymond K

2014-03-10

During the past few years there has been a significant interest in spectrum splitting systems to increase the overall efficiency of photovoltaic solar energy systems. However, methods for comparing the performance of spectrum splitting systems and the effects of optical spectral filter design on system performance are not well developed. This paper addresses these two areas. The system conversion efficiency is examined in detail and the role of optical spectral filters with respect to the efficiency is developed. A new metric termed the Improvement over Best Bandgap is defined which expresses the efficiency gain of the spectrum splitting system with respect to a similar system that contains the highest constituent single bandgap photovoltaic cell. This parameter indicates the benefit of using the more complex spectrum splitting system with respect to a single bandgap photovoltaic system. Metrics are also provided to assess the performance of experimental spectral filters in different spectrum splitting configurations. The paper concludes by using the methodology to evaluate spectrum splitting systems with different filter configurations and indicates the overall efficiency improvement that is possible with ideal and experimental designs.

Task-oriented lossy compression of magnetic resonance images

NASA Astrophysics Data System (ADS)

Anderson, Mark C.; Atkins, M. Stella; Vaisey, Jacques

1996-04-01

A new task-oriented image quality metric is used to quantify the effects of distortion introduced into magnetic resonance images by lossy compression. This metric measures the similarity between a radiologist's manual segmentation of pathological features in the original images and the automated segmentations performed on the original and compressed images. The images are compressed using a general wavelet-based lossy image compression technique, embedded zerotree coding, and segmented using a three-dimensional stochastic model-based tissue segmentation algorithm. The performance of the compression system is then enhanced by compressing different regions of the image volume at different bit rates, guided by prior knowledge about the location of important anatomical regions in the image. Application of the new system to magnetic resonance images is shown to produce compression results superior to the conventional methods, both subjectively and with respect to the segmentation similarity metric.

Sleep deprivation and time-on-task performance decrement in the rat psychomotor vigilance task.

PubMed

Oonk, Marcella; Davis, Christopher J; Krueger, James M; Wisor, Jonathan P; Van Dongen, Hans P A

2015-03-01

The rat psychomotor vigilance task (rPVT) was developed as a rodent analog of the human psychomotor vigilance task (hPVT). We examined whether rPVT performance displays time-on-task effects similar to those observed on the hPVT. The rPVT requires rats to respond to a randomly presented light stimulus to obtain a water reward. Rats were water deprived for 22 h prior to each 30-min rPVT session to motivate performance. We analyzed rPVT performance over time on task and as a function of the response-stimulus interval, at baseline and after sleep deprivation. The study was conducted in an academic research vivarium. Male Long-Evans rats were trained to respond to a 0.5 sec stimulus light within 3 sec of stimulus onset. Complete data were available for n = 20 rats. Rats performed the rPVT for 30 min at baseline and after 24 h total sleep deprivation by gentle handling. Compared to baseline, sleep deprived rats displayed increased performance lapses and premature responses, similar to hPVT lapses of attention and false starts. However, in contrast to hPVT performance, the time-on-task performance decrement was not significantly enhanced by sleep deprivation. Moreover, following sleep deprivation, rPVT response times were not consistently increased after short response-stimulus intervals. The rPVT manifests similarities to the hPVT in global performance outcomes, but not in post-sleep deprivation effects of time on task and response-stimulus interval. © 2015 Associated Professional Sleep Societies, LLC.

Improving older adults' memory performance using prior task success.

PubMed

Geraci, Lisa; Miller, Tyler M

2013-06-01

Holding negative aging stereotypes can lead older adults to perform poorly on memory tests. We attempted to improve older adults' memory performance by giving them task experience that would counter their negative performance expectations. Before participating in a memory experiment, younger and older adults were given a cognitive task that they could either successfully complete, not successfully complete, or they were given no prior task. For older adults, recall was significantly higher and self-reported anxiety was significantly lower for the prior task success group relative to the other groups. There was no effect of prior task experience on younger adults' memory performance. Results suggest that older adults' memory can be improved with a single successful prior task experience. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Exploring the role of task performance and learning style on prefrontal hemodynamics during a working memory task.

PubMed

Anderson, Afrouz A; Parsa, Kian; Geiger, Sydney; Zaragoza, Rachel; Kermanian, Riley; Miguel, Helga; Dashtestani, Hadis; Chowdhry, Fatima A; Smith, Elizabeth; Aram, Siamak; Gandjbakhche, Amir H

2018-01-01

Existing literature outlines the quality and location of activation in the prefrontal cortex (PFC) during working memory (WM) tasks. However, the effects of individual differences on the underlying neural process of WM tasks are still unclear. In this functional near infrared spectroscopy study, we administered a visual and auditory n-back task to examine activation in the PFC while considering the influences of task performance, and preferred learning strategy (VARK score). While controlling for age, results indicated that high performance (HP) subjects (accuracy > 90%) showed task dependent lower activation compared to normal performance subjects in PFC region Specifically HP groups showed lower activation in left dorsolateral PFC (DLPFC) region during performance of auditory task whereas during visual task they showed lower activation in the right DLPFC. After accounting for learning style, we found a correlation between visual and aural VARK score and level of activation in the PFC. Subjects with higher visual VARK scores displayed lower activation during auditory task in left DLPFC, while those with higher visual scores exhibited higher activation during visual task in bilateral DLPFC. During performance of auditory task, HP subjects had higher visual VARK scores compared to NP subjects indicating an effect of learning style on the task performance and activation. The results of this study show that learning style and task performance can influence PFC activation, with applications toward neurological implications of learning style and populations with deficits in auditory or visual processing.

Exploring the role of task performance and learning style on prefrontal hemodynamics during a working memory task

PubMed Central

Anderson, Afrouz A.; Parsa, Kian; Geiger, Sydney; Zaragoza, Rachel; Kermanian, Riley; Miguel, Helga; Chowdhry, Fatima A.; Smith, Elizabeth; Aram, Siamak; Gandjbakhche, Amir H.

2018-01-01

Existing literature outlines the quality and location of activation in the prefrontal cortex (PFC) during working memory (WM) tasks. However, the effects of individual differences on the underlying neural process of WM tasks are still unclear. In this functional near infrared spectroscopy study, we administered a visual and auditory n-back task to examine activation in the PFC while considering the influences of task performance, and preferred learning strategy (VARK score). While controlling for age, results indicated that high performance (HP) subjects (accuracy > 90%) showed task dependent lower activation compared to normal performance subjects in PFC region Specifically HP groups showed lower activation in left dorsolateral PFC (DLPFC) region during performance of auditory task whereas during visual task they showed lower activation in the right DLPFC. After accounting for learning style, we found a correlation between visual and aural VARK score and level of activation in the PFC. Subjects with higher visual VARK scores displayed lower activation during auditory task in left DLPFC, while those with higher visual scores exhibited higher activation during visual task in bilateral DLPFC. During performance of auditory task, HP subjects had higher visual VARK scores compared to NP subjects indicating an effect of learning style on the task performance and activation. The results of this study show that learning style and task performance can influence PFC activation, with applications toward neurological implications of learning style and populations with deficits in auditory or visual processing. PMID:29870536

Brain Modularity Mediates the Relation between Task Complexity and Performance

NASA Astrophysics Data System (ADS)

Ye, Fengdan; Yue, Qiuhai; Martin, Randi; Fischer-Baum, Simon; Ramos-Nuã+/-Ez, Aurora; Deem, Michael

Recent work in cognitive neuroscience has focused on analyzing the brain as a network, rather than a collection of independent regions. Prior studies taking this approach have found that individual differences in the degree of modularity of the brain network relate to performance on cognitive tasks. However, inconsistent results concerning the direction of this relationship have been obtained, with some tasks showing better performance as modularity increases, and other tasks showing worse performance. A recent theoretical model suggests that these inconsistencies may be explained on the grounds that high-modularity networks favor performance on simple tasks whereas low-modularity networks favor performance on complex tasks. The current study tests these predictions by relating modularity from resting-state fMRI to performance on a set of behavioral tasks. Complex and simple tasks were defined on the basis of whether they drew on executive attention. Consistent with predictions, we found a negative correlation between individuals' modularity and their performance on the complex tasks but a positive correlation with performance on the simple tasks. The results presented here provide a framework for linking measures of whole brain organization to cognitive processing.

Human Performance on the Temporal Bisection Task

ERIC Educational Resources Information Center

Kopec, Charles D.; Brody, Carlos D.

2010-01-01

The perception and processing of temporal information are tasks the brain must continuously perform. These include measuring the duration of stimuli, storing duration information in memory, recalling such memories, and comparing two durations. How the brain accomplishes these tasks, however, is still open for debate. The temporal bisection task,…

Quality metrics for sensor images

NASA Technical Reports Server (NTRS)

Ahumada, AL

1993-01-01

Methods are needed for evaluating the quality of augmented visual displays (AVID). Computational quality metrics will help summarize, interpolate, and extrapolate the results of human performance tests with displays. The FLM Vision group at NASA Ames has been developing computational models of visual processing and using them to develop computational metrics for similar problems. For example, display modeling systems use metrics for comparing proposed displays, halftoning optimizing methods use metrics to evaluate the difference between the halftone and the original, and image compression methods minimize the predicted visibility of compression artifacts. The visual discrimination models take as input two arbitrary images A and B and compute an estimate of the probability that a human observer will report that A is different from B. If A is an image that one desires to display and B is the actual displayed image, such an estimate can be regarded as an image quality metric reflecting how well B approximates A. There are additional complexities associated with the problem of evaluating the quality of radar and IR enhanced displays for AVID tasks. One important problem is the question of whether intruding obstacles are detectable in such displays. Although the discrimination model can handle detection situations by making B the original image A plus the intrusion, this detection model makes the inappropriate assumption that the observer knows where the intrusion will be. Effects of signal uncertainty need to be added to our models. A pilot needs to make decisions rapidly. The models need to predict not just the probability of a correct decision, but the probability of a correct decision by the time the decision needs to be made. That is, the models need to predict latency as well as accuracy. Luce and Green have generated models for auditory detection latencies. Similar models are needed for visual detection. Most image quality models are designed for static imagery

Thinking About a Task Is Associated with Increased Connectivity in Regions Activated by Task Performance

PubMed Central

Robertson, Edwin M.; Manoach, Dara S.; Stickgold, Robert

2016-01-01

Abstract We investigated whether functional neuroimaging of quiet “rest” can reveal the neural correlates of conscious thought. Using resting-state functional MRI, we measured functional connectivity during a resting scan that immediately followed performance of a finger tapping motor sequence task. Self-reports of the amount of time spent thinking about the task during the resting scan correlated with connectivity between regions of the motor network activated during task performance. Thus, thinking about a task is associated with coordinated activity in brain regions responsible for that task's performance. More generally, this study demonstrates the feasibility of using the combination of functional connectivity MRI and self-reports to examine the neural correlates of thought. PMID:26650337

Computer task performance by subjects with Duchenne muscular dystrophy.

PubMed

Malheiros, Silvia Regina Pinheiro; da Silva, Talita Dias; Favero, Francis Meire; de Abreu, Luiz Carlos; Fregni, Felipe; Ribeiro, Denise Cardoso; de Mello Monteiro, Carlos Bandeira

2016-01-01

Two specific objectives were established to quantify computer task performance among people with Duchenne muscular dystrophy (DMD). First, we compared simple computational task performance between subjects with DMD and age-matched typically developing (TD) subjects. Second, we examined correlations between the ability of subjects with DMD to learn the computational task and their motor functionality, age, and initial task performance. The study included 84 individuals (42 with DMD, mean age of 18±5.5 years, and 42 age-matched controls). They executed a computer maze task; all participants performed the acquisition (20 attempts) and retention (five attempts) phases, repeating the same maze. A different maze was used to verify transfer performance (five attempts). The Motor Function Measure Scale was applied, and the results were compared with maze task performance. In the acquisition phase, a significant decrease was found in movement time (MT) between the first and last acquisition block, but only for the DMD group. For the DMD group, MT during transfer was shorter than during the first acquisition block, indicating improvement from the first acquisition block to transfer. In addition, the TD group showed shorter MT than the DMD group across the study. DMD participants improved their performance after practicing a computational task; however, the difference in MT was present in all attempts among DMD and control subjects. Computational task improvement was positively influenced by the initial performance of individuals with DMD. In turn, the initial performance was influenced by their distal functionality but not their age or overall functionality.

Approaches to Cycle Analysis and Performance Metrics

NASA Technical Reports Server (NTRS)

Parson, Daniel E.

2003-01-01

The following notes were prepared as part of an American Institute of Aeronautics and Astronautics (AIAA) sponsored short course entitled Air Breathing Pulse Detonation Engine (PDE) Technology. The course was presented in January of 2003, and again in July of 2004 at two different AIAA meetings. It was taught by seven instructors, each of whom provided information on particular areas of PDE research. These notes cover two areas. The first is titled Approaches to Cycle Analysis and Performance Metrics. Here, the various methods of cycle analysis are introduced. These range from algebraic, thermodynamic equations, to single and multi-dimensional Computational Fluid Dynamic (CFD) solutions. Also discussed are the various means by which performance is measured, and how these are applied in a device which is fundamentally unsteady. The second topic covered is titled PDE Hybrid Applications. Here the concept of coupling a PDE to a conventional turbomachinery based engine is explored. Motivation for such a configuration is provided in the form of potential thermodynamic benefits. This is accompanied by a discussion of challenges to the technology.

Dividing Attention Between Tasks: Testing Whether Explicit Payoff Functions Elicit Optimal Dual-Task Performance.

PubMed

Farmer, George D; Janssen, Christian P; Nguyen, Anh T; Brumby, Duncan P

2018-04-01

We test people's ability to optimize performance across two concurrent tasks. Participants performed a number entry task while controlling a randomly moving cursor with a joystick. Participants received explicit feedback on their performance on these tasks in the form of a single combined score. This payoff function was varied between conditions to change the value of one task relative to the other. We found that participants adapted their strategy for interleaving the two tasks, by varying how long they spent on one task before switching to the other, in order to achieve the near maximum payoff available in each condition. In a second experiment, we show that this behavior is learned quickly (within 2-3 min over several discrete trials) and remained stable for as long as the payoff function did not change. The results of this work show that people are adaptive and flexible in how they prioritize and allocate attention in a dual-task setting. However, it also demonstrates some of the limits regarding people's ability to optimize payoff functions. Copyright © 2017 The Authors. Cognitive Science published by Wiley Periodicals, Inc. on behalf of Cognitive Science Society.

Continuous Performance Tasks: Not Just about Sustaining Attention

ERIC Educational Resources Information Center

Roebuck, Hettie; Freigang, Claudia; Barry, Johanna G.

2016-01-01

Purpose: Continuous performance tasks (CPTs) are used to measure individual differences in sustained attention. Many different stimuli have been used as response targets without consideration of their impact on task performance. Here, we compared CPT performance in typically developing adults and children to assess the role of stimulus processing…

Individual Differences in Dual Task Performance. Final Report.

ERIC Educational Resources Information Center

Lansman, Marcy; Hunt, Earl

This report summarizes the research results and provides a reference. The basic question addressed was, "Is performance on multi-component tasks predicted by performance on the individual components performed separately?" In the first series of experiments, a dual task involving memory and verbal processing components to predict a…

Role of quality of service metrics in visual target acquisition and tracking in resource constrained environments

NASA Astrophysics Data System (ADS)

Anderson, Monica; David, Phillip

2007-04-01

Implementation of an intelligent, automated target acquisition and tracking systems alleviates the need for operators to monitor video continuously. This system could identify situations that fatigued operators could easily miss. If an automated acquisition and tracking system plans motions to maximize a coverage metric, how does the performance of that system change when the user intervenes and manually moves the camera? How can the operator give input to the system about what is important and understand how that relates to the overall task balance between surveillance and coverage? In this paper, we address these issues by introducing a new formulation of the average linear uncovered length (ALUL) metric, specially designed for use in surveilling urban environments. This metric coordinates the often competing goals of acquiring new targets and tracking existing targets. In addition, it provides current system performance feedback to system users in terms of the system's theoretical maximum and minimum performance. We show the successful integration of the algorithm via simulation.

Clutter in electronic medical records: examining its performance and attentional costs using eye tracking.

PubMed

Moacdieh, Nadine; Sarter, Nadine

2015-06-01

The objective was to use eye tracking to trace the underlying changes in attention allocation associated with the performance effects of clutter, stress, and task difficulty in visual search and noticing tasks. Clutter can degrade performance in complex domains, yet more needs to be known about the associated changes in attention allocation, particularly in the presence of stress and for different tasks. Frequently used and relatively simple eye tracking metrics do not effectively capture the various effects of clutter, which is critical for comprehensively analyzing clutter and developing targeted, real-time countermeasures. Electronic medical records (EMRs) were chosen as the application domain for this research. Clutter, stress, and task difficulty were manipulated, and physicians' performance on search and noticing tasks was recorded. Several eye tracking metrics were used to trace attention allocation throughout those tasks, and subjective data were gathered via a debriefing questionnaire. Clutter degraded performance in terms of response time and noticing accuracy. These decrements were largely accentuated by high stress and task difficulty. Eye tracking revealed the underlying attentional mechanisms, and several display-independent metrics were shown to be significant indicators of the effects of clutter. Eye tracking provides a promising means to understand in detail (offline) and prevent (in real time) major performance breakdowns due to clutter. Display designers need to be aware of the risks of clutter in EMRs and other complex displays and can use the identified eye tracking metrics to evaluate and/or adjust their display. © 2015, Human Factors and Ergonomics Society.

Students' Performance on a Symmetry Task

ERIC Educational Resources Information Center

Ho, Siew Yin; Logan, Tracy

2013-01-01

This paper describes Singapore and Australian Grade 6 students' (n=1,187) performance on a symmetry task in a recently developed Mathematics Processing Instrument (MPI). The MPI comprised tasks sourced from Australia and Singapore's national assessments, NAPLAN and PSLE. Only half of the cohort solved the item successfully. It is possible that…

Collected notes from the Benchmarks and Metrics Workshop

NASA Technical Reports Server (NTRS)

Drummond, Mark E.; Kaelbling, Leslie P.; Rosenschein, Stanley J.

1991-01-01

In recent years there has been a proliferation of proposals in the artificial intelligence (AI) literature for integrated agent architectures. Each architecture offers an approach to the general problem of constructing an integrated agent. Unfortunately, the ways in which one architecture might be considered better than another are not always clear. There has been a growing realization that many of the positive and negative aspects of an architecture become apparent only when experimental evaluation is performed and that to progress as a discipline, we must develop rigorous experimental methods. In addition to the intrinsic intellectual interest of experimentation, rigorous performance evaluation of systems is also a crucial practical concern to our research sponsors. DARPA, NASA, and AFOSR (among others) are actively searching for better ways of experimentally evaluating alternative approaches to building intelligent agents. One tool for experimental evaluation involves testing systems on benchmark tasks in order to assess their relative performance. As part of a joint DARPA and NASA funded project, NASA-Ames and Teleos Research are carrying out a research effort to establish a set of benchmark tasks and evaluation metrics by which the performance of agent architectures may be determined. As part of this project, we held a workshop on Benchmarks and Metrics at the NASA Ames Research Center on June 25, 1990. The objective of the workshop was to foster early discussion on this important topic. We did not achieve a consensus, nor did we expect to. Collected here is some of the information that was exchanged at the workshop. Given here is an outline of the workshop, a list of the participants, notes taken on the white-board during open discussions, position papers/notes from some participants, and copies of slides used in the presentations.

Operating room metrics score card-creating a prototype for individualized feedback.

PubMed

Gabriel, Rodney A; Gimlich, Robert; Ehrenfeld, Jesse M; Urman, Richard D

2014-11-01

The balance between reducing costs and inefficiencies with that of patient safety is a challenging problem faced in the operating room suite. An ongoing challenge is the creation of effective strategies that reduce these inefficiencies and provide real-time personalized metrics and electronic feedback to anesthesia practitioners. We created a sample report card structure, utilizing existing informatics systems. This system allows to gather and analyze operating room metrics for each anesthesia provider and offer personalized feedback. To accomplish this task, we identified key metrics that represented time and quality parameters. We collected these data for individual anesthesiologists and compared performance to the overall group average. Data were presented as an electronic score card and made available to individual clinicians on a real-time basis in an effort to provide effective feedback. These metrics included number of cancelled cases, average turnover time, average time to operating room ready and patient in room, number of delayed first case starts, average induction time, average extubation time, average time to recovery room arrival to discharge, performance feedback from other providers, compliance to various protocols, and total anesthetic costs. The concept we propose can easily be generalized to a variety of operating room settings, types of facilities and OR health care professionals. Such a scorecard can be created using content that is important for operating room efficiency, research, and practice improvement for anesthesia providers.

Virtual reality robotic surgery warm-up improves task performance in a dry laboratory environment: a prospective randomized controlled study.

PubMed

Lendvay, Thomas S; Brand, Timothy C; White, Lee; Kowalewski, Timothy; Jonnadula, Saikiran; Mercer, Laina D; Khorsand, Derek; Andros, Justin; Hannaford, Blake; Satava, Richard M

2013-06-01

Preoperative simulation warm-up has been shown to improve performance and reduce errors in novice and experienced surgeons, yet existing studies have only investigated conventional laparoscopy. We hypothesized that a brief virtual reality (VR) robotic warm-up would enhance robotic task performance and reduce errors. In a 2-center randomized trial, 51 residents and experienced minimally invasive surgery faculty in General Surgery, Urology, and Gynecology underwent a validated robotic surgery proficiency curriculum on a VR robotic simulator and on the da Vinci surgical robot (Intuitive Surgical Inc). Once they successfully achieved performance benchmarks, surgeons were randomized to either receive a 3- to 5-minute VR simulator warm-up or read a leisure book for 10 minutes before performing similar and dissimilar (intracorporeal suturing) robotic surgery tasks. The primary outcomes compared were task time, tool path length, economy of motion, technical, and cognitive errors. Task time (-29.29 seconds, p = 0.001; 95% CI, -47.03 to -11.56), path length (-79.87 mm; p = 0.014; 95% CI, -144.48 to -15.25), and cognitive errors were reduced in the warm-up group compared with the control group for similar tasks. Global technical errors in intracorporeal suturing (0.32; p = 0.020; 95% CI, 0.06-0.59) were reduced after the dissimilar VR task. When surgeons were stratified by earlier robotic and laparoscopic clinical experience, the more experienced surgeons (n = 17) demonstrated significant improvements from warm-up in task time (-53.5 seconds; p = 0.001; 95% CI, -83.9 to -23.0) and economy of motion (0.63 mm/s; p = 0.007; 95% CI, 0.18-1.09), and improvement in these metrics was not statistically significantly appreciated in the less-experienced cohort (n = 34). We observed significant performance improvement and error reduction rates among surgeons of varying experience after VR warm-up for basic robotic surgery tasks. In addition, the VR warm-up reduced errors on

Oculomotor Behavior Metrics Change According to Circadian Phase and Time Awake

NASA Technical Reports Server (NTRS)

Flynn-Evans, Erin E.; Tyson, Terence L.; Cravalho, Patrick; Feick, Nathan; Stone, Leland S.

2017-01-01

There is a need for non-invasive, objective measures to forecast performance impairment arising from sleep loss and circadian misalignment, particularly in safety-sensitive occupations. Eye-tracking devices have been used in some operational scenarios, but such devices typically focus on eyelid closures and slow rolling eye movements and are susceptible to the intrusion of head movement artifacts. We hypothesized that an expanded suite of oculomotor behavior metrics, collected during a visual tracking task, would change according to circadian phase and time awake, and could be used as a marker of performance impairment.

Tool and Task Analysis Guide for Vocational Welding (150 Tasks). Performance Based Vocational Education.

ERIC Educational Resources Information Center

John H. Hinds Area Vocational School, Elwood, IN.

This book contains a task inventory, a task analysis of 150 tasks from that inventory, and a tool list for performance-based welding courses in the state of Indiana. The task inventory and tool list reflect 28 job titles found in Indiana. In the first part of the guide, tasks are listed by these domains: carbon-arc, electron beam, G.M.A.W., gas…

Effects of speech intelligibility level on concurrent visual task performance.

PubMed

Payne, D G; Peters, L J; Birkmire, D P; Bonto, M A; Anastasi, J S; Wenger, M J

1994-09-01

Four experiments were performed to determine if changes in the level of speech intelligibility in an auditory task have an impact on performance in concurrent visual tasks. The auditory task used in each experiment was a memory search task in which subjects memorized a set of words and then decided whether auditorily presented probe items were members of the memorized set. The visual tasks used were an unstable tracking task, a spatial decision-making task, a mathematical reasoning task, and a probability monitoring task. Results showed that performance on the unstable tracking and probability monitoring tasks was unaffected by the level of speech intelligibility on the auditory task, whereas accuracy in the spatial decision-making and mathematical processing tasks was significantly worse at low speech intelligibility levels. The findings are interpreted within the framework of multiple resource theory.

Spatial task performance, sex differences, and motion sickness susceptibility.

PubMed

Levine, Max E; Stern, Robert M

2002-10-01

There are substantial individual differences in susceptibility to motion sickness, yet little is known about what mediates these differences. Spatial ability and sex have been suggested as possible factors in this relationship. 89 participants (57 women) were administered a Motion Sickness Questionnaire that assesses motion sickness susceptibility, a Water-level Task that gauges sensitivity to gravitational upright, and a Mental Rotation Task that tests an individual's awareness of how objects typically move in space. Significant sex differences were observed in performance of both the Water-level Task (p<.01), and the Mental Rotation Task (p<.005), with women performing less accurately than men. Women also had significantly higher scores on the Motion Sickness Questionnaire (p<.005). Among men, but not women, significant negative relationships were observed between Water-level Task performance and Motion Sickness Questionnaire score (p<.001) and between Mental Rotation Task performance and Motion Sickness Questionnaire score (p<.005). In conclusion, women performed significantly more poorly than men did on the spatial ability tasks and reported significantly more bouts of motion sickness. In addition, men showed a significant negative relationship between spatial ability and motion sickness susceptibility.

Manipulator Performance Evaluation Using Fitts' Taping Task

DOE Office of Scientific and Technical Information (OSTI.GOV)

Draper, J.V.; Jared, B.C.; Noakes, M.W.

1999-04-25

Metaphorically, a teleoperator with master controllers projects the user's arms and hands into a re- mote area, Therefore, human users interact with teleoperators at a more fundamental level than they do with most human-machine systems. Instead of inputting decisions about how the system should func- tion, teleoperator users input the movements they might make if they were truly in the remote area and the remote machine must recreate their trajectories and impedance. This intense human-machine inter- action requires displays and controls more carefully attuned to human motor capabilities than is neces- sary with most systems. It is important for teleoperatedmore » manipulators to be able to recreate human trajectories and impedance in real time. One method for assessing manipulator performance is to observe how well a system be- haves while a human user completes human dexterity tasks with it. Fitts' tapping task has been, used many times in the past for this purpose. This report describes such a performance assessment. The International Submarine Engineering (ISE) Autonomous/Teleoperated Operations Manipulator (ATOM) servomanipulator system was evalu- ated using a generic positioning accuracy task. The task is a simple one but has the merits of (1) pro- ducing a performance function estimate rather than a point estimate and (2) being widely used in the past for human and servomanipulator dexterity tests. Results of testing using this task may, therefore, allow comparison with other manipulators, and is generically representative of a broad class of tasks. Results of the testing indicate that the ATOM manipulator is capable of performing the task. Force reflection had a negative impact on task efficiency in these data. This was most likely caused by the high resistance to movement the master controller exhibited with the force reflection engaged. Measurements of exerted forces were not made, so it is not possible to say whether the force reflection helped partici

Priming performance-related concerns induces task-related mind-wandering.

PubMed

Jordano, Megan L; Touron, Dayna R

2017-10-01

Two experiments tested the hypothesis that priming of performance-related concerns would (1) increase the frequency of task-related mind-wandering (i.e., task-related interference; TRI) and (2) decrease task performance. In each experiment, sixty female participants completed an operation span task (OSPAN) containing thought content probes. The task was framed as a math task for those in a condition primed for math-related stereotype threat and as a memory task for those in a control condition. In both studies, women whose performance-related concerns were primed via stereotype threat reported more TRI than women in the control. The second experiment used a more challenging OSPAN task and stereotype primed women also had lower math accuracy than controls. These results support the "control failures×current concerns" framework of mind-wandering, which posits that the degree to which the environmental context triggers personal concerns influences both mind-wandering frequency and content. Copyright © 2017 Elsevier Inc. All rights reserved.

Performance in complex motor tasks deteriorates in hyperthermic humans.

PubMed

Piil, Jacob F; Lundbye-Jensen, Jesper; Trangmar, Steven J; Nybo, Lars

2017-01-01

Heat stress, leading to elevations in whole-body temperature, has a marked impact on both physical performance and cognition in ecological settings. Lab experiments confirm this for physically demanding activities, whereas observations are inconsistent for tasks involving cognitive processing of information or decision-making prior to responding. We hypothesized that divergences could relate to task complexity and developed a protocol consisting of 1) simple motor task [TARGET_pinch], 2) complex motor task [Visuo-motor tracking], 3) simple math task [MATH_type], 4) combined motor-math task [MATH_pinch]. Furthermore, visuo-motor tracking performance was assessed both in a separate- and a multipart protocol (complex motor tasks alternating with the three other tasks). Following familiarization, each of the 10 male subjects completed separate and multipart protocols in randomized order in the heat (40°C) or control condition (20°C) with testing at baseline (seated rest) and similar seated position, following exercise-induced hyperthermia (core temperature ∼ 39.5°C in the heat and 38.2°C in control condition). All task scores were unaffected by control exercise or passive heat exposure, but visuo-motor tracking performance was reduced by 10.7 ± 6.5% following exercise-induced hyperthermia when integrated in the multipart protocol and 4.4 ± 5.7% when tested separately (both P < 0.05 ). TARGET_pinch precision declined by 2.6 ± 1.3% ( P < 0.05 ), while no significant changes were observed for the math tasks. These results indicate that heat per se has little impact on simple motor or cognitive test performance, but complex motor performance is impaired by hyperthermia and especially so when multiple tasks are combined.

Within-person relationship between self-efficacy and performance across trials. Effect of task objective and task type.

PubMed

Hepler, Teri J; Ritchie, Jason; Hill, Christopher R

2017-07-05

Self-efficacy has been shown to be a consistent, positive predictor of between-persons performance in sport. However, there have been equivocal results regarding the influence of self-efficacy on a person's performance over time. This study investigated the influence of self-efficacy on motor skill performance across trials with respect to two different task objectives and task types. Participants (N=84) performed 4 blocks of 10 trials of a dart throwing (closed skill) and a hitting (open skill) task under 2 different task objectives: competitive and goal-striving. For the goal-striving condition, success was defined as reaching a pre-determined performance level. The competitive condition involved competing against an opponent. Hierarchical linear modeling was used to examine the influence of past performance and self-efficacy on the within-person performance across multiple trials. Previous performance was negatively related with subsequent performance on all conditions. Self-efficacy was not a significant predictor of performance on any of the conditions. While task objective and task type did not moderate the efficacy-performance relationship in the current study, it is important to consider the role of other moderators in future research.

Bayesian performance metrics of binary sensors in homeland security applications

NASA Astrophysics Data System (ADS)

Jannson, Tomasz P.; Forrester, Thomas C.

2008-04-01

Bayesian performance metrics, based on such parameters, as: prior probability, probability of detection (or, accuracy), false alarm rate, and positive predictive value, characterizes the performance of binary sensors; i.e., sensors that have only binary response: true target/false target. Such binary sensors, very common in Homeland Security, produce an alarm that can be true, or false. They include: X-ray airport inspection, IED inspections, product quality control, cancer medical diagnosis, part of ATR, and many others. In this paper, we analyze direct and inverse conditional probabilities in the context of Bayesian inference and binary sensors, using X-ray luggage inspection statistical results as a guideline.

The SPAtial EFficiency metric (SPAEF): multiple-component evaluation of spatial patterns for optimization of hydrological models

NASA Astrophysics Data System (ADS)

Koch, Julian; Cüneyd Demirel, Mehmet; Stisen, Simon

2018-05-01

The process of model evaluation is not only an integral part of model development and calibration but also of paramount importance when communicating modelling results to the scientific community and stakeholders. The modelling community has a large and well-tested toolbox of metrics to evaluate temporal model performance. In contrast, spatial performance evaluation does not correspond to the grand availability of spatial observations readily available and to the sophisticate model codes simulating the spatial variability of complex hydrological processes. This study makes a contribution towards advancing spatial-pattern-oriented model calibration by rigorously testing a multiple-component performance metric. The promoted SPAtial EFficiency (SPAEF) metric reflects three equally weighted components: correlation, coefficient of variation and histogram overlap. This multiple-component approach is found to be advantageous in order to achieve the complex task of comparing spatial patterns. SPAEF, its three components individually and two alternative spatial performance metrics, i.e. connectivity analysis and fractions skill score, are applied in a spatial-pattern-oriented model calibration of a catchment model in Denmark. Results suggest the importance of multiple-component metrics because stand-alone metrics tend to fail to provide holistic pattern information. The three SPAEF components are found to be independent, which allows them to complement each other in a meaningful way. In order to optimally exploit spatial observations made available by remote sensing platforms, this study suggests applying bias insensitive metrics which further allow for a comparison of variables which are related but may differ in unit. This study applies SPAEF in the hydrological context using the mesoscale Hydrologic Model (mHM; version 5.8), but we see great potential across disciplines related to spatially distributed earth system modelling.

Cognitive and motor dual task gait training improve dual task gait performance after stroke - A randomized controlled pilot trial.

PubMed

Liu, Yan-Ci; Yang, Yea-Ru; Tsai, Yun-An; Wang, Ray-Yau

2017-06-22

This study investigated effects of cognitive and motor dual task gait training on dual task gait performance in stroke. Participants (n = 28) were randomly assigned to cognitive dual task gait training (CDTT), motor dual task gait training (MDTT), or conventional physical therapy (CPT) group. Participants in CDTT or MDTT group practiced the cognitive or motor tasks respectively during walking. Participants in CPT group received strengthening, balance, and gait training. The intervention was 30 min/session, 3 sessions/week for 4 weeks. Three test conditions to evaluate the training effects were single walking, walking while performing cognitive task (serial subtraction), and walking while performing motor task (tray-carrying). Parameters included gait speed, dual task cost of gait speed (DTC-speed), cadence, stride time, and stride length. After CDTT, cognitive-motor dual task gait performance (stride length and DTC-speed) was improved (p = 0.021; p = 0.015). After MDTT, motor dual task gait performance (gait speed, stride length, and DTC-speed) was improved (p = 0.008; p = 0.008; p = 0.008 respectively). It seems that CDTT improved cognitive dual task gait performance and MDTT improved motor dual task gait performance although such improvements did not reach significant group difference. Therefore, different types of dual task gait training can be adopted to enhance different dual task gait performance in stroke.

Age-related decrements in dual-task performance: Comparison of different mobility and cognitive tasks. A cross sectional study.

PubMed

Brustio, Paolo Riccardo; Magistro, Daniele; Zecca, Massimiliano; Rabaglietti, Emanuela; Liubicich, Monica Emma

2017-01-01

This cross-sectional study investigated the age-related differences in dual-task performance both in mobility and cognitive tasks and the additive dual-task costs in a sample of older, middle-aged and young adults. 74 older adults (M = 72.63±5.57 years), 58 middle-aged adults (M = 46.69±4.68 years) and 63 young adults (M = 25.34±3.00 years) participated in the study. Participants performed different mobility and subtraction tasks under both single- and dual-task conditions. Linear regressions, repeated-measures and one-way analyses of covariance were used, The results showed: significant effects of the age on the dual and mobility tasks (p<0.05) and differences among the age-groups in the combined dual-task costs (p<0.05); significant decreases in mobility performance under dual-task conditions in all groups (p<0.05) and a decrease in cognitive performance in the older group (p<0.05). Dual-task activity affected mobility and cognitive performance, especially in older adults who showed a higher dual-task cost, suggesting that dual-tasks activities are affected by the age and consequently also mobility and cognitive tasks are negatively influenced.

Age-related decrements in dual-task performance: Comparison of different mobility and cognitive tasks. A cross sectional study

PubMed Central

Brustio, Paolo Riccardo; Zecca, Massimiliano; Rabaglietti, Emanuela; Liubicich, Monica Emma

2017-01-01

This cross-sectional study investigated the age-related differences in dual-task performance both in mobility and cognitive tasks and the additive dual-task costs in a sample of older, middle-aged and young adults. 74 older adults (M = 72.63±5.57 years), 58 middle-aged adults (M = 46.69±4.68 years) and 63 young adults (M = 25.34±3.00 years) participated in the study. Participants performed different mobility and subtraction tasks under both single- and dual-task conditions. Linear regressions, repeated-measures and one-way analyses of covariance were used, The results showed: significant effects of the age on the dual and mobility tasks (p<0.05) and differences among the age-groups in the combined dual-task costs (p<0.05); significant decreases in mobility performance under dual-task conditions in all groups (p<0.05) and a decrease in cognitive performance in the older group (p<0.05). Dual-task activity affected mobility and cognitive performance, especially in older adults who showed a higher dual-task cost, suggesting that dual-tasks activities are affected by the age and consequently also mobility and cognitive tasks are negatively influenced. PMID:28732080

Self-Efficacy, Task Complexity and Task Performance: Exploring Interactions in Two Versions of Vocabulary Learning Tasks

ERIC Educational Resources Information Center

Wu, Xiaoli; Lowyck, Joost; Sercu, Lies; Elen, Jan

2012-01-01

The present study aimed for better understanding of the interactions between task complexity and students' self-efficacy beliefs and students' use of learning strategies, and finally their interacting effects on task performance. This investigation was carried out in the context of Chinese students learning English as a foreign language in a…

Performance metric comparison study for non-magnetic bi-stable energy harvesters

NASA Astrophysics Data System (ADS)

Udani, Janav P.; Wrigley, Cailin; Arrieta, Andres F.

2017-04-01

Energy harvesting employing non-linear systems offers considerable advantages over linear systems given the broadband resonant response which is favorable for applications involving diverse input vibrations. In this respect, the rich dynamics of bi-stable systems present a promising means for harvesting vibrational energy from ambient sources. Harvesters deriving their bi-stability from thermally induced stresses as opposed to magnetic forces are receiving significant attention as it reduces the need for ancillary components and allows for bio- compatible constructions. However, the design of these bi-stable harvesters still requires further optimization to completely exploit the dynamic behavior of these systems. This study presents a comparison of the harvesting capabilities of non-magnetic, bi-stable composite laminates under variations in the design parameters as evaluated utilizing established power metrics. Energy output characteristics of two bi-stable composite laminate plates with a piezoelectric patch bonded on the top surface are experimentally investigated for variations in the thickness ratio and inertial mass positions for multiple load conditions. A particular design configuration is found to perform better over the entire range of testing conditions which include single and multiple frequency excitation, thus indicating that design optimization over the geometry of the harvester yields robust performance. The experimental analysis further highlights the need for appropriate design guidelines for optimization and holistic performance metrics to account for the range of operational conditions.

Advanced Life Support System Value Metric

NASA Technical Reports Server (NTRS)

Jones, Harry W.; Rasky, Daniel J. (Technical Monitor)

1999-01-01

The NASA Advanced Life Support (ALS) Program is required to provide a performance metric to measure its progress in system development. Extensive discussions within the ALS program have led to the following approach. The Equivalent System Mass (ESM) metric has been traditionally used and provides a good summary of the weight, size, and power cost factors of space life support equipment. But ESM assumes that all the systems being traded off exactly meet a fixed performance requirement, so that the value and benefit (readiness, performance, safety, etc.) of all the different systems designs are considered to be exactly equal. This is too simplistic. Actual system design concepts are selected using many cost and benefit factors and the system specification is defined after many trade-offs. The ALS program needs a multi-parameter metric including both the ESM and a System Value Metric (SVM). The SVM would include safety, maintainability, reliability, performance, use of cross cutting technology, and commercialization potential. Another major factor in system selection is technology readiness level (TRL), a familiar metric in ALS. The overall ALS system metric that is suggested is a benefit/cost ratio, SVM/[ESM + function (TRL)], with appropriate weighting and scaling. The total value is given by SVM. Cost is represented by higher ESM and lower TRL. The paper provides a detailed description and example application of a suggested System Value Metric and an overall ALS system metric.

Overview of the ID, EPI and REL tasks of BioNLP Shared Task 2011.

PubMed

Pyysalo, Sampo; Ohta, Tomoko; Rak, Rafal; Sullivan, Dan; Mao, Chunhong; Wang, Chunxia; Sobral, Bruno; Tsujii, Jun'ichi; Ananiadou, Sophia

2012-06-26

for user-facing applications. In this study, we extend on previously reported results and perform further analyses of the outputs of the participating systems. We place specific emphasis on aspects of system performance relating to real-world applicability, considering alternate evaluation metrics and performing additional manual analysis of system outputs. We further demonstrate that the strengths of extraction systems can be combined to improve on the performance achieved by any system in isolation. The manually annotated corpora, supporting resources, and evaluation tools for all tasks are available from http://www.bionlp-st.org and the tasks continue as open challenges for all interested parties.

Overview of the ID, EPI and REL tasks of BioNLP Shared Task 2011

PubMed Central

2012-01-01

for user-facing applications. In this study, we extend on previously reported results and perform further analyses of the outputs of the participating systems. We place specific emphasis on aspects of system performance relating to real-world applicability, considering alternate evaluation metrics and performing additional manual analysis of system outputs. We further demonstrate that the strengths of extraction systems can be combined to improve on the performance achieved by any system in isolation. The manually annotated corpora, supporting resources, and evaluation tools for all tasks are available from http://www.bionlp-st.org and the tasks continue as open challenges for all interested parties. PMID:22759456

Evaluation of the performance of a micromethod for measuring urinary iodine by using six sigma quality metrics.

PubMed

Hussain, Husniza; Khalid, Norhayati Mustafa; Selamat, Rusidah; Wan Nazaimoon, Wan Mohamud

2013-09-01

The urinary iodine micromethod (UIMM) is a modification of the conventional method and its performance needs evaluation. UIMM performance was evaluated using the method validation and 2008 Iodine Deficiency Disorders survey data obtained from four urinary iodine (UI) laboratories. Method acceptability tests and Sigma quality metrics were determined using total allowable errors (TEas) set by two external quality assurance (EQA) providers. UIMM obeyed various method acceptability test criteria with some discrepancies at low concentrations. Method validation data calculated against the UI Quality Program (TUIQP) TEas showed that the Sigma metrics were at 2.75, 1.80, and 3.80 for 51±15.50 µg/L, 108±32.40 µg/L, and 149±38.60 µg/L UI, respectively. External quality control (EQC) data showed that the performance of the laboratories was within Sigma metrics of 0.85-1.12, 1.57-4.36, and 1.46-4.98 at 46.91±7.05 µg/L, 135.14±13.53 µg/L, and 238.58±17.90 µg/L, respectively. No laboratory showed a calculated total error (TEcalc)performance for the medium-high level, and two laboratories showed an acceptable performance for the high level. When calculated against the Ensuring the Quality of UI Procedures (EQUIP) TEas, the performance of all laboratories was≤2.49 Sigma metrics at all concentrations. Only one laboratory had TEcalcperformance for the iodine deficiency levels and variable performance at other concentrations according to different TEas.

Metrication report to the Congress

NASA Technical Reports Server (NTRS)

1991-01-01

NASA's principal metrication accomplishments for FY 1990 were establishment of metrication policy for major programs, development of an implementing instruction for overall metric policy and initiation of metrication planning for the major program offices. In FY 1991, development of an overall NASA plan and individual program office plans will be completed, requirement assessments will be performed for all support areas, and detailed assessment and transition planning will be undertaken at the institutional level. Metric feasibility decisions on a number of major programs are expected over the next 18 months.

A novel ECG detector performance metric and its relationship with missing and false heart rate limit alarms.

PubMed

Daluwatte, Chathuri; Vicente, Jose; Galeotti, Loriano; Johannesen, Lars; Strauss, David G; Scully, Christopher G

Performance of ECG beat detectors is traditionally assessed on long intervals (e.g.: 30min), but only incorrect detections within a short interval (e.g.: 10s) may cause incorrect (i.e., missed+false) heart rate limit alarms (tachycardia and bradycardia). We propose a novel performance metric based on distribution of incorrect beat detection over a short interval and assess its relationship with incorrect heart rate limit alarm rates. Six ECG beat detectors were assessed using performance metrics over long interval (sensitivity and positive predictive value over 30min) and short interval (Area Under empirical cumulative distribution function (AUecdf) for short interval (i.e., 10s) sensitivity and positive predictive value) on two ECG databases. False heart rate limit and asystole alarm rates calculated using a third ECG database were then correlated (Spearman's rank correlation) with each calculated performance metric. False alarm rates correlated with sensitivity calculated on long interval (i.e., 30min) (ρ=-0.8 and p<0.05) and AUecdf for sensitivity (ρ=0.9 and p<0.05) in all assessed ECG databases. Sensitivity over 30min grouped the two detectors with lowest false alarm rates while AUecdf for sensitivity provided further information to identify the two beat detectors with highest false alarm rates as well, which was inseparable with sensitivity over 30min. Short interval performance metrics can provide insights on the potential of a beat detector to generate incorrect heart rate limit alarms. Published by Elsevier Inc.

Effects of cues in a binary categorization task on dual-task performance, mental workload, and effort.

PubMed

Botzer, Assaf; Meyer, Joachim; Parmet, Yisrael

2016-09-01

Binary cues help operators perform binary categorization tasks, such as monitoring for system failures. They may also allow them to attend to other tasks they concurrently perform. If the time saved by using cues is allocated to other concurrent tasks, users' overall effort may remain unchanged. In 2 experiments, participants performed a simulated quality control task, together with a tracking task. In half the experimental blocks cues were available, and participants could use them in their decisions about the quality of products (intact or faulty). In Experiment 1, the difficulty of tracking was constant, while in Experiment 2, tracking difficulty differed in the 2 halves of the experiment. In both experiments, participants reported on the NASA Task Load Index that cues improved their performance and reduced their frustration. Consequently, their overall score on mental workload (MWL) was lower with cues. They also reported, however, that cues did not reduce their effort. We conclude that cues and other forms of automation may support task performance and reduce overall MWL, but this will not necessarily mean that users will work less hard. Thus, effort and overall MWL should be evaluated separately, if one wants to obtain a full picture of the effects of automation. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Does dual-task coordination performance decline in later life?

PubMed

Sebastián, María V; Mediavilla, Roberto

2017-05-01

This cross-sectional study examined whether changes occur in people’s capacity to coordinate two simultaneous tasks (dual-task) when transitioning from adulthood to later life. The central executive, Baddeley’s working memory model component, is responsible for this coordination. Contradictory results have been reported regarding the relationship between ageing and dual-task performance; but these seem to be related to methodological issues that have been addressed in this study. Nine hundred and seventy-two participants, aged between 35 and 90 years old, volunteered to carry out a verbal digit span task, followed by single and concurrent (dual-task) tests: first, a box crossing task, then, the digit recall task in relation to their memory span, and finally, both these tests simultaneously. We found no difference in people’s capacity to coordinate their attention when doing two tasks in adulthood or healthy later life, including those in the oldest age groups. Furthermore, gender and educational level were not related to dual-task performance. The results support the normal functioning of the central executive in very old people. These data contrast with research with patients suffering from different types of dementia, which show a decrease in their dual-task performance.

Advanced Life Support System Value Metric

NASA Technical Reports Server (NTRS)

Jones, Harry W.; Arnold, James O. (Technical Monitor)

1999-01-01

The NASA Advanced Life Support (ALS) Program is required to provide a performance metric to measure its progress in system development. Extensive discussions within the ALS program have reached a consensus. The Equivalent System Mass (ESM) metric has been traditionally used and provides a good summary of the weight, size, and power cost factors of space life support equipment. But ESM assumes that all the systems being traded off exactly meet a fixed performance requirement, so that the value and benefit (readiness, performance, safety, etc.) of all the different systems designs are exactly equal. This is too simplistic. Actual system design concepts are selected using many cost and benefit factors and the system specification is then set accordingly. The ALS program needs a multi-parameter metric including both the ESM and a System Value Metric (SVM). The SVM would include safety, maintainability, reliability, performance, use of cross cutting technology, and commercialization potential. Another major factor in system selection is technology readiness level (TRL), a familiar metric in ALS. The overall ALS system metric that is suggested is a benefit/cost ratio, [SVM + TRL]/ESM, with appropriate weighting and scaling. The total value is the sum of SVM and TRL. Cost is represented by ESM. The paper provides a detailed description and example application of the suggested System Value Metric.

Musical training, bilingualism, and executive function: a closer look at task switching and dual-task performance.

PubMed

Moradzadeh, Linda; Blumenthal, Galit; Wiseheart, Melody

2015-07-01

This study investigated whether musical training and bilingualism are associated with enhancements in specific components of executive function, namely, task switching and dual-task performance. Participants (n = 153) belonging to one of four groups (monolingual musician, bilingual musician, bilingual non-musician, or monolingual non-musician) were matched on age and socioeconomic status and administered task switching and dual-task paradigms. Results demonstrated reduced global and local switch costs in musicians compared with non-musicians, suggesting that musical training can contribute to increased efficiency in the ability to shift flexibly between mental sets. On dual-task performance, musicians also outperformed non-musicians. There was neither a cognitive advantage for bilinguals relative to monolinguals, nor an interaction between music and language to suggest additive effects of both types of experience. These findings demonstrate that long-term musical training is associated with improvements in task switching and dual-task performance. Copyright © 2014 Cognitive Science Society, Inc.

Effect of pre-task music on sports or exercise performance.

PubMed

Smirmaul, Bruno P

2017-01-01

Pre-task music is a very common strategy among sports competitors. However, as opposed to in-task music, the scientific evidence to support its ergogenic effects on either sports or exercise performance is limited. This brief review critically addresses the existing literature investigating the effects of pre-task music on sports and exercise performance, focusing on the methods and results of experimental studies, and offers basic and practical recommendations. In July 2015, a comprehensive literature search was performed in Web of Science, PubMed, and Google Scholar using the following key words in combination: "pre-task music," "pre-test music," "pre-exercise music," "exercise performance," "sports performance." The literature search was further expanded by both hand searching review articles on the topic and by searching the reference lists from the articles retrieved for any relevant references. Overall, a total of 15 studies in 14 articles were included. Pre-task music research has been unsystematic, methodologically limited and infrequent. Using this review as a starting point to overcome previous methodological limitations when designing future experiments may contribute to the development of pre-task music research, which is still in its infancy. Currently, there is no sufficient evidence to support the overall ergogenic effects of pre-task music on sports or exercise performance. Nonetheless, pre-task music has showed a likely ergogenic effect on shorter and predominantly anaerobic tasks such as grip strength, Wingate test, and short-duration sports or sports-like tasks, in contrast to longer and predominantly aerobic tasks.

Ability Beliefs, Task Value, and Performance as a Function of Race in a Dart-Throwing Task

ERIC Educational Resources Information Center

Gao, Zan; Kosma, Maria; Harrison, Louis, Jr.

2009-01-01

This study examines differences in self-efficacy, expectancy-related beliefs, task value, and performance in a dart-throwing task as a function of race among diverse college students using the expectancy-value model and self-efficacy theory. It also examines the predictive contributions of these beliefs on task performance within each racial…

Emotional reactivity and awareness of task performance in Alzheimer's disease.

PubMed

Mograbi, Daniel C; Brown, Richard G; Salas, Christian; Morris, Robin G

2012-07-01

Lack of awareness about performance in tasks is a common feature of Alzheimer's disease. Nevertheless, clinical anecdotes have suggested that patients may show emotional or behavioural responses to the experience of failure despite reporting limited awareness, an aspect which has been little explored experimentally. The current study investigated emotional reactions to success or failure in tasks despite unawareness of performance in Alzheimer's disease. For this purpose, novel computerised tasks which expose participants to systematic success or failure were used in a group of Alzheimer's disease patients (n=23) and age-matched controls (n=21). Two experiments, the first with reaction time tasks and the second with memory tasks, were carried out, and in each experiment two parallel tasks were used, one in a success condition and one in a failure condition. Awareness of performance was measured comparing participant estimations of performance with actual performance. Emotional reactivity was assessed with a self-report questionnaire and rating of filmed facial expressions. In both experiments the results indicated that, relative to controls, Alzheimer's disease patients exhibited impaired awareness of performance, but comparable differential reactivity to failure relative to success tasks, both in terms of self-report and facial expressions. This suggests that affective valence of failure experience is processed despite unawareness of task performance, which might indicate implicit processing of information in neural pathways bypassing awareness. Copyright © 2012 Elsevier Ltd. All rights reserved.

Quantifying performance and effects of load carriage during a challenging balancing task using an array of wireless inertial sensors.

PubMed

Cain, Stephen M; McGinnis, Ryan S; Davidson, Steven P; Vitali, Rachel V; Perkins, Noel C; McLean, Scott G

2016-01-01

We utilize an array of wireless inertial measurement units (IMUs) to measure the movements of subjects (n=30) traversing an outdoor balance beam (zigzag and sloping) as quickly as possible both with and without load (20.5kg). Our objectives are: (1) to use IMU array data to calculate metrics that quantify performance (speed and stability) and (2) to investigate the effects of load on performance. We hypothesize that added load significantly decreases subject speed yet results in increased stability of subject movements. We propose and evaluate five performance metrics: (1) time to cross beam (less time=more speed), (2) percentage of total time spent in double support (more double support time=more stable), (3) stride duration (longer stride duration=more stable), (4) ratio of sacrum M-L to A-P acceleration (lower ratio=less lateral balance corrections=more stable), and (5) M-L torso range of motion (smaller range of motion=less balance corrections=more stable). We find that the total time to cross the beam increases with load (t=4.85, p<0.001). Stability metrics also change significantly with load, all indicating increased stability. In particular, double support time increases (t=6.04, p<0.001), stride duration increases (t=3.436, p=0.002), the ratio of sacrum acceleration RMS decreases (t=-5.56, p<0.001), and the M-L torso lean range of motion decreases (t=-2.82, p=0.009). Overall, the IMU array successfully measures subject movement and gait parameters that reveal the trade-off between speed and stability in this highly dynamic balance task. Copyright © 2015 Elsevier B.V. All rights reserved.

Three-dimensional vision enhances task performance independently of the surgical method.

PubMed

Wagner, O J; Hagen, M; Kurmann, A; Horgan, S; Candinas, D; Vorburger, S A

2012-10-01

Within the next few years, the medical industry will launch increasingly affordable three-dimensional (3D) vision systems for the operating room (OR). This study aimed to evaluate the effect of two-dimensional (2D) and 3D visualization on surgical skills and task performance. In this study, 34 individuals with varying laparoscopic experience (18 inexperienced individuals) performed three tasks to test spatial relationships, grasping and positioning, dexterity, precision, and hand-eye and hand-hand coordination. Each task was performed in 3D using binocular vision for open performance, the Viking 3Di Vision System for laparoscopic performance, and the DaVinci robotic system. The same tasks were repeated in 2D using an eye patch for monocular vision, conventional laparoscopy, and the DaVinci robotic system. Loss of 3D vision significantly increased the perceived difficulty of a task and the time required to perform it, independently of the approach (P < 0.0001-0.02). Simple tasks took 25 % to 30 % longer to complete and more complex tasks took 75 % longer with 2D than with 3D vision. Only the difficult task was performed faster with the robot than with laparoscopy (P = 0.005). In every case, 3D robotic performance was superior to conventional laparoscopy (2D) (P < 0.001-0.015). The more complex the task, the more 3D vision accelerates task completion compared with 2D vision. The gain in task performance is independent of the surgical method.

Resilience Metrics for the Electric Power System: A Performance-Based Approach.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Vugrin, Eric D.; Castillo, Andrea R; Silva-Monroy, Cesar Augusto

Grid resilience is a concept related to a power system's ability to continue operating and delivering power even in the event that low probability, high-consequence disruptions such as hurricanes, earthquakes, and cyber-attacks occur. Grid resilience objectives focus on managing and, ideally, minimizing potential consequences that occur as a result of these disruptions. Currently, no formal grid resilience definitions, metrics, or analysis methods have been universally accepted. This document describes an effort to develop and describe grid resilience metrics and analysis methods. The metrics and methods described herein extend upon the Resilience Analysis Process (RAP) developed by Watson et al. formore » the 2015 Quadrennial Energy Review. The extension allows for both outputs from system models and for historical data to serve as the basis for creating grid resilience metrics and informing grid resilience planning and response decision-making. This document describes the grid resilience metrics and analysis methods. Demonstration of the metrics and methods is shown through a set of illustrative use cases.« less

The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability.

PubMed

Lopes, Julio Cesar Dias; Dos Santos, Fábio Mendes; Martins-José, Andrelly; Augustyns, Koen; De Winter, Hans

2017-01-01

A new metric for the evaluation of model performance in the field of virtual screening and quantitative structure-activity relationship applications is described. This metric has been termed the power metric and is defined as the fraction of the true positive rate divided by the sum of the true positive and false positive rates, for a given cutoff threshold. The performance of this metric is compared with alternative metrics such as the enrichment factor, the relative enrichment factor, the receiver operating curve enrichment factor, the correct classification rate, Matthews correlation coefficient and Cohen's kappa coefficient. The performance of this new metric is found to be quite robust with respect to variations in the applied cutoff threshold and ratio of the number of active compounds to the total number of compounds, and at the same time being sensitive to variations in model quality. It possesses the correct characteristics for its application in early-recognition virtual screening problems.

Context matters: Social cognition task performance in psychometric schizotypes.

PubMed

Pflum, Madeline J; Gooding, Diane C

2018-06-01

Patients with schizophrenia show performance deficits on tasks requiring empathy-related social cognition. The extent to which empathy impairments are observed in psychometric schizotypy is unclear. We compared accuracy and reaction time in three groups of individuals characterized by positive schizotypy (n = 79), negative schizotypy (n = 123), or low schizotypy group (n = 137). On a social cognition task that provided context, namely, the Emotion Perspective Taking Task, the positive schizotypes showed poorer performance than the negative schizotypy and control groups. These results suggest that some schizotypes differ in their ability to make use of context (e.g., social cues from the environment) to affect their social cognitive performance. However, on the Affective Responsiveness Task, in which no context was given, both groups of psychometric schizotypes displayed lower performance than the controls. These findings highlight the importance of assessing multiple groups of schizotypes as well as the value of including several social cognition tasks in order to reveal relative performance deficits. Copyright © 2018 Elsevier B.V. All rights reserved.

Characterizing "fibrofog": Subjective appraisal, objective performance, and task-related brain activity during a working memory task.

PubMed

Walitt, Brian; Čeko, Marta; Khatiwada, Manish; Gracely, John L; Rayhan, Rakib; VanMeter, John W; Gracely, Richard H

2016-01-01

The subjective experience of cognitive dysfunction ("fibrofog") is common in fibromyalgia. This study investigated the relation between subjective appraisal of cognitive function, objective cognitive task performance, and brain activity during a cognitive task using functional magnetic resonance imaging (fMRI). Sixteen fibromyalgia patients and 13 healthy pain-free controls completed a battery of questionnaires, including the Multiple Ability Self-Report Questionnaire (MASQ), a measure of self-perceived cognitive difficulties. Participants were evaluated for working memory performance using a modified N-back working memory task while undergoing Blood Oxygen Level Dependent (BOLD) fMRI measurements. Fibromyalgia patients and controls did not differ in working memory performance. Subjective appraisal of cognitive function was associated with better performance (accuracy) on the working memory task in healthy controls but not in fibromyalgia patients. In fibromyalgia patients, increased perceived cognitive difficulty was positively correlated with the severity of their symptoms. BOLD response during the working memory task did not differ between the groups. BOLD response correlated with task accuracy in control subjects but not in fibromyalgia patients. Increased subjective cognitive impairment correlated with decreased BOLD response in both groups but in different anatomic regions. In conclusion, "fibrofog" appears to be better characterized by subjective rather than objective impairment. Neurologic correlates of this subjective experience of impairment might be separate from those involved in the performance of cognitive tasks.

An Overview and Empirical Comparison of Distance Metric Learning Methods.

PubMed

Moutafis, Panagiotis; Leng, Mengjun; Kakadiaris, Ioannis A

2016-02-16

In this paper, we first offer an overview of advances in the field of distance metric learning. Then, we empirically compare selected methods using a common experimental protocol. The number of distance metric learning algorithms proposed keeps growing due to their effectiveness and wide application. However, existing surveys are either outdated or they focus only on a few methods. As a result, there is an increasing need to summarize the obtained knowledge in a concise, yet informative manner. Moreover, existing surveys do not conduct comprehensive experimental comparisons. On the other hand, individual distance metric learning papers compare the performance of the proposed approach with only a few related methods and under different settings. This highlights the need for an experimental evaluation using a common and challenging protocol. To this end, we conduct face verification experiments, as this task poses significant challenges due to varying conditions during data acquisition. In addition, face verification is a natural application for distance metric learning because the encountered challenge is to define a distance function that: 1) accurately expresses the notion of similarity for verification; 2) is robust to noisy data; 3) generalizes well to unseen subjects; and 4) scales well with the dimensionality and number of training samples. In particular, we utilize well-tested features to assess the performance of selected methods following the experimental protocol of the state-of-the-art database labeled faces in the wild. A summary of the results is presented along with a discussion of the insights obtained and lessons learned by employing the corresponding algorithms.

Comparing performance in discrete and continuous comparison tasks.

PubMed

Leibovich, Tali; Henik, Avishai

2014-05-01

The approximate number system (ANS) theory suggests that all magnitudes, discrete (i.e., number of items) or continuous (i.e., size, density, etc.), are processed by a shared system and comply with Weber's law. The current study reexamined this notion by comparing performance in discrete (comparing numerosities of dot arrays) and continuous (comparisons of area of squares) tasks. We found that: (a) threshold of discrimination was higher for continuous than for discrete comparisons; (b) while performance in the discrete task complied with Weber's law, performance in the continuous task violated it; and (c) performance in the discrete task was influenced by continuous properties (e.g., dot density, dot cumulative area) of the dot array that were not predictive of numerosities or task relevant. Therefore, we propose that the magnitude processing system (MPS) is actually divided into separate (yet interactive) systems for discrete and continuous magnitude processing. Further subdivisions are discussed. We argue that cooperation between these systems results in a holistic comparison of magnitudes, one that takes into account continuous properties in addition to numerosities. Considering the MPS as two systems opens the door to new and important questions that shed light on both normal and impaired development of the numerical system.

Soft-light overhead illumination systems improve laparoscopic task performance.

PubMed

Takai, Akihiro; Takada, Yasutsugu; Motomura, Hideki; Teramukai, Satoshi

2014-02-01

The aim of this study was to evaluate the impact of attached shadow cues for laparoscopic task performance. We developed a soft-light overhead illumination system (SOIS) that produced attached shadows on objects. We compared results using the SOIS with those using a conventional illumination system with regard to laparoscopic experience and laparoscope-to-target distances (LTDs). Forty-two medical students and 23 surgeons participated in the study. A peg transfer task (LTD, 120 mm) for students and surgeons, and a suture removal task (LTD, 30 mm) for students were performed. Illumination systems were randomly assigned to each task. Endpoints were: total number of peg transfers; percentage of peg-dropping errors; and total execution time for suture removal. After the task, participants filled out a questionnaire on their preference for a particular illumination system. Total number of peg transfers was greater with the SOIS for both students and surgeons. Percentage of peg-dropping errors for surgeons was lower with the SOIS. Total execution time for suture removal was shorter with the SOIS. Forty-five participants (69% in total) evaluated the SOIS for easier task performance. The present results confirm that the SOIS improves laparoscopic task performance, regardless of previous laparoscopic experience or LTD.

Mental and psychomotor task performance in noise

NASA Technical Reports Server (NTRS)

1984-01-01

The possible adverse effects of noise on mental and psychomotor task performance were a matter of practical concern for centuries and continue to be a matter of scientific controversy. A review indicates that except for the masking or interferences with the hearing of sounds needed to perform a given task, noise does not necessarily interfer with work performance. However, because of difficulties in the experimental control of some of these possible effects, the results of research on work performance in noise were inconsistent and difficult to encompass in any simple theoretical construct. Indeed, reviews of research in this area conclude that simple generalizations about possible effects of noise on work performance cannot be made. Nevertheless, several general theories were put forth.

EVA Health and Human Performance Benchmarking Study

NASA Technical Reports Server (NTRS)

Abercromby, A. F.; Norcross, J.; Jarvis, S. L.

2016-01-01

Multiple HRP Risks and Gaps require detailed characterization of human health and performance during exploration extravehicular activity (EVA) tasks; however, a rigorous and comprehensive methodology for characterizing and comparing the health and human performance implications of current and future EVA spacesuit designs does not exist. This study will identify and implement functional tasks and metrics, both objective and subjective, that are relevant to health and human performance, such as metabolic expenditure, suit fit, discomfort, suited postural stability, cognitive performance, and potentially biochemical responses for humans working inside different EVA suits doing functional tasks under the appropriate simulated reduced gravity environments. This study will provide health and human performance benchmark data for humans working in current EVA suits (EMU, Mark III, and Z2) as well as shirtsleeves using a standard set of tasks and metrics with quantified reliability. Results and methodologies developed during this test will provide benchmark data against which future EVA suits, and different suit configurations (eg, varied pressure, mass, CG) may be reliably compared in subsequent tests. Results will also inform fitness for duty standards as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Improving Physical Task Performance with Counterfactual and Prefactual Thinking

PubMed Central

Hammell, Cecilia; Chan, Amy Y. C.

2016-01-01

Counterfactual thinking (reflecting on “what might have been”) has been shown to enhance future performance by translating information about past mistakes into plans for future action. Prefactual thinking (imagining “what might be if…”) may serve a greater preparative function than counterfactual thinking as it is future-orientated and focuses on more controllable features, thus providing a practical script to prime future behaviour. However, whether or not this difference in hypothetical thought content may translate into a difference in actual task performance has been largely unexamined. In Experiment 1 (n = 42), participants performed trials of a computer-simulated physical task, in between which they engaged in either task-related hypothetical thinking (counterfactual or prefactual) or an unrelated filler task (control). As hypothesised, prefactuals contained more controllable features than counterfactuals. Moreover, participants who engaged in either form of hypothetical thinking improved significantly in task performance over trials compared to participants in the control group. The difference in thought content between counterfactuals and prefactuals, however, did not yield a significant difference in performance improvement. Experiment 2 (n = 42) replicated these findings in a dynamic balance task environment. Together, these findings provide further evidence for the preparatory function of counterfactuals, and demonstrate that prefactuals share this same functional characteristic. PMID:27942041

Improving Physical Task Performance with Counterfactual and Prefactual Thinking.

PubMed

Hammell, Cecilia; Chan, Amy Y C

2016-01-01

Counterfactual thinking (reflecting on "what might have been") has been shown to enhance future performance by translating information about past mistakes into plans for future action. Prefactual thinking (imagining "what might be if…") may serve a greater preparative function than counterfactual thinking as it is future-orientated and focuses on more controllable features, thus providing a practical script to prime future behaviour. However, whether or not this difference in hypothetical thought content may translate into a difference in actual task performance has been largely unexamined. In Experiment 1 (n = 42), participants performed trials of a computer-simulated physical task, in between which they engaged in either task-related hypothetical thinking (counterfactual or prefactual) or an unrelated filler task (control). As hypothesised, prefactuals contained more controllable features than counterfactuals. Moreover, participants who engaged in either form of hypothetical thinking improved significantly in task performance over trials compared to participants in the control group. The difference in thought content between counterfactuals and prefactuals, however, did not yield a significant difference in performance improvement. Experiment 2 (n = 42) replicated these findings in a dynamic balance task environment. Together, these findings provide further evidence for the preparatory function of counterfactuals, and demonstrate that prefactuals share this same functional characteristic.

Hysteresis in Mental Workload and Task Performance: The Influence of Demand Transitions and Task Prioritization.

PubMed

Jansen, Reinier J; Sawyer, Ben D; van Egmond, René; de Ridder, Huib; Hancock, Peter A

2016-12-01

We examine how transitions in task demand are manifested in mental workload and performance in a dual-task setting. Hysteresis has been defined as the ongoing influence of demand levels prior to a demand transition. Authors of previous studies predominantly examined hysteretic effects in terms of performance. However, little is known about the temporal development of hysteresis in mental workload. A simulated driving task was combined with an auditory memory task. Participants were instructed to prioritize driving or to prioritize both tasks equally. Three experimental conditions with low, high, and low task demands were constructed by manipulating the frequency of lane changing. Multiple measures of subjective mental workload were taken during experimental conditions. Contrary to our prediction, no hysteretic effects were found after the high- to low-demand transition. However, a hysteretic effect in mental workload was found within the high-demand condition, which degraded toward the end of the high condition. Priority instructions were not reflected in performance. Online assessment of both performance and mental workload demonstrates the transient nature of hysteretic effects. An explanation for the observed hysteretic effect in mental workload is offered in terms of effort regulation. An informed arrival at the scene is important in safety operations, but peaks in mental workload should be avoided to prevent buildup of fatigue. Therefore, communication technologies should incorporate the historical profile of task demand. © 2016, Human Factors and Ergonomics Society.

Menstrual cycle phase effects on memory and Stroop task performance.

PubMed

Hatta, Takeshi; Nagaya, Keiko

2009-10-01

The present study examined differences in Stroop and memory task performances modulated by gonadal steroid hormones during the menstrual cycle in women. Thirty women with regular menstrual cycles performed a logical memory task (Wechsler Memory Scale) and the Stroop task. The results showed a significant difference in Stroop task performance between low and high levels of estradiol and progesterone during the menstrual cycle, but there was no significant difference in memory performance between the two phases, nor was there any significant mood change that might have influenced cognitive performance. These findings suggest that sex-related hormone modulation selectively affects cognitive functions depending on the type of task and low level secretion of estradiol appears to contribute to reducing the level of attention that relates to the prefrontal cortex.

Training Attentional Control Improves Cognitive and Motor Task Performance.

PubMed

Ducrocq, Emmanuel; Wilson, Mark; Vine, Sam; Derakshan, Nazanin

2016-10-01

Attentional control is a necessary function for the regulation of goal-directed behavior. In three experiments we investigated whether training inhibitory control using a visual search task could improve task-specific measures of attentional control and performance. In Experiment 1 results revealed that training elicited a near-transfer effect, improving performance on a cognitive (antisaccade) task assessing inhibitory control. In Experiment 2 an initial far-transfer effect of training was observed on an index of attentional control validated for tennis. The principal aim of Experiment 3 was to expand on these findings by assessing objective gaze measures of inhibitory control during the performance of a tennis task. Training improved inhibitory control and performance when pressure was elevated, confirming the mechanisms by which cognitive anxiety impacts performance. These results suggest that attentional control training can improve inhibition and reduce taskspecific distractibility with promise of transfer to more efficient sporting performance in competitive contexts.

The Curvilinear Relationship between State Neuroticism and Momentary Task Performance

PubMed Central

Debusscher, Jonas; Hofmans, Joeri; De Fruyt, Filip

2014-01-01

A daily diary and two experience sampling studies were carried out to investigate curvilinearity of the within-person relationship between state neuroticism and task performance, as well as the moderating effects of within-person variation in momentary job demands (i.e., work pressure and task complexity). In one, results showed that under high work pressure, the state neuroticism–task performance relationship was best described by an exponentially decreasing curve, whereas an inverted U-shaped curve was found for tasks low in work pressure, while in another study, a similar trend was visible for task complexity. In the final study, the state neuroticism–momentary task performance relationship was a linear one, and this relationship was moderated by momentary task complexity. Together, results from all three studies showed that it is important to take into account the moderating effects of momentary job demands because within-person variation in job demands affects the way in which state neuroticism relates to momentary levels of task performance. Specifically, we found that experiencing low levels of state neuroticism may be most beneficial in high demanding tasks, whereas more moderate levels of state neuroticism are optimal under low momentary job demands. PMID:25238547

Evaluation techniques and metrics for assessment of pan+MSI fusion (pansharpening)

NASA Astrophysics Data System (ADS)

Mercovich, Ryan A.

2015-05-01

Fusion of broadband panchromatic data with narrow band multispectral data - pansharpening - is a common and often studied problem in remote sensing. Many methods exist to produce data fusion results with the best possible spatial and spectral characteristics, and a number have been commercially implemented. This study examines the output products of 4 commercial implementations with regard to their relative strengths and weaknesses for a set of defined image characteristics and analyst use-cases. Image characteristics used are spatial detail, spatial quality, spectral integrity, and composite color quality (hue and saturation), and analyst use-cases included a variety of object detection and identification tasks. The imagery comes courtesy of the RIT SHARE 2012 collect. Two approaches are used to evaluate the pansharpening methods, analyst evaluation or qualitative measure and image quality metrics or quantitative measures. Visual analyst evaluation results are compared with metric results to determine which metrics best measure the defined image characteristics and product use-cases and to support future rigorous characterization the metrics' correlation with the analyst results. Because pansharpening represents a trade between adding spatial information from the panchromatic image, and retaining spectral information from the MSI channels, the metrics examined are grouped into spatial improvement metrics and spectral preservation metrics. A single metric to quantify the quality of a pansharpening method would necessarily be a combination of weighted spatial and spectral metrics based on the importance of various spatial and spectral characteristics for the primary task of interest. Appropriate metrics and weights for such a combined metric are proposed here, based on the conducted analyst evaluation. Additionally, during this work, a metric was developed specifically focused on assessment of spatial structure improvement relative to a reference image and

Training improves laparoscopic tasks performance and decreases operator workload.

PubMed

Hu, Jesse S L; Lu, Jirong; Tan, Wee Boon; Lomanto, Davide

2016-05-01

It has been postulated that increased operator workload during task performance may increase fatigue and surgical errors. The National Aeronautics and Space Administration-Task Load Index (NASA-TLX) is a validated tool for self-assessment for workload. Our study aims to assess the relationship of workload and performance of novices in simulated laparoscopic tasks of different complexity levels before and after training. Forty-seven novices without prior laparoscopic experience were recruited in a trial to investigate whether training improves task performance as well as mental workload. The participants were tested on three standard tasks (ring transfer, precision cutting and intracorporeal suturing) in increasing complexity based on the Fundamentals of Laparoscopic Surgery (FLS) curriculum. Following a period of training and rest, participants were tested again. Test scores were computed from time taken and time penalties for precision errors. Test scores and NASA-TLX scores were recorded pre- and post-training and analysed using paired t tests. One-way repeated measures ANOVA was used to analyse differences in NASA-TLX scores between the three tasks. NASA-TLX score was lowest with ring transfer and highest with intracorporeal suturing. This was statistically significant in both pre-training (p < 0.001) and post-training (p < 0.001). NASA-TLX scores mirror the changes in test scores for the three tasks. Workload scores decreased significantly after training for all three tasks (ring transfer = 2.93, p < 0.001, precision cutting = 3.74, p < 0.001, intracorporeal suturing = 2.98, p < 0.001). NASA-TLX score is an accurate reflection of the complexity of simulated laparoscopic tasks in the FLS curriculum. This also correlates with the relationship of test scores between the three tasks. Simulation training improves both performance score and workload score across the tasks.

Introducing Co-Activation Pattern Metrics to Quantify Spontaneous Brain Network Dynamics

PubMed Central

Chen, Jingyuan E.; Chang, Catie; Greicius, Michael D.; Glover, Gary H.

2015-01-01

Recently, fMRI researchers have begun to realize that the brain's intrinsic network patterns may undergo substantial changes during a single resting state (RS) scan. However, despite the growing interest in brain dynamics, metrics that can quantify the variability of network patterns are still quite limited. Here, we first introduce various quantification metrics based on the extension of co-activation pattern (CAP) analysis, a recently proposed point-process analysis that tracks state alternations at each individual time frame and relies on very few assumptions; then apply these proposed metrics to quantify changes of brain dynamics during a sustained 2-back working memory (WM) task compared to rest. We focus on the functional connectivity of two prominent RS networks, the default-mode network (DMN) and executive control network (ECN). We first demonstrate less variability of global Pearson correlations with respect to the two chosen networks using a sliding-window approach during WM task compared to rest; then we show that the macroscopic decrease in variations in correlations during a WM task is also well characterized by the combined effect of a reduced number of dominant CAPs, increased spatial consistency across CAPs, and increased fractional contributions of a few dominant CAPs. These CAP metrics may provide alternative and more straightforward quantitative means of characterizing brain network dynamics than time-windowed correlation analyses. PMID:25662866

Self-Reported Stickiness of Mind-Wandering Affects Task Performance

PubMed Central

van Vugt, Marieke K.; Broers, Nico

2016-01-01

When asked to perform a certain task, we typically spend a decent amount of time thinking thoughts unrelated to that task–a phenomenon referred to as “mind-wandering.” It is thought that this mind-wandering is driven at least in part by our unfinished goals and concerns. Previous studies have shown that just after presenting a participant with their own concerns, their reports of task-unrelated thinking increased somewhat. However, effects of these concerns on task performance were somewhat inconsistent. In this study we take the opposite approach, and examine whether task performance depends on the self-reported thought content. Specifically, a particularly intriguing aspect of mind-wandering that has hitherto received little attention is the difficulty of disengaging from it, in other words, the “stickiness” of the thoughts. While presenting participants with their own concerns was not associated with clear effects on task performance, we showed that the reports of off-task thinking and variability of response times increased with the amount of self-reported stickiness of thoughts. This suggests that the stickiness of mind-wandering is a relevant variable, and participants are able to meaningfully report on it. PMID:27242636

Rules and more rules: the effects of multiple tasks, extensive training, and aging on task-switching performance.

PubMed

Buchler, Norbou G; Hoyer, William J; Cerella, John

2008-06-01

Task-switching performance was assessed in young and older adults as a function of the number of task sets to be actively maintained in memory (varied from 1 to 4) over the course of extended training (5 days). Each of the four tasks required the execution of a simple computational algorithm, which was instantaneously cued by the color of the two-digit stimulus. Tasks were presented in pure (task set size 1) and mixed blocks (task set sizes 2, 3, 4), and the task sequence was unpredictable. By considering task switching beyond two tasks, we found evidence for a cognitive control system that is not overwhelmed by task set size load manipulations. Extended training eliminated age effects in task-switching performance, even when the participants had to manage the execution of up to four tasks. The results are discussed in terms of current theories of cognitive control, including task set inertia and production system postulates.

Highway safety performance metrics and emergency response in an advanced transportation environment : final report.

DOT National Transportation Integrated Search

2016-06-01

Traditional highway safety performance metrics have been largely based on fatal crashes and more recently serious injury crashes. In the near future however, there may be less severe motor vehicle crashes due to advances in driver assistance systems,...

Selecting Tasks for Evaluating Human Performance as a Function of Gravity

NASA Technical Reports Server (NTRS)

Norcross, Jason R.; Gernhardt, Michael L.

2011-01-01

A challenge in understanding human performance as a function of gravity is determining which tasks to research. Initial studies began with treadmill walking, which was easy to quantify and control. However, with the development of pressurized rovers, it is less important to optimize human performance for ambulation as pressurized rovers will likely perform gross translation for them. Future crews are likely to spend much of their extravehicular activity (EVA) performing geology, construction,a nd maintenance type tasks. With these types of tasks, people have different performance strategies, and it is often difficult to quantify the task and measure steady-state metabolic rates or perform biomechanical analysis. For many of these types of tasks, subjective feedback may be the only data that can be collected. However, subjective data may not fully support a rigorous scientific comparison of human performance across different gravity levels and suit factors. NASA would benefit from having a wide variety of quantifiable tasks that allow human performance comparison across different conditions. In order to determine which tasks will effectively support scientific studies, many different tasks and data analysis techniques will need to be employed. Many of these tasks and techniques will not be effective, but some will produce quantifiable results that are sensitive enough to show performance differences. One of the primary concerns related to EVA performance is metabolic rate. The higher the metabolic rate, the faster the astronaut will exhaust consumables. The focus of this poster will be on how different tasks affect metabolic rate across different gravity levels.

Individual Differences in Secondary Task Performance.

DTIC Science & Technology

1980-09-01

applied than in the experimental literature (e.g. Brown, 1968). The assertion that primary and secondary tasks compete for mental resources has a further...Subjects were paid $8.00 for participation in two 1 -hour sessions. Bonus points were awarded on the basis of performance in the experimental tasks...the experimental measures are presented in Table 3. Reliabilities, shown in the diagonal, are based on correlations between measures from Day 1 and Day

Effects of metric change on safety in the workplace for selected occupations

NASA Astrophysics Data System (ADS)

Lefande, J. M.; Pokorney, J. L.

1982-04-01

The study assesses the potential safety issues of metric conversion in the workplace. A purposive sample of 35 occupations based on injury and illnesses indexes were assessed. After an analysis of workforce population, hazard analysis and measurement sensitivity of the occupations, jobs were analyzed to identify potential safety hazards by industrial hygienists, safety engineers and academia. The study's major findings were as follows: No metric hazard experience was identified. An increased exposure might occur when particular jobs and their job tasks are going the transition from customary measurement to metric measurement. Well planned metric change programs reduce hazard potential. Metric safety issues are unresolved in the aviation industry.

Changing Metrics of Organ Procurement Organization Performance in Order to Increase Organ Donation Rates in the United States.

PubMed

Goldberg, D; Kallan, M J; Fu, L; Ciccarone, M; Ramirez, J; Rosenberg, P; Arnold, J; Segal, G; Moritsugu, K P; Nathan, H; Hasz, R; Abt, P L

2017-12-01

The shortage of deceased-donor organs is compounded by donation metrics that fail to account for the total pool of possible donors, leading to ambiguous donor statistics. We sought to assess potential metrics of organ procurement organizations (OPOs) utilizing data from the Nationwide Inpatient Sample (NIS) from 2009-2012 and State Inpatient Databases (SIDs) from 2008-2014. A possible donor was defined as a ventilated inpatient death ≤75 years of age, without multi-organ system failure, sepsis, or cancer, whose cause of death was consistent with organ donation. These estimates were compared to patient-level data from chart review from two large OPOs. Among 2,907,658 inpatient deaths from 2009-2012, 96,028 (3.3%) were a "possible deceased-organ donor." The two proposed metrics of OPO performance were: (1) donation percentage (percentage of possible deceased-donors who become actual donors; range: 20.0-57.0%); and (2) organs transplanted per possible donor (range: 0.52-1.74). These metrics allow for comparisons of OPO performance and geographic-level donation rates, and identify areas in greatest need of interventions to improve donation rates. We demonstrate that administrative data can be used to identify possible deceased donors in the US and could be a data source for CMS to implement new OPO performance metrics in a standardized fashion. © 2017 The American Society of Transplantation and the American Society of Transplant Surgeons.

Research and development on performance models of thermal imaging systems

NASA Astrophysics Data System (ADS)

Wang, Ji-hui; Jin, Wei-qi; Wang, Xia; Cheng, Yi-nan

2009-07-01

Traditional ACQUIRE models perform the discrimination tasks of detection (target orientation, recognition and identification) for military target based upon minimum resolvable temperature difference (MRTD) and Johnson criteria for thermal imaging systems (TIS). Johnson criteria is generally pessimistic for performance predict of sampled imager with the development of focal plane array (FPA) detectors and digital image process technology. Triangle orientation discrimination threshold (TOD) model, minimum temperature difference perceived (MTDP)/ thermal range model (TRM3) Model and target task performance (TTP) metric have been developed to predict the performance of sampled imager, especially TTP metric can provides better accuracy than the Johnson criteria. In this paper, the performance models above are described; channel width metrics have been presented to describe the synthesis performance including modulate translate function (MTF) channel width for high signal noise to ration (SNR) optoelectronic imaging systems and MRTD channel width for low SNR TIS; the under resolvable questions for performance assessment of TIS are indicated; last, the development direction of performance models for TIS are discussed.

Operational testing of a figure of merit for overall task performance

NASA Technical Reports Server (NTRS)

Lemay, Moira

1990-01-01

An overall indicator or figure of merit (FOM), for the quality of pilot performance is needed to define optimal workload levels, predict system failure, measure the impact of new automation in the cockpit, and define the relative contributions of subtasks to overall task performance. A normative FOM was developed based on the calculation of a standard score for each component of a complex task. It reflected some effects, detailed in an earlier study, of the introduction of new data link technology into the cockpit. Since the technique showed promise, further testing was done. A new set of data was obtained using the recently developed Multi-Attribute Task Battery. This is a complex battery consisting of four tasks which can be varied in task demand, and on which performance measures can be obtained. This battery was presented to 12 subjects in a 20 minute trial at each of three levels of workload or task demand, and performance measures collected on all four tasks. The NASA-TLX workload rating scale was presented at minutes 6, 12, and 18, of each trial. A figure of merit was then obtained for each run of the battery by calculating a mean, SD, and standard score for each task. Each task contributed its own proportion to the overall FOM, and relative contributions changed with increasing workload. Thus, the FOM shows the effect of task changes, not only on the individual task that is changed, but also on the performance of other tasks and of the whole task. The cost to other tasks of maintaining constant performance on an individual task can be quantified.

Comparing species decisions in a dichotomous choice task: adjusting task parameters improves performance in monkeys.

PubMed

Prétôt, Laurent; Bshary, Redouan; Brosnan, Sarah F

2016-07-01

In comparative psychology, both similarities and differences among species are studied to better understand the evolution of their behavior. To do so, we first test species in tasks using similar procedures, but if differences are found, it is important to determine their underlying cause(s) (e.g., are they due to ecology, cognitive ability, an artifact of the study, and/or some other factor?). In our previous work, primates performed unexpectedly poorly on an apparently simple two-choice discrimination task based on the natural behavior of cleaner fish, while the fish did quite well. In this task, if the subjects first chose one of the options (ephemeral) they received both food items, but if they chose the other (permanent) option first, the ephemeral option disappeared. Here, we test several proposed explanations for primates' relatively poorer performance. In Study 1, we used a computerized paradigm that differed from the previous test by removing interaction with human experimenters, which may be distracting, and providing a more standardized testing environment. In Study 2, we adapted the computerized paradigm from Study 1 to be more relevant to primate ecology. Monkeys' overall performance in these adapted tasks matched the performance of the fish in the original study, showing that with the appropriate modifications they can solve the task. We discuss these results in light of comparative research, which requires balancing procedural similarity with considerations of how the details of the task or the context may influence how different species perceive and solve tasks differently.

Strategic predictors of performance in a divided attention task

PubMed Central

Faragó, Kinga Bettina; Lőrincz, András

2018-01-01

In this study we investigate the strategies of subjects in a complex divided attention task. We conducted a series of experiments with ten participants and evaluated their performance. After an extensive analysis, we identified four strategic measures that justify the achievement of the participants, by highlighting the individual differences and predicting performance in a regression analysis using generalized estimating equations. Selecting the more urgent task and user action between multiple simultaneous possibilities form two of the strategic decisions, respectively. The third one refers to choosing a response within the same task when the opportunity is present. The fourth and most important measure of strategy involves thinking ahead and executing an action before a situation would become critical. This latter one has the effect of reducing later cognitive load or timing constraints and it is shown to explain almost as much variance in performance as the other three, more straightforward predictors together. In addition to determining these strategic predictors, we also show how manipulating task difficulty induces a shift in strategy, thus impairing human performance in the rehearsed task. The results of this study indicate that considerable differences in the divided attention ability of normal subjects can be identified early and with simple measurements. The importance of describing and analyzing strategies is also emphasized, which can substantially influence performance in complex tasks and may serve training needs. PMID:29621292

Strategic predictors of performance in a divided attention task.

PubMed

Rill, Róbert Adrian; Faragó, Kinga Bettina; Lőrincz, András

2018-01-01

In this study we investigate the strategies of subjects in a complex divided attention task. We conducted a series of experiments with ten participants and evaluated their performance. After an extensive analysis, we identified four strategic measures that justify the achievement of the participants, by highlighting the individual differences and predicting performance in a regression analysis using generalized estimating equations. Selecting the more urgent task and user action between multiple simultaneous possibilities form two of the strategic decisions, respectively. The third one refers to choosing a response within the same task when the opportunity is present. The fourth and most important measure of strategy involves thinking ahead and executing an action before a situation would become critical. This latter one has the effect of reducing later cognitive load or timing constraints and it is shown to explain almost as much variance in performance as the other three, more straightforward predictors together. In addition to determining these strategic predictors, we also show how manipulating task difficulty induces a shift in strategy, thus impairing human performance in the rehearsed task. The results of this study indicate that considerable differences in the divided attention ability of normal subjects can be identified early and with simple measurements. The importance of describing and analyzing strategies is also emphasized, which can substantially influence performance in complex tasks and may serve training needs.

Strategy quantification using body worn inertial sensors in a reactive agility task.

PubMed

Eke, Chika U; Cain, Stephen M; Stirling, Leia A

2017-11-07

Agility performance is often evaluated using time-based metrics, which provide little information about which factors aid or limit success. The objective of this study was to better understand agility strategy by identifying biomechanical metrics that were sensitive to performance speed, which were calculated with data from an array of body-worn inertial sensors. Five metrics were defined (normalized number of foot contacts, stride length variance, arm swing variance, mean normalized stride frequency, and number of body rotations) that corresponded to agility terms defined by experts working in athletic, clinical, and military environments. Eighteen participants donned 13 sensors to complete a reactive agility task, which involved navigating a set of cones in response to a vocal cue. Participants were grouped into fast, medium, and slow performance based on their completion time. Participants in the fast group had the smallest number of foot contacts (normalizing by height), highest stride length variance (normalizing by height), highest forearm angular velocity variance, and highest stride frequency (normalizing by height). The number of body rotations was not sensitive to speed and may have been determined by hand and foot dominance while completing the agility task. The results of this study have the potential to inform the development of a composite agility score constructed from the list of significant metrics. By quantifying the agility terms previously defined by expert evaluators through an agility score, this study can assist in strategy development for training and rehabilitation across athletic, clinical, and military domains. Copyright © 2017 Elsevier Ltd. All rights reserved.

Computer-mediated communication: task performance and satisfaction.

PubMed

Simon, Andrew F

2006-06-01

The author assessed satisfaction and performance on 3 tasks (idea generation, intellective, judgment) among 75 dyads (N = 150) working through 1 of 3 modes of communication (instant messaging, videoconferencing, face to face). The author based predictions on the Media Naturalness Theory (N. Kock, 2001, 2002) and on findings from past researchers (e.g., D. M. DeRosa, C. Smith, & D. A. Hantula, in press) of the interaction between tasks and media. The present author did not identify task performance differences, although satisfaction with the medium was lower among those dyads communicating through an instant-messaging system than among those interacting face to face or through videoconferencing. The findings support the Media Naturalness Theory. The author discussed them in relation to the participants' frequent use of instant messaging and their familiarity with new communication media.

How do task characteristics affect learning and performance? The roles of variably mapped and dynamic tasks.

PubMed

Macnamara, Brooke N; Frank, David J

2018-05-01

For well over a century, scientists have investigated individual differences in performance. The majority of studies have focused on either differences in practice, or differences in cognitive resources. However, the predictive ability of either practice or cognitive resources varies considerably across tasks. We are the first to examine task characteristics' impact on learning and performance in a complex task while controlling for other task characteristics. In 2 experiments we test key theoretical task characteristic thought to moderate the relationship between practice, cognitive resources, and performance. We devised a task where each of several key task characteristics can be manipulated independently. Participants played 5 rounds of a game similar to the popular tower defense videogame Plants vs. Zombies where both cognitive load and game characteristics were manipulated. In Experiment 1, participants either played a consistently mapped version-the stimuli and the associated meaning of their properties were constant across the 5 rounds-or played a variably mapped version-the stimuli and the associated meaning of their properties changed every few minutes. In Experiment 2, participants either played a static version-that is, turn taking with no time pressure-or played a dynamic version-that is, the stimuli moved regardless of participants' response rates. In Experiment 1, participants' accuracy and efficiency were substantially hindered in the variably mapped conditions. In Experiment 2, learning and performance accuracy were hindered in the dynamic conditions, especially when under cognitive load. Our results suggest that task characteristics impact the relative importance of cognitive resources and practice on predicting learning and performance. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Light Water Reactor Sustainability Program Operator Performance Metrics for Control Room Modernization: A Practical Guide for Early Design Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald Boring; Roger Lew; Thomas Ulrich

2014-03-01

As control rooms are modernized with new digital systems at nuclear power plants, it is necessary to evaluate the operator performance using these systems as part of a verification and validation process. There are no standard, predefined metrics available for assessing what is satisfactory operator interaction with new systems, especially during the early design stages of a new system. This report identifies the process and metrics for evaluating human system interfaces as part of control room modernization. The report includes background information on design and evaluation, a thorough discussion of human performance measures, and a practical example of how themore » process and metrics have been used as part of a turbine control system upgrade during the formative stages of design. The process and metrics are geared toward generalizability to other applications and serve as a template for utilities undertaking their own control room modernization activities.« less

Real-Time Performance Feedback for the Manual Control of Spacecraft

NASA Astrophysics Data System (ADS)

Karasinski, John Austin

Real-time performance metrics were developed to quantify workload, situational awareness, and manual task performance for use as visual feedback to pilots of aerospace vehicles. Results from prior lunar lander experiments with variable levels of automation were replicated and extended to provide insights for the development of real-time metrics. Increased levels of automation resulted in increased flight performance, lower workload, and increased situational awareness. Automated Speech Recognition (ASR) was employed to detect verbal callouts as a limited measure of subjects' situational awareness. A one-dimensional manual tracking task and simple instructor-model visual feedback scheme was developed. This feedback was indicated to the operator by changing the color of a guidance element on the primary flight display, similar to how a flight instructor points out elements of a display to a student pilot. Experiments showed that for this low-complexity task, visual feedback did not change subject performance, but did increase the subjects' measured workload. Insights gained from these experiments were applied to a Simplified Aid for EVA Rescue (SAFER) inspection task. The effects of variations of an instructor-model performance-feedback strategy on human performance in a novel SAFER inspection task were investigated. Real-time feedback was found to have a statistically significant effect of improving subject performance and decreasing workload in this complicated four degree of freedom manual control task with two secondary tasks.

Dose-volume metrics and their relation to memory performance in pediatric brain tumor patients: A preliminary study.

PubMed

Raghubar, Kimberly P; Lamba, Michael; Cecil, Kim M; Yeates, Keith Owen; Mahone, E Mark; Limke, Christina; Grosshans, David; Beckwith, Travis J; Ris, M Douglas

2018-06-01

Advances in radiation treatment (RT), specifically volumetric planning with detailed dose and volumetric data for specific brain structures, have provided new opportunities to study neurobehavioral outcomes of RT in children treated for brain tumor. The present study examined the relationship between biophysical and physical dose metrics and neurocognitive ability, namely learning and memory, 2 years post-RT in pediatric brain tumor patients. The sample consisted of 26 pediatric patients with brain tumor, 14 of whom completed neuropsychological evaluations on average 24 months post-RT. Prescribed dose and dose-volume metrics for specific brain regions were calculated including physical metrics (i.e., mean dose and maximum dose) and biophysical metrics (i.e., integral biological effective dose and generalized equivalent uniform dose). We examined the associations between dose-volume metrics (whole brain, right and left hippocampus), and performance on measures of learning and memory (Children's Memory Scale). Biophysical dose metrics were highly correlated with the physical metric of mean dose but not with prescribed dose. Biophysical metrics and mean dose, but not prescribed dose, correlated with measures of learning and memory. These preliminary findings call into question the value of prescribed dose for characterizing treatment intensity; they also suggest that biophysical dose has only a limited advantage compared to physical dose when calculated for specific regions of the brain. We discuss the implications of the findings for evaluating and understanding the relation between RT and neurocognitive functioning. © 2018 Wiley Periodicals, Inc.

Task-specific motor performance and musculoskeletal response in self-classified right handers.

PubMed

Kumar, Sameer; Mandal, Manas K

2003-11-01

We examined the difference between the left and right hand motor performance (in terms of erg produced) of self-classified right handers (15 men, 15 women) for power (task involving muscle force) and skilled (task involving precision and eye hand coordination) tasks. Musculoskeletal response during task performance was measured by electromyogram to test the hypothesis that performance with the nondominant hand would trigger more generalized muscle tension. The difference between the left and right hand performance of men was nonsignificant for power task; for women, right hand performance was significantly superior than left for such task. Men excelled in power and women excelled in skilled tasks relative to their counterparts. Generalized muscle tension was significantly more during the left than the right hand performance for power but not for skilled tasks.

Surveillance metrics sensitivity study.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hamada, Michael S.; Bierbaum, Rene Lynn; Robertson, Alix A.

2011-09-01

In September of 2009, a Tri-Lab team was formed to develop a set of metrics relating to the NNSA nuclear weapon surveillance program. The purpose of the metrics was to develop a more quantitative and/or qualitative metric(s) describing the results of realized or non-realized surveillance activities on our confidence in reporting reliability and assessing the stockpile. As a part of this effort, a statistical sub-team investigated various techniques and developed a complementary set of statistical metrics that could serve as a foundation for characterizing aspects of meeting the surveillance program objectives. The metrics are a combination of tolerance limit calculationsmore » and power calculations, intending to answer level-of-confidence type questions with respect to the ability to detect certain undesirable behaviors (catastrophic defects, margin insufficiency defects, and deviations from a model). Note that the metrics are not intended to gauge product performance but instead the adequacy of surveillance. This report gives a short description of four metrics types that were explored and the results of a sensitivity study conducted to investigate their behavior for various inputs. The results of the sensitivity study can be used to set the risk parameters that specify the level of stockpile problem that the surveillance program should be addressing.« less

Surveillance Metrics Sensitivity Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bierbaum, R; Hamada, M; Robertson, A

2011-11-01

In September of 2009, a Tri-Lab team was formed to develop a set of metrics relating to the NNSA nuclear weapon surveillance program. The purpose of the metrics was to develop a more quantitative and/or qualitative metric(s) describing the results of realized or non-realized surveillance activities on our confidence in reporting reliability and assessing the stockpile. As a part of this effort, a statistical sub-team investigated various techniques and developed a complementary set of statistical metrics that could serve as a foundation for characterizing aspects of meeting the surveillance program objectives. The metrics are a combination of tolerance limit calculationsmore » and power calculations, intending to answer level-of-confidence type questions with respect to the ability to detect certain undesirable behaviors (catastrophic defects, margin insufficiency defects, and deviations from a model). Note that the metrics are not intended to gauge product performance but instead the adequacy of surveillance. This report gives a short description of four metrics types that were explored and the results of a sensitivity study conducted to investigate their behavior for various inputs. The results of the sensitivity study can be used to set the risk parameters that specify the level of stockpile problem that the surveillance program should be addressing.« less

Improving balance by performing a secondary cognitive task.

PubMed

Swan, Laurie; Otani, Hajime; Loubert, Peter V; Sheffert, Sonya M; Dunbar, Gary L

2004-02-01

Contrary to general findings in the attention and memory literature, some studies have shown that performing a secondary cognitive task produces an improvement in balance performance. The purpose of the present experiment was to investigate under what condition such an improvement would occur. Young and older adults were asked to hold as still as possible on a platform that measured sway while performing or not performing the encoding phase of the Brooks' (1967) spatial or non-spatial memory task. The difficulty of maintaining balance was manipulated by varying the availability of visual input and sway-referenced motion of the platform. Sway scores were computed based on the distance between the individual pressure centres and the average centre of pressure during each 20-s trial. The results indicated that both the spatial and non-spatial memory tasks improved balance for older adults under the most difficult balance condition.

Metrics for Evaluation of Student Models

ERIC Educational Resources Information Center

Pelanek, Radek

2015-01-01

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student…

Performance monitoring in obsessive-compulsive undergraduates: Effects of task difficulty.

PubMed

Riesel, Anja; Richter, Anika; Kaufmann, Christian; Kathmann, Norbert; Endrass, Tanja

2015-08-01

Both obsessive-compulsive disorder and subclinical obsessive-compulsive (OC) symptoms seem to be associated with hyperactive error-related brain activity. The current study examined performance monitoring in subjects with subclinical OC symptoms using a new task with different levels of difficulty. Nineteen subjects with high and 18 subjects with low OC characteristics performed a random dot cinematogram (RDC) task with three levels of difficulty. The high and low OC groups did not differ in error-related negativity (ERN), correct-related negativity (CRN) and performance irrespective of task difficulty. The amplitude of the ERN decreased with increasing difficulty whereas the magnitude of CRN did not vary. ERN and CRN approached in size and topography with increasing difficulty, which suggests that errors and correct responses are processed more similarly. These results add to a growing number of studies that fail to replicate hyperactive performance monitoring in individuals with OC symptoms in task with higher difficulty or requiring learning. Together with these findings our results suggest that the relationship between OC symptoms and performance monitoring may be sensitive to type of task and task characteristics and cannot be observed in a RDC that differs from typically used tasks in difficulty and the amount of response-conflict. Copyright © 2015 Elsevier Inc. All rights reserved.

Association between educational status and dual-task performance in young adults.

PubMed

Voos, Mariana Callil; Pimentel Piemonte, Maria Elisa; Castelli, Lilian Zanchetta; Andrade Machado, Mariane Silva; Dos Santos Teixeira, Patrícia Pereira; Caromano, Fátima Aparecida; Ribeiro Do Valle, Luiz Eduardo

2015-04-01

The influence of educational status on perceptual-motor performance has not been investigated. The single- and dual-task performances of 15 Low educated adults (9 men, 6 women; M age=24.1 yr.; 6-9 yr. of education) and 15 Higher educated adults (8 men, 7 women; M age=24.7 yr.; 10-13 yr. of education) were compared. The perceptual task consisted of verbally classifying two figures (equal or different). The motor task consisted of alternating steps from the floor to a stool. Tasks were assessed individually and simultaneously. Two analyses of variance (2 groups×4 blocks) compared the errors and steps. The Low education group committed more errors and had less improvement on the perceptual task than the High education group. During and after the perceptual-motor task performance, errors increased only in the Low education group. Education correlated to perceptual and motor performance. The Low education group showed more errors and less step alternations on the perceptual-motor task compared to the High education group. This difference on the number of errors was also observed after the dual-task, when the perceptual task was performed alone.

Characterizing “fibrofog”: Subjective appraisal, objective performance, and task-related brain activity during a working memory task

PubMed Central

Walitt, Brian; Čeko, Marta; Khatiwada, Manish; Gracely, John L.; Rayhan, Rakib; VanMeter, John W.; Gracely, Richard H.

2016-01-01

The subjective experience of cognitive dysfunction (“fibrofog”) is common in fibromyalgia. This study investigated the relation between subjective appraisal of cognitive function, objective cognitive task performance, and brain activity during a cognitive task using functional magnetic resonance imaging (fMRI). Sixteen fibromyalgia patients and 13 healthy pain-free controls completed a battery of questionnaires, including the Multiple Ability Self-Report Questionnaire (MASQ), a measure of self-perceived cognitive difficulties. Participants were evaluated for working memory performance using a modified N-back working memory task while undergoing Blood Oxygen Level Dependent (BOLD) fMRI measurements. Fibromyalgia patients and controls did not differ in working memory performance. Subjective appraisal of cognitive function was associated with better performance (accuracy) on the working memory task in healthy controls but not in fibromyalgia patients. In fibromyalgia patients, increased perceived cognitive difficulty was positively correlated with the severity of their symptoms. BOLD response during the working memory task did not differ between the groups. BOLD response correlated with task accuracy in control subjects but not in fibromyalgia patients. Increased subjective cognitive impairment correlated with decreased BOLD response in both groups but in different anatomic regions. In conclusion, “fibrofog” appears to be better characterized by subjective rather than objective impairment. Neurologic correlates of this subjective experience of impairment might be separate from those involved in the performance of cognitive tasks. PMID:26955513

Complexity Management Using Metrics for Trajectory Flexibility Preservation and Constraint Minimization

NASA Technical Reports Server (NTRS)

Idris, Husni; Shen, Ni; Wing, David J.

2011-01-01

The growing demand for air travel is increasing the need for mitigating air traffic congestion and complexity problems, which are already at high levels. At the same time new surveillance, navigation, and communication technologies are enabling major transformations in the air traffic management system, including net-based information sharing and collaboration, performance-based access to airspace resources, and trajectory-based rather than clearance-based operations. The new system will feature different schemes for allocating tasks and responsibilities between the ground and airborne agents and between the human and automation, with potential capacity and cost benefits. Therefore, complexity management requires new metrics and methods that can support these new schemes. This paper presents metrics and methods for preserving trajectory flexibility that have been proposed to support a trajectory-based approach for complexity management by airborne or ground-based systems. It presents extensions to these metrics as well as to the initial research conducted to investigate the hypothesis that using these metrics to guide user and service provider actions will naturally mitigate traffic complexity. The analysis showed promising results in that: (1) Trajectory flexibility preservation mitigated traffic complexity as indicated by inducing self-organization in the traffic patterns and lowering traffic complexity indicators such as dynamic density and traffic entropy. (2)Trajectory flexibility preservation reduced the potential for secondary conflicts in separation assurance. (3) Trajectory flexibility metrics showed potential application to support user and service provider negotiations for minimizing the constraints imposed on trajectories without jeopardizing their objectives.

Sigma metrics as a tool for evaluating the performance of internal quality control in a clinical chemistry laboratory

PubMed Central

Kumar, B. Vinodh; Mohan, Thuthi

2018-01-01

OBJECTIVE: Six Sigma is one of the most popular quality management system tools employed for process improvement. The Six Sigma methods are usually applied when the outcome of the process can be measured. This study was done to assess the performance of individual biochemical parameters on a Sigma Scale by calculating the sigma metrics for individual parameters and to follow the Westgard guidelines for appropriate Westgard rules and levels of internal quality control (IQC) that needs to be processed to improve target analyte performance based on the sigma metrics. MATERIALS AND METHODS: This is a retrospective study, and data required for the study were extracted between July 2015 and June 2016 from a Secondary Care Government Hospital, Chennai. The data obtained for the study are IQC - coefficient of variation percentage and External Quality Assurance Scheme (EQAS) - Bias% for 16 biochemical parameters. RESULTS: For the level 1 IQC, four analytes (alkaline phosphatase, magnesium, triglyceride, and high-density lipoprotein-cholesterol) showed an ideal performance of ≥6 sigma level, five analytes (urea, total bilirubin, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level and for level 2 IQCs, same four analytes of level 1 showed a performance of ≥6 sigma level, and four analytes (urea, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level. For all analytes <6 sigma level, the quality goal index (QGI) was <0.8 indicating the area requiring improvement to be imprecision except cholesterol whose QGI >1.2 indicated inaccuracy. CONCLUSION: This study shows that sigma metrics is a good quality tool to assess the analytical performance of a clinical chemistry laboratory. Thus, sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the efficiency of existing laboratory processes. PMID:29692587

Sigma metrics as a tool for evaluating the performance of internal quality control in a clinical chemistry laboratory.

PubMed

Kumar, B Vinodh; Mohan, Thuthi

2018-01-01

Six Sigma is one of the most popular quality management system tools employed for process improvement. The Six Sigma methods are usually applied when the outcome of the process can be measured. This study was done to assess the performance of individual biochemical parameters on a Sigma Scale by calculating the sigma metrics for individual parameters and to follow the Westgard guidelines for appropriate Westgard rules and levels of internal quality control (IQC) that needs to be processed to improve target analyte performance based on the sigma metrics. This is a retrospective study, and data required for the study were extracted between July 2015 and June 2016 from a Secondary Care Government Hospital, Chennai. The data obtained for the study are IQC - coefficient of variation percentage and External Quality Assurance Scheme (EQAS) - Bias% for 16 biochemical parameters. For the level 1 IQC, four analytes (alkaline phosphatase, magnesium, triglyceride, and high-density lipoprotein-cholesterol) showed an ideal performance of ≥6 sigma level, five analytes (urea, total bilirubin, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level and for level 2 IQCs, same four analytes of level 1 showed a performance of ≥6 sigma level, and four analytes (urea, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level. For all analytes <6 sigma level, the quality goal index (QGI) was <0.8 indicating the area requiring improvement to be imprecision except cholesterol whose QGI >1.2 indicated inaccuracy. This study shows that sigma metrics is a good quality tool to assess the analytical performance of a clinical chemistry laboratory. Thus, sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the efficiency of existing laboratory processes.

Aging and Concurrent Task Performance: Cognitive Demand and Motor Control

ERIC Educational Resources Information Center

Albinet, Cedric; Tomporowski, Phillip D.; Beasman, Kathryn

2006-01-01

A motor task that requires fine control of upper limb movements and a cognitive task that requires executive processing--first performing them separately and then concurrently--was performed by 18 young and 18 older adults. The motor task required participants to tap alternatively on two targets, the sizes of which varied systematically. The…

Modeling Task Switching without Switching Tasks: A Short-Term Priming Account of Explicitly Cued Performance

ERIC Educational Resources Information Center

Schneider, Darryl W.; Logan, Gordon D.

2005-01-01

Switch costs in task switching are commonly attributed to an executive control process of task-set reconfiguration, particularly in studies involving the explicit task-cuing procedure. The authors propose an alternative account of explicitly cued performance that is based on 2 mechanisms: priming of cue encoding from residual activation of cues in…

Is performance in task-cuing experiments mediated by task set selection or associative compound retrieval?

PubMed

Forrest, Charlotte L D; Monsell, Stephen; McLaren, Ian P L

2014-07-01

Task-cuing experiments are usually intended to explore control of task set. But when small stimulus sets are used, they plausibly afford learning of the response associated with a combination of cue and stimulus, without reference to tasks. In 3 experiments we presented the typical trials of a task-cuing experiment: a cue (colored shape) followed, after a short or long interval, by a digit to which 1 of 2 responses was required. In a tasks condition, participants were (as usual) directed to interpret the cue as an instruction to perform either an odd/even or a high/low classification task. In a cue + stimulus → response (CSR) condition, to induce learning of mappings between cue-stimulus compound and response, participants were, in Experiment 1, given standard task instructions and additionally encouraged to learn the CSR mappings; in Experiment 2, informed of all the CSR mappings and asked to learn them, without standard task instructions; in Experiment 3, required to learn the mappings by trial and error. The effects of a task switch, response congruence, preparation, and transfer to a new set of stimuli differed substantially between the conditions in ways indicative of classification according to task rules in the tasks condition, and retrieval of responses specific to stimulus-cue combinations in the CSR conditions. Qualitative features of the latter could be captured by an associative learning network. Hence associatively based compound retrieval can serve as the basis for performance with a small stimulus set. But when organization by tasks is apparent, control via task set selection is the natural and efficient strategy. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Performance-based workload assessment: Allocation strategy and added task sensitivity

NASA Technical Reports Server (NTRS)

Vidulich, Michael A.

1990-01-01

The preliminary results of a research program investigating the use of added tasks to evaluate mental workload are reviewed. The focus of the first studies was a reappraisal of the traditional secondary task logic that encouraged the use of low-priority instructions for the added task. It was believed that such low-priority tasks would encourage subjects to split their available resources among the two tasks. The primary task would be assigned all the resources it needed, and any remaining reserve capacity would be assigned to the secondary task. If the model were correct, this approach was expected to combine sensitivity to primary task difficulty with unintrusiveness to primary task performance. The first studies of the current project demonstrated that a high-priority added task, although intrusive, could be more sensitive than the traditional low-priority secondary task. These results suggested that a more appropriate model of the attentional effects associated with added task performance might be based on capacity switching, rather than the traditional optimal allocation model.

Accommodation in Astigmatic Children During Visual Task Performance

PubMed Central

Harvey, Erin M.; Miller, Joseph M.; Apple, Howard P.; Parashar, Pavan; Twelker, J. Daniel; Crescioni, Mabel; Davis, Amy L.; Leonard-Green, Tina K.; Campus, Irene; Sherrill, Duane L.

2014-01-01

Purpose. To determine the accuracy and stability of accommodation in uncorrected children during visual task performance. Methods. Subjects were second- to seventh-grade children from a highly astigmatic population. Measurements of noncycloplegic right eye spherical equivalent (Mnc) were obtained while uncorrected subjects performed three visual tasks at near (40 cm) and distance (2 m). Tasks included reading sentences with stimulus letter size near acuity threshold and an age-appropriate letter size (high task demands) and viewing a video (low task demand). Repeated measures ANOVA assessed the influence of astigmatism, task demand, and accommodative demand on accuracy (mean Mnc) and variability (mean SD of Mnc) of accommodation. Results. For near and distance analyses, respectively, sample size was 321 and 247, mean age was 10.37 (SD 1.77) and 10.30 (SD 1.74) years, mean cycloplegic M was 0.48 (SD 1.10) and 0.79 diopters (D) (SD 1.00), and mean astigmatism was 0.99 (SD 1.15) and 0.75 D (SD 0.96). Poor accommodative accuracy was associated with high astigmatism, low task demand (video viewing), and high accommodative demand. The negative effect of accommodative demand on accuracy increased with increasing astigmatism, with the poorest accommodative accuracy observed in high astigmats (≥3.00 D) with high accommodative demand/high hyperopia (1.53 D and 2.05 D of underaccommodation for near and distant stimuli, respectively). Accommodative variability was greatest in high astigmats and was uniformly high across task condition. No/low and moderate astigmats showed higher variability for the video task than the reading tasks. Conclusions. Accuracy of accommodation is reduced in uncorrected children with high astigmatism and high accommodative demand/high hyperopia, but improves with increased visual task demand (reading). High astigmats showed the greatest variability in accommodation. PMID:25103265

Software Quality Assurance Metrics

NASA Technical Reports Server (NTRS)

McRae, Kalindra A.

2004-01-01

Software Quality Assurance (SQA) is a planned and systematic set of activities that ensures conformance of software life cycle processes and products conform to requirements, standards and procedures. In software development, software quality means meeting requirements and a degree of excellence and refinement of a project or product. Software Quality is a set of attributes of a software product by which its quality is described and evaluated. The set of attributes includes functionality, reliability, usability, efficiency, maintainability, and portability. Software Metrics help us understand the technical process that is used to develop a product. The process is measured to improve it and the product is measured to increase quality throughout the life cycle of software. Software Metrics are measurements of the quality of software. Software is measured to indicate the quality of the product, to assess the productivity of the people who produce the product, to assess the benefits derived from new software engineering methods and tools, to form a baseline for estimation, and to help justify requests for new tools or additional training. Any part of the software development can be measured. If Software Metrics are implemented in software development, it can save time, money, and allow the organization to identify the caused of defects which have the greatest effect on software development. The summer of 2004, I worked with Cynthia Calhoun and Frank Robinson in the Software Assurance/Risk Management department. My task was to research and collect, compile, and analyze SQA Metrics that have been used in other projects that are not currently being used by the SA team and report them to the Software Assurance team to see if any metrics can be implemented in their software assurance life cycle process.

Is a Responsive Default Mode Network Required for Successful Working Memory Task Performance?

PubMed Central

Čeko, Marta; Gracely, John L.; Fitzcharles, Mary-Ann; Seminowicz, David A.; Schweinhardt, Petra

2015-01-01

In studies of cognitive processing using tasks with externally directed attention, regions showing increased (external-task-positive) and decreased or “negative” [default-mode network (DMN)] fMRI responses during task performance are dynamically responsive to increasing task difficulty. Responsiveness (modulation of fMRI signal by increasing load) has been linked directly to successful cognitive task performance in external-task-positive regions but not in DMN regions. To investigate whether a responsive DMN is required for successful cognitive performance, we compared healthy human subjects (n = 23) with individuals shown to have decreased DMN engagement (chronic pain patients, n = 28). Subjects performed a multilevel working-memory task (N-back) during fMRI. If a responsive DMN is required for successful performance, patients having reduced DMN responsiveness should show worsened performance; if performance is not reduced, their brains should show compensatory activation in external-task-positive regions or elsewhere. All subjects showed decreased accuracy and increased reaction times with increasing task level, with no significant group differences on either measure at any level. Patients had significantly reduced negative fMRI response (deactivation) of DMN regions (posterior cingulate/precuneus, medial prefrontal cortex). Controls showed expected modulation of DMN deactivation with increasing task difficulty. Patients showed significantly reduced modulation of DMN deactivation by task difficulty, despite their successful task performance. We found no evidence of compensatory neural recruitment in external-task-positive regions or elsewhere. Individual responsiveness of the external-task-positive ventrolateral prefrontal cortex, but not of DMN regions, correlated with task accuracy. These findings suggest that a responsive DMN may not be required for successful cognitive performance; a responsive external-task-positive network may be sufficient

The Effects of Self-Esteem and Task Perception on Goal Setting, Efficacy, and Task Performance.

ERIC Educational Resources Information Center

Tang, Thomas Li-Ping; Reynolds, David Bryan

This study examined the effects of self-esteem and task perception on goal setting, efficacy, and task performance in 52 recreational dart throwers who were members of two dart organizations. Task perception was manipulated by asking each dart thrower to compete against self, a difficult competitor, and an easy competitor on the same dart game.…

How age affects memory task performance in clinically normal hearing persons.

PubMed

Vercammen, Charlotte; Goossens, Tine; Wouters, Jan; van Wieringen, Astrid

2017-05-01

The main objective of this study is to investigate memory task performance in different age groups, irrespective of hearing status. Data are collected on a short-term memory task (WAIS-III Digit Span forward) and two working memory tasks (WAIS-III Digit Span backward and the Reading Span Test). The tasks are administered to young (20-30 years, n = 56), middle-aged (50-60 years, n = 47), and older participants (70-80 years, n = 16) with normal hearing thresholds. All participants have passed a cognitive screening task (Montreal Cognitive Assessment (MoCA)). Young participants perform significantly better than middle-aged participants, while middle-aged and older participants perform similarly on the three memory tasks. Our data show that older clinically normal hearing persons perform equally well on the memory tasks as middle-aged persons. However, even under optimal conditions of preserved sensory processing, changes in memory performance occur. Based on our data, these changes set in before middle age.

Are factors related to dual-task performance in people with Parkinson's disease dependent on the type of dual task?

PubMed

Strouwen, Carolien; Molenaar, Esther A L M; Keus, Samyra H J; Münks, Liesbeth; Heremans, Elke; Vandenberghe, Wim; Bloem, Bastiaan R; Nieuwboer, Alice

2016-02-01

Impaired dual-task performance significantly impacts upon functional mobility in people with Parkinson's disease (PD). The aim of this study was to identify determinants of dual-task performance in people with PD in three different dual tasks to assess their possible task-dependency. We recruited 121 home-dwelling patients with PD (mean age 65.93 years; mean disease duration 8.67 years) whom we subjected to regular walking (control condition) and to three dual-task conditions: walking combined with a backwards Digit Span task, an auditory Stroop task and a Mobile Phone task. We measured dual-task gait velocity using the GAITRite mat and dual-task reaction times and errors on the concurrent tasks as outcomes. Motor, cognitive and descriptive variables which correlated to dual-task performance (p < 0.20) were entered into a stepwise forward multiple linear regression model. Single-task gait velocity and executive function, tested by the alternating intake test, was significantly associated with gait velocity during the Digit Span (R(2) = 0.65; p < 0.001), the Stroop (R(2) = 0.73; p < 0.001) and the Mobile Phone task (R(2) = 0.62; p < 0.001). In addition, disease severity proved correlated to gait velocity during the Stroop task. Age was a surplus determinant of gait velocity while using a mobile phone. Single-task gait velocity and executive function as measured by a verbal fluency switching task were independent determinants of dual-task gait performance in people with PD. In contrast to expectation, these factors were the same across different tasks, supporting the robustness of the findings. Future study needs to determine whether these factors predict dual-task abnormalities prospectively. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development of task network models of human performance in microgravity

NASA Technical Reports Server (NTRS)

Diaz, Manuel F.; Adam, Susan

1992-01-01

This paper discusses the utility of task-network modeling for quantifying human performance variability in microgravity. The data are gathered for: (1) improving current methodologies for assessing human performance and workload in the operational space environment; (2) developing tools for assessing alternative system designs; and (3) developing an integrated set of methodologies for the evaluation of performance degradation during extended duration spaceflight. The evaluation entailed an analysis of the Remote Manipulator System payload-grapple task performed on many shuttle missions. Task-network modeling can be used as a tool for assessing and enhancing human performance in man-machine systems, particularly for modeling long-duration manned spaceflight. Task-network modeling can be directed toward improving system efficiency by increasing the understanding of basic capabilities of the human component in the system and the factors that influence these capabilities.

Selecting Tasks for Evaluating Human Performance as a Function of Gravity

NASA Technical Reports Server (NTRS)

Norcross, J. R.; Gernhardt, M. L.

2010-01-01

A challenge in understanding human performance as a function of gravity is determining which tasks to research. Initial studies began with treadmill walking, which was easy to quantify and control. However, with the development of pressurized rovers, it is less important to optimize human performance for ambulation as rovers will likely perform gross translation for them. Future crews are likely to spend much of their extravehicular activity (EVA) performing geology, construction and maintenance type tasks, for which it is difficult to measure steady-state-workloads. To evaluate human performance in reduced gravity, we have collected metabolic, biomechanical and subjective data for different tasks at varied gravity levels. Methods: Ten subjects completed 5 different tasks including weight transfer, shoveling, treadmill walking, treadmill running and treadmill incline walking. All tasks were performed shirt-sleeved at 1-g, 3/8-g and 1/6-g. Off-loaded conditions were achieved via the Active Response Gravity Offload System. Treadmill tasks were performed for 3 minutes with reported oxygen consumption (VO2) averaged over the last 2 minutes. Shoveling was performed for 3 minutes with metabolic cost reported as ml O2 consumed per kg material shoveled. Weight transfer reports metabolic cost as liters O2 consumed to complete the task. Statistical analysis was performed via repeated measures ANOVA. Results: Statistically significant metabolic differences were noted between all 3 gravity levels for treadmill running and incline walking. For the other 3 tasks, there were significant differences between 1-g and each reduced gravity, but not between 1/6-g and 3/8-g. For weight transfer, significant differences were seen between gravities in both trial-average VO2 and time-to-completion with noted differences in strategy for task completion. Conclusion: To determine if gravity has a metabolic effect on human performance, this research may indicate that tasks should be selected

Critical thinking skills in nursing students: comparison of simulation-based performance with metrics.

PubMed

Fero, Laura J; O'Donnell, John M; Zullo, Thomas G; Dabbs, Annette DeVito; Kitutu, Julius; Samosky, Joseph T; Hoffman, Leslie A

2010-10-01

This paper is a report of an examination of the relationship between metrics of critical thinking skills and performance in simulated clinical scenarios. Paper and pencil assessments are commonly used to assess critical thinking but may not reflect simulated performance. In 2007, a convenience sample of 36 nursing students participated in measurement of critical thinking skills and simulation-based performance using videotaped vignettes, high-fidelity human simulation, the California Critical Thinking Disposition Inventory and California Critical Thinking Skills Test. Simulation-based performance was rated as 'meeting' or 'not meeting' overall expectations. Test scores were categorized as strong, average, or weak. Most (75.0%) students did not meet overall performance expectations using videotaped vignettes or high-fidelity human simulation; most difficulty related to problem recognition and reporting findings to the physician. There was no difference between overall performance based on method of assessment (P = 0.277). More students met subcategory expectations for initiating nursing interventions (P ≤ 0.001) using high-fidelity human simulation. The relationship between videotaped vignette performance and critical thinking disposition or skills scores was not statistically significant, except for problem recognition and overall critical thinking skills scores (Cramer's V = 0.444, P = 0.029). There was a statistically significant relationship between overall high-fidelity human simulation performance and overall critical thinking disposition scores (Cramer's V = 0.413, P = 0.047). Students' performance reflected difficulty meeting expectations in simulated clinical scenarios. High-fidelity human simulation performance appeared to approximate scores on metrics of critical thinking best. Further research is needed to determine if simulation-based performance correlates with critical thinking skills in the clinical setting. © 2010 The Authors. Journal of Advanced

Critical thinking skills in nursing students: comparison of simulation-based performance with metrics

PubMed Central

Fero, Laura J.; O’Donnell, John M.; Zullo, Thomas G.; Dabbs, Annette DeVito; Kitutu, Julius; Samosky, Joseph T.; Hoffman, Leslie A.

2018-01-01

Aim This paper is a report of an examination of the relationship between metrics of critical thinking skills and performance in simulated clinical scenarios. Background Paper and pencil assessments are commonly used to assess critical thinking but may not reflect simulated performance. Methods In 2007, a convenience sample of 36 nursing students participated in measurement of critical thinking skills and simulation-based performance using videotaped vignettes, high-fidelity human simulation, the California Critical Thinking Disposition Inventory and California Critical Thinking Skills Test. Simulation- based performance was rated as ‘meeting’ or ‘not meeting’ overall expectations. Test scores were categorized as strong, average, or weak. Results Most (75·0%) students did not meet overall performance expectations using videotaped vignettes or high-fidelity human simulation; most difficulty related to problem recognition and reporting findings to the physician. There was no difference between overall performance based on method of assessment (P = 0·277). More students met subcategory expectations for initiating nursing interventions (P ≤ 0·001) using high-fidelity human simulation. The relationship between video-taped vignette performance and critical thinking disposition or skills scores was not statistically significant, except for problem recognition and overall critical thinking skills scores (Cramer’s V = 0·444, P = 0·029). There was a statistically significant relationship between overall high-fidelity human simulation performance and overall critical thinking disposition scores (Cramer’s V = 0·413, P = 0·047). Conclusion Students’ performance reflected difficulty meeting expectations in simulated clinical scenarios. High-fidelity human simulation performance appeared to approximate scores on metrics of critical thinking best. Further research is needed to determine if simulation-based performance correlates with critical thinking skills

Gray matter volume and dual-task gait performance in mild cognitive impairment

PubMed Central

Blumen, Helena M.; Verghese, Joe; Shimada, Hiroyuki; Makizako, Hyuma; Tsutsumimoto, Kota; Hotta, Ryo; Nakakubo, Sho; Suzuki, Takao

2017-01-01

Dual-task gait performance is impaired in older adults with mild cognitive impairment, but the brain substrates associated with dual-task gait performance are not well-established. The relationship between gray matter and gait speed under single-task and dual-task conditions (walking while counting backward) was examined in 560 seniors with mild cognitive impairment (non-amnestic mild cognitive impairment: n = 270; mean age = 72.4 yrs., 63.6 % women; amnestic mild cognitive impairment: n = 290; mean age = 73.4 yrs., 45.4 % women). Multivariate covariance-based analyses of magnetic resonance imaging data, adjusted for potential confounders including single-task gait speed, were performed to identify gray matter patterns associated with dual-task gait speed. There were no differences in gait speed or cognitive performance during dual-task gait between individuals with non-amnestic mild cognitive impairment and amnestic mild cognitive impairment. Overall, increased dual-task gait speed was associated with a gray matter pattern of increased volume in medial frontal gyrus, superior frontal gyrus, anterior cingulate, cingulate, precuneus, fusiform gyrus, middle occipital gyrus, inferior temporal gyrus and middle temporal gyrus. The relationship between dual-task gait speed and brain substrates also differed by mild cognitive impairment subtype. Our study revealed a pattern of gray matter regions associated with dual-task performance. Although dual-task gait performance was similar in amnestic and non-amnestic mild cognitive impairment, the gray matter patterns associated with dual-task gait performance differed by mild cognitive impairment subtype. These findings suggest that the brain substrates supporting dual-task gait performance in amnestic and non-amnestic subtypes are different, and consequently may respond differently to interventions, or require different interventions. PMID:27392792

Motor-cognitive dual-task performance: effects of a concurrent motor task on distinct components of visual processing capacity.

PubMed

Künstler, E C S; Finke, K; Günther, A; Klingner, C; Witte, O; Bublak, P

2018-01-01

Dual tasking, or the simultaneous execution of two continuous tasks, is frequently associated with a performance decline that can be explained within a capacity sharing framework. In this study, we assessed the effects of a concurrent motor task on the efficiency of visual information uptake based on the 'theory of visual attention' (TVA). TVA provides parameter estimates reflecting distinct components of visual processing capacity: perceptual threshold, visual processing speed, and visual short-term memory (VSTM) storage capacity. Moreover, goodness-of-fit values and bootstrapping estimates were derived to test whether the TVA-model is validly applicable also under dual task conditions, and whether the robustness of parameter estimates is comparable in single- and dual-task conditions. 24 subjects of middle to higher age performed a continuous tapping task, and a visual processing task (whole report of briefly presented letter arrays) under both single- and dual-task conditions. Results suggest a decline of both visual processing capacity and VSTM storage capacity under dual-task conditions, while the perceptual threshold remained unaffected by a concurrent motor task. In addition, goodness-of-fit values and bootstrapping estimates support the notion that participants processed the visual task in a qualitatively comparable, although quantitatively less efficient way under dual-task conditions. The results support a capacity sharing account of motor-cognitive dual tasking and suggest that even performing a relatively simple motor task relies on central attentional capacity that is necessary for efficient visual information uptake.

Investigation of Two Models to Set and Evaluate Quality Targets for HbA1c: Biological Variation and Sigma-metrics

PubMed Central

Weykamp, Cas; John, Garry; Gillery, Philippe; English, Emma; Ji, Linong; Lenters-Westra, Erna; Little, Randie R.; Roglic, Gojka; Sacks, David B.; Takei, Izumi

2016-01-01

Background A major objective of the IFCC Task Force on implementation of HbA1c standardization is to develop a model to define quality targets for HbA1c. Methods Two generic models, the Biological Variation and Sigma-metrics model, are investigated. Variables in the models were selected for HbA1c and data of EQA/PT programs were used to evaluate the suitability of the models to set and evaluate quality targets within and between laboratories. Results In the biological variation model 48% of individual laboratories and none of the 26 instrument groups met the minimum performance criterion. In the Sigma-metrics model, with a total allowable error (TAE) set at 5 mmol/mol (0.46% NGSP) 77% of the individual laboratories and 12 of 26 instrument groups met the 2 sigma criterion. Conclusion The Biological Variation and Sigma-metrics model were demonstrated to be suitable for setting and evaluating quality targets within and between laboratories. The Sigma-metrics model is more flexible as both the TAE and the risk of failure can be adjusted to requirements related to e.g. use for diagnosis/monitoring or requirements of (inter)national authorities. With the aim of reaching international consensus on advice regarding quality targets for HbA1c, the Task Force suggests the Sigma-metrics model as the model of choice with default values of 5 mmol/mol (0.46%) for TAE, and risk levels of 2 and 4 sigma for routine laboratories and laboratories performing clinical trials, respectively. These goals should serve as a starting point for discussion with international stakeholders in the field of diabetes. PMID:25737535

Continuous performance task in ADHD: Is reaction time variability a key measure?

PubMed

Levy, Florence; Pipingas, Andrew; Harris, Elizabeth V; Farrow, Maree; Silberstein, Richard B

2018-01-01

To compare the use of the Continuous Performance Task (CPT) reaction time variability (intraindividual variability or standard deviation of reaction time), as a measure of vigilance in attention-deficit hyperactivity disorder (ADHD), and stimulant medication response, utilizing a simple CPT X-task vs an A-X-task. Comparative analyses of two separate X-task vs A-X-task data sets, and subgroup analyses of performance on and off medication were conducted. The CPT X-task reaction time variability had a direct relationship to ADHD clinician severity ratings, unlike the CPT A-X-task. Variability in X-task performance was reduced by medication compared with the children's unmedicated performance, but this effect did not reach significance. When the coefficient of variation was applied, severity measures and medication response were significant for the X-task, but not for the A-X-task. The CPT-X-task is a useful clinical screening test for ADHD and medication response. In particular, reaction time variability is related to default mode interference. The A-X-task is less useful in this regard.

Benchmarking the performance of fixed-image receptor digital radiography systems. Part 2: system performance metric.

PubMed

Lee, Kam L; Bernardo, Michael; Ireland, Timothy A

2016-06-01

This is part two of a two-part study in benchmarking system performance of fixed digital radiographic systems. The study compares the system performance of seven fixed digital radiography systems based on quantitative metrics like modulation transfer function (sMTF), normalised noise power spectrum (sNNPS), detective quantum efficiency (sDQE) and entrance surface air kerma (ESAK). It was found that the most efficient image receptors (greatest sDQE) were not necessarily operating at the lowest ESAK. In part one of this study, sMTF is shown to depend on system configuration while sNNPS is shown to be relatively consistent across systems. Systems are ranked on their signal-to-noise ratio efficiency (sDQE) and their ESAK. Systems using the same equipment configuration do not necessarily have the same system performance. This implies radiographic practice at the site will have an impact on the overall system performance. In general, systems are more dose efficient at low dose settings.

How task demands influence scanpath similarity in a sequential number-search task.

PubMed

Dewhurst, Richard; Foulsham, Tom; Jarodzka, Halszka; Johansson, Roger; Holmqvist, Kenneth; Nyström, Marcus

2018-06-07

More and more researchers are considering the omnibus eye movement sequence-the scanpath-in their studies of visual and cognitive processing (e.g. Hayes, Petrov, & Sederberg, 2011; Madsen, Larson, Loschky, & Rebello, 2012; Ni et al., 2011; von der Malsburg & Vasishth, 2011). However, it remains unclear how recent methods for comparing scanpaths perform in experiments producing variable scanpaths, and whether these methods supplement more traditional analyses of individual oculomotor statistics. We address this problem for MultiMatch (Jarodzka et al., 2010; Dewhurst et al., 2012), evaluating its performance with a visual search-like task in which participants must fixate a series of target numbers in a prescribed order. This task should produce predictable sequences of fixations and thus provide a testing ground for scanpath measures. Task difficulty was manipulated by making the targets more or less visible through changes in font and the presence of distractors or visual noise. These changes in task demands led to slower search and more fixations. Importantly, they also resulted in a reduction in the between-subjects scanpath similarity, demonstrating that participants' gaze patterns became more heterogenous in terms of saccade length and angle, and fixation position. This implies a divergent strategy or random component to eye-movement behaviour which increases as the task becomes more difficult. Interestingly, the duration of fixations along aligned vectors showed the opposite pattern, becoming more similar between observers in 2 of the 3 difficulty manipulations. This provides important information for vision scientists who may wish to use scanpath metrics to quantify variations in gaze across a spectrum of perceptual and cognitive tasks. Copyright © 2018 Elsevier Ltd. All rights reserved.

Is a Responsive Default Mode Network Required for Successful Working Memory Task Performance?

PubMed

Čeko, Marta; Gracely, John L; Fitzcharles, Mary-Ann; Seminowicz, David A; Schweinhardt, Petra; Bushnell, M Catherine

2015-08-19

In studies of cognitive processing using tasks with externally directed attention, regions showing increased (external-task-positive) and decreased or "negative" [default-mode network (DMN)] fMRI responses during task performance are dynamically responsive to increasing task difficulty. Responsiveness (modulation of fMRI signal by increasing load) has been linked directly to successful cognitive task performance in external-task-positive regions but not in DMN regions. To investigate whether a responsive DMN is required for successful cognitive performance, we compared healthy human subjects (n = 23) with individuals shown to have decreased DMN engagement (chronic pain patients, n = 28). Subjects performed a multilevel working-memory task (N-back) during fMRI. If a responsive DMN is required for successful performance, patients having reduced DMN responsiveness should show worsened performance; if performance is not reduced, their brains should show compensatory activation in external-task-positive regions or elsewhere. All subjects showed decreased accuracy and increased reaction times with increasing task level, with no significant group differences on either measure at any level. Patients had significantly reduced negative fMRI response (deactivation) of DMN regions (posterior cingulate/precuneus, medial prefrontal cortex). Controls showed expected modulation of DMN deactivation with increasing task difficulty. Patients showed significantly reduced modulation of DMN deactivation by task difficulty, despite their successful task performance. We found no evidence of compensatory neural recruitment in external-task-positive regions or elsewhere. Individual responsiveness of the external-task-positive ventrolateral prefrontal cortex, but not of DMN regions, correlated with task accuracy. These findings suggest that a responsive DMN may not be required for successful cognitive performance; a responsive external-task-positive network may be sufficient. We studied the

Gray matter volume and dual-task gait performance in mild cognitive impairment.

PubMed

Doi, Takehiko; Blumen, Helena M; Verghese, Joe; Shimada, Hiroyuki; Makizako, Hyuma; Tsutsumimoto, Kota; Hotta, Ryo; Nakakubo, Sho; Suzuki, Takao

2017-06-01

Dual-task gait performance is impaired in older adults with mild cognitive impairment, but the brain substrates associated with dual-task gait performance are not well-established. The relationship between gray matter and gait speed under single-task and dual-task conditions (walking while counting backward) was examined in 560 seniors with mild cognitive impairment (non-amnestic mild cognitive impairment: n = 270; mean age = 72.4 yrs., 63.6 % women; amnestic mild cognitive impairment: n = 290; mean age = 73.4 yrs., 45.4 % women). Multivariate covariance-based analyses of magnetic resonance imaging data, adjusted for potential confounders including single-task gait speed, were performed to identify gray matter patterns associated with dual-task gait speed. There were no differences in gait speed or cognitive performance during dual-task gait between individuals with non-amnestic mild cognitive impairment and amnestic mild cognitive impairment. Overall, increased dual-task gait speed was associated with a gray matter pattern of increased volume in medial frontal gyrus, superior frontal gyrus, anterior cingulate, cingulate, precuneus, fusiform gyrus, middle occipital gyrus, inferior temporal gyrus and middle temporal gyrus. The relationship between dual-task gait speed and brain substrates also differed by mild cognitive impairment subtype. Our study revealed a pattern of gray matter regions associated with dual-task performance. Although dual-task gait performance was similar in amnestic and non-amnestic mild cognitive impairment, the gray matter patterns associated with dual-task gait performance differed by mild cognitive impairment subtype. These findings suggest that the brain substrates supporting dual-task gait performance in amnestic and non-amnestic subtypes are different, and consequently may respond differently to interventions, or require different interventions.

Attention tasks as skills performance measures of drug effects.

PubMed

Moskowitz, H

1984-01-01

Both empirical epidemiological data on the causes of traffic accidents and conceptual models of skilled human performance stress the central role of perception and cognition. This paper examines the effects of drugs on two major components of cognitive perceptual performance, namely, concentrated attention or vigilance and divided attention. It is demonstrated that these two types of attention tasks are differentially affected by various drugs, so that sometimes one and sometimes another of these tasks is impaired. Various experimental paradigms to investigate these two attention functions are presented. It is demonstrated that attention tasks are frequently highly sensitive to drug effects, suggesting the importance of examining these functions when investigating the effects of drugs on skills performance.

Is Adaptation to Task Complexity Really Beneficial for Performance?

ERIC Educational Resources Information Center

Pieschl, Stephanie; Stahl, Elmar; Murray, Tom; Bromme, Rainer

2012-01-01

Theories of self-regulated learning assume that learners flexibly adapt their learning process to external task demands and that this is positively related to performance. In this study, university students (n = 119) solved three tasks that greatly differed in complexity. Their learning processes were captured in detail by task-specific…

An empirically derived figure of merit for the quality of overall task performance

NASA Technical Reports Server (NTRS)

Lemay, Moira

1989-01-01

The need to develop an operationally relevant figure of merit for the quality of performance of a complex system such as an aircraft cockpit stems from a hypothesized dissociation between measures of performance and those of workload. Performance can be measured in terms of time, errors, or a combination of these. In most tasks performed by expert operators, errors are relatively rare and often corrected in time to avoid consequences. Moreover, perfect performance is seldom necessary to accomplish a particular task. Moreover, how well an expert performs a complex task consisting of a series of discrete cognitive tasks superimposed on a continuous task, such as flying an aircraft, does not depend on how well each discrete task is performed, but on their smooth sequencing. This makes the amount of time spent on each subtask of paramount importance in measuring overall performance, since smooth sequencing requires a minimum amount of time spent on each task. Quality consists in getting tasks done within a crucial time interval while maintaining acceptable continuous task performance. Thus, a figure of merit for overall quality of performance should be primarily a measure of time to perform discrete subtasks combined with a measure of basic vehicle control. Thus, the proposed figure of merit requires doing a task analysis on a series of performance, or runs, of a particular task, listing each discrete task and its associated time, and calculating the mean and standard deviation of these times, along with the mean and standard deviation of tracking error for the whole task. A set of simulator data on 30 runs of a landing task was obtained and a figure of merit will be calculated for each run. The figure of merit will be compared for voice and data link, so that the impact of this technology on total crew performance (not just communication performance) can be assessed. The effect of data link communication on other cockpit tasks will also be considered.

Can tutoring improve performance on a reasoning task under deadline conditions?

PubMed

Osman, Magda

2007-03-01

The present study examined the effectiveness of a tutoring technique that has been used to identify and address participants' misunderstandings in Wason's selection task. In particular, the study investigated whether the technique would lead to improvements in performance when the task was presented in a deadline format (a condition in which time restrictions are imposed). In Experiment 1, the effects of tutoring on performance were compared in free time (conditions in which no time restrictions are imposed) and deadline task formats. In Experiment 2, improvements in performance were studied in deadline task formats, in which the tutoring and test phases were separated by an interval of 1 day. The results suggested that tutoring improved performance on the selection task under deadline and in free time conditions. Additionally, the study showed that participants made errors because they had misinterpreted the task. With tutoring, they were able to modify their initial misunderstandings.

Making the Case for Objective Performance Metrics in Newborn Screening by Tandem Mass Spectrometry

ERIC Educational Resources Information Center

Rinaldo, Piero; Zafari, Saba; Tortorelli, Silvia; Matern, Dietrich

2006-01-01

The expansion of newborn screening programs to include multiplex testing by tandem mass spectrometry requires understanding and close monitoring of performance metrics. This is not done consistently because of lack of defined targets, and interlaboratory comparison is almost nonexistent. Between July 2004 and April 2006 (N = 176,185 cases), the…

Applying Sigma Metrics to Reduce Outliers.

PubMed

Litten, Joseph

2017-03-01

Sigma metrics can be used to predict assay quality, allowing easy comparison of instrument quality and predicting which tests will require minimal quality control (QC) rules to monitor the performance of the method. A Six Sigma QC program can result in fewer controls and fewer QC failures for methods with a sigma metric of 5 or better. The higher the number of methods with a sigma metric of 5 or better, the lower the costs for reagents, supplies, and control material required to monitor the performance of the methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Selective impairment of masked priming in dual-task performance.

PubMed

Fischer, Rico; Kiesel, Andrea; Kunde, Wilfried; Schubert, Torsten

2011-03-01

This study investigated the impact of divided attention on masked priming. In a dual-task setting, two tasks had to be carried out in close temporal succession: a tone discrimination task and a masked priming task. The order of the tasks was varied between experiments, and attention was always allocated to the first task-that is, the first task was prioritized. The priming task was the second (nonprioritized) task in Experiment 1 and the first (prioritized) task in Experiment 2. In both experiments, "novel" prime stimuli associated with semantic processing were essentially ineffective. However, there was intact priming by another type of prime stimuli associated with response priming. Experiment 3 showed that all these prime stimuli can reveal significant priming effects during a task-switching paradigm in which both tasks were performed consecutively. We conclude that dual-task specific interference processes (e.g., the simultaneous coordination of multiple stimulus-response rules) selectively impair priming that is assumed to rely on semantic processing.

Children's difficulty with true belief tasks: Competence deficit or performance problem?

PubMed

Oktay-Gür, Nese; Rakoczy, Hannes

2017-09-01

According to the standard picture of explicit theory of mind (ToM) development, children begin to (explicitly) ascribe beliefs to others and themselves from around age 4. The empirical basis of this picture comes from numerous studies consistently showing that children master verbal false belief (FB) tasks from around age 4 while children much younger have no difficulty in mastering structurally analogous true belief (TB) tasks. The standard picture, though, has come under serious attack from recent studies using TB tasks with wider age ranges. These studies have found that, paradoxically, children begin to fail TB tasks once they master FB tasks. Such findings cast doubt on the standard picture and suggest, instead, that FB tasks may be solved by much simpler strategies than proper belief reasoning. In the present study, we tested for the development of FB and TB performance in comprehensive and systematic ways. In particular, we tested the competing predictions of competence accounts (according to which TB failure reflects lack of conceptual competence) versus performance limitation accounts (according to which the standard picture is true yet children from around age 4 fail TB tasks due to performance factors). Studies 1 and 2 showed that performance in a variety of novel TB tasks showed a clear U-shaped curve, with children until age 3 and from age 10 performing competently and children in between failing, with strong negative correlations between TB and FB. Crucially, these patterns were found for various kinds of TB tasks, including those for which existing competence limitation accounts would not even predict any difficulty. Study 3, therefore, directly tested performance limitation accounts in terms of pragmatic and related factors and found that these patterns (failure in TB and negative TB-FB correlations) disappear once the relevant performance factors have been removed from the TB tasks. Taken together, these findings suggest that previous TB findings

Circadian Effects on Simple Components of Complex Task Performance

NASA Technical Reports Server (NTRS)

Clegg, Benjamin A.; Wickens, Christopher D.; Vieane, Alex Z.; Gutzwiller, Robert S.; Sebok, Angelia L.

2015-01-01

The goal of this study was to advance understanding and prediction of the impact of circadian rhythm on aspects of complex task performance during unexpected automation failures, and subsequent fault management. Participants trained on two tasks: a process control simulation, featuring automated support; and a multi-tasking platform. Participants then completed one task in a very early morning (circadian night) session, and the other during a late afternoon (circadian day) session. Small effects of time of day were seen on simple components of task performance, but impacts on more demanding components, such as those that occur following an automation failure, were muted relative to previous studies where circadian rhythm was compounded with sleep deprivation and fatigue. Circadian low participants engaged in compensatory strategies, rather than passively monitoring the automation. The findings and implications are discussed in the context of a model that includes the effects of sleep and fatigue factors.

Deep Thinking Increases Task-Set Shielding and Reduces Shifting Flexibility in Dual-Task Performance

ERIC Educational Resources Information Center

Fischer, Rico; Hommel, Bernhard

2012-01-01

Performing two tasks concurrently is difficult, which has been taken to imply the existence of a structural processing bottleneck. Here we sought to assess whether and to what degree one's multitasking abilities depend on the cognitive-control style one engages in. Participants were primed with creativity tasks that either called for divergent…

Functional Task Test: 1. Sensorimotor changes Associated with Postflight Alterations in Astronaut Functional Task Performance

NASA Technical Reports Server (NTRS)

Bloomberg, J. J.; Arzeno, N. H.; Buxton, R. E.; Feiveson, A. H.; Kofman, I. S.; Lee, S. M. C.; Miller, C. A.; Mulavara, A. P.; Platts, S. H.; Peters, B. T.;

Children's mathematical performance: five cognitive tasks across five grades.

PubMed

Moore, Alex M; Ashcraft, Mark H

2015-07-01

Children in elementary school, along with college adults, were tested on a battery of basic mathematical tasks, including digit naming, number comparison, dot enumeration, and simple addition or subtraction. Beyond cataloguing performance to these standard tasks in Grades 1 to 5, we also examined relationships among the tasks, including previously reported results on a number line estimation task. Accuracy and latency improved across grades for all tasks, and classic interaction patterns were found, for example, a speed-up of subitizing and counting, increasingly shallow slopes in number comparison, and progressive speeding of responses especially to larger addition and subtraction problems. Surprisingly, digit naming was faster than subitizing at all ages, arguing against a pre-attentive processing explanation for subitizing. Estimation accuracy and speed were strong predictors of children's addition and subtraction performance. Children who gave exponential responses on the number line estimation task were slower at counting in the dot enumeration task and had longer latencies on addition and subtraction problems. The results provided further support for the importance of estimation as an indicator of children's current and future mathematical expertise. Copyright © 2015 Elsevier Inc. All rights reserved.

Do Your Students Measure Up Metrically?

ERIC Educational Resources Information Center

Taylor, P. Mark; Simms, Ken; Kim, Ok-Kyeong; Reys, Robert E.

2001-01-01

Examines released metric items from the Third International Mathematics and Science Study (TIMSS) and the 3rd and 4th grade results. Recommends refocusing instruction on the metric system to improve student performance in measurement. (KHR)

Testing the Limits of Optimizing Dual-Task Performance in Younger and Older Adults

PubMed Central

Strobach, Tilo; Frensch, Peter; Müller, Herrmann Josef; Schubert, Torsten

2012-01-01

Impaired dual-task performance in younger and older adults can be improved with practice. Optimal conditions even allow for a (near) elimination of this impairment in younger adults. However, it is unknown whether such (near) elimination is the limit of performance improvements in older adults. The present study tests this limit in older adults under conditions of (a) a high amount of dual-task training and (b) training with simplified component tasks in dual-task situations. The data showed that a high amount of dual-task training in older adults provided no evidence for an improvement of dual-task performance to the optimal dual-task performance level achieved by younger adults. However, training with simplified component tasks in dual-task situations exclusively in older adults provided a similar level of optimal dual-task performance in both age groups. Therefore through applying a testing the limits approach, we demonstrated that older adults improved dual-task performance to the same level as younger adults at the end of training under very specific conditions. PMID:22408613

Context-Sensitive Adjustment of Cognitive Control in Dual-Task Performance

ERIC Educational Resources Information Center

Fischer, Rico; Gottschalk, Caroline; Dreisbach, Gesine

2014-01-01

Performing 2 highly similar tasks at the same time requires an adaptive regulation of cognitive control to shield prioritized primary task processing from between-task (cross-talk) interference caused by secondary task processing. In the present study, the authors investigated how implicitly and explicitly delivered information promotes the…

Patterns of Hospital Performance on the Hospital-Wide 30-Day Readmission Metric: Is the Playing Field Level?

PubMed

Hoyer, Erik H; Padula, William V; Brotman, Daniel J; Reid, Natalie; Leung, Curtis; Lepley, Diane; Deutschendorf, Amy

2018-01-01

Hospital performance on the 30-day hospital-wide readmission (HWR) metric as calculated by the Centers for Medicare and Medicaid Services (CMS) is currently reported as a quality measure. Focusing on patient-level factors may provide an incomplete picture of readmission risk at the hospital level to explain variations in hospital readmission rates. To evaluate and quantify hospital-level characteristics that track with hospital performance on the current HWR metric. Retrospective cohort study. A total of 4785 US hospitals. We linked publically available data on individual hospitals published by CMS on patient-level adjusted 30-day HWR rates from July 1, 2011, through June 30, 2014, to the 2014 American Hospital Association annual survey. Primary outcome was performance in the worst CMS-calculated HWR quartile. Primary hospital-level exposure variables were defined as: size (total number of beds), safety net status (top quartile of disproportionate share), academic status [member of the Association of American Medical Colleges (AAMC)], National Cancer Institute Comprehensive Cancer Center (NCI-CCC) status, and hospital services offered (e.g., transplant, hospice, emergency department). Multilevel regression was used to evaluate the association between 30-day HWR and the hospital-level factors. Hospital-level characteristics significantly associated with performing in the worst CMS-calculated HWR quartile included: safety net status [adjusted odds ratio (aOR) 1.99, 95% confidence interval (95% CI) 1.61-2.45, p < 0.001], large size (> 400 beds, aOR 1.42, 95% CI 1.07-1.90, p = 0.016), AAMC alone status (aOR 1.95, 95% CI 1.35-2.83, p < 0.001), and AAMC plus NCI-CCC status (aOR 5.16, 95% CI 2.58-10.31, p < 0.001). Hospitals with more critical care beds (aOR 1.26, 95% CI 1.02-1.56, p = 0.033), those with transplant services (aOR 2.80, 95% CI 1.48-5.31,p = 0.001), and those with emergency room services (aOR 3.37, 95% CI 1.12-10.15, p = 0.031) demonstrated

Method and Apparatus for Performance Optimization Through Physical Perturbation of Task Elements

NASA Technical Reports Server (NTRS)

Prinzel, Lawrence J., III (Inventor); Pope, Alan T. (Inventor); Palsson, Olafur S. (Inventor); Turner, Marsha J. (Inventor)

2016-01-01

The invention is an apparatus and method of biofeedback training for attaining a physiological state optimally consistent with the successful performance of a task, wherein the probability of successfully completing the task is made is inversely proportional to a physiological difference value, computed as the absolute value of the difference between at least one physiological signal optimally consistent with the successful performance of the task and at least one corresponding measured physiological signal of a trainee performing the task. The probability of successfully completing the task is made inversely proportional to the physiological difference value by making one or more measurable physical attributes of the environment in which the task is performed, and upon which completion of the task depends, vary in inverse proportion to the physiological difference value.

Performance Metrics in Professional Baseball Pitchers before and after Surgical Treatment for Neurogenic Thoracic Outlet Syndrome.

PubMed

Thompson, Robert W; Dawkins, Corey; Vemuri, Chandu; Mulholland, Michael W; Hadzinsky, Tyler D; Pearl, Gregory J

2017-02-01

High-performance throwing athletes may be susceptible to the development of neurogenic thoracic outlet syndrome (NTOS). This condition can be career-threatening but the outcomes of treatment for NTOS in elite athletes have not been well characterized. The purpose of this study was to utilize objective performance metrics to evaluate the impact of surgical treatment for NTOS in Major League Baseball (MLB) pitchers. Thirteen established MLB pitchers underwent operations for NTOS between July 2001 and July 2014. For those returning to MLB, traditional and advanced (PitchF/x) MLB performance metrics were acquired from public databases for various time-period scenarios before and after surgery, with comparisons made using paired t-tests, Wilcoxon matched-pair signed-rank tests, and Kruskal-Wallis analysis of variance. Ten of 13 pitchers (77%) achieved a sustained return to MLB, with a mean age of 30.2 ± 1.4 years at the time of surgery and 10.8 ± 1.5 months of postoperative rehabilitation before the return to MLB. Pre- and postoperative career data revealed no significant differences for 15 traditional pitching metrics, including earned run average (ERA), fielding independent pitching, walks plus hits per inning pitched (WHIP), walks per 9 innings, and strikeouts to walk ratio (SO/BB). There were also no significant differences between the 3 years before and the 3 years after surgical treatment. Using PitchF/x data for 72 advanced metrics and 25 different time-period scenarios, the highest number of significant relationships (n = 18) was observed for the 8 weeks before/12 weeks after scenario. In this analysis, 54 (75%) measures were unchanged (including ERA, WHIP, and SO/BB) and 14 (19%) were significantly improved, while only 4 (6%) were significantly decreased (including hard pitch maximal velocity 93.1 ± 1.0 vs. 92.5 ± 0.9 miles/hr, P = 0.047). Six pitchers remained active in MLB during the study period, while the other 4 had retired due to

The director task: A test of Theory-of-Mind use or selective attention?

PubMed

Rubio-Fernández, Paula

2017-08-01

Over two decades, the director task has increasingly been employed as a test of the use of Theory of Mind in communication, first in psycholinguistics and more recently in social cognition research. A new version of this task was designed to test two independent hypotheses. First, optimal performance in the director task, as established by the standard metrics of interference, is possible by using selective attention alone, and not necessarily Theory of Mind. Second, pragmatic measures of Theory-of-Mind use can reveal that people actively represent the director's mental states, contrary to recent claims that they only use domain-general cognitive processes to perform this task. The results of this study support both hypotheses and provide a new interactive paradigm to reliably test Theory-of-Mind use in referential communication.

Modeling Cognitive Strategies during Complex Task Performing Process

ERIC Educational Resources Information Center

Mazman, Sacide Guzin; Altun, Arif

2012-01-01

The purpose of this study is to examine individuals' computer based complex task performing processes and strategies in order to determine the reasons of failure by cognitive task analysis method and cued retrospective think aloud with eye movement data. Study group was five senior students from Computer Education and Instructional Technologies…

Perceived control in rhesus monkeys (Macaca mulatta) - Enhanced video-task performance

NASA Technical Reports Server (NTRS)

Washburn, David A.; Hopkins, William D.; Rumbaugh, Duane M.

1991-01-01

This investigation was designed to determine whether perceived control effects found in humans extend to rhesus monkeys (Macaca mulatta) tested in a video-task format, using a computer-generated menu program, SELECT. Choosing one of the options in SELECT resulted in presentation of five trials of a corresponding task and subsequent return to the menu. In Experiments 1-3, the animals exhibited stable, meaningful response patterns in this task (i.e., they made choices). In Experiment 4, performance on tasks that were selected by the animals significantly exceeded performance on identical tasks when assigned by the experimenter under comparable conditions (e.g., time of day, order, variety). The reliable and significant advantage for performance on selected tasks, typically found in humans, suggests that rhesus monkeys were able to perceive the availability of choices.

The effects of voice and manual control mode on dual task performance

NASA Technical Reports Server (NTRS)

Wickens, C. D.; Zenyuh, J.; Culp, V.; Marshak, W.

1986-01-01

Two fundamental principles of human performance, compatibility and resource competition, are combined with two structural dichotomies in the human information processing system, manual versus voice output, and left versus right cerebral hemisphere, in order to predict the optimum combination of voice and manual control with either hand, for time-sharing performance of a dicrete and continuous task. Eight right handed male subjected performed a discrete first-order tracking task, time-shared with an auditorily presented Sternberg Memory Search Task. Each task could be controlled by voice, or by the left or right hand, in all possible combinations except for a dual voice mode. When performance was analyzed in terms of a dual-task decrement from single task control conditions, the following variables influenced time-sharing efficiency in diminishing order of magnitude, (1) the modality of control, (discrete manual control of tracking was superior to discrete voice control of tracking and the converse was true with the memory search task), (2) response competition, (performance was degraded when both tasks were responded manually), (3) hemispheric competition, (performance degraded whenever two tasks were controlled by the left hemisphere) (i.e., voice or right handed control). The results confirm the value of predictive models invoice control implementation.

Metrics to assess ecological condition, change, and impacts in sandy beach ecosystems.

PubMed

Schlacher, Thomas A; Schoeman, David S; Jones, Alan R; Dugan, Jenifer E; Hubbard, David M; Defeo, Omar; Peterson, Charles H; Weston, Michael A; Maslo, Brooke; Olds, Andrew D; Scapini, Felicita; Nel, Ronel; Harris, Linda R; Lucrezi, Serena; Lastra, Mariano; Huijbers, Chantal M; Connolly, Rod M

2014-11-01

Complexity is increasingly the hallmark in environmental management practices of sandy shorelines. This arises primarily from meeting growing public demands (e.g., real estate, recreation) whilst reconciling economic demands with expectations of coastal users who have modern conservation ethics. Ideally, shoreline management is underpinned by empirical data, but selecting ecologically-meaningful metrics to accurately measure the condition of systems, and the ecological effects of human activities, is a complex task. Here we construct a framework for metric selection, considering six categories of issues that authorities commonly address: erosion; habitat loss; recreation; fishing; pollution (litter and chemical contaminants); and wildlife conservation. Possible metrics were scored in terms of their ability to reflect environmental change, and against criteria that are widely used for judging the performance of ecological indicators (i.e., sensitivity, practicability, costs, and public appeal). From this analysis, four types of broadly applicable metrics that also performed very well against the indicator criteria emerged: 1.) traits of bird populations and assemblages (e.g., abundance, diversity, distributions, habitat use); 2.) breeding/reproductive performance sensu lato (especially relevant for birds and turtles nesting on beaches and in dunes, but equally applicable to invertebrates and plants); 3.) population parameters and distributions of vertebrates associated primarily with dunes and the supralittoral beach zone (traditionally focused on birds and turtles, but expandable to mammals); 4.) compound measurements of the abundance/cover/biomass of biota (plants, invertebrates, vertebrates) at both the population and assemblage level. Local constraints (i.e., the absence of birds in highly degraded urban settings or lack of dunes on bluff-backed beaches) and particular issues may require alternatives. Metrics - if selected and applied correctly - provide

The Effect of Cerebellar Transcranial Direct Current Stimulation on A Throwing Task Depends on Individual Level of Task Performance.

PubMed

Mizuguchi, Nobuaki; Katayama, Takashi; Kanosue, Kazuyuki

2018-02-10

The effect of cerebellar transcranial direct current stimulation (tDCS) on motor performance remains controversial. Some studies suggest that the effect of tDCS depends upon task-difficulty and individual level of task performance. Here, we investigated whether the effect of cerebellar tDCS on the motor performance depends upon the individual's level of performance. Twenty-four naïve participants practiced dart throwing while receiving a 2-mA cerebellar tDCS for 20 min under three stimulus conditions (anodal-, cathodal-, and sham-tDCS) on separate days with a double-blind, counter-balanced cross-over design. Task performance was assessed by measuring the distance between the center of the bull's eye and the dart's position. Although task performance tended to improve throughout the practice under all stimulus conditions, improvement within a given day was not significant as compared to the first no-stimulus block. In addition, improvement did not differ among stimulation conditions. However, the magnitude of improvement was associated with an individual's level of task performance only under cathodal tDCS condition (p < 0.05). This resulted in a significant performance improvement only for the sub-group of participants with lower performance levels as compared to that with sham-tDCS (p < 0.05). These findings suggest that the facilitation effect of cerebellar cathodal tDCS on motor skill learning of complex whole-body movements depends on the level of an individual's task performance. Thus, cerebellar tDCS would facilitate learning of a complex motor skill task only in a subset of individuals. Copyright © 2017 IBRO. Published by Elsevier Ltd. All rights reserved.

Frontal Representation as a Metric of Model Performance

NASA Astrophysics Data System (ADS)

Douglass, E.; Mask, A. C.

2017-12-01

Representation of fronts detected by altimetry are used to evaluate the performance of the HYCOM global operational product. Fronts are detected and assessed in daily alongtrack altimetry. Then, modeled sea surface height is interpolated to the locations of the alongtrack observations, and the same frontal detection algorithm is applied to the interpolated model output. The percentage of fronts found in the altimetry and replicated in the model gives a score (0-100) that assesses the model's ability to replicate fronts in the proper location with the proper orientation. Further information can be obtained from determining the number of "extra" fronts found in the model but not in the altimetry, and from assessing the horizontal and vertical dimensions of the front in the model as compared to observations. Finally, the sensitivity of this metric to choices regarding the smoothing of noisy alongtrack altimetry observations, and to the minimum size of fronts being analyzed, is assessed.

The Role of Task Understanding on Younger and Older Adults' Performance.

PubMed

Frank, David J; Touron, Dayna R

2016-12-16

Age-related performance decrements have been linked to inferior strategic choices. Strategy selection models argue that accurate task representations are necessary for choosing appropriate strategies. But no studies to date have compared task representations in younger and older adults. Metacognition research suggests age-related deficits in updating and utilizing strategy knowledge, but other research suggests age-related sparing when information can be consolidated into a coherent mental model. Study 1 validated the use of concept mapping as a tool for measuring task representation accuracy. Study 2 measured task representations before and after a complex strategic task to test for age-related decrements in task representation formation and updating. Task representation accuracy and task performance were equivalent across age groups. Better task representations were related to better performance. However, task representation scores remained fairly stable over the task with minimal evidence of updating. Our findings mirror those in the mental model literature suggesting age-related sparing of strategy use when information can be integrated into a coherent mental model. Future research should manipulate the presence of a unifying context to better evaluate this hypothesis. © The Author 2016. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The Effect of Focus on Form and Task Complexity on L2 Learners' Oral Task Performance

ERIC Educational Resources Information Center

Salimi, Asghar

2015-01-01

Second Language learners' oral task performance has been one of interesting and research generating areas of investigations in the field of second language acquisition specially, task-based language teaching and learning. The main purpose of the present study is to investigate the effect of focus on form and task complexity on L2 learners' oral…

Developing a Measurement for Task Complexity in Flight.

PubMed

Zheng, Yiyuan; Lu, Yanyu; Wang, Zhen; Huang, Dan; Fu, Shan

2015-08-01

Task complexity is regarded as an essential metric that is related to a pilot's performance and workload. Normally, pilots follow Standard Operating Procedures (SOPs) during a flight. In this study, we developed a measurement named Task Complexity in Flight (TCIF) to represent the task complexity in the SOPs. The TCIF measurement combined four complexity components into one index: actions logic complexity (ALC), actions size complexity (ASC), information control exchange complexity (ICEC), and control mode complexity (CMC).To verify the measurement, we calculated 11 tasks during the takeoff and landing phases from the SOPs, and invited 10 pilots to perform the same tasks in a flight simulator. After flight, the TCIF results were compared with two workload measurements: the Bedford scale and heart rate. The results of TCIF and the 4 components of the 11 tasks were calculated. Further, the TCIF results showed a significant correlation with the Bedford scores (R=0.851) and were also consistent with the difference in heart rate (R=0.816). Therefore, with the increased TCIF results, both the Bedford scale and the difference in heart rate increased. TCIF was proposed based on the flight operating conditions. Although additional studies of TCIF are necessary, the results of this study suggest this measurement could effectively indicate task complexity in flight, and could also be used to guide pilot training and task allocation on the flight deck.

Evaluation of cassette-based digital radiography detectors using standardized image quality metrics: AAPM TG-150 Draft Image Detector Tests.

PubMed

Li, Guang; Greene, Travis C; Nishino, Thomas K; Willis, Charles E

2016-09-08

The purpose of this study was to evaluate several of the standardized image quality metrics proposed by the American Association of Physics in Medicine (AAPM) Task Group 150. The task group suggested region-of-interest (ROI)-based techniques to measure nonuniformity, minimum signal-to-noise ratio (SNR), number of anomalous pixels, and modulation transfer function (MTF). This study evaluated the effects of ROI size and layout on the image metrics by using four different ROI sets, assessed result uncertainty by repeating measurements, and compared results with two commercially available quality control tools, namely the Carestream DIRECTVIEW Total Quality Tool (TQT) and the GE Healthcare Quality Assurance Process (QAP). Seven Carestream DRX-1C (CsI) detectors on mobile DR systems and four GE FlashPad detectors in radiographic rooms were tested. Images were analyzed using MATLAB software that had been previously validated and reported. Our values for signal and SNR nonuniformity and MTF agree with values published by other investigators. Our results show that ROI size affects nonuniformity and minimum SNR measurements, but not detection of anomalous pixels. Exposure geometry affects all tested image metrics except for the MTF. TG-150 metrics in general agree with the TQT, but agree with the QAP only for local and global signal nonuniformity. The difference in SNR nonuniformity and MTF values between the TG-150 and QAP may be explained by differences in the calculation of noise and acquisition beam quality, respectively. TG-150's SNR nonuniformity metrics are also more sensitive to detector nonuniformity compared to the QAP. Our results suggest that fixed ROI size should be used for consistency because nonuniformity metrics depend on ROI size. Ideally, detector tests should be performed at the exact calibration position. If not feasible, a baseline should be established from the mean of several repeated measurements. Our study indicates that the TG-150 tests can be

Evaluation of cassette‐based digital radiography detectors using standardized image quality metrics: AAPM TG‐150 Draft Image Detector Tests

PubMed Central

Greene, Travis C.; Nishino, Thomas K.; Willis, Charles E.

2016-01-01

The purpose of this study was to evaluate several of the standardized image quality metrics proposed by the American Association of Physics in Medicine (AAPM) Task Group 150. The task group suggested region‐of‐interest (ROI)‐based techniques to measure nonuniformity, minimum signal‐to‐noise ratio (SNR), number of anomalous pixels, and modulation transfer function (MTF). This study evaluated the effects of ROI size and layout on the image metrics by using four different ROI sets, assessed result uncertainty by repeating measurements, and compared results with two commercially available quality control tools, namely the Carestream DIRECTVIEW Total Quality Tool (TQT) and the GE Healthcare Quality Assurance Process (QAP). Seven Carestream DRX‐1C (CsI) detectors on mobile DR systems and four GE FlashPad detectors in radiographic rooms were tested. Images were analyzed using MATLAB software that had been previously validated and reported. Our values for signal and SNR nonuniformity and MTF agree with values published by other investigators. Our results show that ROI size affects nonuniformity and minimum SNR measurements, but not detection of anomalous pixels. Exposure geometry affects all tested image metrics except for the MTF. TG‐150 metrics in general agree with the TQT, but agree with the QAP only for local and global signal nonuniformity. The difference in SNR nonuniformity and MTF values between the TG‐150 and QAP may be explained by differences in the calculation of noise and acquisition beam quality, respectively. TG‐150's SNR nonuniformity metrics are also more sensitive to detector nonuniformity compared to the QAP. Our results suggest that fixed ROI size should be used for consistency because nonuniformity metrics depend on ROI size. Ideally, detector tests should be performed at the exact calibration position. If not feasible, a baseline should be established from the mean of several repeated measurements. Our study indicates that the TG�

A New Distance Metric for Unsupervised Learning of Categorical Data.

PubMed

Jia, Hong; Cheung, Yiu-Ming; Liu, Jiming

2016-05-01

Distance metric is the basis of many learning algorithms, and its effectiveness usually has a significant influence on the learning results. In general, measuring distance for numerical data is a tractable task, but it could be a nontrivial problem for categorical data sets. This paper, therefore, presents a new distance metric for categorical data based on the characteristics of categorical values. In particular, the distance between two values from one attribute measured by this metric is determined by both the frequency probabilities of these two values and the values of other attributes that have high interdependence with the calculated one. Dynamic attribute weight is further designed to adjust the contribution of each attribute-distance to the distance between the whole data objects. Promising experimental results on different real data sets have shown the effectiveness of the proposed distance metric.

Interpersonal synergies: static prehension tasks performed by two actors.

PubMed

Solnik, Stanislaw; Reschechtko, Sasha; Wu, Yen-Hsun; Zatsiorsky, Vladimir M; Latash, Mark L

2016-08-01

We investigated multidigit synergies stabilizing components of the resultant force vector during joint performance of a static prehension task by two persons as compared to similar tasks performed by a single person using both hands. Subjects transferred the instrumented handle from the right hand to the left hand (one-person condition) or passed that handle to another person (two-person condition) while keeping the handle's position and orientation stationary. Only three digits were involved per hand, the thumb, the index finger, and the middle finger; the forces and moments produced by the digits were measured by six-component sensors. We estimated the performance-stabilizing synergies within the uncontrolled manifold framework by quantifying the intertrial variance structure of digit forces and moments. The analysis was performed at three levels: between hands, between virtual finger and virtual thumb (imagined digits producing the same mechanical variables as the corresponding actual digits combined) produced by the two hands (in both interpersonal and intrapersonal conditions), and between the thumb and virtual finger for one hand only. Additionally, we performed correlation and phase synchronization analyses of resultant tangential forces and internal normal forces. Overall, the one-person conditions were characterized by higher amount of intertrial variance that did not affect resultant normal force components, higher internal components of normal forces, and stronger synchronization of the normal forces generated by the hands. Our observations suggest that in two-person tasks, when participants try to achieve a common mechanical outcome, the performance-stabilizing synergies depend on non-visual information exchange, possibly via the haptic and proprioceptive systems. Therefore, synergies quantified in tasks using visual feedback only may not be generalizable to more natural tasks.

Using Performance Task Data to Improve Instruction

ERIC Educational Resources Information Center

Abbott, Amy L.; Wren, Douglas G.

2016-01-01

Two well-accepted ideas among educators are (a) performance assessment is an effective means of assessing higher-order thinking skills and (b) data-driven instruction planning is a valuable tool for optimizing student learning. This article describes a locally developed performance task (LDPT) designed to measure critical thinking, problem…

Pointing Device Performance in Steering Tasks.

PubMed

Senanayake, Ransalu; Goonetilleke, Ravindra S

2016-06-01

Use of touch-screen-based interactions is growing rapidly. Hence, knowing the maneuvering efficacy of touch screens relative to other pointing devices is of great importance in the context of graphical user interfaces. Movement time, accuracy, and user preferences of four pointing device settings were evaluated on a computer with 14 participants aged 20.1 ± 3.13 years. It was found that, depending on the difficulty of the task, the optimal settings differ for ballistic and visual control tasks. With a touch screen, resting the arm increased movement time for steering tasks. When both performance and comfort are considered, whether to use a mouse or a touch screen for person-computer interaction depends on the steering difficulty. Hence, a input device should be chosen based on the application, and should be optimized to match the graphical user interface. © The Author(s) 2016.

PV System 'Availability' as a Reliability Metric -- Improving Standards, Contract Language and Performance Models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Klise, Geoffrey T.; Hill, Roger; Walker, Andy

The use of the term 'availability' to describe a photovoltaic (PV) system and power plant has been fraught with confusion for many years. A term that is meant to describe equipment operational status is often omitted, misapplied or inaccurately combined with PV performance metrics due to attempts to measure performance and reliability through the lens of traditional power plant language. This paper discusses three areas where current research in standards, contract language and performance modeling is improving the way availability is used with regards to photovoltaic systems and power plants.

R&D100: Lightweight Distributed Metric Service

ScienceCinema

Gentile, Ann; Brandt, Jim; Tucker, Tom; Showerman, Mike

2018-06-12

On today's High Performance Computing platforms, the complexity of applications and configurations makes efficient use of resources difficult. The Lightweight Distributed Metric Service (LDMS) is monitoring software developed by Sandia National Laboratories to provide detailed metrics of system performance. LDMS provides collection, transport, and storage of data from extreme-scale systems at fidelities and timescales to provide understanding of application and system performance with no statistically significant impact on application performance.

R&D100: Lightweight Distributed Metric Service

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gentile, Ann; Brandt, Jim; Tucker, Tom

2015-11-19

On today's High Performance Computing platforms, the complexity of applications and configurations makes efficient use of resources difficult. The Lightweight Distributed Metric Service (LDMS) is monitoring software developed by Sandia National Laboratories to provide detailed metrics of system performance. LDMS provides collection, transport, and storage of data from extreme-scale systems at fidelities and timescales to provide understanding of application and system performance with no statistically significant impact on application performance.

Manipulating perceptual parameters in a continuous performance task.

PubMed

Shalev, Nir; Humphreys, Glyn; Demeyere, Nele

2018-02-01

Sustained attention (SA) is among the most studied faculties of human cognition, and thought to be crucial for many aspects of behavior. Measuring SA often relies on performance on a continuous, low-demanding task. Such continuous performance tasks (CPTs) have many variations, and sustained attention is typically estimated based on variability in reaction times. While relying on reaction times may be useful in some cases, it can pose a challenge when working with clinical populations. To increase interpersonal variability in task parameters that do not rely on speed, researchers have increased demands for memory and response inhibition. These approaches, however, may be confounded when used to assess populations that suffer from multiple cognitive deficits. In the current study, we propose a new approach for increasing task variability by increasing the attentional demands. In order to do so, we created a new variation of a CPT - a masked version, where inattention is more likely to cause misidentifying a target. After establishing that masking indeed decreases target detection, we further investigated which task parameter may influence response biases. To do so, we contrasted two versions of the CPT with different target/distractor ratio. We then established how perceptual parameters can be controlled independently in a CPT. Following the experimental manipulations, we tested the MCCPT with aging controls and chronic stroke patients to assure the task can be used with target populations. The results confirm the MCCPT as a task providing high sensitivity without relying on reaction speed, and feasible for patients.

Development of Internet-Based Tasks for the Executive Function Performance Test.

PubMed

Rand, Debbie; Lee Ben-Haim, Keren; Malka, Rachel; Portnoy, Sigal

The Executive Function Performance Test (EFPT) is a reliable and valid performance-based tool to assess executive functions (EFs). This study's objective was to develop and verify two Internet-based tasks for the EFPT. A cross-sectional study assessed the alternate-form reliability of the Internet-based bill-paying and telephone-use tasks in healthy adults and people with subacute stroke (Study 1). It also sought to establish the tasks' criterion reliability for assessing EF deficits by correlating performance with that on the Trail Making Test in five groups: healthy young adults, healthy older adults, people with subacute stroke, people with chronic stroke, and young adults with attention deficit hyperactivity disorder (Study 2). The alternative-form reliability and initial construct validity for the Internet-based bill-paying task were verified. Criterion validity was established for both tasks. The Internet-based tasks are comparable to the original EFPT tasks and can be used for assessment of EF deficits. Copyright © 2018 by the American Occupational Therapy Association, Inc.

The effect of processing code, response modality and task difficulty on dual task performance and subjective workload in a manual system

NASA Technical Reports Server (NTRS)

Liu, Yili; Wickens, Christopher D.

1987-01-01

This paper reports on the first experiment of a series studying the effect of task structure and difficulty demand on time-sharing performance and workload in both automated and corresponding manual systems. The experimental task involves manual control time-shared with spatial and verbal decisions tasks of two levels of difficulty and two modes of response (voice or manual). The results provide strong evidence that tasks and processes competing for common processing resources are time shared less effecively and have higher workload than tasks competing for separate resources. Subjective measures and the structure of multiple resources are used in conjunction to predict dual task performance. The evidence comes from both single-task and from dual-task performance.

Uniform task level definitions for robotic system performance comparisons

NASA Technical Reports Server (NTRS)

Price, Charles; Tesar, Delbert

1989-01-01

A series of ten task levels of increasing difficulty was compiled for use in comparative performance evaluations of available and future robotics technology. Each level has a breakdown of ten additional levels of difficulty to provide a layering of 100 levels. It is assumed that each level of task performance must be achieved by the system before it can be appropriately considered for the next level.

A Case Study Based Analysis of Performance Metrics for Green Infrastructure

NASA Astrophysics Data System (ADS)

Gordon, B. L.; Ajami, N.; Quesnel, K.

2017-12-01

Aging infrastructure, population growth, and urbanization are demanding new approaches to management of all components of the urban water cycle, including stormwater. Traditionally, urban stormwater infrastructure was designed to capture and convey rainfall-induced runoff out of a city through a network of curbs, gutters, drains, and pipes, also known as grey infrastructure. These systems were planned with a single-purpose and designed under the assumption of hydrologic stationarity, a notion that no longer holds true in the face of a changing climate. One solution gaining momentum around the world is green infrastructure (GI). Beyond stormwater quality improvement and quantity reduction (or technical benefits), GI solutions offer many environmental, economic, and social benefits. Yet many practical barriers have prevented the widespread adoption of these systems worldwide. At the center of these challenges is the inability of stakeholders to know how to monitor, measure, and assess the multi-sector performance of GI systems. Traditional grey infrastructure projects require different monitoring strategies than natural systems; there are no overarching policies on how to best design GI monitoring and evaluation systems and measure performance. Previous studies have attempted to quantify the performance of GI, mostly using one evaluation method on a specific case study. We use a case study approach to address these knowledge gaps and develop a conceptual model of how to evaluate the performance of GI through the lens of financing. First, we examined many different case studies of successfully implemented GI around the world. Then we narrowed in on 10 exemplary case studies. For each case studies, we determined what performance method the project developer used such as LCA, TBL, Low Impact Design Assessment (LIDA) and others. Then, we determined which performance metrics were used to determine success and what data was needed to calculate those metrics. Finally, we

Shift Work and Cognitive Flexibility: Decomposing Task Performance.

PubMed

Cheng, Philip; Tallent, Gabriel; Bender, Thomas John; Tran, Kieulinh Michelle; Drake, Christopher L

2017-04-01

Deficits in cognitive functioning associated with shift work are particularly relevant to occupational performance; however, few studies have examined how cognitive functioning is associated with specific components of shift work. This observational study examined how circadian phase, nocturnal sleepiness, and daytime insomnia in a sample of shift workers ( N = 30) were associated with cognitive flexibility during the night shift. Cognitive flexibility was measured using a computerized task-switching paradigm, which produces 2 indexes of flexibility: switch cost and set inhibition. Switch cost represents the additional cognitive effort required in switching to a different task and can impact performance when multitasking is involved. Set inhibition is the efficiency in returning to previously completed tasks and represents the degree of cognitive perseveration, which can lead to reduced accuracy. Circadian phase was measured via melatonin assays, nocturnal sleepiness was assessed using the Multiple Sleep Latency Test, and daytime insomnia was assessed using the Insomnia Severity Index. Results indicated that those with an earlier circadian phase, insomnia, and sleepiness exhibited reduced cognitive flexibility; however, specific components of cognitive flexibility were differentially associated with circadian phase, insomnia, and sleepiness. Individuals with an earlier circadian phase (thus more misaligned to the night shift) exhibited larger switch costs, which was also associated with reduced task efficiency. Shift workers with more daytime insomnia demonstrated difficulties with cognitive inhibition, whereas nocturnal sleepiness was associated with difficulties in reactivating previous tasks. Deficits in set inhibition were also related to reduced accuracy and increased perseverative errors. Together, this study indicates that task performance deficits in shift work are complex and are variably impacted by different mechanisms. Future research may examine

An opportunity cost model of subjective effort and task performance

PubMed Central

Kurzban, Robert; Duckworth, Angela; Kable, Joseph W.; Myers, Justus

2013-01-01

Why does performing certain tasks cause the aversive experience of mental effort and concomitant deterioration in task performance? One explanation posits a physical resource that is depleted over time. We propose an alternate explanation that centers on mental representations of the costs and benefits associated with task performance. Specifically, certain computational mechanisms, especially those associated with executive function, can be deployed for only a limited number of simultaneous tasks at any given moment. Consequently, the deployment of these computational mechanisms carries an opportunity cost – that is, the next-best use to which these systems might be put. We argue that the phenomenology of effort can be understood as the felt output of these cost/benefit computations. In turn, the subjective experience of effort motivates reduced deployment of these computational mechanisms in the service of the present task. These opportunity cost representations, then, together with other cost/benefit calculations, determine effort expended and, everything else equal, result in performance reductions. In making our case for this position, we review alternate explanations both for the phenomenology of effort associated with these tasks and for performance reductions over time. Likewise, we review the broad range of relevant empirical results from across subdisciplines, especially psychology and neuroscience. We hope that our proposal will help to build links among the diverse fields that have been addressing similar questions from different perspectives, and we emphasize ways in which alternate models might be empirically distinguished. PMID:24304775