Translating Fatigue to Human Performance

PubMed Central

Enoka, Roger M.; Duchateau, Jacques

2016-01-01

Despite flourishing interest in the topic of fatigue—as indicated by the many presentations on fatigue at the 2015 annual meeting of the American College of Sports Medicine—surprisingly little is known about its impact on human performance. There are two main reasons for this dilemma: (1) the inability of current terminology to accommodate the scope of the conditions ascribed to fatigue, and (2) a paucity of validated experimental models. In contrast to current practice, a case is made for a unified definition of fatigue to facilitate its management in health and disease. Based on the classic two-domain concept of Mosso, fatigue is defined as a disabling symptom in which physical and cognitive function is limited by interactions between performance fatigability and perceived fatigability. As a symptom, fatigue can only be measured by self-report, quantified as either a trait characteristic or a state variable. One consequence of such a definition is that the word fatigue should not be preceded by an adjective (e.g., central, mental, muscle, peripheral, and supraspinal) to suggest the locus of the changes responsible for an observed level of fatigue. Rather, mechanistic studies should be performed with validated experimental models to identify the changes responsible for the reported fatigue. As indicated by three examples (walking endurance in old adults, time trials by endurance athletes, and fatigue in persons with multiple sclerosis) discussed in the review, however, it has proven challenging to develop valid experimental models of fatigue. The proposed framework provides a foundation to address the many gaps in knowledge of how laboratory measures of fatigue and fatigability impact real-world performance. PMID:27015386

Scopolamine disrupts place navigation in rats and humans: a translational validation of the Hidden Goal Task in the Morris water maze and a real maze for humans.

PubMed

Laczó, Jan; Markova, Hana; Lobellova, Veronika; Gazova, Ivana; Parizkova, Martina; Cerman, Jiri; Nekovarova, Tereza; Vales, Karel; Klovrzova, Sylva; Harrison, John; Windisch, Manfred; Vlcek, Kamil; Svoboda, Jan; Hort, Jakub; Stuchlik, Ales

2017-02-01

Development of new drugs for treatment of Alzheimer's disease (AD) requires valid paradigms for testing their efficacy and sensitive tests validated in translational research. We present validation of a place-navigation task, a Hidden Goal Task (HGT) based on the Morris water maze (MWM), in comparable animal and human protocols. We used scopolamine to model cognitive dysfunction similar to that seen in AD and donepezil, a symptomatic medication for AD, to assess its potential reversible effect on this scopolamine-induced cognitive dysfunction. We tested the effects of scopolamine and the combination of scopolamine and donepezil on place navigation and compared their effects in human and rat versions of the HGT. Place navigation testing consisted of 4 sessions of HGT performed at baseline, 2, 4, and 8 h after dosing in humans or 1, 2.5, and 5 h in rats. Scopolamine worsened performance in both animals and humans. In the animal experiment, co-administration of donepezil alleviated the negative effect of scopolamine. In the human experiment, subjects co-administered with scopolamine and donepezil performed similarly to subjects on placebo and scopolamine, indicating a partial ameliorative effect of donepezil. In the task based on the MWM, scopolamine impaired place navigation, while co-administration of donepezil alleviated this effect in comparable animal and human protocols. Using scopolamine and donepezil to challenge place navigation testing can be studied concurrently in animals and humans and may be a valid and reliable model for translational research, as well as for preclinical and clinical phases of drug trials.

Crowdsourcing seizure detection: algorithm development and validation on human implanted device recordings.

PubMed

Baldassano, Steven N; Brinkmann, Benjamin H; Ung, Hoameng; Blevins, Tyler; Conrad, Erin C; Leyde, Kent; Cook, Mark J; Khambhati, Ankit N; Wagenaar, Joost B; Worrell, Gregory A; Litt, Brian

2017-06-01

There exist significant clinical and basic research needs for accurate, automated seizure detection algorithms. These algorithms have translational potential in responsive neurostimulation devices and in automatic parsing of continuous intracranial electroencephalography data. An important barrier to developing accurate, validated algorithms for seizure detection is limited access to high-quality, expertly annotated seizure data from prolonged recordings. To overcome this, we hosted a kaggle.com competition to crowdsource the development of seizure detection algorithms using intracranial electroencephalography from canines and humans with epilepsy. The top three performing algorithms from the contest were then validated on out-of-sample patient data including standard clinical data and continuous ambulatory human data obtained over several years using the implantable NeuroVista seizure advisory system. Two hundred teams of data scientists from all over the world participated in the kaggle.com competition. The top performing teams submitted highly accurate algorithms with consistent performance in the out-of-sample validation study. The performance of these seizure detection algorithms, achieved using freely available code and data, sets a new reproducible benchmark for personalized seizure detection. We have also shared a 'plug and play' pipeline to allow other researchers to easily use these algorithms on their own datasets. The success of this competition demonstrates how sharing code and high quality data results in the creation of powerful translational tools with significant potential to impact patient care. © The Author (2017). Published by Oxford University Press on behalf of the Guarantors of Brain. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

A new method to evaluate human-robot system performance

NASA Technical Reports Server (NTRS)

Rodriguez, G.; Weisbin, C. R.

2003-01-01

One of the key issues in space exploration is that of deciding what space tasks are best done with humans, with robots, or a suitable combination of each. In general, human and robot skills are complementary. Humans provide as yet unmatched capabilities to perceive, think, and act when faced with anomalies and unforeseen events, but there can be huge potential risks to human safety in getting these benefits. Robots provide complementary skills in being able to work in extremely risky environments, but their ability to perceive, think, and act by themselves is currently not error-free, although these capabilities are continually improving with the emergence of new technologies. Substantial past experience validates these generally qualitative notions. However, there is a need for more rigorously systematic evaluation of human and robot roles, in order to optimize the design and performance of human-robot system architectures using well-defined performance evaluation metrics. This article summarizes a new analytical method to conduct such quantitative evaluations. While the article focuses on evaluating human-robot systems, the method is generally applicable to a much broader class of systems whose performance needs to be evaluated.

Validating models of target acquisition performance in the dismounted soldier context

NASA Astrophysics Data System (ADS)

Glaholt, Mackenzie G.; Wong, Rachel K.; Hollands, Justin G.

2018-04-01

The problem of predicting real-world operator performance with digital imaging devices is of great interest within the military and commercial domains. There are several approaches to this problem, including: field trials with imaging devices, laboratory experiments using imagery captured from these devices, and models that predict human performance based on imaging device parameters. The modeling approach is desirable, as both field trials and laboratory experiments are costly and time-consuming. However, the data from these experiments is required for model validation. Here we considered this problem in the context of dismounted soldiering, for which detection and identification of human targets are essential tasks. Human performance data were obtained for two-alternative detection and identification decisions in a laboratory experiment in which photographs of human targets were presented on a computer monitor and the images were digitally magnified to simulate range-to-target. We then compared the predictions of different performance models within the NV-IPM software package: Targeting Task Performance (TTP) metric model and the Johnson model. We also introduced a modification to the TTP metric computation that incorporates an additional correction for target angular size. We examined model predictions using NV-IPM default values for a critical model constant, V50, and we also considered predictions when this value was optimized to fit the behavioral data. When using default values, certain model versions produced a reasonably close fit to the human performance data in the detection task, while for the identification task all models substantially overestimated performance. When using fitted V50 values the models produced improved predictions, though the slopes of the performance functions were still shallow compared to the behavioral data. These findings are discussed in relation to the models' designs and parameters, and the characteristics of the behavioral

Reference Proteome Extracts for Mass Spec Instrument Performance Validation and Method Development

PubMed Central

Rosenblatt, Mike; Urh, Marjeta; Saveliev, Sergei

2014-01-01

Biological samples of high complexity are required to test protein mass spec sample preparation procedures and validate mass spec instrument performance. Total cell protein extracts provide the needed sample complexity. However, to be compatible with mass spec applications, such extracts should meet a number of design requirements: compatibility with LC/MS (free of detergents, etc.)high protein integrity (minimal level of protein degradation and non-biological PTMs)compatibility with common sample preparation methods such as proteolysis, PTM enrichment and mass-tag labelingLot-to-lot reproducibility Here we describe total protein extracts from yeast and human cells that meet the above criteria. Two extract formats have been developed: Intact protein extracts with primary use for sample preparation method development and optimizationPre-digested extracts (peptides) with primary use for instrument validation and performance monitoring

An Assessment-based Solution to a Human-Service Employee Performance Problem

PubMed Central

Wilder, David A.; Majdalany, Lina; Mathisen, David; Strain, Leigh Ann

2013-01-01

The PDC-HS implicated a lack of proper training on participant duties and a lack of performance feedback as contributors to the performance problems. As a result, an intervention targeting training on participant duties and performance feedback was implemented across eight treatment rooms; the intervention increased performance in all rooms. This preliminary validation study suggests the PDC-HS may prove useful in solving performance problems in human-service settings. PMID:25729505

Performance of a Cartridge-Based Assay for Detection of Clinically Significant Human Papillomavirus (HPV) Infection: Lessons from VALGENT (Validation of HPV Genotyping Tests)

PubMed Central

Geraets, Daan; Cuzick, Jack; Cadman, Louise; Moore, Catherine; Vanden Broeck, Davy; Padalko, Elisaveta; Quint, Wim; Arbyn, Marc

2016-01-01

The Validation of Human Papillomavirus (HPV) Genotyping Tests (VALGENT) studies offer an opportunity to clinically validate HPV assays for use in primary screening for cervical cancer and also provide a framework for the comparison of analytical and type-specific performance. Through VALGENT, we assessed the performance of the cartridge-based Xpert HPV assay (Xpert HPV), which detects 14 high-risk (HR) types and resolves HPV16 and HPV18/45. Samples from women attending the United Kingdom cervical screening program enriched with cytologically abnormal samples were collated. All had been previously tested by a clinically validated standard comparator test (SCT), the GP5+/6+ enzyme immunoassay (EIA). The clinical sensitivity and specificity of the Xpert HPV for the detection of cervical intraepithelial neoplasia grade 2 or higher (CIN2+) and CIN3+ relative to those of the SCT were assessed as were the inter- and intralaboratory reproducibilities according to international criteria for test validation. Type concordance for HPV16 and HPV18/45 between the Xpert HPV and the SCT was also analyzed. The Xpert HPV detected 94% of CIN2+ and 98% of CIN3+ lesions among all screened women and 90% of CIN2+ and 96% of CIN3+ lesions in women 30 years and older. The specificity for CIN1 or less (≤CIN1) was 83% (95% confidence interval [CI], 80 to 85%) in all women and 88% (95% CI, 86 to 91%) in women 30 years and older. Inter- and intralaboratory agreements for the Xpert HPV were 98% and 97%, respectively. The kappa agreements for HPV16 and HPV18/45 between the clinically validated reference test (GP5+/6+ LMNX) and the Xpert HPV were 0.92 and 0.91, respectively. The clinical performance and reproducibility of the Xpert HPV are comparable to those of well-established HPV assays and fulfill the criteria for use in primary cervical cancer screening. PMID:27385707

Assessment of predictive performance in incomplete data by combining internal validation and multiple imputation.

PubMed

Wahl, Simone; Boulesteix, Anne-Laure; Zierer, Astrid; Thorand, Barbara; van de Wiel, Mark A

2016-10-26

Missing values are a frequent issue in human studies. In many situations, multiple imputation (MI) is an appropriate missing data handling strategy, whereby missing values are imputed multiple times, the analysis is performed in every imputed data set, and the obtained estimates are pooled. If the aim is to estimate (added) predictive performance measures, such as (change in) the area under the receiver-operating characteristic curve (AUC), internal validation strategies become desirable in order to correct for optimism. It is not fully understood how internal validation should be combined with multiple imputation. In a comprehensive simulation study and in a real data set based on blood markers as predictors for mortality, we compare three combination strategies: Val-MI, internal validation followed by MI on the training and test parts separately, MI-Val, MI on the full data set followed by internal validation, and MI(-y)-Val, MI on the full data set omitting the outcome followed by internal validation. Different validation strategies, including bootstrap und cross-validation, different (added) performance measures, and various data characteristics are considered, and the strategies are evaluated with regard to bias and mean squared error of the obtained performance estimates. In addition, we elaborate on the number of resamples and imputations to be used, and adopt a strategy for confidence interval construction to incomplete data. Internal validation is essential in order to avoid optimism, with the bootstrap 0.632+ estimate representing a reliable method to correct for optimism. While estimates obtained by MI-Val are optimistically biased, those obtained by MI(-y)-Val tend to be pessimistic in the presence of a true underlying effect. Val-MI provides largely unbiased estimates, with a slight pessimistic bias with increasing true effect size, number of covariates and decreasing sample size. In Val-MI, accuracy of the estimate is more strongly improved by

Construct validity of the individual work performance questionnaire.

PubMed

Koopmans, Linda; Bernaards, Claire M; Hildebrandt, Vincent H; de Vet, Henrica C W; van der Beek, Allard J

2014-03-01

To examine the construct validity of the Individual Work Performance Questionnaire (IWPQ). A total of 1424 Dutch workers from three occupational sectors (blue, pink, and white collar) participated in the study. First, IWPQ scores were correlated with related constructs (convergent validity). Second, differences between known groups were tested (discriminative validity). First, IWPQ scores correlated weakly to moderately with absolute and relative presenteeism, and work engagement. Second, significant differences in IWPQ scores were observed for workers differing in job satisfaction, and workers differing in health. Overall, the results indicate acceptable construct validity of the IWPQ. Researchers are provided with a reliable and valid instrument to measure individual work performance comprehensively and generically, among workers from different occupational sectors, with and without health problems.

Computational Models of Human Performance: Validation of Memory and Procedural Representation in Advanced Air/Ground Simulation

NASA Technical Reports Server (NTRS)

Corker, Kevin M.; Labacqz, J. Victor (Technical Monitor)

1997-01-01

The Man-Machine Interaction Design and Analysis System (MIDAS) under joint U.S. Army and NASA cooperative is intended to assist designers of complex human/automation systems in successfully incorporating human performance capabilities and limitations into decision and action support systems. MIDAS is a computational representation of multiple human operators, selected perceptual, cognitive, and physical functions of those operators, and the physical/functional representation of the equipment with which they operate. MIDAS has been used as an integrated predictive framework for the investigation of human/machine systems, particularly in situations with high demands on the operators. We have extended the human performance models to include representation of both human operators and intelligent aiding systems in flight management, and air traffic service. The focus of this development is to predict human performance in response to aiding system developed to identify aircraft conflict and to assist in the shared authority for resolution. The demands of this application requires representation of many intelligent agents sharing world-models, coordinating action/intention, and cooperative scheduling of goals and action in an somewhat unpredictable world of operations. In recent applications to airborne systems development, MIDAS has demonstrated an ability to predict flight crew decision-making and procedural behavior when interacting with automated flight management systems and Air Traffic Control. In this paper, we describe two enhancements to MIDAS. The first involves the addition of working memory in the form of an articulatory buffer for verbal communication protocols and a visuo-spatial buffer for communications via digital datalink. The second enhancement is a representation of multiple operators working as a team. This enhanced model was used to predict the performance of human flight crews and their level of compliance with commercial aviation communication

Development and Initial Validation of an Instrument for Human Capital Planning

ERIC Educational Resources Information Center

Zula, Kenneth J.; Chermack, Thomas J.

2008-01-01

This article reports on development and validation of an instrument for use in human capital approaches for organizational planning. The article describes use of a team of subject matter experts in developing a measure of human capital planning, and use of exploratory factor analysis techniques to validate the resulting instrument. These data were…

Embedded performance validity testing in neuropsychological assessment: Potential clinical tools.

PubMed

Rickards, Tyler A; Cranston, Christopher C; Touradji, Pegah; Bechtold, Kathleen T

2018-01-01

The article aims to suggest clinically-useful tools in neuropsychological assessment for efficient use of embedded measures of performance validity. To accomplish this, we integrated available validity-related and statistical research from the literature, consensus statements, and survey-based data from practicing neuropsychologists. We provide recommendations for use of 1) Cutoffs for embedded performance validity tests including Reliable Digit Span, California Verbal Learning Test (Second Edition) Forced Choice Recognition, Rey-Osterrieth Complex Figure Test Combination Score, Wisconsin Card Sorting Test Failure to Maintain Set, and the Finger Tapping Test; 2) Selecting number of performance validity measures to administer in an assessment; and 3) Hypothetical clinical decision-making models for use of performance validity testing in a neuropsychological assessment collectively considering behavior, patient reporting, and data indicating invalid or noncredible performance. Performance validity testing helps inform the clinician about an individual's general approach to tasks: response to failure, task engagement and persistence, compliance with task demands. Data-driven clinical suggestions provide a resource to clinicians and to instigate conversation within the field to make more uniform, testable decisions to further the discussion, and guide future research in this area.

Automation and robotics human performance

NASA Technical Reports Server (NTRS)

Mah, Robert W.

1990-01-01

The scope of this report is limited to the following: (1) assessing the feasibility of the assumptions for crew productivity during the intra-vehicular activities and extra-vehicular activities; (2) estimating the appropriate level of automation and robotics to accomplish balanced man-machine, cost-effective operations in space; (3) identifying areas where conceptually different approaches to the use of people and machines can leverage the benefits of the scenarios; and (4) recommending modifications to scenarios or developing new scenarios that will improve the expected benefits. The FY89 special assessments are grouped into the five categories shown in the report. The high level system analyses for Automation & Robotics (A&R) and Human Performance (HP) were performed under the Case Studies Technology Assessment category, whereas the detailed analyses for the critical systems and high leverage development areas were performed under the appropriate operations categories (In-Space Vehicle Operations or Planetary Surface Operations). The analysis activities planned for the Science Operations technology areas were deferred to FY90 studies. The remaining activities such as analytic tool development, graphics/video demonstrations and intelligent communicating systems software architecture were performed under the Simulation & Validations category.

NEXT Performance Curve Analysis and Validation

NASA Technical Reports Server (NTRS)

Saripalli, Pratik; Cardiff, Eric; Englander, Jacob

2016-01-01

Performance curves of the NEXT thruster are highly important in determining the thruster's ability in performing towards mission-specific goals. New performance curves are proposed and examined here. The Evolutionary Mission Trajectory Generator (EMTG) is used to verify variations in mission solutions based on both available thruster curves and the new curves generated. Furthermore, variations in BOL and EOL curves are also examined. Mission design results shown here validate the use of EMTG and the new performance curves.

Validation of biological activity testing procedure of recombinant human interleukin-7.

PubMed

Lutsenko, T N; Kovalenko, M V; Galkin, O Yu

2017-01-01

Validation procedure for method of monitoring the biological activity of reсombinant human interleukin-7 has been developed and conducted according to the requirements of national and international recommendations. This method is based on the ability of recombinant human interleukin-7 to induce proliferation of T lymphocytes. It has been shown that to control the biological activity of recombinant human interleukin-7 peripheral blood mononuclear cells (PBMCs) derived from blood or cell lines can be used. Validation charac­teristics that should be determined depend on the method, type of product or object test/measurement and biological test systems used in research. The validation procedure for the method of control of biological activity of recombinant human interleukin-7 in peripheral blood mononuclear cells showed satisfactory results on all parameters tested such as specificity, accuracy, precision and linearity.

Verification and Validation Plan for Flight Performance Requirements on the CEV Parachute Assembly System

NASA Technical Reports Server (NTRS)

Morris, Aaron L.; Olson, Leah M.

2011-01-01

The Crew Exploration Vehicle Parachute Assembly System (CPAS) is engaged in a multi-year design and test campaign aimed at qualifying a parachute recovery system for human use on the Orion Spacecraft. Orion has parachute flight performance requirements that will ultimately be verified through the use of Monte Carlo multi-degree of freedom flight simulations. These simulations will be anchored by real world flight test data and iteratively improved to provide a closer approximation to the real physics observed in the inherently chaotic inflation and steady state flight of the CPAS parachutes. This paper will examine the processes necessary to verify the flight performance requirements of the human rated spacecraft. The focus will be on the requirements verification and model validation planned on CPAS.

Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method

DOE PAGES

Liao, Huafei N.; Groth, Katrina; Stevens-Adams, Susan

2015-07-29

Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification aremore » discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.« less

Cross-Validation of Predictor Equations for Armor Crewman Performance

DTIC Science & Technology

1980-01-01

Technical Report 447 CROSS-VALIDATION OF PREDICTOR EQUATIONS FOR ARMOR CREWMAN PERFORMANCE Anthony J. Maitland , Newell K. Eaton, and Janet F. Neft...ORG. REPORT NUMBER Anthony J/ Maitland . Newell K/EatorV. and B OTATO RN UBR. 9- PERFORMING ORGANIZATION NAME AND ADDRESS I0. PROGRAM ELEMENT, PROJECT...Technical Report 447 CROSS-VALIDATION OF PREDICTOR EQUATIONS FOR ARMOR CREWMAN PERFORMANCE Anthony J. Maitland , Newell K. Eaton, Accession For and

Validation of Bioreactor and Human-on-a-Chip Devices for Chemical Safety Assessment.

PubMed

Rebelo, Sofia P; Dehne, Eva-Maria; Brito, Catarina; Horland, Reyk; Alves, Paula M; Marx, Uwe

2016-01-01

Equipment and device qualification and test assay validation in the field of tissue engineered human organs for substance assessment remain formidable tasks with only a few successful examples so far. The hurdles seem to increase with the growing complexity of the biological systems, emulated by the respective models. Controlled single tissue or organ culture in bioreactors improves the organ-specific functions and maintains their phenotypic stability for longer periods of time. The reproducibility attained with bioreactor operations is, per se, an advantage for the validation of safety assessment. Regulatory agencies have gradually altered the validation concept from exhaustive "product" to rigorous and detailed process characterization, valuing reproducibility as a standard for validation. "Human-on-a-chip" technologies applying micro-physiological systems to the in vitro combination of miniaturized human organ equivalents into functional human micro-organisms are nowadays thought to be the most elaborate solution created to date. They target the replacement of the current most complex models-laboratory animals. Therefore, we provide here a road map towards the validation of such "human-on-a-chip" models and qualification of their respective bioreactor and microchip equipment along a path currently used for the respective animal models.

Performance Ratings: Designs for Evaluating Their Validity and Accuracy.

DTIC Science & Technology

1986-07-01

ratees with substantial validity and with little bias due to the ethod for rating. Convergent validity and discriminant validity account for approximately...The expanded research design suggests that purpose for the ratings has little influence on the multitrait-multimethod properties of the ratings...Convergent and discriminant validity again account for substantial differences in the ratings of performance. Little method bias is present; both methods of

Construct Validity of Three Clerkship Performance Assessments

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2010-01-01

This study examined construct validity of three commonly used clerkship performance assessments: preceptors' evaluations, OSCE-type clinical performance measures, and the NBME [National Board of Medical Examiners] medicine subject examination. Six hundred and eighty-six students taking the inpatient medicine clerkship from 2003 to 2007…

Human System Simulation in Support of Human Performance Technical Basis at NPPs

DOE Office of Scientific and Technical Information (OSTI.GOV)

David Gertman; Katya Le Blanc; alan mecham

2010-06-01

This paper focuses on strategies and progress toward establishing the Idaho National Laboratory’s (INL’s) Human Systems Simulator Laboratory at the Center for Advanced Energy Studies (CAES), a consortium of Idaho State Universities. The INL is one of the National Laboratories of the US Department of Energy. One of the first planned applications for the Human Systems Simulator Laboratory is implementation of a dynamic nuclear power plant simulation (NPP) where studies of operator workload, situation awareness, performance and preference will be carried out in simulated control rooms including nuclear power plant control rooms. Simulation offers a means by which to reviewmore » operational concepts, improve design practices and provide a technical basis for licensing decisions. In preparation for the next generation power plant and current government and industry efforts in support of light water reactor sustainability, human operators will be attached to a suite of physiological measurement instruments and, in combination with traditional Human Factors Measurement techniques, carry out control room tasks in simulated advanced digital and hybrid analog/digital control rooms. The current focus of the Human Systems Simulator Laboratory is building core competence in quantitative and qualitative measurements of situation awareness and workload. Of particular interest is whether introduction of digital systems including automated procedures has the potential to reduce workload and enhance safety while improving situation awareness or whether workload is merely shifted and situation awareness is modified in yet to be determined ways. Data analysis is carried out by engineers and scientists and includes measures of the physical and neurological correlates of human performance. The current approach supports a user-centered design philosophy (see ISO 13407 “Human Centered Design Process for Interactive Systems, 1999) wherein the context for task performance along

Development and validation of the Hospitality Axiological Scale for Humanization of Nursing Care

PubMed Central

Galán González-Serna, José María; Ferreras-Mencia, Soledad; Arribas-Marín, Juan Manuel

2017-01-01

ABSTRACT Objective: to develop and validate a scale to evaluate nursing attitudes in relation to hospitality for the humanization of nursing care. Participants: the sample consisted of 499 nursing professionals and undergraduate students of the final two years of the Bachelor of Science in Nursing program. Method: the instrument has been developed and validated to evaluate the ethical values related to hospitality using a methodological approach. Subsequently, a model was developed to measure the dimensions forming the construct hospitality. Results: the Axiological Hospitality Scale showed a high internal consistency, with Cronbach’s Alpha=0.901. The validation of the measuring instrument was performed using factorial, exploratory and confirmatory analysis techniques with high goodness of fit measures. Conclusions: the developed instrument showed an adequate validity and a high internal consistency. Based on the consistency of its psychometric properties, it is possible to affirm that the scale provides a reliable measurement of the hospitality. It was also possible to determine the dimensions or sources that embrace it: respect, responsibility, quality and transpersonal care. PMID:28793127

EEG-neurofeedback for optimising performance. II: creativity, the performing arts and ecological validity.

PubMed

Gruzelier, John H

2014-07-01

As a continuation of a review of evidence of the validity of cognitive/affective gains following neurofeedback in healthy participants, including correlations in support of the gains being mediated by feedback learning (Gruzelier, 2014a), the focus here is on the impact on creativity, especially in the performing arts including music, dance and acting. The majority of research involves alpha/theta (A/T), sensory-motor rhythm (SMR) and heart rate variability (HRV) protocols. There is evidence of reliable benefits from A/T training with advanced musicians especially for creative performance, and reliable benefits from both A/T and SMR training for novice music performance in adults and in a school study with children with impact on creativity, communication/presentation and technique. Making the SMR ratio training context ecologically relevant for actors enhanced creativity in stage performance, with added benefits from the more immersive training context. A/T and HRV training have benefitted dancers. The neurofeedback evidence adds to the rapidly accumulating validation of neurofeedback, while performing arts studies offer an opportunity for ecological validity in creativity research for both creative process and product. Copyright © 2013 Elsevier Ltd. All rights reserved.

Analysis of new psychoactive substances in human urine by ultra-high performance supercritical fluid and liquid chromatography: Validation and comparison.

PubMed

Borovcová, Lucie; Pauk, Volodymyr; Lemr, Karel

2018-05-01

New psychoactive substances represent serious social and health problem as tens of new compounds are detected in Europe annually. They often show structural proximity or even isomerism, which complicates their analysis. Two methods based on ultra high performance supercritical fluid chromatography and ultra high performance liquid chromatography with mass spectrometric detection were validated and compared. A simple dilute-filter-and-shoot protocol utilizing propan-2-ol or methanol for supercritical fluid or liquid chromatography, respectively, was proposed to detect and quantify 15 cathinones and phenethylamines in human urine. Both methods offered fast separation (<3 min) and short total analysis time. Precision was well <15% with a few exceptions in liquid chromatography. Limits of detection in urine ranged from 0.01 to 2.3 ng/mL, except for cathinone (5 ng/mL) in supercritical fluid chromatography. Nevertheless, this technique distinguished all analytes including four pairs of isomers, while liquid chromatography was unable to resolve fluoromethcathinone regioisomers. Concerning matrix effects and recoveries, supercritical fluid chromatography produced more uniform results for different compounds and at different concentration levels. This work demonstrates the performance and reliability of supercritical fluid chromatography and corroborates its applicability as an alternative tool for analysis of new psychoactive substances in biological matrixes. © 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Policy and Validity Prospects for Performance-Based Assessment.

ERIC Educational Resources Information Center

Baker, Eva L.; And Others

1994-01-01

This article describes performance-based assessment as expounded by its proponents, comments on these conceptions, reviews evidence regarding the technical quality of performance-based assessment, and considers its validity under various policy options. (JDD)

Wearable carbon nanotube-based fabric sensors for monitoring human physiological performance

NASA Astrophysics Data System (ADS)

Wang, Long; Loh, Kenneth J.

2017-05-01

A target application of wearable sensors is to detect human motion and to monitor physical activity for improving athletic performance and for delivering better physical therapy. In addition, measuring human vital signals (e.g., respiration rate and body temperature) provides rich information that can be used to assess a subject’s physiological or psychological condition. This study aims to design a multifunctional, wearable, fabric-based sensing system. First, carbon nanotube (CNT)-based thin films were fabricated by spraying. Second, the thin films were integrated with stretchable fabrics to form the fabric sensors. Third, the strain and temperature sensing properties of sensors fabricated using different CNT concentrations were characterized. Furthermore, the sensors were demonstrated to detect human finger bending motions, so as to validate their practical strain sensing performance. Finally, to monitor human respiration, the fabric sensors were integrated with a chest band, which was directly worn by a human subject. Quantification of respiration rates were successfully achieved. Overall, the fabric sensors were characterized by advantages such as flexibility, ease of fabrication, lightweight, low-cost, noninvasiveness, and user comfort.

A Unified Model of Performance: Validation of its Predictions across Different Sleep/Wake Schedules

PubMed Central

Ramakrishnan, Sridhar; Wesensten, Nancy J.; Balkin, Thomas J.; Reifman, Jaques

2016-01-01

Study Objectives: Historically, mathematical models of human neurobehavioral performance developed on data from one sleep study were limited to predicting performance in similar studies, restricting their practical utility. We recently developed a unified model of performance (UMP) to predict the effects of the continuum of sleep loss—from chronic sleep restriction (CSR) to total sleep deprivation (TSD) challenges—and validated it using data from two studies of one laboratory. Here, we significantly extended this effort by validating the UMP predictions across a wide range of sleep/wake schedules from different studies and laboratories. Methods: We developed the UMP on psychomotor vigilance task (PVT) lapse data from one study encompassing four different CSR conditions (7 d of 3, 5, 7, and 9 h of sleep/night), and predicted performance in five other studies (from four laboratories), including different combinations of TSD (40 to 88 h), CSR (2 to 6 h of sleep/night), control (8 to 10 h of sleep/night), and nap (nocturnal and diurnal) schedules. Results: The UMP accurately predicted PVT performance trends across 14 different sleep/wake conditions, yielding average prediction errors between 7% and 36%, with the predictions lying within 2 standard errors of the measured data 87% of the time. In addition, the UMP accurately predicted performance impairment (average error of 15%) for schedules (TSD and naps) not used in model development. Conclusions: The unified model of performance can be used as a tool to help design sleep/wake schedules to optimize the extent and duration of neurobehavioral performance and to accelerate recovery after sleep loss. Citation: Ramakrishnan S, Wesensten NJ, Balkin TJ, Reifman J. A unified model of performance: validation of its predictions across different sleep/wake schedules. SLEEP 2016;39(1):249–262. PMID:26518594

The Multifactor Measure of Performance: Its Development, Norming, and Validation.

PubMed

Bar-On, Reuven

2018-01-01

This article describes the development as well as the initial norming and validation of the Multifactor Measure of Performance™ (MMP™), which is a psychometric instrument that is designed to study, assess and enhance key predictors of human performance to help individuals perform at a higher level. It was created by the author, for the purpose of going beyond existing conceptual and psychometric models that often focus on relatively few factors that are purported to assess performance at school, in the workplace and elsewhere. The relative sparsity of multifactorial pre-employment assessment instruments exemplifies, for the author, one of the important reasons for developing the MMP™, which attempts to comprehensively evaluate a wider array of factors that are thought to contribute to performance. In that this situation creates a need in the area of test-construction that should be addressed, the author sought to develop a multifactorial assessment and development instrument that could concomitantly evaluate a combination of physical, cognitive, intra-personal, inter-personal, and motivational factors that significantly contribute to performance. The specific aim of this article is to show why, how and if this could be done as well as to present and discuss the potential importance of the results obtained to date. The findings presented here will hopefully add to what is known about human performance and thus contribute to the professional literature, in addition to contribute to the continued development of the MMP™. The impetus for developing the MMP™ is first explained below, followed by a detailed description of the process involved and the findings obtained; and their potential application is then discussed as well as the possible limitations of the present research and the need for future studies to address them.

The Multifactor Measure of Performance: Its Development, Norming, and Validation

PubMed Central

Bar-On, Reuven

2018-01-01

This article describes the development as well as the initial norming and validation of the Multifactor Measure of Performance™ (MMP™)1, which is a psychometric instrument that is designed to study, assess and enhance key predictors of human performance to help individuals perform at a higher level. It was created by the author, for the purpose of going beyond existing conceptual and psychometric models that often focus on relatively few factors that are purported to assess performance at school, in the workplace and elsewhere. The relative sparsity of multifactorial pre-employment assessment instruments exemplifies, for the author, one of the important reasons for developing the MMP™, which attempts to comprehensively evaluate a wider array of factors that are thought to contribute to performance. In that this situation creates a need in the area of test-construction that should be addressed, the author sought to develop a multifactorial assessment and development instrument that could concomitantly evaluate a combination of physical, cognitive, intra-personal, inter-personal, and motivational factors that significantly contribute to performance. The specific aim of this article is to show why, how and if this could be done as well as to present and discuss the potential importance of the results obtained to date. The findings presented here will hopefully add to what is known about human performance and thus contribute to the professional literature, in addition to contribute to the continued development of the MMP™. The impetus for developing the MMP™ is first explained below, followed by a detailed description of the process involved and the findings obtained; and their potential application is then discussed as well as the possible limitations of the present research and the need for future studies to address them. PMID:29515479

Performance Validation Approach for the GTX Air-Breathing Launch Vehicle

NASA Technical Reports Server (NTRS)

Trefny, Charles J.; Roche, Joseph M.

2002-01-01

The primary objective of the GTX effort is to determine whether or not air-breathing propulsion can enable a launch vehicle to achieve orbit in a single stage. Structural weight, vehicle aerodynamics, and propulsion performance must be accurately known over the entire flight trajectory in order to make a credible assessment. Structural, aerodynamic, and propulsion parameters are strongly interdependent, which necessitates a system approach to design, evaluation, and optimization of a single-stage-to-orbit concept. The GTX reference vehicle serves this purpose, by allowing design, development, and validation of components and subsystems in a system context. The reference vehicle configuration (including propulsion) was carefully chosen so as to provide high potential for structural and volumetric efficiency, and to allow the high specific impulse of air-breathing propulsion cycles to be exploited. Minor evolution of the configuration has occurred as analytical and experimental results have become available. With this development process comes increasing validation of the weight and performance levels used in system performance determination. This paper presents an overview of the GTX reference vehicle and the approach to its performance validation. Subscale test rigs and numerical studies used to develop and validate component performance levels and unit structural weights are outlined. The sensitivity of the equivalent, effective specific impulse to key propulsion component efficiencies is presented. The role of flight demonstration in development and validation is discussed.

Electrolysis Performance Improvement and Validation Experiment

NASA Technical Reports Server (NTRS)

Schubert, Franz H.

1992-01-01

Viewgraphs on electrolysis performance improvement and validation experiment are presented. Topics covered include: water electrolysis: an ever increasing need/role for space missions; static feed electrolysis (SFE) technology: a concept developed for space applications; experiment objectives: why test in microgravity environment; and experiment description: approach, hardware description, test sequence and schedule.

A cross-validated cytoarchitectonic atlas of the human ventral visual stream.

PubMed

Rosenke, Mona; Weiner, Kevin S; Barnett, Michael A; Zilles, Karl; Amunts, Katrin; Goebel, Rainer; Grill-Spector, Kalanit

2018-04-15

The human ventral visual stream consists of several areas that are considered processing stages essential for perception and recognition. A fundamental microanatomical feature differentiating areas is cytoarchitecture, which refers to the distribution, size, and density of cells across cortical layers. Because cytoarchitectonic structure is measured in 20-micron-thick histological slices of postmortem tissue, it is difficult to assess (a) how anatomically consistent these areas are across brains and (b) how they relate to brain parcellations obtained with prevalent neuroimaging methods, acquired at the millimeter and centimeter scale. Therefore, the goal of this study was to (a) generate a cross-validated cytoarchitectonic atlas of the human ventral visual stream on a whole brain template that is commonly used in neuroimaging studies and (b) to compare this atlas to a recently published retinotopic parcellation of visual cortex (Wang et al., 2014). To achieve this goal, we generated an atlas of eight cytoarchitectonic areas: four areas in the occipital lobe (hOc1-hOc4v) and four in the fusiform gyrus (FG1-FG4), then we tested how the different alignment techniques affect the accuracy of the resulting atlas. Results show that both cortex-based alignment (CBA) and nonlinear volumetric alignment (NVA) generate an atlas with better cross-validation performance than affine volumetric alignment (AVA). Additionally, CBA outperformed NVA in 6/8 of the cytoarchitectonic areas. Finally, the comparison of the cytoarchitectonic atlas to a retinotopic atlas shows a clear correspondence between cytoarchitectonic and retinotopic areas in the ventral visual stream. The successful performance of CBA suggests a coupling between cytoarchitectonic areas and macroanatomical landmarks in the human ventral visual stream, and furthermore, that this coupling can be utilized for generating an accurate group atlas. In addition, the coupling between cytoarchitecture and retinotopy highlights

International Validation of Two Human Recombinant Estrogen ...

EPA Pesticide Factsheets

An international validation study has been successfully completed for 2 competitive binding assays using human recombinant ERa. Assays evaluated included the Freyberger-Wilson (FW) assay using a full length human ER, and the Chemical Evaluation and Research Institute (CERI) assay using a ligand-binding domain of the human ER. Twenty three compounds were tested in 6 laboratories for the FW assay and 5 for the CERJ assay, which included three controls (used with every run), 9 uncoded, and 14 coded chemicals across 3 subtasks. The overall goal of this validation study was to demonstrate the ability of each of the two assays to reliably classify the test chemicals as binders or non-binders. Laboratories had little trouble with the ER binders that produced a full binding curve when using either the CERI or FW assays. As is typical with all ER competitive binding assays, the weak binders proved to be more challenging. However, overall results from both the FW and CERI assays were consistent and in agreement with expected classifications regardless of the form of the hrER (i.e., full length ER versus an ER ligand binding domain) or the subtle differences in the protocols for conducting each assay. The reproducibility and accuracy for classification of chemicals as potential ER binders and non- binders using the FW and CERI hrER binding assays were comparable to that of the U.S.EPA’s existing ER binding test guideline OPPTS 890.1250, while providing an improved, highe

The Model Human Processor and the Older Adult: Parameter Estimation and Validation Within a Mobile Phone Task

PubMed Central

Jastrzembski, Tiffany S.; Charness, Neil

2009-01-01

The authors estimate weighted mean values for nine information processing parameters for older adults using the Card, Moran, and Newell (1983) Model Human Processor model. The authors validate a subset of these parameters by modeling two mobile phone tasks using two different phones and comparing model predictions to a sample of younger (N = 20; Mage = 20) and older (N = 20; Mage = 69) adults. Older adult models fit keystroke-level performance at the aggregate grain of analysis extremely well (R = 0.99) and produced equivalent fits to previously validated younger adult models. Critical path analyses highlighted points of poor design as a function of cognitive workload, hardware/software design, and user characteristics. The findings demonstrate that estimated older adult information processing parameters are valid for modeling purposes, can help designers understand age-related performance using existing interfaces, and may support the development of age-sensitive technologies. PMID:18194048

The Model Human Processor and the older adult: parameter estimation and validation within a mobile phone task.

PubMed

Jastrzembski, Tiffany S; Charness, Neil

2007-12-01

The authors estimate weighted mean values for nine information processing parameters for older adults using the Card, Moran, and Newell (1983) Model Human Processor model. The authors validate a subset of these parameters by modeling two mobile phone tasks using two different phones and comparing model predictions to a sample of younger (N = 20; M-sub(age) = 20) and older (N = 20; M-sub(age) = 69) adults. Older adult models fit keystroke-level performance at the aggregate grain of analysis extremely well (R = 0.99) and produced equivalent fits to previously validated younger adult models. Critical path analyses highlighted points of poor design as a function of cognitive workload, hardware/software design, and user characteristics. The findings demonstrate that estimated older adult information processing parameters are valid for modeling purposes, can help designers understand age-related performance using existing interfaces, and may support the development of age-sensitive technologies.

International Validation of Two Human Recombinant Estrogen Receptor (ERa) Binding Assays

EPA Science Inventory

An international validation study has been successfully completed for 2 competitive binding assays using human recombinant ERa. Assays evaluated included the Freyberger-Wilson (FW) assay using a full length human ER, and the Chemical Evaluation and Research Institute (CERI) assay...

Human Performance in Space

NASA Technical Reports Server (NTRS)

Jones, Patricia M.; Fiedler, Edna

2010-01-01

Human factors is a critical discipline for human spaceflight. Nearly every human factors research area is relevant to space exploration -- from the ergonomics of hand tools used by astronauts, to the displays and controls of a spacecraft cockpit or mission control workstation, to levels of automation designed into rovers on Mars, to organizational issues of communication between crew and ground. This chapter focuses more on the ways in which the space environment (especially altered gravity and the isolated and confined nature of long-duration spaceflight) affects crew performance, and thus has specific novel implications for human factors research and practice. We focus on four aspects of human performance: neurovestibular integration, motor control and musculo-skeletal effects, cognitive effects, and behavioral health. We also provide a sampler of recent human factors studies from NASA.

Impact of External Cue Validity on Driving Performance in Parkinson's Disease

PubMed Central

Scally, Karen; Charlton, Judith L.; Iansek, Robert; Bradshaw, John L.; Moss, Simon; Georgiou-Karistianis, Nellie

2011-01-01

This study sought to investigate the impact of external cue validity on simulated driving performance in 19 Parkinson's disease (PD) patients and 19 healthy age-matched controls. Braking points and distance between deceleration point and braking point were analysed for red traffic signals preceded either by Valid Cues (correctly predicting signal), Invalid Cues (incorrectly predicting signal), and No Cues. Results showed that PD drivers braked significantly later and travelled significantly further between deceleration and braking points compared with controls for Invalid and No-Cue conditions. No significant group differences were observed for driving performance in response to Valid Cues. The benefit of Valid Cues relative to Invalid Cues and No Cues was significantly greater for PD drivers compared with controls. Trail Making Test (B-A) scores correlated with driving performance for PDs only. These results highlight the importance of external cues and higher cognitive functioning for driving performance in mild to moderate PD. PMID:21789275

Validation of hot-poured crack sealant performance-based guidelines.

DOT National Transportation Integrated Search

2017-06-01

This report summarizes a comprehensive research effort to validate thresholds for performance-based guidelines and : grading system for hot-poured asphalt crack sealants. A series of performance tests were established in earlier research and : includ...

Reaction time as an indicator of insufficient effort: Development and validation of an embedded performance validity parameter.

PubMed

Stevens, Andreas; Bahlo, Simone; Licha, Christina; Liske, Benjamin; Vossler-Thies, Elisabeth

2016-11-30

Subnormal performance in attention tasks may result from various sources including lack of effort. In this report, the derivation and validation of a performance validity parameter for reaction time is described, using a set of malingering-indices ("Slick-criteria"), and 3 independent samples of participants (total n =893). The Slick-criteria yield an estimate of the probability of malingering based on the presence of an external incentive, evidence from neuropsychological testing, from self-report and clinical data. In study (1) a validity parameter is derived using reaction time data of a sample, composed of inpatients with recent severe brain lesions not involved in litigation and of litigants with and without brain lesion. In study (2) the validity parameter is tested in an independent sample of litigants. In study (3) the parameter is applied to an independent sample comprising cooperative and non-cooperative testees. Logistic regression analysis led to a derived validity parameter based on median reaction time and standard deviation. It performed satisfactorily in studies (2) and (3) (study 2 sensitivity=0.94, specificity=1.00; study 3 sensitivity=0.79, specificity=0.87). The findings suggest that median reaction time and standard deviation may be used as indicators of negative response bias. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Human target acquisition performance

NASA Astrophysics Data System (ADS)

Teaney, Brian P.; Du Bosq, Todd W.; Reynolds, Joseph P.; Thompson, Roger; Aghera, Sameer; Moyer, Steven K.; Flug, Eric; Espinola, Richard; Hixson, Jonathan

2012-06-01

The battlefield has shifted from armored vehicles to armed insurgents. Target acquisition (identification, recognition, and detection) range performance involving humans as targets is vital for modern warfare. The acquisition and neutralization of armed insurgents while at the same time minimizing fratricide and civilian casualties is a mounting concern. U.S. Army RDECOM CERDEC NVESD has conducted many experiments involving human targets for infrared and reflective band sensors. The target sets include human activities, hand-held objects, uniforms & armament, and other tactically relevant targets. This paper will define a set of standard task difficulty values for identification and recognition associated with human target acquisition performance.

Performance Validity Testing in Neuropsychology: Scientific Basis and Clinical Application-A Brief Review.

PubMed

Greher, Michael R; Wodushek, Thomas R

2017-03-01

Performance validity testing refers to neuropsychologists' methodology for determining whether neuropsychological test performances completed in the course of an evaluation are valid (ie, the results of true neurocognitive function) or invalid (ie, overly impacted by the patient's effort/engagement in testing). This determination relies upon the use of either standalone tests designed for this sole purpose, or specific scores/indicators embedded within traditional neuropsychological measures that have demonstrated this utility. In response to a greater appreciation for the critical role that performance validity issues play in neuropsychological testing and the need to measure this variable to the best of our ability, the scientific base for performance validity testing has expanded greatly over the last 20 to 30 years. As such, the majority of current day neuropsychologists in the United States use a variety of measures for the purpose of performance validity testing as part of everyday forensic and clinical practice and address this issue directly in their evaluations. The following is the first article of a 2-part series that will address the evolution of performance validity testing in the field of neuropsychology, both in terms of the science as well as the clinical application of this measurement technique. The second article of this series will review performance validity tests in terms of methods for development of these measures, and maximizing of diagnostic accuracy.

A Unified Model of Performance: Validation of its Predictions across Different Sleep/Wake Schedules.

PubMed

Ramakrishnan, Sridhar; Wesensten, Nancy J; Balkin, Thomas J; Reifman, Jaques

2016-01-01

Historically, mathematical models of human neurobehavioral performance developed on data from one sleep study were limited to predicting performance in similar studies, restricting their practical utility. We recently developed a unified model of performance (UMP) to predict the effects of the continuum of sleep loss-from chronic sleep restriction (CSR) to total sleep deprivation (TSD) challenges-and validated it using data from two studies of one laboratory. Here, we significantly extended this effort by validating the UMP predictions across a wide range of sleep/wake schedules from different studies and laboratories. We developed the UMP on psychomotor vigilance task (PVT) lapse data from one study encompassing four different CSR conditions (7 d of 3, 5, 7, and 9 h of sleep/night), and predicted performance in five other studies (from four laboratories), including different combinations of TSD (40 to 88 h), CSR (2 to 6 h of sleep/night), control (8 to 10 h of sleep/night), and nap (nocturnal and diurnal) schedules. The UMP accurately predicted PVT performance trends across 14 different sleep/wake conditions, yielding average prediction errors between 7% and 36%, with the predictions lying within 2 standard errors of the measured data 87% of the time. In addition, the UMP accurately predicted performance impairment (average error of 15%) for schedules (TSD and naps) not used in model development. The unified model of performance can be used as a tool to help design sleep/wake schedules to optimize the extent and duration of neurobehavioral performance and to accelerate recovery after sleep loss. © 2016 Associated Professional Sleep Societies, LLC.

Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery.

PubMed

Ribeiro de Oliveira, Marcelo Magaldi; Nicolato, Arthur; Santos, Marcilea; Godinho, Joao Victor; Brito, Rafael; Alvarenga, Alexandre; Martins, Ana Luiza Valle; Prosdocimi, André; Trivelato, Felipe Padovani; Sabbagh, Abdulrahman J; Reis, Augusto Barbosa; Maestro, Rolando Del

2016-05-01

OBJECT The development of neurointerventional treatments of central nervous system disorders has resulted in the need for adequate training environments for novice interventionalists. Virtual simulators offer anatomical definition but lack adequate tactile feedback. Animal models, which provide more lifelike training, require an appropriate infrastructure base. The authors describe a training model for neurointerventional procedures using the human placenta (HP), which affords haptic training with significantly fewer resource requirements, and discuss its validation. METHODS Twelve HPs were prepared for simulated endovascular procedures. Training exercises performed by interventional neuroradiologists and novice fellows were placental angiography, stent placement, aneurysm coiling, and intravascular liquid embolic agent injection. RESULTS The endovascular training exercises proposed can be easily reproduced in the HP. Face, content, and construct validity were assessed by 6 neurointerventional radiologists and 6 novice fellows in interventional radiology. CONCLUSIONS The use of HP provides an inexpensive training model for the training of neurointerventionalists. Preliminary validation results show that this simulation model has face and content validity and has demonstrated construct validity for the interventions assessed in this study.

High-definition fiber tractography of the human brain: neuroanatomical validation and neurosurgical applications.

PubMed

Fernandez-Miranda, Juan C; Pathak, Sudhir; Engh, Johnathan; Jarbo, Kevin; Verstynen, Timothy; Yeh, Fang-Cheng; Wang, Yibao; Mintz, Arlan; Boada, Fernando; Schneider, Walter; Friedlander, Robert

2012-08-01

High-definition fiber tracking (HDFT) is a novel combination of processing, reconstruction, and tractography methods that can track white matter fibers from cortex, through complex fiber crossings, to cortical and subcortical targets with subvoxel resolution. To perform neuroanatomical validation of HDFT and to investigate its neurosurgical applications. Six neurologically healthy adults and 36 patients with brain lesions were studied. Diffusion spectrum imaging data were reconstructed with a Generalized Q-Ball Imaging approach. Fiber dissection studies were performed in 20 human brains, and selected dissection results were compared with tractography. HDFT provides accurate replication of known neuroanatomical features such as the gyral and sulcal folding patterns, the characteristic shape of the claustrum, the segmentation of the thalamic nuclei, the decussation of the superior cerebellar peduncle, the multiple fiber crossing at the centrum semiovale, the complex angulation of the optic radiations, the terminal arborization of the arcuate tract, and the cortical segmentation of the dorsal Broca area. From a clinical perspective, we show that HDFT provides accurate structural connectivity studies in patients with intracerebral lesions, allowing qualitative and quantitative white matter damage assessment, aiding in understanding lesional patterns of white matter structural injury, and facilitating innovative neurosurgical applications. High-grade gliomas produce significant disruption of fibers, and low-grade gliomas cause fiber displacement. Cavernomas cause both displacement and disruption of fibers. Our HDFT approach provides an accurate reconstruction of white matter fiber tracts with unprecedented detail in both the normal and pathological human brain. Further studies to validate the clinical findings are needed.

Ride qualities criteria validation/pilot performance study: Flight test results

NASA Technical Reports Server (NTRS)

Nardi, L. U.; Kawana, H. Y.; Greek, D. C.

1979-01-01

Pilot performance during a terrain following flight was studied for ride quality criteria validation. Data from manual and automatic terrain following operations conducted during low level penetrations were analyzed to determine the effect of ride qualities on crew performance. The conditions analyzed included varying levels of turbulence, terrain roughness, and mission duration with a ride smoothing system on and off. Limited validation of the B-1 ride quality criteria and some of the first order interactions between ride qualities and pilot/vehicle performance are highlighted. An earlier B-1 flight simulation program correlated well with the flight test results.

Human Factors Validation of the AeroForm Tissue Expander System for Breast Reconstruction.

PubMed

Kelley, Kathy; Kim, Jennie

The tissue expansion process using traditional saline expanders is lengthy and uncomfortable. A new technology has been developed, providing a needle-free option implanted after a mastectomy, and is activated by a handheld remote control releasing small amounts (10 cc) of carbon dioxide from an internal reservoir. The expander is gradually filled with CO2 resulting in mechanical stretching of the overlying tissue. The AeroForm System has been evaluated in a series of clinical trials including a randomized, controlled U.S. study comparing the AeroForm System with saline expanders. Results demonstrated patients can safely and reliably dose and complete their expansions in half the time compared to saline expanders. A human factors validation study was conducted in 8 patients to evaluate whether patients could correctly use the device to complete their expansion at home. The sessions were recorded and data on performance, behavioral, and subjective measures were collected and analyzed and submitted to the FDA as part of the U.S. marketing approval. All 8 participants were successful in using the controller to deliver a simulated dose. Participants found the device easy to use and the training material provided adequate to understand use of the controller. For women who choose 2-stage breast reconstruction, a new safe and effective option is available for tissue expansion, offering a convenient and empowering alternative. The human factors validation study conducted confirmed the simplicity of the device and further validated that the device can be used safely and effectively for breast tissue expansion.

Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation.

PubMed

Wickens, Christopher D; Sebok, Angelia; Li, Huiyang; Sarter, Nadine; Gacy, Andrew M

2015-09-01

The aim of this study was to develop and validate a computational model of the automation complacency effect, as operators work on a robotic arm task, supported by three different degrees of automation. Some computational models of complacency in human-automation interaction exist, but those are formed and validated within the context of fairly simplified monitoring failures. This research extends model validation to a much more complex task, so that system designers can establish, without need for human-in-the-loop (HITL) experimentation, merits and shortcomings of different automation degrees. We developed a realistic simulation of a space-based robotic arm task that could be carried out with three different levels of trajectory visualization and execution automation support. Using this simulation, we performed HITL testing. Complacency was induced via several trials of correctly performing automation and then was assessed on trials when automation failed. Following a cognitive task analysis of the robotic arm operation, we developed a multicomponent model of the robotic operator and his or her reliance on automation, based in part on visual scanning. The comparison of model predictions with empirical results revealed that the model accurately predicted routine performance and predicted the responses to these failures after complacency developed. However, the scanning models do not account for the entire attention allocation effects of complacency. Complacency modeling can provide a useful tool for predicting the effects of different types of imperfect automation. The results from this research suggest that focus should be given to supporting situation awareness in automation development. © 2015, Human Factors and Ergonomics Society.

Assessment of human epidermal model LabCyte EPI-MODEL for in vitro skin irritation testing according to European Centre for the Validation of Alternative Methods (ECVAM)-validated protocol.

PubMed

Katoh, Masakazu; Hamajima, Fumiyasu; Ogasawara, Takahiro; Hata, Ken-Ichiro

2009-06-01

A validation study of an in vitro skin irritation testing method using a reconstructed human skin model has been conducted by the European Centre for the Validation of Alternative Methods (ECVAM), and a protocol using EpiSkin (SkinEthic, France) has been approved. The structural and performance criteria of skin models for testing are defined in the ECVAM Performance Standards announced along with the approval. We have performed several evaluations of the new reconstructed human epidermal model LabCyte EPI-MODEL, and confirmed that it is applicable to skin irritation testing as defined in the ECVAM Performance Standards. We selected 19 materials (nine irritants and ten non-irritants) available in Japan as test chemicals among the 20 reference chemicals described in the ECVAM Performance Standard. A test chemical was applied to the surface of the LabCyte EPI-MODEL for 15 min, after which it was completely removed and the model then post-incubated for 42 hr. Cell v iability was measured by MTT assay and skin irritancy of the test chemical evaluated. In addition, interleukin-1 alpha (IL-1alpha) concentration in the culture supernatant after post-incubation was measured to provide a complementary evaluation of skin irritation. Evaluation of the 19 test chemicals resulted in 79% accuracy, 78% sensitivity and 80% specificity, confirming that the in vitro skin irritancy of the LabCyte EPI-MODEL correlates highly with in vivo skin irritation. These results suggest that LabCyte EPI-MODEL is applicable to the skin irritation testing protocol set out in the ECVAM Performance Standards.

Parametric convergence sensitivity and validation of a finite element model of the human lumbar spine.

PubMed

Ayturk, Ugur M; Puttlitz, Christian M

2011-08-01

The primary objective of this study was to generate a finite element model of the human lumbar spine (L1-L5), verify mesh convergence for each tissue constituent and perform an extensive validation using both kinematic/kinetic and stress/strain data. Mesh refinement was accomplished via convergence of strain energy density (SED) predictions for each spinal tissue. The converged model was validated based on range of motion, intradiscal pressure, facet force transmission, anterolateral cortical bone strain and anterior longitudinal ligament deformation predictions. Changes in mesh resolution had the biggest impact on SED predictions under axial rotation loading. Nonlinearity of the moment-rotation curves was accurately simulated and the model predictions on the aforementioned parameters were in good agreement with experimental data. The validated and converged model will be utilised to study the effects of degeneration on the lumbar spine biomechanics, as well as to investigate the mechanical underpinning of the contemporary treatment strategies.

Psychological collectivism: a measurement validation and linkage to group member performance.

PubMed

Jackson, Christine L; Colquitt, Jason A; Wesson, Michael J; Zapata-Phelan, Cindy P

2006-07-01

The 3 studies presented here introduce a new measure of the individual-difference form of collectivism. Psychological collectivism is conceptualized as a multidimensional construct with the following 5 facets: preference for in-groups, reliance on in-groups, concern for in-groups, acceptance of in-group norms, and prioritization of in-group goals. Study 1 developed and tested the new measure in a sample of consultants. Study 2 cross-validated the measure using an alumni sample of a Southeastern university, assessing its convergent validity with other collectivism measures. Study 3 linked scores on the measure to 4 dimensions of group member performance (task performance, citizenship behavior, counterproductive behavior, and withdrawal behavior) in a computer software firm and assessed discriminant validity using the Big Five. The results of the studies support the construct validity of the measure and illustrate the potential value of collectivism as a predictor of group member performance. ((c) 2006 APA, all rights reserved).

Development and validation of an ultra-high performance liquid chromatography-tandem mass spectrometry method to measure creatinine in human urine.

PubMed

Fraselle, S; De Cremer, K; Coucke, W; Glorieux, G; Vanmassenhove, J; Schepers, E; Neirynck, N; Van Overmeire, I; Van Loco, J; Van Biesen, W; Vanholder, R

2015-04-15

Despite decades of creatinine measurement in biological fluids using a large variety of analytical methods, an accurate determination of this compound remains challenging. Especially with the novel trend to assess biomarkers on large sample sets preserved in biobanks, a simple and fast method that could cope with both a high sample throughput and a low volume of sample is still of interest. In answer to these challenges, a fast and accurate ultra-high performance liquid chromatography-tandem mass spectrometry (UHPLC-MS/MS) method was developed to measure creatinine in small volumes of human urine. In this method, urine samples are simply diluted with a basic mobile phase and injected directly under positive electrospray ionization (ESI) conditions, without further purification steps. The combination of an important diluting factor (10(4) times) due to the use of a very sensitive triple quadrupole mass spectrometer (XEVO TQ) and the addition of creatinine-d3 as internal standard completely eliminates matrix effects coming from the urine. The method was validated in-house in 2012 according to the EMA guideline on bioanalytical method validation using Certified Reference samples from the German External Quality Assessment Scheme (G-Equas) proficiency test. All obtained results for accuracy and recovery are within the authorized tolerance ranges defined by G-Equas. The method is linear between 0 and 5 g/L, with LOD and LOQ of 5 × 10(-3) g/L and 10(-2) g/L, respectively. The repeatability (CV(r) = 1.03-2.07%) and intra-laboratory reproducibility (CV(RW) = 1.97-2.40%) satisfy the EMA 2012 guideline. The validated method was firstly applied to perform the German G-Equas proficiency test rounds 51 and 53, in 2013 and 2014, respectively. The obtained results were again all within the accepted tolerance ranges and very close to the reference values defined by the organizers of the proficiency test scheme, demonstrating an excellent accuracy of the developed method. The

Excavator Design Validation

NASA Technical Reports Server (NTRS)

Pholsiri, Chalongrath; English, James; Seberino, Charles; Lim, Yi-Je

2010-01-01

The Excavator Design Validation tool verifies excavator designs by automatically generating control systems and modeling their performance in an accurate simulation of their expected environment. Part of this software design includes interfacing with human operations that can be included in simulation-based studies and validation. This is essential for assessing productivity, versatility, and reliability. This software combines automatic control system generation from CAD (computer-aided design) models, rapid validation of complex mechanism designs, and detailed models of the environment including soil, dust, temperature, remote supervision, and communication latency to create a system of high value. Unique algorithms have been created for controlling and simulating complex robotic mechanisms automatically from just a CAD description. These algorithms are implemented as a commercial cross-platform C++ software toolkit that is configurable using the Extensible Markup Language (XML). The algorithms work with virtually any mobile robotic mechanisms using module descriptions that adhere to the XML standard. In addition, high-fidelity, real-time physics-based simulation algorithms have also been developed that include models of internal forces and the forces produced when a mechanism interacts with the outside world. This capability is combined with an innovative organization for simulation algorithms, new regolith simulation methods, and a unique control and study architecture to make powerful tools with the potential to transform the way NASA verifies and compares excavator designs. Energid's Actin software has been leveraged for this design validation. The architecture includes parametric and Monte Carlo studies tailored for validation of excavator designs and their control by remote human operators. It also includes the ability to interface with third-party software and human-input devices. Two types of simulation models have been adapted: high-fidelity discrete

Standards Performance Continuum: Development and Validation of a Measure of Effective Pedagogy.

ERIC Educational Resources Information Center

Doherty, R. William; Hilberg, R. Soleste; Epaloose, Georgia; Tharp, Roland G.

2002-01-01

Describes the development and validation of the Standards Performance Continuum (SPC) for assessing teacher performance of the Standards for Effective Pedagogy. Three studies involving Florida, California, and New Mexico public school teachers provided evidence of inter-rater reliability, concurrent validity, and criterion-related validity…

Crazy like a fox. Validity and ethics of animal models of human psychiatric disease.

PubMed

Rollin, Michael D H; Rollin, Bernard E

2014-04-01

Animal models of human disease play a central role in modern biomedical science. Developing animal models for human mental illness presents unique practical and philosophical challenges. In this article we argue that (1) existing animal models of psychiatric disease are not valid, (2) attempts to model syndromes are undermined by current nosology, (3) models of symptoms are rife with circular logic and anthropomorphism, (4) any model must make unjustified assumptions about subjective experience, and (5) any model deemed valid would be inherently unethical, for if an animal adequately models human subjective experience, then there is no morally relevant difference between that animal and a human.

Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

PubMed

Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

2018-02-01

Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

Bioanalytical method development and validation for the determination of glycine in human cerebrospinal fluid by ion-pair reversed-phase liquid chromatography-tandem mass spectrometry.

PubMed

Jiang, Jian; James, Christopher A; Wong, Philip

2016-09-05

A LC-MS/MS method has been developed and validated for the determination of glycine in human cerebrospinal fluid (CSF). The validated method used artificial cerebrospinal fluid as a surrogate matrix for calibration standards. The calibration curve range for the assay was 100-10,000ng/mL and (13)C2, (15)N-glycine was used as an internal standard (IS). Pre-validation experiments were performed to demonstrate parallelism with surrogate matrix and standard addition methods. The mean endogenous glycine concentration in a pooled human CSF determined on three days by using artificial CSF as a surrogate matrix and the method of standard addition was found to be 748±30.6 and 768±18.1ng/mL, respectively. A percentage difference of -2.6% indicated that artificial CSF could be used as a surrogate calibration matrix for the determination of glycine in human CSF. Quality control (QC) samples, except the lower limit of quantitation (LLOQ) QC and low QC samples, were prepared by spiking glycine into aliquots of pooled human CSF sample. The low QC sample was prepared from a separate pooled human CSF sample containing low endogenous glycine concentrations, while the LLOQ QC sample was prepared in artificial CSF. Standard addition was used extensively to evaluate matrix effects during validation. The validated method was used to determine the endogenous glycine concentrations in human CSF samples. Incurred sample reanalysis demonstrated reproducibility of the method. Copyright © 2016 Elsevier B.V. All rights reserved.

The SACADA database for human reliability and human performance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Y. James Chang; Dennis Bley; Lawrence Criscione

2014-05-01

Lack of appropriate and sufficient human performance data has been identified as a key factor affecting human reliability analysis (HRA) quality especially in the estimation of human error probability (HEP). The Scenario Authoring, Characterization, and Debriefing Application (SACADA) database was developed by the U.S. Nuclear Regulatory Commission (NRC) to address this data need. An agreement between NRC and the South Texas Project Nuclear Operating Company (STPNOC) was established to support the SACADA development with aims to make the SACADA tool suitable for implementation in the nuclear power plants' operator training program to collect operator performance information. The collected data wouldmore » support the STPNOC's operator training program and be shared with the NRC for improving HRA quality. This paper discusses the SACADA data taxonomy, the theoretical foundation, the prospective data to be generated from the SACADA raw data to inform human reliability and human performance, and the considerations on the use of simulator data for HRA. Each SACADA data point consists of two information segments: context and performance results. Context is a characterization of the performance challenges to task success. The performance results are the results of performing the task. The data taxonomy uses a macrocognitive functions model for the framework. At a high level, information is classified according to the macrocognitive functions of detecting the plant abnormality, understanding the abnormality, deciding the response plan, executing the response plan, and team related aspects (i.e., communication, teamwork, and supervision). The data are expected to be useful for analyzing the relations between context, error modes and error causes in human performance.« less

Exploring a Framework for Consequential Validity for Performance-Based Assessments

ERIC Educational Resources Information Center

Kim, Su Jung

2017-01-01

This study explores a new comprehensive framework for understanding elements of validity, specifically for performance assessments that are administered within specific and dynamic contexts. The adoption of edTPA is a good empirical case for examining the concept of consequential validity because this assessment has been implemented at the state…

Human factors engineering and design validation for the redesigned follitropin alfa pen injection device.

PubMed

Mahony, Mary C; Patterson, Patricia; Hayward, Brooke; North, Robert; Green, Dawne

2015-05-01

To demonstrate, using human factors engineering (HFE), that a redesigned, pre-filled, ready-to-use, pre-asembled follitropin alfa pen can be used to administer prescribed follitropin alfa doses safely and accurately. A failure modes and effects analysis identified hazards and harms potentially caused by use errors; risk-control measures were implemented to ensure acceptable device use risk management. Participants were women with infertility, their significant others, and fertility nurse (FN) professionals. Preliminary testing included 'Instructions for Use' (IFU) and pre-validation studies. Validation studies used simulated injections in a representative use environment; participants received prior training on pen use. User performance in preliminary testing led to IFU revisions and a change to outer needle cap design to mitigate needle stick potential. In the first validation study (49 users, 343 simulated injections), in the FN group, one observed critical use error resulted in a device design modification and another in an IFU change. A second validation study tested the mitigation strategies; previously reported use errors were not repeated. Through an iterative process involving a series of studies, modifications were made to the pen design and IFU. Simulated-use testing demonstrated that the redesigned pen can be used to administer follitropin alfa effectively and safely.

SDBI 1904: Human Factors Assessment of Vibration Effects on Visual Performance during Launch

NASA Technical Reports Server (NTRS)

Thompson, Shelby G.; Holden, Kritina; Root, Phillip; Ebert, Douglas; Jones, Jeffery; Adelstein, Bernard

2009-01-01

The primary objective of the of Human Factors Short Duration Bioastronautics Investigation (SDBI) 1904 is to determine visual performance limits during operational vibration and g-loads, specifically through the determination of minimal usable font sized using Orion-type display formats. Currently there is little to no data available to quantify human visual performance under these extreme conditions. Existing data on shuttle vibration magnitude and frequency is incomplete, does not address sear and crew vibration in the current configuration, and does not address human visual performance. There have been anecdotal reports of performance decrements from shuttle crews, but no structured data has been collected. The SDBI is a companion effort to the Detailed Test Objective (DTO) 695, which will measure shuttle seat accelerations (vibration) during ascent. Data fro the SDBI will serve an important role in interpreting the DTO vibration data. This data will be collected during the ascent phase of three shuttle missions (STS-119, 127, and 128). Both SDBI1904 and DTO 695 are low impact with respect to flight resources, and combined they represent an efficient and focused problem solving approach. The SDBI and DTO data will be correlated to determine the nature of perceived visual performance under varying vibrations and g-loads. This project will provide: 1) Immediate data for developing preliminary human performance vibration requirements; 2) Flight validated inputs for ongoing and future ground-based research; and 3) Information of functional needs that will drive Orion display format design decisions.

Structural and Convergent Validity of the Homework Performance Questionnaire

ERIC Educational Resources Information Center

Pendergast, Laura L.; Watkins, Marley W.; Canivez, Gary L.

2014-01-01

Homework is a requirement for most school-age children, but research on the benefits and drawbacks of homework is limited by lack of psychometrically sound measurement of homework performance. This study examined the structural and convergent validity of scores from the newly developed Homework Performance Questionnaire -- Teacher Scale (HPQ-T).…

Physical performance tests after stroke: reliability and validity.

PubMed

Maeda, A; Yuasa, T; Nakamura, K; Higuchi, S; Motohashi, Y

2000-01-01

To evaluate the reliability and validity of the modified physical performance tests for stroke survivors who live in a community. The subjects included 40 stroke survivors and 40 apparently healthy independent elderly persons. The physical performance tests for the stroke survivors comprised two physical capacity evaluation tasks that represented physical abilities necessary to perform the main activities of daily living, e.g., standing-up ability (time needed to stand up from bed rest) and walking ability (time needed to walk 10 m). Regarding the reliability of tests, significant correlations were confirmed between test and retest of physical performance tests with both short and long intervals in individuals after stroke. Regarding the validity of tests, the authors studied the significant correlations between the maximum isometric strength of the quardriceps muscle and the time needed to walk 10 m, centimeters reached while sitting and reaching, and the time needed to stand up from bed rest. The authors confirmed that there were significant correlations between the instrumental activity of daily living and the time needed to stand up from bed rest, along with the time needed to walk 10 m for the stroke survivors. These physical performance tests are useful guides for evaluating a level of activity of daily living and physical frailty of stroke survivors living in a community.

The Five Key Questions of Human Performance Modeling.

PubMed

Wu, Changxu

2018-01-01

Via building computational (typically mathematical and computer simulation) models, human performance modeling (HPM) quantifies, predicts, and maximizes human performance, human-machine system productivity and safety. This paper describes and summarizes the five key questions of human performance modeling: 1) Why we build models of human performance; 2) What the expectations of a good human performance model are; 3) What the procedures and requirements in building and verifying a human performance model are; 4) How we integrate a human performance model with system design; and 5) What the possible future directions of human performance modeling research are. Recent and classic HPM findings are addressed in the five questions to provide new thinking in HPM's motivations, expectations, procedures, system integration and future directions.

Radiation Measurements Performed with Active Detectors Relevant for Human Space Exploration.

PubMed

Narici, Livio; Berger, Thomas; Matthiä, Daniel; Reitz, Günther

2015-01-01

A reliable radiation risk assessment in space is a mandatory step for the development of countermeasures and long-duration mission planning in human spaceflight. Research in radiobiology provides information about possible risks linked to radiation. In addition, for a meaningful risk evaluation, the radiation exposure has to be assessed to a sufficient level of accuracy. Consequently, both the radiation models predicting the risks and the measurements used to validate such models must have an equivalent precision. Corresponding measurements can be performed both with passive and active devices. The former is easier to handle, cheaper, lighter, and smaller but they measure neither the time dependence of the radiation environment nor some of the details useful for a comprehensive radiation risk assessment. Active detectors provide most of these details and have been extensively used in the International Space Station. To easily access such an amount of data, a single point access is becoming essential. This review presents an ongoing work on the development of a tool that allows obtaining information about all relevant measurements performed with active detectors providing reliable inputs for radiation model validation.

Validating workplace performance assessments in health sciences students: a case study from speech pathology.

PubMed

McAllister, Sue; Lincoln, Michelle; Ferguson, Allison; McAllister, Lindy

2013-01-01

Valid assessment of health science students' ability to perform in the real world of workplace practice is critical for promoting quality learning and ultimately certifying students as fit to enter the world of professional practice. Current practice in performance assessment in the health sciences field has been hampered by multiple issues regarding assessment content and process. Evidence for the validity of scores derived from assessment tools are usually evaluated against traditional validity categories with reliability evidence privileged over validity, resulting in the paradoxical effect of compromising the assessment validity and learning processes the assessments seek to promote. Furthermore, the dominant statistical approaches used to validate scores from these assessments fall under the umbrella of classical test theory approaches. This paper reports on the successful national development and validation of measures derived from an assessment of Australian speech pathology students' performance in the workplace. Validation of these measures considered each of Messick's interrelated validity evidence categories and included using evidence generated through Rasch analyses to support score interpretation and related action. This research demonstrated that it is possible to develop an assessment of real, complex, work based performance of speech pathology students, that generates valid measures without compromising the learning processes the assessment seeks to promote. The process described provides a model for other health professional education programs to trial.

Where Public Health Meets Human Rights: Integrating Human Rights into the Validation of the Elimination of Mother-to-Child Transmission of HIV and Syphilis.

PubMed

Kismödi, Eszter; Kiragu, Karusa; Sawicki, Olga; Smith, Sally; Brion, Sophie; Sharma, Aditi; Mworeko, Lilian; Iovita, Alexandrina

2017-12-01

In 2014, the World Health Organization (WHO) initiated a process for validation of the elimination of mother-to-child transmission (EMTCT) of HIV and syphilis by countries. For the first time in such a process for the validation of disease elimination, WHO introduced norms and approaches that are grounded in human rights, gender equality, and community engagement. This human rights-based validation process can serve as a key opportunity to enhance accountability for human rights protection by evaluating EMTCT programs against human rights norms and standards, including in relation to gender equality and by ensuring the provision of discrimination-free quality services. The rights-based validation process also involves the assessment of participation of affected communities in EMTCT program development, implementation, and monitoring and evaluation. It brings awareness to the types of human rights abuses and inequalities faced by women living with, at risk of, or affected by HIV and syphilis, and commits governments to eliminate those barriers. This process demonstrates the importance and feasibility of integrating human rights, gender, and community into key public health interventions in a manner that improves health outcomes, legitimizes the participation of affected communities, and advances the human rights of women living with HIV.

The Development and Validation of a Rubric to Enhance Performer Feedback for Undergraduate Vocal Solo Performance

ERIC Educational Resources Information Center

Herrell, Katherine A.

2014-01-01

This is a study of the development and validation of a rubric to enhance performer feedback for undergraduate vocal solo performance. In the literature, assessment of vocal performance is under-represented, and the value of feedback from the assessment of musical performances, from the point of view of the performer, is nonexistent. The research…

The reliability and validity of the Complex Task Performance Assessment: A performance-based assessment of executive function.

PubMed

Wolf, Timothy J; Dahl, Abigail; Auen, Colleen; Doherty, Meghan

2017-07-01

The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): an ecologically valid performance-based assessment of executive function. Community control participants (n = 20) and individuals with mild stroke (n = 14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was .991. The ICCs for all of the sub-scores of the CTPA were also high (.889-.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (p = -.425), and the Wechsler Test of Adult Reading (p  = -.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p = .007) and all sub-scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function.

Human Rights Attitude Scale: A Validity and Reliability Study

ERIC Educational Resources Information Center

Ercan, Recep; Yaman, Tugba; Demir, Selcuk Besir

2015-01-01

The objective of this study is to develop a valid and reliable attitude scale having quality psychometric features that can measure secondary school students' attitudes towards human rights. The study group of the research is comprised by 710 6th, 7th and 8th grade students who study at 4 secondary schools in the centre of Sivas. The study group…

Measuring human performance on NASA's microgravity aircraft

NASA Technical Reports Server (NTRS)

Morris, Randy B.; Whitmore, Mihriban

1993-01-01

Measuring human performance in a microgravity environment will aid in identifying the design requirements, human capabilities, safety, and productivity of future astronauts. The preliminary understanding of the microgravity effects on human performance can be achieved through evaluations conducted onboard NASA's KC-135 aircraft. These evaluations can be performed in relation to hardware performance, human-hardware interface, and hardware integration. Measuring human performance in the KC-135 simulated environment will contribute to the efforts of optimizing the human-machine interfaces for future and existing space vehicles. However, there are limitations, such as limited number of qualified subjects, unexpected hardware problems, and miscellaneous plane movements which must be taken into consideration. Examples for these evaluations, the results, and their implications are discussed in the paper.

Reconsidering Human Performance Technology

ERIC Educational Resources Information Center

Jang, Hwan Young

2008-01-01

This article discusses three perceived challenges in the field of human performance technology: a missing link from training to performance, limitations in gap analysis and cause analysis, and a lack of attention to business and organization performance. It then provides possible alternatives for each issue, such as instructional system…

NASA Human Health and Performance Strategy

NASA Technical Reports Server (NTRS)

Davis, Jeffrey R.

2012-01-01

In May 2007, what was then the Space Life Sciences Directorate, issued the 2007 Space Life Sciences Strategy for Human Space Exploration. In January 2012, leadership and key directorate personnel were once again brought together to assess the current and expected future environment against its 2007 Strategy and the Agency and Johnson Space Center goals and strategies. The result was a refined vision and mission, and revised goals, objectives, and strategies. One of the first changes implemented was to rename the directorate from Space Life Sciences to Human Health and Performance to better reflect our vision and mission. The most significant change in the directorate from 2007 to the present is the integration of the Human Research Program and Crew Health and Safety activities. Subsequently, the Human Health and Performance Directorate underwent a reorganization to achieve enhanced integration of research and development with operations to better support human spaceflight and International Space Station utilization. These changes also enable a more effective and efficient approach to human system risk mitigation. Since 2007, we have also made significant advances in external collaboration and implementation of new business models within the directorate and the Agency, and through two newly established virtual centers, the NASA Human Health and Performance Center and the Center of Excellence for Collaborative Innovation. Our 2012 Strategy builds upon these successes to address the Agency s increased emphasis on societal relevance and being a leader in research and development and innovative business and communications practices. The 2012 Human Health and Performance Vision is to lead the world in human health and performance innovations for life in space and on Earth. Our mission is to enable optimization of human health and performance throughout all phases of spaceflight. All HHPD functions are ultimately aimed at achieving this mission. Our activities enable

NASA Human Health and Performance Strategy

NASA Technical Reports Server (NTRS)

Davis, Jeffrey R.

2012-01-01

In May 2007, what was then the Space Life Sciences Directorate, issued the 2007 Space Life Sciences Strategy for Human Space Exploration. In January 2012, leadership and key directorate personnel were once again brought together to assess the current and expected future environment against its 2007 Strategy and the Agency and Johnson Space Center goals and strategies. The result was a refined vision and mission, and revised goals, objectives, and strategies. One of the first changes implemented was to rename the directorate from Space Life Sciences to Human Health and Performance to better reflect our vision and mission. The most significant change in the directorate from 2007 to the present is the integration of the Human Research Program and Crew Health and Safety activities. Subsequently, the Human Health and Performance Directorate underwent a reorganization to achieve enhanced integration of research and development with operations to better support human spaceflight and International Space Station utilization. These changes also enable a more effective and efficient approach to human system risk mitigation. Since 2007, we have also made significant advances in external collaboration and implementation of new business models within the directorate and the Agency, and through two newly established virtual centers, the NASA Human Health and Performance Center and the Center of Excellence for Collaborative Innovation. Our 2012 Strategy builds upon these successes to address the Agency's increased emphasis on societal relevance and being a leader in research and development and innovative business and communications practices. The 2012 Human Health and Performance Vision is to lead the world in human health and performance innovations for life in space and on Earth. Our mission is to enable optimization of human health and performance throughout all phases of spaceflight. All HH&P functions are ultimately aimed at achieving this mission. Our activities enable

Advanced forensic validation for human spermatozoa identification using SPERM HY-LITER™ Express with quantitative image analysis.

PubMed

Takamura, Ayari; Watanabe, Ken; Akutsu, Tomoko

2017-07-01

Identification of human semen is indispensable for the investigation of sexual assaults. Fluorescence staining methods using commercial kits, such as the series of SPERM HY-LITER™ kits, have been useful to detect human sperm via strong fluorescence. These kits have been examined from various forensic aspects. However, because of a lack of evaluation methods, these studies did not provide objective, or quantitative, descriptions of the results nor clear criteria for the decisions reached. In addition, the variety of validations was considerably limited. In this study, we conducted more advanced validations of SPERM HY-LITER™ Express using our established image analysis method. Use of this method enabled objective and specific identification of fluorescent sperm's spots and quantitative comparisons of the sperm detection performance under complex experimental conditions. For body fluid mixtures, we examined interference with the fluorescence staining from other body fluid components. Effects of sample decomposition were simulated in high humidity and high temperature conditions. Semen with quite low sperm concentrations, such as azoospermia and oligospermia samples, represented the most challenging cases in application of the kit. Finally, the tolerance of the kit against various acidic and basic environments was analyzed. The validations herein provide useful information for the practical applications of the SPERM HY-LITER™ Express kit, which were previously unobtainable. Moreover, the versatility of our image analysis method toward various complex cases was demonstrated.

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Assessment of a robust model protocol with accelerated throughput for a human recombinant full length estrogen receptor-alpha binding assay: protocol optimization and intralaboratory assay performance as initial steps towards validation.

PubMed

Freyberger, Alexius; Wilson, Vickie; Weimer, Marc; Tan, Shirlee; Tran, Hoai-Son; Ahr, Hans-Jürgen

2010-08-01

Despite about two decades of research in the field of endocrine active compounds, still no validated human recombinant (hr) estrogen receptor-alpha (ERalpha) binding assay is available, although hr-ERalpha is available from several sources. In a joint effort, US EPA and Bayer Schering Pharma with funding from the EU-sponsored 6th framework project, ReProTect, developed a model protocol for such a binding assay. Important features of this assay are the use of a full length hr-ERalpha and performance in a 96-well plate format. A full length hr-ERalpha was chosen, as it was considered to provide the most accurate and human-relevant results, whereas truncated receptors could perform differently. Besides three reference compounds [17beta-estradiol, norethynodrel, dibutylphthalate] nine test compounds with different affinities for the ERalpha [diethylstilbestrol (DES), ethynylestradiol, meso-hexestrol, equol, genistein, o,p'-DDT, nonylphenol, n-butylparaben, and corticosterone] were used to explore the performance of the assay. Three independent experiments per compound were performed on different days, and dilutions of test compounds from deep-frozen stocks, solutions of radiolabeled ligand and receptor preparation were freshly prepared for each experiment. The ERalpha binding properties of reference and test compounds were well detected. As expected dibutylphthalate and corticosterone were non-binders in this assay. In terms of the relative ranking of binding affinities, there was good agreement with published data obtained from experiments using a human recombinant ERalpha ligand binding domain. Irrespective of the chemical nature of the compound, individual IC(50)-values for a given compound varied by not more than a factor of 2.5. Our data demonstrate that the assay was robust and reliably ranked compounds with strong, weak, and no affinity for the ERalpha with high accuracy. It avoids the manipulation and use of animals, i.e., the preparation of uterine cytosol as

Validation of the updated ArthroS simulator: face and construct validity of a passive haptic virtual reality simulator with novel performance metrics.

PubMed

Garfjeld Roberts, Patrick; Guyver, Paul; Baldwin, Mathew; Akhtar, Kash; Alvand, Abtin; Price, Andrew J; Rees, Jonathan L

2017-02-01

To assess the construct and face validity of ArthroS, a passive haptic VR simulator. A secondary aim was to evaluate the novel performance metrics produced by this simulator. Two groups of 30 participants, each divided into novice, intermediate or expert based on arthroscopic experience, completed three separate tasks on either the knee or shoulder module of the simulator. Performance was recorded using 12 automatically generated performance metrics and video footage of the arthroscopic procedures. The videos were blindly assessed using a validated global rating scale (GRS). Participants completed a survey about the simulator's realism and training utility. This new simulator demonstrated construct validity of its tasks when evaluated against a GRS (p ≤ 0.003 in all cases). Regarding it's automatically generated performance metrics, established outputs such as time taken (p ≤ 0.001) and instrument path length (p ≤ 0.007) also demonstrated good construct validity. However, two-thirds of the proposed 'novel metrics' the simulator reports could not distinguish participants based on arthroscopic experience. Face validity assessment rated the simulator as a realistic and useful tool for trainees, but the passive haptic feedback (a key feature of this simulator) is rated as less realistic. The ArthroS simulator has good task construct validity based on established objective outputs, but some of the novel performance metrics could not distinguish between surgical experience. The passive haptic feedback of the simulator also needs improvement. If simulators could offer automated and validated performance feedback, this would facilitate improvements in the delivery of training by allowing trainees to practise and self-assess.

Validating YouTube Factors Affecting Learning Performance

NASA Astrophysics Data System (ADS)

Pratama, Yoga; Hartanto, Rudy; Suning Kusumawardani, Sri

2018-03-01

YouTube is often used as a companion medium or a learning supplement. One of the educational places that often uses is Jogja Audio School (JAS) which focuses on music production education. Music production is a difficult material to learn, especially at the audio mastering. With tutorial contents from YouTube, students find it easier to learn and understand audio mastering and improved their learning performance. This study aims to validate the role of YouTube as a medium of learning in improving student’s learning performance by looking at the factors that affect student learning performance. The sample involves 100 respondents from JAS at audio mastering level. The results showed that student learning performance increases seen from factors that have a significant influence of motivation, instructional content, and YouTube usefulness. Overall findings suggest that YouTube has a important role to student learning performance in music production education and as an innovative and efficient learning medium.

Issues in developing valid assessments of speech pathology students' performance in the workplace.

PubMed

McAllister, Sue; Lincoln, Michelle; Ferguson, Alison; McAllister, Lindy

2010-01-01

Workplace-based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be 'the gold standard', but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace-based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. This paper reviews important conceptual issues in the design of valid and reliable workplace-based assessments of competence including assessment content, process, impact on learning, measurement issues, and validation strategies. It then goes on to share what has been learned about quality assessment and validation of a workplace-based performance assessment using competency-based ratings. The outcomes of a four-year national development and validation of an assessment tool are described. A literature review of issues in conceptualizing, designing, and validating workplace-based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling, and data analysis in the validation stages of the development process. This paper provides an accessible overview of factors to consider in the design and validation of workplace-based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS, used in an every speech pathology programme in Australia, New Zealand, and Singapore. The paper also describes Rasch analysis, a model-based statistical approach which is useful for establishing validity and reliability of assessment tools. Through careful attention to conceptual and design issues in the development and trialling of workplace-based assessments, it has been possible to develop the

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient.

PubMed

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t -test, and comparisons between Groups A and B were analyzed with an independent t -test. Compared to the preseminar result, Group A's postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Improved pre-post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence.

Validity of three clinical performance assessments of internal medicine clerks.

PubMed

Hull, A L; Hodder, S; Berger, B; Ginsberg, D; Lindheim, N; Quan, J; Kleinhenz, M E

1995-06-01

To analyze the construct validity of three methods to assess the clinical performances of internal medicine clerks. A multitrait-multimethod (MTMM) study was conducted at the Case Western Reserve University School of Medicine to determine the convergent and divergent validity of a clinical evaluation form (CEF) completed by faculty and residents, an objective structured clinical examination (OSCE), and the medicine subject test of the National Board of Medical Examiners. Three traits were involved in the analysis: clinical skills, knowledge, and personal characteristics. A correlation matrix was computed for 410 third-year students who completed the clerkship between August 1988 and July 1991. There was a significant (p < .01) convergence of the four correlations that assessed the same traits by using different methods. However, the four convergent correlations were of moderate magnitude (ranging from .29 to .47). Divergent validity was assessed by comparing the magnitudes of the convergence correlations with the magnitudes of correlations among unrelated assessments (i.e., different traits by different methods). Seven of nine possible coefficients were smaller than the convergent coefficients, suggesting evidence of divergent validity. A significant CEF method effect was identified. There was convergent validity and some evidence of divergent validity with a significant method effect. The findings were similar for correlations corrected for attenuation. Four conclusions were reached: (1) the reliability of the OSCE must be improved, (2) the CEF ratings must be redesigned to further discriminate among the specific traits assessed, (3) additional methods to assess personal characteristics must be instituted, and (4) several assessment methods should be used to evaluate individual student performances.

A validated high-performance liquid chromatographic method for the determination of moclobemide and its two metabolites in human plasma and application to pharmacokinetic studies.

PubMed

Plenis, Alina; Chmielewska, Aleksandra; Konieczna, Lucyna; Lamparczyk, Henryk

2007-09-01

A rapid and sensitive reversed-phase high-performance liquid chromatographic method (RP-HPLC) with ultraviolet detection has been developed for the determination of moclobemide and its metabolites, p-chloro-N-(-2-morpholinoethyl)benzamide N'-oxide (Ro 12-5637) and p-chloro-N-[2-(3-oxomorpholino)ethyl]-benzamide (Ro 12-8095), in human plasma. The assay was performed after single liquid-liquid extraction with dichloromethane at alkaline pH using phenacetin as the internal standard. Chromatographic separation was performed on a C(18) column using a mixture of acetonitrile and water (25:75, v/v), adjusted to pH 2.7 with ortho-phosphoric acid, as mobile phase. Spectrophotometric detection was performed at 239 nm. The method has been validated for accuracy, precision, selectivity, linearity, recovery and stability. The quantification limit for moclobemide and Ro 12-8095 was 10 ng/mL, and for Ro 12-5637 was 30 ng/mL. Linearity of the method was confirmed for the range 20-2500 ng/mL for moclobemide (r = 0.9998), 20-1750 ng/mL for Ro 12-8095 (r = 0.9996) and 30-350 ng/mL for Ro 12-5637 (r = 0.9991). Moreover, within-day and between-day precisions and accuracies of the method were established. The described method was successfully applied in pharmacokinetic studies of parent drug and its two metabolites after a single oral administration of 150 mg of moclobemide to 20 healthy volunteers. Copyright (c) 2007 John Wiley & Sons, Ltd.

Use of the color trails test as an embedded measure of performance validity.

PubMed

Henry, George K; Algina, James

2013-01-01

One hundred personal injury litigants and disability claimants referred for a forensic neuropsychological evaluation were administered both portions of the Color Trails Test (CTT) as part of a more comprehensive battery of standardized tests. Subjects who failed two or more free-standing tests of cognitive performance validity formed the Failed Performance Validity (FPV) group, while subjects who passed all free-standing performance validity measures were assigned to the Passed Performance Validity (PPV) group. A cutscore of ≥45 seconds to complete Color Trails 1 (CT1) was associated with a classification accuracy of 78%, good sensitivity (66%) and high specificity (90%), while a cutscore of ≥84 seconds to complete Color Trails 2 (CT2) was associated with a classification accuracy of 82%, good sensitivity (74%) and high specificity (90%). A CT1 cutscore of ≥58 seconds, and a CT2 cutscore ≥100 seconds was associated with 100% positive predictive power at base rates from 20 to 50%.

Test validity and performance validity: considerations in providing a framework for development of an ability-focused neuropsychological test battery.

PubMed

Larrabee, Glenn J

2014-11-01

Literature on test validity and performance validity is reviewed to propose a framework for specification of an ability-focused battery (AFB). Factor analysis supports six domains of ability: first, verbal symbolic; secondly, visuoperceptual and visuospatial judgment and problem solving; thirdly, sensorimotor skills; fourthly, attention/working memory; fifthly, processing speed; finally, learning and memory (which can be divided into verbal and visual subdomains). The AFB should include at least three measures for each of the six domains, selected based on various criteria for validity including sensitivity to presence of disorder, sensitivity to severity of disorder, correlation with important activities of daily living, and containing embedded/derived measures of performance validity. Criterion groups should include moderate and severe traumatic brain injury, and Alzheimer's disease. Validation groups should also include patients with left and right hemisphere stroke, to determine measures sensitive to lateralized cognitive impairment and so that the moderating effects of auditory comprehension impairment and neglect can be analyzed on AFB measures. © The Author 2014. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development and validation of a UPLC-MS/MS method for simultaneous determination of fotagliptin and its two major metabolites in human plasma and urine.

PubMed

Wang, Zhenlei; Jiang, Ji; Hu, Pei; Zhao, Qian

2017-02-01

Fotagliptin is a novel dipeptidyl peptidase IV inhibitor under clinical development for the treatment of Type II diabetes mellitus. The objective of this study was to develop and validate a specific and sensitive ultra-performance liquid chromatography (UPLC)-MS/MS method for simultaneous determination of fotagliptin and its two major metabolites in human plasma and urine. Methodology & results: After being pretreated using an automatized procedure, the plasma and urine samples were separated and detected using a UPLC-ESI-MS/MS method, which was validated following the international guidelines. A selective and sensitive UPLC-MS/MS method was first developed and validated for quantifying fotagliptin and its metabolite in human plasma and urine. The method was successfully applied to support the clinical study of fotagliptin in Chinese healthy subjects.

Surrogate measures: A proposed alternative in human factors assessment of operational measures of performance

NASA Technical Reports Server (NTRS)

Kennedy, Robert S.; Lane, Norman E.; Kuntz, Lois A.

1987-01-01

Surrogate measures are proposed as an alternative to direct assessment of operational performance for purposes of screening agents who may have to work under unusual stresses or in exotic environments. Such measures are particularly proposed when the surrogate can be empirically validated against the operational criterion. The focus is on cognitive (or throughput) performances in humans as opposed to sensory (input) or motor (output) measures, but the methods should be applicable for development of batteries which will tap input/output functions. A menu of performance tasks is under development for implementation on a battery-operated portable microcomputer, with 21 tests currently available. The tasks are reliable and become stable in minimum amounts of time; appear sensitive to some agents; comprise constructs related to actual job tasks; and are easily administered in most environments. Implications for human factors engineering studies in environmental stress are discussed.

The use of MR B+1 imaging for validation of FDTD electromagnetic simulations of human anatomies.

PubMed

Van den Berg, Cornelis A T; Bartels, Lambertus W; van den Bergen, Bob; Kroeze, Hugo; de Leeuw, Astrid A C; Van de Kamer, Jeroen B; Lagendijk, Jan J W

2006-10-07

In this study, MR B(+)(1) imaging is employed to experimentally verify the validity of FDTD simulations of electromagnetic field patterns in human anatomies. Measurements and FDTD simulations of the B(+)(1) field induced by a 3 T MR body coil in a human corpse were performed. It was found that MR B(+)(1) imaging is a sensitive method to measure the radiofrequency (RF) magnetic field inside a human anatomy with a precision of approximately 3.5%. A good correlation was found between the B(+)(1) measurements and FDTD simulations. The measured B(+)(1) pattern for a human pelvis consisted of a global, diagonal modulation pattern plus local B(+)(1) heterogeneties. It is believed that these local B(+)(1) field variations are the result of peaks in the induced electric currents, which could not be resolved by the FDTD simulations on a 5 mm(3) simulation grid. The findings from this study demonstrate that B(+)(1) imaging is a valuable experimental technique to gain more knowledge about the dielectric interaction of RF fields with the human anatomy.

Development and Initial Validation of the Performance Perfectionism Scale for Sport (PPS-S)

ERIC Educational Resources Information Center

Hill, Andrew P.; Appleton, Paul R.; Mallinson, Sarah H.

2016-01-01

Valid and reliable instruments are required to appropriately study perfectionism. With this in mind, three studies are presented that describe the development and initial validation of a new instrument designed to measure multidimensional performance perfectionism for use in sport (Performance Perfectionism Scale--Sport [PPS-S]). The instrument is…

An Evaluation of the Performance Diagnostic Checklist-Human Services (PDC-HS) Across Domains.

PubMed

Wilder, David A; Lipschultz, Joshua; Gehrman, Chana

2018-06-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to assess the environmental variables that contribute to poor employee performance in human service settings. Although the PDC-HS has been shown to effectively identify variables contributing to problematic performance, interventions based on only two of the four PDC-HS domains have been evaluated to date. In addition, the extent to which PDC-HS-indicated interventions are more effective than nonindicated interventions for two domains remains unclear. In the current study, we administered the PDC-HS to supervisors to assess the variables contributing to infrequent teaching of verbal operants and use of a timer by therapists at a center-based autism treatment program. Each of the four PDC-HS domains was identified as contributing to poor performance for at least one therapist. We then evaluated PDC-HS-indicated interventions for each domain. In addition, to assess the predictive validity of the tool, we evaluated various nonindicated interventions prior to implementing a PDC-HS-indicated intervention for two of the four domains. Results suggest that the PDC-HS-indicated interventions were effective across all four domains and were more effective than the nonindicated interventions for the two domains for which they were evaluated. Results are discussed in terms of the utility of the PDC-HS to identify appropriate interventions to manage therapist performance in human service settings.

A reliability and validity study of the Palliative Performance Scale

PubMed Central

Ho, Francis; Lau, Francis; Downing, Michael G; Lesperance, Mary

2008-01-01

Background The Palliative Performance Scale (PPS) was first introduced in1996 as a new tool for measurement of performance status in palliative care. PPS has been used in many countries and has been translated into other languages. Methods This study evaluated the reliability and validity of PPS. A web-based, case scenarios study with a test-retest format was used to determine reliability. Fifty-three participants were recruited and randomly divided into two groups, each evaluating 11 cases at two time points. The validity study was based on the content validation of 15 palliative care experts conducted over telephone interviews, with discussion on five themes: PPS as clinical assessment tool, the usefulness of PPS, PPS scores affecting decision making, the problems in using PPS, and the adequacy of PPS instruction. Results The intraclass correlation coefficients for absolute agreement were 0.959 and 0.964 for Group 1, at Time-1 and Time-2; 0.951 and 0.931 for Group 2, at Time-1 and Time-2 respectively. Results showed that the participants were consistent in their scoring over the two times, with a mean Cohen's kappa of 0.67 for Group 1 and 0.71 for Group 2. In the validity study, all experts agreed that PPS is a valuable clinical assessment tool in palliative care. Many of them have already incorporated PPS as part of their practice standard. Conclusion The results of the reliability study demonstrated that PPS is a reliable tool. The validity study found that most experts did not feel a need to further modify PPS and, only two experts requested that some performance status measures be defined more clearly. Areas of PPS use include prognostication, disease monitoring, care planning, hospital resource allocation, clinical teaching and research. PPS is also a good communication tool between palliative care workers. PMID:18680590

Human Performance

DTIC Science & Technology

2008-03-01

modification (e.g., for increased aggressiveness or decreased empathy ). Thus one strong recommendation of this study is that the US should develop a...Human Performance JASON The MITRE Corporation 7515 Colshire Drive McLean, Virginia 22102-7508 (703) 983-6997 Study Leader: E. Williams Contributors...AVAILABILITY STATEMENT Approved for public release, distribution unlimited. 13. SUPPLEMENTARY NOTES 14. ABSTRACT The tasking for this study was to

Radiation Measurements Performed with Active Detectors Relevant for Human Space Exploration

PubMed Central

Narici, Livio; Berger, Thomas; Matthiä, Daniel; Reitz, Günther

2015-01-01

A reliable radiation risk assessment in space is a mandatory step for the development of countermeasures and long-duration mission planning in human spaceflight. Research in radiobiology provides information about possible risks linked to radiation. In addition, for a meaningful risk evaluation, the radiation exposure has to be assessed to a sufficient level of accuracy. Consequently, both the radiation models predicting the risks and the measurements used to validate such models must have an equivalent precision. Corresponding measurements can be performed both with passive and active devices. The former is easier to handle, cheaper, lighter, and smaller but they measure neither the time dependence of the radiation environment nor some of the details useful for a comprehensive radiation risk assessment. Active detectors provide most of these details and have been extensively used in the International Space Station. To easily access such an amount of data, a single point access is becoming essential. This review presents an ongoing work on the development of a tool that allows obtaining information about all relevant measurements performed with active detectors providing reliable inputs for radiation model validation. PMID:26697408

Human genomic DNA quantitation system, H-Quant: development and validation for use in forensic casework.

PubMed

Shewale, Jaiprakash G; Schneida, Elaine; Wilson, Jonathan; Walker, Jerilyn A; Batzer, Mark A; Sinha, Sudhir K

2007-03-01

The human DNA quantification (H-Quant) system, developed for use in human identification, enables quantitation of human genomic DNA in biological samples. The assay is based on real-time amplification of AluYb8 insertions in hominoid primates. The relatively high copy number of subfamily-specific Alu repeats in the human genome enables quantification of very small amounts of human DNA. The oligonucleotide primers present in H-Quant are specific for human DNA and closely related great apes. During the real-time PCR, the SYBR Green I dye binds to the DNA that is synthesized by the human-specific AluYb8 oligonucleotide primers. The fluorescence of the bound SYBR Green I dye is measured at the end of each PCR cycle. The cycle at which the fluorescence crosses the chosen threshold correlates to the quantity of amplifiable DNA in that sample. The minimal sensitivity of the H-Quant system is 7.6 pg/microL of human DNA. The amplicon generated in the H-Quant assay is 216 bp, which is within the same range of the common amplifiable short tandem repeat (STR) amplicons. This size amplicon enables quantitation of amplifiable DNA as opposed to a quantitation of degraded or nonamplifiable DNA of smaller sizes. Development and validation studies were performed on the 7500 real-time PCR system following the Quality Assurance Standards for Forensic DNA Testing Laboratories.

Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure Validation Simulation Study

NASA Technical Reports Server (NTRS)

Murdoch, Jennifer L.; Bussink, Frank J. L.; Chamberlain, James P.; Chartrand, Ryan C.; Palmer, Michael T.; Palmer, Susan O.

2008-01-01

The Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure (ITP) Validation Simulation Study investigated the viability of an ITP designed to enable oceanic flight level changes that would not otherwise be possible. Twelve commercial airline pilots with current oceanic experience flew a series of simulated scenarios involving either standard or ITP flight level change maneuvers and provided subjective workload ratings, assessments of ITP validity and acceptability, and objective performance measures associated with the appropriate selection, request, and execution of ITP flight level change maneuvers. In the majority of scenarios, subject pilots correctly assessed the traffic situation, selected an appropriate response (i.e., either a standard flight level change request, an ITP request, or no request), and executed their selected flight level change procedure, if any, without error. Workload ratings for ITP maneuvers were acceptable and not substantially higher than for standard flight level change maneuvers, and, for the majority of scenarios and subject pilots, subjective acceptability ratings and comments for ITP were generally high and positive. Qualitatively, the ITP was found to be valid and acceptable. However, the error rates for ITP maneuvers were higher than for standard flight level changes, and these errors may have design implications for both the ITP and the study's prototype traffic display. These errors and their implications are discussed.

Review and evaluation of performance measures for survival prediction models in external validation settings.

PubMed

Rahman, M Shafiqur; Ambler, Gareth; Choodari-Oskooei, Babak; Omar, Rumana Z

2017-04-18

When developing a prediction model for survival data it is essential to validate its performance in external validation settings using appropriate performance measures. Although a number of such measures have been proposed, there is only limited guidance regarding their use in the context of model validation. This paper reviewed and evaluated a wide range of performance measures to provide some guidelines for their use in practice. An extensive simulation study based on two clinical datasets was conducted to investigate the performance of the measures in external validation settings. Measures were selected from categories that assess the overall performance, discrimination and calibration of a survival prediction model. Some of these have been modified to allow their use with validation data, and a case study is provided to describe how these measures can be estimated in practice. The measures were evaluated with respect to their robustness to censoring and ease of interpretation. All measures are implemented, or are straightforward to implement, in statistical software. Most of the performance measures were reasonably robust to moderate levels of censoring. One exception was Harrell's concordance measure which tended to increase as censoring increased. We recommend that Uno's concordance measure is used to quantify concordance when there are moderate levels of censoring. Alternatively, Gönen and Heller's measure could be considered, especially if censoring is very high, but we suggest that the prediction model is re-calibrated first. We also recommend that Royston's D is routinely reported to assess discrimination since it has an appealing interpretation. The calibration slope is useful for both internal and external validation settings and recommended to report routinely. Our recommendation would be to use any of the predictive accuracy measures and provide the corresponding predictive accuracy curves. In addition, we recommend to investigate the characteristics

Development and Validation of the Basketball Offensive Game Performance Instrument

ERIC Educational Resources Information Center

Chen, Weiyun; Hendricks, Kristin; Zhu, Weimo

2013-01-01

The purpose of this study was to design and validate the Basketball Offensive Game Performance Instrument (BOGPI) that assesses an individual player's offensive game performance competency in basketball. Twelve physical education teacher education (PETE) students playing two 10-minute, 3 vs. 3 basketball games were videotaped at end of a…

Automatic Human Movement Assessment With Switching Linear Dynamic System: Motion Segmentation and Motor Performance.

PubMed

de Souza Baptista, Roberto; Bo, Antonio P L; Hayashibe, Mitsuhiro

2017-06-01

Performance assessment of human movement is critical in diagnosis and motor-control rehabilitation. Recent developments in portable sensor technology enable clinicians to measure spatiotemporal aspects to aid in the neurological assessment. However, the extraction of quantitative information from such measurements is usually done manually through visual inspection. This paper presents a novel framework for automatic human movement assessment that executes segmentation and motor performance parameter extraction in time-series of measurements from a sequence of human movements. We use the elements of a Switching Linear Dynamic System model as building blocks to translate formal definitions and procedures from human movement analysis. Our approach provides a method for users with no expertise in signal processing to create models for movements using labeled dataset and later use it for automatic assessment. We validated our framework on preliminary tests involving six healthy adult subjects that executed common movements in functional tests and rehabilitation exercise sessions, such as sit-to-stand and lateral elevation of the arms and five elderly subjects, two of which with limited mobility, that executed the sit-to-stand movement. The proposed method worked on random motion sequences for the dual purpose of movement segmentation (accuracy of 72%-100%) and motor performance assessment (mean error of 0%-12%).

Display format, highlight validity, and highlight method: Their effects on search performance

NASA Technical Reports Server (NTRS)

Donner, Kimberly A.; Mckay, Tim D.; Obrien, Kevin M.; Rudisill, Marianne

1991-01-01

Display format and highlight validity were shown to affect visual display search performance; however, these studies were conducted on small, artificial displays of alphanumeric stimuli. A study manipulating these variables was conducted using realistic, complex Space Shuttle information displays. A 2x2x3 within-subjects analysis of variance found that search times were faster for items in reformatted displays than for current displays. Responses to valid applications of highlight were significantly faster than responses to non or invalidly highlighted applications. The significant format by highlight validity interaction showed that there was little difference in response time to both current and reformatted displays when the highlight validity was applied; however, under the non or invalid highlight conditions, search times were faster with reformatted displays. A separate within-subject analysis of variance of display format, highlight validity, and several highlight methods did not reveal a main effect of highlight method. In addition, observed display search times were compared to search time predicted by Tullis' Display Analysis Program. Benefits of highlighting and reformatting displays to enhance search and the necessity to consider highlight validity and format characteristics in tandem for predicting search performance are discussed.

NASA Human Health and Performance Center (NHHPC)

NASA Technical Reports Server (NTRS)

Davis, J. R.; Richard, E. E.

2010-01-01

The NASA Human Health and Performance Center (NHHPC) will provide a collaborative and virtual forum to integrate all disciplines of the human system to address spaceflight, aviation, and terrestrial human health and performance topics and issues. The NHHPC will serve a vital role as integrator, convening members to share information and capture a diverse knowledge base, while allowing the parties to collaborate to address the most important human health and performance topics of interest to members. The Center and its member organizations will address high-priority risk reduction strategies, including research and technology development, improved medical and environmental health diagnostics and therapeutics, and state-of-the art design approaches for human factors and habitability. Once full established in 2011, the NHHPC will focus on a number of collaborative projects focused on human health and performance, including workshops, education and outreach, information sharing and knowledge management, and research and technology development projects, to advance the study of the human system for spaceflight and other national and international priorities.

Human performance models for computer-aided engineering

NASA Technical Reports Server (NTRS)

Elkind, Jerome I. (Editor); Card, Stuart K. (Editor); Hochberg, Julian (Editor); Huey, Beverly Messick (Editor)

1989-01-01

This report discusses a topic important to the field of computational human factors: models of human performance and their use in computer-based engineering facilities for the design of complex systems. It focuses on a particular human factors design problem -- the design of cockpit systems for advanced helicopters -- and on a particular aspect of human performance -- vision and related cognitive functions. By focusing in this way, the authors were able to address the selected topics in some depth and develop findings and recommendations that they believe have application to many other aspects of human performance and to other design domains.

Reliability and Validity of the Professional Counseling Performance Evaluation

ERIC Educational Resources Information Center

Shepherd, J. Brad; Britton, Paula J.; Kress, Victoria E.

2008-01-01

The definition and measurement of counsellor trainee competency is an issue that has received increased attention yet lacks quantitative study. This research evaluates item responses, scale reliability and intercorrelations, interrater agreement, and criterion-related validity of the Professional Performance Fitness Evaluation/Professional…

Human performance interfaces in air traffic control.

PubMed

Chang, Yu-Hern; Yeh, Chung-Hsing

2010-01-01

This paper examines how human performance factors in air traffic control (ATC) affect each other through their mutual interactions. The paper extends the conceptual SHEL model of ergonomics to describe the ATC system as human performance interfaces in which the air traffic controllers interact with other human performance factors including other controllers, software, hardware, environment, and organisation. New research hypotheses about the relationships between human performance interfaces of the system are developed and tested on data collected from air traffic controllers, using structural equation modelling. The research result suggests that organisation influences play a more significant role than individual differences or peer influences on how the controllers interact with the software, hardware, and environment of the ATC system. There are mutual influences between the controller-software, controller-hardware, controller-environment, and controller-organisation interfaces of the ATC system, with the exception of the controller-controller interface. Research findings of this study provide practical insights in managing human performance interfaces of the ATC system in the face of internal or external change, particularly in understanding its possible consequences in relation to the interactions between human performance factors.

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient

PubMed Central

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Background Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. Methods We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t-test, and comparisons between Groups A and B were analyzed with an independent t-test. Results Compared to the preseminar result, Group A’s postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Conclusion Improved pre–post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence. PMID:28794664

Solar power plant performance evaluation: simulation and experimental validation

NASA Astrophysics Data System (ADS)

Natsheh, E. M.; Albarbar, A.

2012-05-01

In this work the performance of solar power plant is evaluated based on a developed model comprise photovoltaic array, battery storage, controller and converters. The model is implemented using MATLAB/SIMULINK software package. Perturb and observe (P&O) algorithm is used for maximizing the generated power based on maximum power point tracker (MPPT) implementation. The outcome of the developed model are validated and supported by a case study carried out using operational 28.8kW grid-connected solar power plant located in central Manchester. Measurements were taken over 21 month's period; using hourly average irradiance and cell temperature. It was found that system degradation could be clearly monitored by determining the residual (the difference) between the output power predicted by the model and the actual measured power parameters. It was found that the residual exceeded the healthy threshold, 1.7kW, due to heavy snow in Manchester last winter. More important, the developed performance evaluation technique could be adopted to detect any other reasons that may degrade the performance of the P V panels such as shading and dirt. Repeatability and reliability of the developed system performance were validated during this period. Good agreement was achieved between the theoretical simulation and the real time measurement taken the online grid connected solar power plant.

Cyclic Variations in Sustained Human Performance

ERIC Educational Resources Information Center

Aue, William R.; Arruda, James E.; Kass, Steven J.; Stanny, Claudia J.

2009-01-01

Biological rhythms play a prominent role in the modulation of human physiology and behavior. [Smith, K., Valentino, D., & Arruda, J. (2003). "Rhythmic oscillations in the performance of a sustained attention task." "Journal of Clinical and Experimental Neuropsychology," 25, 561-570] suggested that sustained human performance may systematically…

Validity and reliability of the Short Physical Performance Battery (SPPB)

PubMed Central

Curcio, Carmen-Lucía; Alvarado, Beatriz; Zunzunegui, María Victoria; Guralnik, Jack

2013-01-01

Objectives: To assess the validity (convergent and construct) and reliability of the Short Physical Performance Battery (SPPB) among non-disabled adults between 65 to 74 years of age residing in the Andes Mountains of Colombia. Methods: Design Validation study; Participants: 150 subjects aged 65 to 74 years recruited from elderly associations (day-centers) in Manizales, Colombia. Measurements: The SPPB tests of balance, including time to walk 4 meters and time required to stand from a chair 5 times were administered to all participants. Reliability was analyzed with a 7-day interval between assessments and use of repeated ANOVA testing. Construct validity was assessed using factor analysis and by testing the relationship between SPPB and depressive symptoms, cognitive function, and self rated health (SRH), while the concurrent validity was measured through relationships with mobility limitations and disability in Activities of Daily Living (ADL). ANOVA tests were used to establish these associations. Results: Test-retest reliability of the SPPB was high: 0.87 (CI95%: 0.77-0.96). A one factor solution was found with three SPPB tests. SPPB was related to self-rated health, limitations in walking and climbing steps and to indicators of disability, as well as to cognitive function and depression. There was a graded decrease in the mean SPPB score with increasing disability and poor health. Conclusion: The Spanish version of SPPB is reliable and valid to assess physical performance among older adults from our region. Future studies should establish their clinical applications and explore usage in population studies. PMID:24892614

21st Century Human Performance.

ERIC Educational Resources Information Center

Clark, Ruth Colvin

1995-01-01

Technology can extend human memory and improve performance, but bypassing human intelligence has its dangers. Cognitive apprenticeships that compress learning experiences, provide coaching, and allow trial and error can build complex problem-solving skills and develop expertise. (SK)

Simulation verification techniques study: Simulation performance validation techniques document. [for the space shuttle system

NASA Technical Reports Server (NTRS)

Duncan, L. M.; Reddell, J. P.; Schoonmaker, P. B.

1975-01-01

Techniques and support software for the efficient performance of simulation validation are discussed. Overall validation software structure, the performance of validation at various levels of simulation integration, guidelines for check case formulation, methods for real time acquisition and formatting of data from an all up operational simulator, and methods and criteria for comparison and evaluation of simulation data are included. Vehicle subsystems modules, module integration, special test requirements, and reference data formats are also described.

Design Characteristics Influence Performance of Clinical Prediction Rules in Validation: A Meta-Epidemiological Study.

PubMed

Ban, Jong-Wook; Emparanza, José Ignacio; Urreta, Iratxe; Burls, Amanda

2016-01-01

Many new clinical prediction rules are derived and validated. But the design and reporting quality of clinical prediction research has been less than optimal. We aimed to assess whether design characteristics of validation studies were associated with the overestimation of clinical prediction rules' performance. We also aimed to evaluate whether validation studies clearly reported important methodological characteristics. Electronic databases were searched for systematic reviews of clinical prediction rule studies published between 2006 and 2010. Data were extracted from the eligible validation studies included in the systematic reviews. A meta-analytic meta-epidemiological approach was used to assess the influence of design characteristics on predictive performance. From each validation study, it was assessed whether 7 design and 7 reporting characteristics were properly described. A total of 287 validation studies of clinical prediction rule were collected from 15 systematic reviews (31 meta-analyses). Validation studies using case-control design produced a summary diagnostic odds ratio (DOR) 2.2 times (95% CI: 1.2-4.3) larger than validation studies using cohort design and unclear design. When differential verification was used, the summary DOR was overestimated by twofold (95% CI: 1.2 -3.1) compared to complete, partial and unclear verification. The summary RDOR of validation studies with inadequate sample size was 1.9 (95% CI: 1.2 -3.1) compared to studies with adequate sample size. Study site, reliability, and clinical prediction rule was adequately described in 10.1%, 9.4%, and 7.0% of validation studies respectively. Validation studies with design shortcomings may overestimate the performance of clinical prediction rules. The quality of reporting among studies validating clinical prediction rules needs to be improved.

A validated high-performance liquid chromatographic method for the determination of glibenclamide in human plasma and its application to pharmacokinetic studies.

PubMed

Niopas, Ioannis; Daftsios, Athanasios C

2002-05-15

Glibenclamide is a potent second generation oral sulfonylurea antidiabetic agent widely used for the treatment of type II diabetes melitus. A rapid, sensitive, precise, accurate and specific HPLC assay for the determination of glibenclamide in human plasma was developed and validated. After addition of flufenamic acid as internal standard, the analytes were isolated from human plasma by liquid-liquid extraction. The method was linear in the 10-400 ng/ml concentration range (r > 0.999). Recovery for glibenclamide was greater than 91.5% and for internal standard was 93.5%. Within-day and between-day precision, expressed as the relative standard deviation (RSD%), ranged from 1.4 to 5.9% and 5.8 to 6.6%, respectively. Assay accuracy was better than 93.4%. The assay was used to estimate the pharmacokinetics of glibenclamide after oral administration of a 5 mg tablet of glibenclamide to 18 healthy volunteers.

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NASA Technical Reports Server (NTRS)

Wickens, Christopher; Sebok, Angelia; Keller, John; Peters, Steve; Small, Ronald; Hutchins, Shaun; Algarin, Liana; Gore, Brian Francis; Hooey, Becky Lee; Foyle, David C.

2013-01-01

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA

Validation of In utero Tractography of Human Fetal Commissural and Internal Capsule Fibers with Histological Structure Tensor Analysis

PubMed Central

Mitter, Christian; Jakab, András; Brugger, Peter C.; Ricken, Gerda; Gruber, Gerlinde M.; Bettelheim, Dieter; Scharrer, Anke; Langs, Georg; Hainfellner, Johannes A.; Prayer, Daniela; Kasprian, Gregor

2015-01-01

Diffusion tensor imaging (DTI) and tractography offer the unique possibility to visualize the developing white matter macroanatomy of the human fetal brain in vivo and in utero and are currently under investigation for their potential use in the diagnosis of developmental pathologies of the human central nervous system. However, in order to establish in utero DTI as a clinical imaging tool, an independent comparison between macroscopic imaging and microscopic histology data in the same subject is needed. The present study aimed to cross-validate normal as well as abnormal in utero tractography results of commissural and internal capsule fibers in human fetal brains using postmortem histological structure tensor (ST) analysis. In utero tractography findings from two structurally unremarkable and five abnormal fetal brains were compared to the results of postmortem ST analysis applied to digitalized whole hemisphere sections of the same subjects. An approach to perform ST-based deterministic tractography in histological sections was implemented to overcome limitations in correlating in utero tractography to postmortem histology data. ST analysis and histology-based tractography of fetal brain sections enabled the direct assessment of the anisotropic organization and main fiber orientation of fetal telencephalic layers on a micro- and macroscopic scale, and validated in utero tractography results of corpus callosum and internal capsule fiber tracts. Cross-validation of abnormal in utero tractography results could be achieved in four subjects with agenesis of the corpus callosum (ACC) and in two cases with malformations of internal capsule fibers. In addition, potential limitations of current DTI-based in utero tractography could be demonstrated in several brain regions. Combining the three-dimensional nature of DTI-based in utero tractography with the microscopic resolution provided by histological ST analysis may ultimately facilitate a more complete morphologic

EVA Health and Human Performance Benchmarking Study

NASA Technical Reports Server (NTRS)

Abercromby, A. F.; Norcross, J.; Jarvis, S. L.

2016-01-01

Multiple HRP Risks and Gaps require detailed characterization of human health and performance during exploration extravehicular activity (EVA) tasks; however, a rigorous and comprehensive methodology for characterizing and comparing the health and human performance implications of current and future EVA spacesuit designs does not exist. This study will identify and implement functional tasks and metrics, both objective and subjective, that are relevant to health and human performance, such as metabolic expenditure, suit fit, discomfort, suited postural stability, cognitive performance, and potentially biochemical responses for humans working inside different EVA suits doing functional tasks under the appropriate simulated reduced gravity environments. This study will provide health and human performance benchmark data for humans working in current EVA suits (EMU, Mark III, and Z2) as well as shirtsleeves using a standard set of tasks and metrics with quantified reliability. Results and methodologies developed during this test will provide benchmark data against which future EVA suits, and different suit configurations (eg, varied pressure, mass, CG) may be reliably compared in subsequent tests. Results will also inform fitness for duty standards as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Design Characteristics Influence Performance of Clinical Prediction Rules in Validation: A Meta-Epidemiological Study

PubMed Central

Ban, Jong-Wook; Emparanza, José Ignacio; Urreta, Iratxe; Burls, Amanda

2016-01-01

Background Many new clinical prediction rules are derived and validated. But the design and reporting quality of clinical prediction research has been less than optimal. We aimed to assess whether design characteristics of validation studies were associated with the overestimation of clinical prediction rules’ performance. We also aimed to evaluate whether validation studies clearly reported important methodological characteristics. Methods Electronic databases were searched for systematic reviews of clinical prediction rule studies published between 2006 and 2010. Data were extracted from the eligible validation studies included in the systematic reviews. A meta-analytic meta-epidemiological approach was used to assess the influence of design characteristics on predictive performance. From each validation study, it was assessed whether 7 design and 7 reporting characteristics were properly described. Results A total of 287 validation studies of clinical prediction rule were collected from 15 systematic reviews (31 meta-analyses). Validation studies using case-control design produced a summary diagnostic odds ratio (DOR) 2.2 times (95% CI: 1.2–4.3) larger than validation studies using cohort design and unclear design. When differential verification was used, the summary DOR was overestimated by twofold (95% CI: 1.2 -3.1) compared to complete, partial and unclear verification. The summary RDOR of validation studies with inadequate sample size was 1.9 (95% CI: 1.2 -3.1) compared to studies with adequate sample size. Study site, reliability, and clinical prediction rule was adequately described in 10.1%, 9.4%, and 7.0% of validation studies respectively. Conclusion Validation studies with design shortcomings may overestimate the performance of clinical prediction rules. The quality of reporting among studies validating clinical prediction rules needs to be improved. PMID:26730980

Development and Fit-for-Purpose Validation of a Soluble Human Programmed Death-1 Protein Assay.

PubMed

Ni, Yan G; Yuan, Xiling; Newitt, John A; Peterson, Jon E; Gleason, Carol R; Haulenbeek, Jonathan; Santockyte, Rasa; Lafont, Virginie; Marsilio, Frank; Neely, Robert J; DeSilva, Binodh; Piccoli, Steven P

2015-07-01

Programmed death-1 (PD-1) protein is a co-inhibitory receptor which negatively regulates immune cell activation and permits tumors to evade normal immune defense. Anti-PD-1 antibodies have been shown to restore immune cell activation and effector function-an exciting breakthrough in cancer immunotherapy. Recent reports have documented a soluble form of PD-1 (sPD-1) in the circulation of normal and disease state individuals. A clinical assay to quantify sPD-1 would contribute to the understanding of sPD-1-function and facilitate the development of anti-PD-1 drugs. Here, we report the development and validation of a sPD-1 protein assay. The assay validation followed the framework for full validation of a biotherapeutic pharmacokinetic assay. A purified recombinant human PD-1 protein was characterized extensively and was identified as the assay reference material which mimics the endogenous analyte in structure and function. The lower limit of quantitation (LLOQ) was determined to be 100 pg/mL, with a dynamic range spanning three logs to 10,000 pg/mL. The intra- and inter-assay imprecision were ≤15%, and the assay bias (percent deviation) was ≤10%. Potential matrix effects were investigated in sera from both normal healthy volunteers and selected cancer patients. Bulk-prepared frozen standards and pre-coated Streptavidin plates were used in the assay to ensure consistency in assay performance over time. This assay appears to specifically measure total sPD-1 protein since the human anti-PD-1 antibody, nivolumab, and the endogenous ligands of PD-1 protein, PDL-1 and PDL-2, do not interfere with the assay.

Five-Kilometers Time Trial: Preliminary Validation of a Short Test for Cycling Performance Evaluation.

PubMed

Dantas, Jose Luiz; Pereira, Gleber; Nakamura, Fabio Yuzo

2015-09-01

The five-kilometer time trial (TT5km) has been used to assess aerobic endurance performance without further investigation of its validity. This study aimed to perform a preliminary validation of the TT5km to rank well-trained cyclists based on aerobic endurance fitness and assess changes of the aerobic endurance performance. After the incremental test, 20 cyclists (age = 31.3 ± 7.9 years; body mass index = 22.7 ± 1.5 kg/m(2); maximal aerobic power = 360.5 ± 49.5 W) performed the TT5km twice, collecting performance (time to complete, absolute and relative power output, average speed) and physiological responses (heart rate and electromyography activity). The validation criteria were pacing strategy, absolute and relative reliability, validity, and sensitivity. Sensitivity index was obtained from the ratio between the smallest worthwhile change and typical error. The TT5km showed high absolute (coefficient of variation < 3%) and relative (intraclass coefficient correlation > 0.95) reliability of performance variables, whereas it presented low reliability of physiological responses. The TT5km performance variables were highly correlated with the aerobic endurance indices obtained from incremental test (r > 0.70). These variables showed adequate sensitivity index (> 1). TT5km is a valid test to rank the aerobic endurance fitness of well-trained cyclists and to differentiate changes on aerobic endurance performance. Coaches can detect performance changes through either absolute (± 17.7 W) or relative power output (± 0.3 W.kg(-1)), the time to complete the test (± 13.4 s) and the average speed (± 1.0 km.h(-1)). Furthermore, TT5km performance can also be used to rank the athletes according to their aerobic endurance fitness.

Derivation and Cross-Validation of Cutoff Scores for Patients With Schizophrenia Spectrum Disorders on WAIS-IV Digit Span-Based Performance Validity Measures.

PubMed

Glassmire, David M; Toofanian Ross, Parnian; Kinney, Dominique I; Nitch, Stephen R

2016-06-01

Two studies were conducted to identify and cross-validate cutoff scores on the Wechsler Adult Intelligence Scale-Fourth Edition Digit Span-based embedded performance validity (PV) measures for individuals with schizophrenia spectrum disorders. In Study 1, normative scores were identified on Digit Span-embedded PV measures among a sample of patients (n = 84) with schizophrenia spectrum diagnoses who had no known incentive to perform poorly and who put forth valid effort on external PV tests. Previously identified cutoff scores resulted in unacceptable false positive rates and lower cutoff scores were adopted to maintain specificity levels ≥90%. In Study 2, the revised cutoff scores were cross-validated within a sample of schizophrenia spectrum patients (n = 96) committed as incompetent to stand trial. Performance on Digit Span PV measures was significantly related to Full Scale IQ in both studies, indicating the need to consider the intellectual functioning of examinees with psychotic spectrum disorders when interpreting scores on Digit Span PV measures. © The Author(s) 2015.

Development of a new calibration procedure and its experimental validation applied to a human motion capture system.

PubMed

Royo Sánchez, Ana Cristina; Aguilar Martín, Juan José; Santolaria Mazo, Jorge

2014-12-01

Motion capture systems are often used for checking and analyzing human motion in biomechanical applications. It is important, in this context, that the systems provide the best possible accuracy. Among existing capture systems, optical systems are those with the highest accuracy. In this paper, the development of a new calibration procedure for optical human motion capture systems is presented. The performance and effectiveness of that new calibration procedure are also checked by experimental validation. The new calibration procedure consists of two stages. In the first stage, initial estimators of intrinsic and extrinsic parameters are sought. The camera calibration method used in this stage is the one proposed by Tsai. These parameters are determined from the camera characteristics, the spatial position of the camera, and the center of the capture volume. In the second stage, a simultaneous nonlinear optimization of all parameters is performed to identify the optimal values, which minimize the objective function. The objective function, in this case, minimizes two errors. The first error is the distance error between two markers placed in a wand. The second error is the error of position and orientation of the retroreflective markers of a static calibration object. The real co-ordinates of the two objects are calibrated in a co-ordinate measuring machine (CMM). The OrthoBio system is used to validate the new calibration procedure. Results are 90% lower than those from the previous calibration software and broadly comparable with results from a similarly configured Vicon system.

Collaborative study for the validation of alternative in vitro potency assays for human tetanus immunoglobulin.

PubMed

Gross, S; Janssen, S W J; de Vries, B; Terao, E; Daas, A; Buchheit, K-H

2009-10-01

The European Pharmacopoeia (Ph. Eur.) monograph Human tetanus immunoglobulin (0398) gives a clear outline of the in vivo assay to be performed to determine the potency of human tetanus immunoglobulins during their development. Furthermore, it states that an in vitro method shall be validated for the batch potency estimation. Since no further guidance is given on the in vitro assay, every control laboratory concerned is free to design and validate an in-house method. At the moment there is no agreed in vitro method available. The aim of this study was to validate and compare 2 alternative in vitro assays, i.e. an enzyme-linked immunoassay (EIA) and a toxoid inhibition assay (TIA), through an international collaborative study, in view of their eventual inclusion into the Ph. Eur.. The study was run in the framework of the Biological Standardisation Programme (BSP), under the aegis of the European Commission and the Council of Europe. The collaborative study reported here involved 21 laboratories (public and industry) from 15 countries. Initially, 3 samples with low, medium and high potencies were tested by EIA and TIA. Results showed good reproducibility and repeatability of the 2 in vitro methods. The correlation of the data with the in vivo potency assigned by the manufacturers however appeared initially poor for high potency samples. Thorough re-examination of the data showed that the in vivo potencies assigned by the manufacturers had to be corrected: one for potency loss at the time of in vitro testing and one because of a reporting error. After these corrections the values obtained by in vivo and in vitro methods were in close agreement. A supplementary collaborative work was carried out to validate the 2 methods for immunoglobulin products with high potencies. Eight laboratories (public and industry) took part in this additional study to test 3 samples with medium and high potencies by EIA and TIA. Results confirmed that the 2 alternative methods are

Learning, Remembering, Believing. Enhancing Human Performance.

ERIC Educational Resources Information Center

Druckman, Daniel, Ed.; Bjork, Robert A., Ed.

This book is the third report of the Committee on Techniques for the Enhancement of Human Performance. Based on hundreds of research studies of learning and human performance as reported in the literature, the book consists of 11 chapters organized in five parts. The two chapters of the first part provide the background and summary of the…

Challenges in validating the sterilisation dose for processed human amniotic membranes

NASA Astrophysics Data System (ADS)

Yusof, Norimah; Hassan, Asnah; Firdaus Abd Rahman, M. N.; Hamid, Suzina A.

2007-11-01

Most of the tissue banks in the Asia Pacific region have been using ionising radiation at 25 kGy to sterilise human tissues for save clinical usage. Under tissue banking quality system, any dose employed for sterilisation has to be validated and the validation exercise has to be a part of quality document. Tissue grafts, unlike medical items, are not produced in large number per each processing batch and tissues relatively have a different microbial population. A Code of Practice established by the International Atomic Energy Agency (IAEA) in 2004 offers several validation methods using smaller number of samples compared to ISO 11137 (1995), which is meant for medical products. The methods emphasise on bioburden determination, followed by sterility test on samples after they were exposed to verification dose for attaining of sterility assurance level (SAL) of 10 -1. This paper describes our experience in using the IAEA Code of Practice in conducting the validation exercise for substantiating 25 kGy as sterilisation dose for both air-dried amnion and those preserved in 99% glycerol.

Extending Validated Human Performance Models to Explore NextGen Concepts

NASA Technical Reports Server (NTRS)

Gore, Brian Francis; Hooey, Becky Lee; Mahlstedt, Eric; Foyle, David C.

2012-01-01

To meet the expected increases in air traffic demands, NASA and FAA are researching and developing Next Generation Air Transportation System (NextGen) concepts. NextGen will require substantial increases in the data available to pilots on the flight deck (e.g., weather,wake, traffic trajectory predictions, etc.) to support more precise and closely coordinated operations (e.g., self-separation, RNAV/RNP, and closely spaced parallel operations, CSPOs). These NextGen procedures and operations, along with the pilot's roles and responsibilities, must be designed with consideration of the pilot's capabilities and limitations. Failure to do so will leave the pilots, and thus the entire aviation system, vulnerable to error. A validated Man-machine Integration and design Analysis System (MIDAS) v5 model was extended to evaluate anticipated changes to flight deck and controller roles and responsibilities in NextGen approach and Land operations. Compared to conditions when the controllers are responsible for separation on decent to land phase of flight, the output from these model predictions suggest that the flight deck response time to detect the lead aircraft blunder will decrease, pilot scans to the navigation display will increase, and workload will increase.

New validated method for piracetam HPLC determination in human plasma.

PubMed

Curticapean, Augustin; Imre, Silvia

2007-01-10

The new method for HPLC determination of piracetam in human plasma was developed and validated by a new approach. The simple determination by UV detection was performed on supernatant, obtained from plasma, after proteins precipitation with perchloric acid. The chromatographic separation of piracetam under a gradient elution was achieved at room temperature with a RP-18 LiChroSpher 100 column and aqueous mobile phase containing acetonitrile and methanol. The quantitative determination of piracetam was performed at 200 nm with a lower limit of quantification LLQ=2 microg/ml. For this limit, the calculated values of the coefficient of variation and difference between mean and the nominal concentration are CV%=9.7 and bias%=0.9 for the intra-day assay, and CV%=19.1 and bias%=-7.45 for the between-days assay. For precision, the range was CV%=1.8/11.6 in the intra-day and between-days assay, and for accuracy, the range was bias%=2.3/14.9 in the intra-day and between-days assay. In addition, the stability of piracetam in different conditions was verified. Piracetam proved to be stable in plasma during 4 weeks at -20 degrees C and for 36 h at 20 degrees C in the supernatant after protein precipitation. The new proposed method was used for a bioequivalence study of two medicines containing 800 mg piracetam.

Functional performance testing of the hip in athletes: a systematic review for reliability and validity.

PubMed

Kivlan, Benjamin R; Martin, Robroy L

2012-08-01

The purpose of this study was to systematically review the literature for functional performance tests with evidence of reliability and validity that could be used for a young, athletic population with hip dysfunction. A search of PubMed and SPORTDiscus databases were performed to identify movement, balance, hop/jump, or agility functional performance tests from the current peer-reviewed literature used to assess function of the hip in young, athletic subjects. The single-leg stance, deep squat, single-leg squat, and star excursion balance tests (SEBT) demonstrated evidence of validity and normative data for score interpretation. The single-leg stance test and SEBT have evidence of validity with association to hip abductor function. The deep squat test demonstrated evidence as a functional performance test for evaluating femoroacetabular impingement. Hop/Jump tests and agility tests have no reported evidence of reliability or validity in a population of subjects with hip pathology. Use of functional performance tests in the assessment of hip dysfunction has not been well established in the current literature. Diminished squat depth and provocation of pain during the single-leg balance test have been associated with patients diagnosed with FAI and gluteal tendinopathy, respectively. The SEBT and single-leg squat tests provided evidence of convergent validity through an analysis of kinematics and muscle function in normal subjects. Reliability of functional performance tests have not been established on patients with hip dysfunction. Further study is needed to establish reliability and validity of functional performance tests that can be used in a young, athletic population with hip dysfunction. 2b (Systematic Review of Literature).

The Validity of Conscientiousness Is Overestimated in the Prediction of Job Performance.

PubMed

Kepes, Sven; McDaniel, Michael A

2015-01-01

Sensitivity analyses refer to investigations of the degree to which the results of a meta-analysis remain stable when conditions of the data or the analysis change. To the extent that results remain stable, one can refer to them as robust. Sensitivity analyses are rarely conducted in the organizational science literature. Despite conscientiousness being a valued predictor in employment selection, sensitivity analyses have not been conducted with respect to meta-analytic estimates of the correlation (i.e., validity) between conscientiousness and job performance. To address this deficiency, we reanalyzed the largest collection of conscientiousness validity data in the personnel selection literature and conducted a variety of sensitivity analyses. Publication bias analyses demonstrated that the validity of conscientiousness is moderately overestimated (by around 30%; a correlation difference of about .06). The misestimation of the validity appears to be due primarily to suppression of small effects sizes in the journal literature. These inflated validity estimates result in an overestimate of the dollar utility of personnel selection by millions of dollars and should be of considerable concern for organizations. The fields of management and applied psychology seldom conduct sensitivity analyses. Through the use of sensitivity analyses, this paper documents that the existing literature overestimates the validity of conscientiousness in the prediction of job performance. Our data show that effect sizes from journal articles are largely responsible for this overestimation.

Studying the neurobiology of human social interaction: Making the case for ecological validity.

PubMed

Hogenelst, Koen; Schoevers, Robert A; aan het Rot, Marije

2015-01-01

With this commentary we make the case for an increased focus on the ecological validity of the measures used to assess aspects of human social functioning. Impairments in social functioning are seen in many types of psychopathology, negatively affecting the lives of psychiatric patients and those around them. Yet the neurobiology underlying abnormal social interaction remains unclear. As an example of human social neuroscience research with relevance to biological psychiatry and clinical psychopharmacology, this commentary discusses published experimental studies involving manipulation of the human brain serotonin system that included assessments of social behavior. To date, these studies have mostly been laboratory-based and included computer tasks, observations by others, or single-administration self-report measures. Most laboratory measures used so far inform about the role of serotonin in aspects of social interaction, but the relevance for real-life interaction is often unclear. Few studies have used naturalistic assessments in real life. We suggest several laboratory methods with high ecological validity as well as ecological momentary assessment, which involves intensive repeated measures in naturalistic settings. In sum, this commentary intends to stimulate experimental research on the neurobiology of human social interaction as it occurs in real life.

Validated high-performance liquid chromatographic method utilizing solid-phase extraction for the simultaneous determination of naringenin and hesperetin in human plasma.

PubMed

Kanaze, Feras Imad; Kokkalou, Eugene; Georgarakis, Manolis; Niopas, Ioannis

2004-03-05

Naringenin and hesperetin, the aglycones of the flavanone glucosides naringin and hesperidin occur naturally in citrus fruits. They exert a variety of pharmacological effects such as antioxidant, blood lipid-lowering, anticarcinogenic and inhibit selected cytochrome P-450 enzymes resulting in drug interactions. A specific, sensitive, precise, and accurate solid-phase extraction high-performance liquid chromatographic (HPLC) assay for the simultaneous determination of naringenin and hesperetin in human plasma was developed and validated. After addition of 7-ethoxycoumarin as internal standard, plasma samples were incubated with beta-glucuronidase/sulphatase, and the analytes were isolated from plasma by solid-phase extraction using C(18) cartridges and separated on a C(8) reversed phase column with methanol/water/acetic acid (40:58:2, v/v/v) as the eluent at 45 degrees C. The method was linear in the 10-300 ng/ml concentration range for both naringenin and hesperetin (r>0.999). Recovery for naringenin, hesperetin and internal standard was greater than 76.7%. Intra- and inter-day precision for naringenin ranged from 1.4 to 4.2% and from 1.9 to 5.2%, respectively, and for hesperetin ranged from 1.3 to 4.1% and from 1.7 to 5.1%, respectively. Accuracy was better than 91.5 and 91.3% for naringenin and hesperetin, respectively.

Performance Validity Testing in Neuropsychology: Methods for Measurement Development and Maximizing Diagnostic Accuracy.

PubMed

Wodushek, Thomas R; Greher, Michael R

2017-05-01

In the first column in this 2-part series, Performance Validity Testing in Neuropsychology: Scientific Basis and Clinical Application-A Brief Review, the authors introduced performance validity tests (PVTs) and their function, provided a justification for why they are necessary, traced their ongoing endorsement by neuropsychological organizations, and described how they are used and interpreted by ever increasing numbers of clinical neuropsychologists. To enhance readers' understanding of these measures, this second column briefly describes common detection strategies used in PVTs as well as the typical methods used to validate new PVTs and determine cut scores for valid/invalid determinations. We provide a discussion of the latest research demonstrating how neuropsychologists can combine multiple PVTs in a single battery to improve sensitivity/specificity to invalid responding. Finally, we discuss future directions for the research and application of PVTs.

Human behavior and human performance: Psychomotor demands

NASA Technical Reports Server (NTRS)

1992-01-01

The results of several experiments are presented in abstract form. These studies are critical for the interpretation and acceptance of flight based science to be conducted by the Behavior and Performance project. Some representative titles are as follow: External audio for IBM/PC compatible computers; A comparative assessment of psychomotor performance (target prediction by humans and macaques); Response path (a dependent measure for computer maze solving and other tasks); Behavioral asymmetries of psychomotor performance in Rhesus monkey (a dissociation between hand preference and skill); Testing primates with joystick based automated apparatus; and Environmental enrichment and performance assessment for ground or flight based research with primates;

A validation study of a stochastic model of human interaction

NASA Astrophysics Data System (ADS)

Burchfield, Mitchel Talmadge

The purpose of this dissertation is to validate a stochastic model of human interactions which is part of a developmentalism paradigm. Incorporating elements of ancient and contemporary philosophy and science, developmentalism defines human development as a progression of increasing competence and utilizes compatible theories of developmental psychology, cognitive psychology, educational psychology, social psychology, curriculum development, neurology, psychophysics, and physics. To validate a stochastic model of human interactions, the study addressed four research questions: (a) Does attitude vary over time? (b) What are the distributional assumptions underlying attitudes? (c) Does the stochastic model, {-}N{intlimitssbsp{-infty}{infty}}varphi(chi,tau)\\ Psi(tau)dtau, have utility for the study of attitudinal distributions and dynamics? (d) Are the Maxwell-Boltzmann, Fermi-Dirac, and Bose-Einstein theories applicable to human groups? Approximately 25,000 attitude observations were made using the Semantic Differential Scale. Positions of individuals varied over time and the logistic model predicted observed distributions with correlations between 0.98 and 1.0, with estimated standard errors significantly less than the magnitudes of the parameters. The results bring into question the applicability of Fisherian research designs (Fisher, 1922, 1928, 1938) for behavioral research based on the apparent failure of two fundamental assumptions-the noninteractive nature of the objects being studied and normal distribution of attributes. The findings indicate that individual belief structures are representable in terms of a psychological space which has the same or similar properties as physical space. The psychological space not only has dimension, but individuals interact by force equations similar to those described in theoretical physics models. Nonlinear regression techniques were used to estimate Fermi-Dirac parameters from the data. The model explained a high degree

Validation of NOViSE.

PubMed

Korzeniowski, Przemyslaw; Brown, Daniel C; Sodergren, Mikael H; Barrow, Alastair; Bello, Fernando

2017-02-01

The goal of this study was to establish face, content, and construct validity of NOViSE-the first force-feedback enabled virtual reality (VR) simulator for natural orifice transluminal endoscopic surgery (NOTES). Fourteen surgeons and surgical trainees performed 3 simulated hybrid transgastric cholecystectomies using a flexible endoscope on NOViSE. Four of them were classified as "NOTES experts" who had independently performed 10 or more simulated or human NOTES procedures. Seven participants were classified as "Novices" and 3 as "Gastroenterologists" with no or minimal NOTES experience. A standardized 5-point Likert-type scale questionnaire was administered to assess the face and content validity. NOViSE showed good overall face and content validity. In 14 out of 15 statements pertaining to face validity (graphical appearance, endoscope and tissue behavior, overall realism), ≥50% of responses were "agree" or "strongly agree." In terms of content validity, 85.7% of participants agreed or strongly agreed that NOViSE is a useful training tool for NOTES and 71.4% that they would recommend it to others. Construct validity was established by comparing a number of performance metrics such as task completion times, path lengths, applied forces, and so on. NOViSE demonstrated early signs of construct validity. Experts were faster and used a shorter endoscopic path length than novices in all but one task. The results indicate that NOViSE authentically recreates a transgastric hybrid cholecystectomy and sets promising foundations for the further development of a VR training curriculum for NOTES without compromising patient safety or requiring expensive animal facilities.

Validation of mid-infrared spectroscopy for macronutrient analysis of human milk.

PubMed

Parat, S; Groh-Wargo, S; Merlino, S; Wijers, C; Super, D M

2017-07-01

Human milk has considerable variation in its composition. Hence, the nutrient profile is only an estimate and can result in under- or over-estimation of the intake of preterm infants. Mid-infrared (MIR) spectroscopy is an evolving technique for analyzing human milk but needs validation before use in clinical practice. Human milk samples from 35 mothers delivering at 35 weeks to term gestation were analyzed for macronutrients by MIR spectroscopy and by standard laboratory methods using Kjeldahl assay for protein, Mojonnier assay for fat and high-pressure liquid chromatography assay for lactose. MIR analysis of the macronutrients in human milk correlated well with standard laboratory tests with intraclass correlation coefficients of 0.997 for fat, 0.839 for protein and 0.776 for lactose. Agreement between the two methods was excellent for fat, and moderate for protein and lactose (P<0.001). This methodological paper provides evidence that MIR spectroscopy can be used to analyze macronutrient composition of human milk. Agreement between the methodologies varies by macronutrient.

Structured Uncertainty Bound Determination From Data for Control and Performance Validation

NASA Technical Reports Server (NTRS)

Lim, Kyong B.

2003-01-01

This report attempts to document the broad scope of issues that must be satisfactorily resolved before one can expect to methodically obtain, with a reasonable confidence, a near-optimal robust closed loop performance in physical applications. These include elements of signal processing, noise identification, system identification, model validation, and uncertainty modeling. Based on a recently developed methodology involving a parameterization of all model validating uncertainty sets for a given linear fractional transformation (LFT) structure and noise allowance, a new software, Uncertainty Bound Identification (UBID) toolbox, which conveniently executes model validation tests and determine uncertainty bounds from data, has been designed and is currently available. This toolbox also serves to benchmark the current state-of-the-art in uncertainty bound determination and in turn facilitate benchmarking of robust control technology. To help clarify the methodology and use of the new software, two tutorial examples are provided. The first involves the uncertainty characterization of a flexible structure dynamics, and the second example involves a closed loop performance validation of a ducted fan based on an uncertainty bound from data. These examples, along with other simulation and experimental results, also help describe the many factors and assumptions that determine the degree of success in applying robust control theory to practical problems.

The Validity and Reliability of a Performance Assessment Procedure in Ice Hockey

ERIC Educational Resources Information Center

Nadeau, Luc; Richard, Jean-Francois; Godbout, Paul

2008-01-01

Background: Coaches and physical educators must obtain valid data relating to the contribution of each of their players in order to assess their level of performance in team sport competition. This information must also be collected and used in real game situations to be more valid. Developed initially for a physical education class context, the…

Victoria Symptom Validity Test performance in children and adolescents with neurological disorders.

PubMed

Brooks, Brian L

2012-12-01

It is becoming increasingly more important to study, use, and promote the utility of measures that are designed to detect non-compliance with testing (i.e., poor effort, symptom non-validity, response bias) as part of neuropsychological assessments with children and adolescents. Several measures have evidence for use in pediatrics, but there is a paucity of published support for the Victoria Symptom Validity Test (VSVT) in this population. The purpose of this study was to examine the performance on the VSVT in a sample of pediatric patients with known neurological disorders. The sample consisted of 100 consecutively referred children and adolescents between the ages of 6 and 19 years (mean = 14.0, SD = 3.1) with various neurological diagnoses. On the VSVT total items, 95% of the sample had performance in the "valid" range, with 5% being deemed "questionable" and 0% deemed "invalid". On easy items, 97% were "valid", 2% were "questionable", and 1% was "invalid." For difficult items, 84% were "valid," 16% were "questionable," and 0% was "invalid." For those patients given two effort measures (i.e., VSVT and Test of Memory Malingering; n = 65), none was identified as having poor test-taking compliance on both measures. VSVT scores were significantly correlated with age, intelligence, processing speed, and functional ratings of daily abilities (attention, executive functioning, and adaptive functioning), but not objective performance on the measure of sustained attention, verbal memory, or visual memory. The VSVT has potential to be used in neuropsychological assessments with pediatric patients.

Validation of a commercially available enzyme-linked immunoabsorbent assay for the quantification of human α-Synuclein in cerebrospinal fluid.

PubMed

Kruse, Niels; Mollenhauer, Brit

2015-11-01

The quantification of α-Synuclein in cerebrospinal fluid (CSF) as a biomarker has gained tremendous interest in the last years. Several commercially available immunoassays are emerging. We here describe the full validation of one commercially available ELISA assay for the quantification of α-Synuclein in human CSF (Covance alpha-Synuclein ELISA kit). The study was conducted within the BIOMARKAPD project in the European initiative Joint Program for Neurodegenerative Diseases (JPND). We investigated the effect of several pre-analytical and analytical confounders: i.e. (1) need for centrifugation of freshly drawn CSF, (2) sample stability, (3) delay of freezing, (4) volume of storage aliquots, (5) freeze/thaw cycles, (6) thawing conditions, (7) dilution linearity, (8) parallelism, (9) spike recovery, and (10) precision. None of these confounders influenced the levels of α-Synuclein in CSF significantly. We found a very high intra-assay precision. The inter-assay precision was lower than expected due to different performances of kit lots used. Overall the validated immunoassay is useful for the quantification of α-Synuclein in human CSF. Copyright © 2015 Elsevier B.V. All rights reserved.

FUNCTIONAL PERFORMANCE TESTING OF THE HIP IN ATHLETES: A SYSTEMATIC REVIEW FOR RELIABILITY AND VALIDITY

PubMed Central

Martin, RobRoy L.

2012-01-01

Purpose/Background: The purpose of this study was to systematically review the literature for functional performance tests with evidence of reliability and validity that could be used for a young, athletic population with hip dysfunction. Methods: A search of PubMed and SPORTDiscus databases were performed to identify movement, balance, hop/jump, or agility functional performance tests from the current peer-reviewed literature used to assess function of the hip in young, athletic subjects. Results: The single-leg stance, deep squat, single-leg squat, and star excursion balance tests (SEBT) demonstrated evidence of validity and normative data for score interpretation. The single-leg stance test and SEBT have evidence of validity with association to hip abductor function. The deep squat test demonstrated evidence as a functional performance test for evaluating femoroacetabular impingement. Hop/Jump tests and agility tests have no reported evidence of reliability or validity in a population of subjects with hip pathology. Conclusions: Use of functional performance tests in the assessment of hip dysfunction has not been well established in the current literature. Diminished squat depth and provocation of pain during the single-leg balance test have been associated with patients diagnosed with FAI and gluteal tendinopathy, respectively. The SEBT and single-leg squat tests provided evidence of convergent validity through an analysis of kinematics and muscle function in normal subjects. Reliability of functional performance tests have not been established on patients with hip dysfunction. Further study is needed to establish reliability and validity of functional performance tests that can be used in a young, athletic population with hip dysfunction. Level of Evidence: 2b (Systematic Review of Literature) PMID:22893860

Performing a Content Validation Study.

ERIC Educational Resources Information Center

Spool, Mark D.

Content validity is concerned with three components: (1) the job content; (2) the test content, and (3) the strength of the relationship between the two. A content validation study, to be considered adequate and defensible should include at least the following four procedures: (1) A thorough and accurate job analysis (to define the job content);…

Development and validation of an extraction method for the analysis of perfluoroalkyl substances in human hair.

PubMed

Kim, Da-Hye; Oh, Jeong-Eun

2017-05-01

Human hair has many advantages as a non-invasive sample; however, analytical methods for detecting perfluoroalkyl substances (PFASs) in human hair are still in the development stage. Therefore, the aim of this study was to develop and validate a method for monitoring 11 PFASs in human hair. Solid-phase extraction (SPE), ion-pairing extraction (IPE), a combined method (SPE+IPE) and solvent extraction with ENVI-carb clean-up were compared to develop an optimal extraction method using two types of hair sample (powder and piece forms). Analysis of PFASs was performed using liquid chromatography and tandem mass spectrometry. Among the four different extraction procedures, the SPE method using powdered hair showed the best extraction efficiency and recoveries ranged from 85.8 to 102%. The method detection limits for the SPE method were 0.114-0.796 ng/g and good precision (below 10%) and accuracy (66.4-110%) were obtained. In light of these results, SPE is considered the optimal method for PFAS extraction from hair. It was also successfully used to detect PFASs in human hair samples. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Validity of Conscientiousness Is Overestimated in the Prediction of Job Performance

PubMed Central

2015-01-01

Introduction Sensitivity analyses refer to investigations of the degree to which the results of a meta-analysis remain stable when conditions of the data or the analysis change. To the extent that results remain stable, one can refer to them as robust. Sensitivity analyses are rarely conducted in the organizational science literature. Despite conscientiousness being a valued predictor in employment selection, sensitivity analyses have not been conducted with respect to meta-analytic estimates of the correlation (i.e., validity) between conscientiousness and job performance. Methods To address this deficiency, we reanalyzed the largest collection of conscientiousness validity data in the personnel selection literature and conducted a variety of sensitivity analyses. Results Publication bias analyses demonstrated that the validity of conscientiousness is moderately overestimated (by around 30%; a correlation difference of about .06). The misestimation of the validity appears to be due primarily to suppression of small effects sizes in the journal literature. These inflated validity estimates result in an overestimate of the dollar utility of personnel selection by millions of dollars and should be of considerable concern for organizations. Conclusion The fields of management and applied psychology seldom conduct sensitivity analyses. Through the use of sensitivity analyses, this paper documents that the existing literature overestimates the validity of conscientiousness in the prediction of job performance. Our data show that effect sizes from journal articles are largely responsible for this overestimation. PMID:26517553

Performance validation of the ANSER control laws for the F-18 HARV

NASA Technical Reports Server (NTRS)

Messina, Michael D.

1995-01-01

The ANSER control laws were implemented in Ada by NASA Dryden for flight test on the High Alpha Research Vehicle (HARV). The Ada implementation was tested in the hardware-in-the-loop (HIL) simulation, and results were compared to those obtained with the NASA Langley batch Fortran implementation of the control laws which are considered the 'truth model.' This report documents the performance validation test results between these implementations. This report contains the ANSER performance validation test plan, HIL versus batch time-history comparisons, simulation scripts used to generate checkcases, and detailed analysis of discrepancies discovered during testing.

Performance validation of the ANSER Control Laws for the F-18 HARV

NASA Technical Reports Server (NTRS)

Messina, Michael D.

1995-01-01

The ANSER control laws were implemented in Ada by NASA Dryden for flight test on the High Alpha Research Vehicle (HARV). The Ada implementation was tested in the hardware-in-the-loop (HIL) simulation, and results were compared to those obtained with the NASA Langley batch Fortran implementation of the control laws which are considered the 'truth model'. This report documents the performance validation test results between these implementations. This report contains the ANSER performance validation test plan, HIL versus batch time-history comparisons, simulation scripts used to generate checkcases, and detailed analysis of discrepancies discovered during testing.

Determination of rifampicin in human plasma by high-performance liquid chromatography coupled with ultraviolet detection after automatized solid-liquid extraction.

PubMed

Louveau, B; Fernandez, C; Zahr, N; Sauvageon-Martre, H; Maslanka, P; Faure, P; Mourah, S; Goldwirt, L

2016-12-01

A precise and accurate high-performance liquid chromatography (HPLC) quantification method of rifampicin in human plasma was developed and validated using ultraviolet detection after an automatized solid-phase extraction. The method was validated with respect to selectivity, extraction recovery, linearity, intra- and inter-day precision, accuracy, lower limit of quantification and stability. Chromatographic separation was performed on a Chromolith RP 8 column using a mixture of 0.05 m acetate buffer pH 5.7-acetonitrile (35:65, v/v) as mobile phase. The compounds were detected at a wavelength of 335 nm with a lower limit of quantification of 0.05 mg/L in human plasma. Retention times for rifampicin and 6,7-dimethyl-2,3-di(2-pyridyl) quinoxaline used as internal standard were respectively 3.77 and 4.81 min. This robust and exact method was successfully applied in routine for therapeutic drug monitoring in patients treated with rifampicin. Copyright © 2016 John Wiley & Sons, Ltd.

A validated HPLC-MS/MS assay for quantifying unstable pharmacologically active metabolites of clopidogrel in human plasma: application to a clinical pharmacokinetic study.

PubMed

Furlong, Michael T; Savant, Ishani; Yuan, Moucun; Scott, Laura; Mylott, William; Mariannino, Thomas; Kadiyala, Pathanjali; Roongta, Vikram; Arnold, Mark E

2013-05-01

Clopidogrel is prescribed for the treatment of Acute Coronary Syndrome and recent myocardial infarction, recent stroke, or established peripheral arterial disease. A sensitive and reliable high performance liquid chromatography-tandem mass spectrometry (HPLC-MS/MS) assay was developed and validated to enable reliable quantification of four diastereomeric and chemically reactive thiol metabolites, two of which are pharmacologically active, in human plasma. The metabolites were stabilized by alkylation of their reactive thiol moieties with 2-bromo-3'-methoxyacetophenone (MPB). Following organic solvent mediated-protein precipitation in a 96-well plate format, chromatographic separation was achieved by gradient elution on an Ascentis Express RP-amide column. Chromatographic conditions were optimized to ensure separation of the four derivatized active metabolites. Derivatized metabolites and stable isotope-labeled internal standards were detected by positive ion electrospray tandem mass spectrometry. The HPLC-MS/MS assay was validated over concentration ranges of 0.125-125 ng/mL for metabolites H1-H3 and 0.101-101 ng/mL for H4. Intra- and inter-assay precision values for replicate quality control samples were within 14.3% for all analytes during the assay validation. Mean quality control accuracy values were within ±6.3% of nominal values for all analytes. Assay recoveries were high (>79%). The four derivatized analytes were stable in human blood for at least 2 h at room temperature and on ice. The analytes were also stable in human plasma for at least 25 h at room temperature, 372 days at -20 °C and -70 °C, and following at least five freeze-thaw cycles. The validated assay was successfully applied to the quantification of all four thiol metabolites in human plasma in support of a human pharmacokinetic study. Copyright © 2013 Elsevier B.V. All rights reserved.

Predicting Pilot Error in Nextgen: Pilot Performance Modeling and Validation Efforts

NASA Technical Reports Server (NTRS)

Wickens, Christopher; Sebok, Angelia; Gore, Brian; Hooey, Becky

2012-01-01

We review 25 articles presenting 5 general classes of computational models to predict pilot error. This more targeted review is placed within the context of the broader review of computational models of pilot cognition and performance, including such aspects as models of situation awareness or pilot-automation interaction. Particular emphasis is placed on the degree of validation of such models against empirical pilot data, and the relevance of the modeling and validation efforts to Next Gen technology and procedures.

Validation of the human odor span task: effects of nicotine.

PubMed

MacQueen, David A; Drobes, David J

2017-10-01

Amongst non-smokers, nicotine generally enhances performance on tasks of attention, with limited effect on working memory. In contrast, nicotine has been shown to produce robust enhancements of working memory in non-humans. To address this gap, the present study investigated the effects of nicotine on the performance of non-smokers on a cognitive battery which included a working memory task reverse-translated from use with rodents (the odor span task, OST). Nicotine has been reported to enhance OST performance in rats and the present study assessed whether this effect generalizes to human performance. Thirty non-smokers were tested on three occasions after consuming either placebo, 2 mg, or 4 mg nicotine gum. On each occasion, participants completed a battery of clinical and experimental tasks of working memory and attention. Nicotine was associated with dose-dependent enhancements in sustained attention, as evidenced by increased hit accuracy on the rapid visual information processing (RVIP) task. However, nicotine failed to produce main effects on OST performance or on alternative measures of working memory (digit span, spatial span, letter-number sequencing, 2-back) or attention (digits forward, 0-back). Interestingly, enhancement of RVIP performance occurred concomitant to significant reductions in self-reported attention/concentration. Human OST performance was significantly related to N-back performance, and as in rodents, OST accuracy declined with increasing memory load. Given the similarity of human and rodent OST performance under baseline conditions and the strong association between OST and visual 0-back accuracy, the OST may be particular useful in the study of conditions characterized by inattention.

Assessing Cognitive Performance in Badminton Players: A Reproducibility and Validity Study

PubMed Central

van de Water, Tanja; Faber, Irene; Elferink-Gemser, Marije

2017-01-01

Abstract Fast reaction and good inhibitory control are associated with elite sports performance. To evaluate the reproducibility and validity of a newly developed Badminton Reaction Inhibition Test (BRIT), fifteen elite (25 ± 4 years) and nine non-elite (24 ± 4 years) Dutch male badminton players participated in the study. The BRIT measured four components: domain-general reaction time, badminton-specific reaction time, domain-general inhibitory control and badminton-specific inhibitory control. Five participants were retested within three weeks on the badminton-specific components. Reproducibility was acceptable for badminton-specific reaction time (ICC = 0.626, CV = 6%) and for badminton-specific inhibitory control (ICC = 0.317, CV = 13%). Good construct validity was shown for badminton-specific reaction time discriminating between elite and non-elite players (F = 6.650, p < 0.05). Elite players did not outscore non-elite players on domain-general reaction time nor on both components of inhibitory control (p > 0.05). Concurrent validity for domain-general reaction time was good, as it was associated with a national ranking for elite (p = 0.70, p < 0.01) and non-elite (p = 0.70, p < 0.05) players. No relationship was found between the national ranking and badminton-specific reaction time, nor both components of inhibitory control (p > 0.05). In conclusion, reproducibility and validity of inhibitory control assessment was not confirmed, however, the BRIT appears a reproducible and valid measure of reaction time in badminton players. Reaction time measured with the BRIT may provide input for training programs aiming to improve badminton players’ performance. PMID:28210347

Assessing Cognitive Performance in Badminton Players: A Reproducibility and Validity Study.

PubMed

van de Water, Tanja; Huijgen, Barbara; Faber, Irene; Elferink-Gemser, Marije

2017-01-01

Fast reaction and good inhibitory control are associated with elite sports performance. To evaluate the reproducibility and validity of a newly developed Badminton Reaction Inhibition Test (BRIT), fifteen elite (25 ± 4 years) and nine non-elite (24 ± 4 years) Dutch male badminton players participated in the study. The BRIT measured four components: domain-general reaction time, badminton-specific reaction time, domain-general inhibitory control and badminton-specific inhibitory control. Five participants were retested within three weeks on the badminton-specific components. Reproducibility was acceptable for badminton-specific reaction time (ICC = 0.626, CV = 6%) and for badminton-specific inhibitory control (ICC = 0.317, CV = 13%). Good construct validity was shown for badminton-specific reaction time discriminating between elite and non-elite players (F = 6.650, p < 0.05). Elite players did not outscore non-elite players on domain-general reaction time nor on both components of inhibitory control (p > 0.05). Concurrent validity for domain-general reaction time was good, as it was associated with a national ranking for elite (p = 0.70, p < 0.01) and non-elite (p = 0.70, p < 0.05) players. No relationship was found between the national ranking and badminton-specific reaction time, nor both components of inhibitory control (p > 0.05). In conclusion, reproducibility and validity of inhibitory control assessment was not confirmed, however, the BRIT appears a reproducible and valid measure of reaction time in badminton players. Reaction time measured with the BRIT may provide input for training programs aiming to improve badminton players' performance.

Development and validation of a music performance anxiety inventory for gifted adolescent musicians.

PubMed

Osborne, Margaret S; Kenny, Dianna T

2005-01-01

Music performance anxiety (MPA) is a distressing experience for musicians of all ages, yet the empirical investigation of MPA in adolescents has received little attention to date. No measures specifically targeting MPA in adolescents have been empirically validated. This article presents findings of an initial study into the psychometric properties and validation of the Music Performance Anxiety Inventory for Adolescents (MPAI-A), a new self-report measure of MPA for this group. Data from 381 elite young musicians aged 12-19 years was used to investigate the factor structure, internal reliability, construct and divergent validity of the MPAI-A. Cronbach's alpha for the full measure was .91. Factor analysis identified three factors, which together accounted for 53% of the variance. Construct validity was demonstrated by significant positive relationships with social phobia (measured using the Social Phobia Anxiety Inventory [Beidel, D. C., Turner, S. M., & Morris, T. L. (1995). A new inventory to assess childhood social anxiety and phobia: The Social Phobia and Anxiety Inventory for Children. Psychological Assessment, 7(1), 73-79; Beidel, D. C., Turner, S. M., & Morris, T. L. (1998). Social Phobia and Anxiety Inventory for Children (SPAI-C). North Tonawanda, NY: Multi-Health Systems Inc.]) and trait anxiety (measured using the State Trait Anxiety Inventory [Spielberger, C. D. (1983). State-Trait Anxiety Inventory STAI (Form Y). Palo Alto, CA: Consulting Psychologists Press, Inc.]). The MPAI-A demonstrated convergent validity by a moderate to strong positive correlation with an adult measure of MPA. Discriminant validity was established by a weaker positive relationship with depression, and no relationship with externalizing behavior problems. It is hoped that the MPAI-A, as the first empirically validated measure of adolescent musicians' performance anxiety, will enhance and promote phenomenological and treatment research in this area.

Optimal control model predictions of system performance and attention allocation and their experimental validation in a display design study

NASA Technical Reports Server (NTRS)

Johannsen, G.; Govindaraj, T.

1980-01-01

The influence of different types of predictor displays in a longitudinal vertical takeoff and landing (VTOL) hover task is analyzed in a theoretical study. Several cases with differing amounts of predictive and rate information are compared. The optimal control model of the human operator is used to estimate human and system performance in terms of root-mean-square (rms) values and to compute optimized attention allocation. The only part of the model which is varied to predict these data is the observation matrix. Typical cases are selected for a subsequent experimental validation. The rms values as well as eye-movement data are recorded. The results agree favorably with those of the theoretical study in terms of relative differences. Better matching is achieved by revised model input data.

Evaluating Models of Human Performance: Safety-Critical Systems Applications

NASA Technical Reports Server (NTRS)

Feary, Michael S.

2012-01-01

This presentation is part of panel discussion on Evaluating Models of Human Performance. The purpose of this panel is to discuss the increasing use of models in the world today and specifically focus on how to describe and evaluate models of human performance. My presentation will focus on discussions of generating distributions of performance, and the evaluation of different strategies for humans performing tasks with mixed initiative (Human-Automation) systems. I will also discuss issues with how to provide Human Performance modeling data to support decisions on acceptability and tradeoffs in the design of safety critical systems. I will conclude with challenges for the future.

Human Performance Models of Pilot Behavior

NASA Technical Reports Server (NTRS)

Foyle, David C.; Hooey, Becky L.; Byrne, Michael D.; Deutsch, Stephen; Lebiere, Christian; Leiden, Ken; Wickens, Christopher D.; Corker, Kevin M.

2005-01-01

Five modeling teams from industry and academia were chosen by the NASA Aviation Safety and Security Program to develop human performance models (HPM) of pilots performing taxi operations and runway instrument approaches with and without advanced displays. One representative from each team will serve as a panelist to discuss their team s model architecture, augmentations and advancements to HPMs, and aviation-safety related lessons learned. Panelists will discuss how modeling results are influenced by a model s architecture and structure, the role of the external environment, specific modeling advances and future directions and challenges for human performance modeling in aviation.

The Stroop test as a measure of performance validity in adults clinically referred for neuropsychological assessment.

PubMed

Erdodi, Laszlo A; Sagar, Sanya; Seke, Kristian; Zuccato, Brandon G; Schwartz, Eben S; Roth, Robert M

2018-06-01

This study was designed to develop performance validity indicators embedded within the Delis-Kaplan Executive Function Systems (D-KEFS) version of the Stroop task. Archival data from a mixed clinical sample of 132 patients (50% male; M Age = 43.4; M Education = 14.1) clinically referred for neuropsychological assessment were analyzed. Criterion measures included the Warrington Recognition Memory Test-Words and 2 composites based on several independent validity indicators. An age-corrected scaled score ≤6 on any of the 4 trials reliably differentiated psychometrically defined credible and noncredible response sets with high specificity (.87-.94) and variable sensitivity (.34-.71). An inverted Stroop effect was less sensitive (.14-.29), but comparably specific (.85-90) to invalid performance. Aggregating the newly developed D-KEFS Stroop validity indicators further improved classification accuracy. Failing the validity cutoffs was unrelated to self-reported depression or anxiety. However, it was associated with elevated somatic symptom report. In addition to processing speed and executive function, the D-KEFS version of the Stroop task can function as a measure of performance validity. A multivariate approach to performance validity assessment is generally superior to univariate models. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Information processing. [in human performance

NASA Technical Reports Server (NTRS)

Wickens, Christopher D.; Flach, John M.

1988-01-01

Theoretical models of sensory-information processing by the human brain are reviewed from a human-factors perspective, with a focus on their implications for aircraft and avionics design. The topics addressed include perception (signal detection and selection), linguistic factors in perception (context provision, logical reversals, absence of cues, and order reversals), mental models, and working and long-term memory. Particular attention is given to decision-making problems such as situation assessment, decision formulation, decision quality, selection of action, the speed-accuracy tradeoff, stimulus-response compatibility, stimulus sequencing, dual-task performance, task difficulty and structure, and factors affecting multiple task performance (processing modalities, codes, and stages).

Validation and Evaluation of Army Aviation Collective Performance Measures

DTIC Science & Technology

2014-01-01

Research Report 1972 Validation and Evaluation of Army Aviation Collective Performance Measures Martin L. Bink U.S. Army...United States Army Research Institute for the Behavioral and Social Sciences Approved for public release; distribution is unlimited. U.S. Army...Research Institute for the Behavioral and Social Sciences Department of the Army Deputy Chief of Staff, G1 Authorized and approved for

Predictive validity of pre-admission assessments on medical student performance.

PubMed

Dabaliz, Al-Awwab; Kaadan, Samy; Dabbagh, M Marwan; Barakat, Abdulaziz; Shareef, Mohammad Abrar; Al-Tannir, Mohamad; Obeidat, Akef; Mohamed, Ayman

2017-11-24

To examine the predictive validity of pre-admission variables on students' performance in a medical school in Saudi Arabia. In this retrospective study, we collected admission and college performance data for 737 students in preclinical and clinical years. Data included high school scores and other standardized test scores, such as those of the National Achievement Test and the General Aptitude Test. Additionally, we included the scores of the Test of English as a Foreign Language (TOEFL) and the International English Language Testing System (IELTS) exams. Those datasets were then compared with college performance indicators, namely the cumulative Grade Point Average (cGPA) and progress test, using multivariate linear regression analysis. In preclinical years, both the National Achievement Test (p=0.04, B=0.08) and TOEFL (p=0.017, B=0.01) scores were positive predictors of cGPA, whereas the General Aptitude Test (p=0.048, B=-0.05) negatively predicted cGPA. Moreover, none of the pre-admission variables were predictive of progress test performance in the same group. On the other hand, none of the pre-admission variables were predictive of cGPA in clinical years. Overall, cGPA strongly predict-ed students' progress test performance (p<0.001 and B=19.02). Only the National Achievement Test and TOEFL significantly predicted performance in preclinical years. However, these variables do not predict progress test performance, meaning that they do not predict the functional knowledge reflected in the progress test. We report various strengths and deficiencies in the current medical college admission criteria, and call for employing more sensitive and valid ones that predict student performance and functional knowledge, especially in the clinical years.

Human performance measuring device

NASA Technical Reports Server (NTRS)

Michael, J.; Scow, J.

1970-01-01

Complex coordinator, consisting of operator control console, recorder, subject display panel, and limb controls, measures human performance by testing perceptual and motor skills. Device measures psychophysiological functions in drug and environmental studies, and is applicable to early detection of psychophysiological body changes.

Validating the Assessment for Measuring Indonesian Secondary School Students Performance in Ecology

NASA Astrophysics Data System (ADS)

Rachmatullah, A.; Roshayanti, F.; Ha, M.

2017-09-01

The aims of this current study are validating the American Association for the Advancement of Science (AAAS) Ecology assessment and examining the performance of Indonesian secondary school students on the assessment. A total of 611 Indonesian secondary school students (218 middle school students and 393 high school students) participated in the study. Forty-five items of AAAS assessment in the topic of Interdependence in Ecosystems were divided into two versions which every version has 21 similar items. Linking item method was used as the method to combine those two versions of assessment and further Rasch analyses were utilized to validate the instrument. Independent sample t-test was also run to compare the performance of Indonesian students and American students based on the mean of item difficulty. We found that from the total of 45 items, three items were identified as misfitting items. Later on, we also found that both Indonesian middle and high school students were significantly lower performance with very large and medium effect size compared to American students. We will discuss our findings in the regard of validation issue and the connection to Indonesian student’s science literacy.

Quantifying Human Movement Using the Movn Smartphone App: Validation and Field Study

PubMed Central

2017-01-01

Background The use of embedded smartphone sensors offers opportunities to measure physical activity (PA) and human movement. Big data—which includes billions of digital traces—offers scientists a new lens to examine PA in fine-grained detail and allows us to track people’s geocoded movement patterns to determine their interaction with the environment. Objective The objective of this study was to examine the validity of the Movn smartphone app (Moving Analytics) for collecting PA and human movement data. Methods The criterion and convergent validity of the Movn smartphone app for estimating energy expenditure (EE) were assessed in both laboratory and free-living settings, compared with indirect calorimetry (criterion reference) and a stand-alone accelerometer that is commonly used in PA research (GT1m, ActiGraph Corp, convergent reference). A supporting cross-validation study assessed the consistency of activity data when collected across different smartphone devices. Global positioning system (GPS) and accelerometer data were integrated with geographical information software to demonstrate the feasibility of geospatial analysis of human movement. Results A total of 21 participants contributed to linear regression analysis to estimate EE from Movn activity counts (standard error of estimation [SEE]=1.94 kcal/min). The equation was cross-validated in an independent sample (N=42, SEE=1.10 kcal/min). During laboratory-based treadmill exercise, EE from Movn was comparable to calorimetry (bias=0.36 [−0.07 to 0.78] kcal/min, t82=1.66, P=.10) but overestimated as compared with the ActiGraph accelerometer (bias=0.93 [0.58-1.29] kcal/min, t89=5.27, P<.001). The absolute magnitude of criterion biases increased as a function of locomotive speed (F1,4=7.54, P<.001) but was relatively consistent for the convergent comparison (F1,4=1.26, P<.29). Furthermore, 95% limits of agreement were consistent for criterion and convergent biases, and EE from Movn was strongly

The Backyard Human Performance Technologist: Applying the Development Research Methodology to Develop and Validate a New Instructional Design Framework

ERIC Educational Resources Information Center

Brock, Timothy R.

2009-01-01

Development research methodology (DRM) has been recommended as a viable research approach to expand the practice-to-theory/theory-to-practice literature that human performance technology (HPT) practitioners can integrate into the day-to-day work flow they already use to develop instructional products. However, little has been written about how it…

Image quality validation of Sentinel 2 Level-1 products: performance status at the beginning of the constellation routine phase

NASA Astrophysics Data System (ADS)

Francesconi, Benjamin; Neveu-VanMalle, Marion; Espesset, Aude; Alhammoud, Bahjat; Bouzinac, Catherine; Clerc, Sébastien; Gascon, Ferran

2017-09-01

Sentinel-2 is an Earth Observation mission developed by the European Space Agency (ESA) in the frame of the Copernicus program of the European Commission. The mission is based on a constellation of 2-satellites: Sentinel-2A launched in June 2015 and Sentinel-2B launched in March 2017. It offers an unprecedented combination of systematic global coverage of land and coastal areas, a high revisit of five days at the equator and 2 days at mid-latitudes under the same viewing conditions, high spatial resolution, and a wide field of view for multispectral observations from 13 bands in the visible, near infrared and short wave infrared range of the electromagnetic spectrum. The mission performances are routinely and closely monitored by the S2 Mission Performance Centre (MPC), including a consortium of Expert Support Laboratories (ESL). This publication focuses on the Sentinel-2 Level-1 product quality validation activities performed by the MPC. It presents an up-to-date status of the Level-1 mission performances at the beginning of the constellation routine phase. Level-1 performance validations routinely performed cover Level-1 Radiometric Validation (Equalisation Validation, Absolute Radiometry Vicarious Validation, Absolute Radiometry Cross-Mission Validation, Multi-temporal Relative Radiometry Vicarious Validation and SNR Validation), and Level-1 Geometric Validation (Geolocation Uncertainty Validation, Multi-spectral Registration Uncertainty Validation and Multi-temporal Registration Uncertainty Validation). Overall, the Sentinel-2 mission is proving very successful in terms of product quality thereby fulfilling the promises of the Copernicus program.

Development and validation of an RP-HPLC method for the quantitation of odanacatib in rat and human plasma and its application to a pharmacokinetic study.

PubMed

Police, Anitha; Gurav, Sandip; Dhiman, Vinay; Zainuddin, Mohd; Bhamidipati, Ravi Kanth; Rajagopal, Sriram; Mullangi, Ramesh

2015-11-01

A simple, specific, sensitive and reproducible high-performance liquid chromatography (HPLC) assay method has been developed and validated for the estimation of odanacatib in rat and human plasma. The bioanalytical procedure involves extraction of odanacatib and itraconazole (internal standard, IS) from a 200 μL plasma aliquot with simple liquid-liquid extraction process. Chromatographic separation was achieved on a Symmetry Shield RP18 using an isocratic mobile phase at a flow rate of 0.7 mL/min. The UV detection wave length was 268 nm. Odanacatib and IS eluted at 5.5 and 8.6 min, respectively with a total run time of 10 min. Method validation was performed as per US Food and Drug Administration guidelines and the results met the acceptance criteria. The calibration curve was linear over a concentration range of 50.9-2037 ng/mL (r(2) = 0.994). The intra- and inter-day precisions were in the range of 2.06-5.11 and 5.84-13.1%, respectively, in rat plasma and 2.38-7.90 and 6.39-10.2%, respectively, in human plasma. The validated HPLC method was successfully applied to a pharmacokinetic study in rats. Copyright © 2015 John Wiley & Sons, Ltd.

Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems—I-MeDeSA

PubMed Central

Zachariah, Marianne; Seidling, Hanna M; Neri, Pamela M; Cresswell, Kathrin M; Duke, Jon; Bloomrosen, Meryl; Volk, Lynn A; Bates, David W

2011-01-01

Background Medication-related decision support can reduce the frequency of preventable adverse drug events. However, the design of current medication alerts often results in alert fatigue and high over-ride rates, thus reducing any potential benefits. Methods The authors previously reviewed human-factors principles for relevance to medication-related decision support alerts. In this study, instrument items were developed for assessing the appropriate implementation of these human-factors principles in drug–drug interaction (DDI) alerts. User feedback regarding nine electronic medical records was considered during the development process. Content validity, construct validity through correlation analysis, and inter-rater reliability were assessed. Results The final version of the instrument included 26 items associated with nine human-factors principles. Content validation on three systems resulted in the addition of one principle (Corrective Actions) to the instrument and the elimination of eight items. Additionally, the wording of eight items was altered. Correlation analysis suggests a direct relationship between system age and performance of DDI alerts (p=0.0016). Inter-rater reliability indicated substantial agreement between raters (κ=0.764). Conclusion The authors developed and gathered preliminary evidence for the validity of an instrument that measures the appropriate use of human-factors principles in the design and display of DDI alerts. Designers of DDI alerts may use the instrument to improve usability and increase user acceptance of medication alerts, and organizations selecting an electronic medical record may find the instrument helpful in meeting their clinicians' usability needs. PMID:21946241

Further examination of embedded performance validity indicators for the Conners' Continuous Performance Test and Brief Test of Attention in a large outpatient clinical sample.

PubMed

Sharland, Michael J; Waring, Stephen C; Johnson, Brian P; Taran, Allise M; Rusin, Travis A; Pattock, Andrew M; Palcher, Jeanette A

2018-01-01

Assessing test performance validity is a standard clinical practice and although studies have examined the utility of cognitive/memory measures, few have examined attention measures as indicators of performance validity beyond the Reliable Digit Span. The current study further investigates the classification probability of embedded Performance Validity Tests (PVTs) within the Brief Test of Attention (BTA) and the Conners' Continuous Performance Test (CPT-II), in a large clinical sample. This was a retrospective study of 615 patients consecutively referred for comprehensive outpatient neuropsychological evaluation. Non-credible performance was defined two ways: failure on one or more PVTs and failure on two or more PVTs. Classification probability of the BTA and CPT-II into non-credible groups was assessed. Sensitivity, specificity, positive predictive value, and negative predictive value were derived to identify clinically relevant cut-off scores. When using failure on two or more PVTs as the indicator for non-credible responding compared to failure on one or more PVTs, highest classification probability, or area under the curve (AUC), was achieved by the BTA (AUC = .87 vs. .79). CPT-II Omission, Commission, and Total Errors exhibited higher classification probability as well. Overall, these findings corroborate previous findings, extending them to a large clinical sample. BTA and CPT-II are useful embedded performance validity indicators within a clinical battery but should not be used in isolation without other performance validity indicators.

Development and validation of LC-MS/MS methods for the determination of mirabegron and its metabolites in human plasma and their application to a clinical pharmacokinetic study.

PubMed

Teijlingen, Raymond van; Meijer, John; Takusagawa, Shin; Gelderen, Marcel van; Beld, Cas van den; Usui, Takashi

2012-03-01

Mirabegron is being developed for the treatment of overactive bladder. To support the development of mirabegron, including pharmacokinetic studies, liquid chromatography/tandem mass spectrometry methods for mirabegron and eight metabolites (M5, M8, M11-M16) were developed and validated for heparinized human plasma containing sodium fluoride. Four separate bioanalytical methods were developed for the analysis of: (1) mirabegron; (2) M5 and M16; (3) M8; and (4) M11-M15. Either solid-phase extraction or liquid-liquid extraction was used to extract the analytes of interest from matrix constituents. For mirabegron, an Inertsil C₈-3 analytical column was used and detection was performed using a triple-quad mass spectrometer equipped with an atmospheric pressure chemical ionization interface. For the metabolite assays, chromatographic separation was performed through a Phenomenex Synergi Fusion-RP C₁₈ analytical column and detection was performed using a triple-quad mass spectrometer equipped with a Heated Electrospray Ionization interface. The validation results demonstrated that the developed liquid chromatography/tandem mass spectrometry methods were precise, accurate, and selective for the determination of mirabegron and its metabolites in human plasma. All methods were successfully applied in evaluating the pharmacokinetic parameters of mirabegron and metabolites in human plasma. Copyright © 2012 Elsevier B.V. All rights reserved.

Geographic and temporal validity of prediction models: Different approaches were useful to examine model performance

PubMed Central

Austin, Peter C.; van Klaveren, David; Vergouwe, Yvonne; Nieboer, Daan; Lee, Douglas S.; Steyerberg, Ewout W.

2017-01-01

Objective Validation of clinical prediction models traditionally refers to the assessment of model performance in new patients. We studied different approaches to geographic and temporal validation in the setting of multicenter data from two time periods. Study Design and Setting We illustrated different analytic methods for validation using a sample of 14,857 patients hospitalized with heart failure at 90 hospitals in two distinct time periods. Bootstrap resampling was used to assess internal validity. Meta-analytic methods were used to assess geographic transportability. Each hospital was used once as a validation sample, with the remaining hospitals used for model derivation. Hospital-specific estimates of discrimination (c-statistic) and calibration (calibration intercepts and slopes) were pooled using random effects meta-analysis methods. I2 statistics and prediction interval width quantified geographic transportability. Temporal transportability was assessed using patients from the earlier period for model derivation and patients from the later period for model validation. Results Estimates of reproducibility, pooled hospital-specific performance, and temporal transportability were on average very similar, with c-statistics of 0.75. Between-hospital variation was moderate according to I2 statistics and prediction intervals for c-statistics. Conclusion This study illustrates how performance of prediction models can be assessed in settings with multicenter data at different time periods. PMID:27262237

The Application of the Human Engineering Modeling and Performance Laboratory for Space Vehicle Ground Processing Tasks at Kennedy Space Center

NASA Technical Reports Server (NTRS)

Woodbury, Sarah K.

2008-01-01

The introduction of United Space Alliance's Human Engineering Modeling and Performance Laboratory began in early 2007 in an attempt to address the problematic workspace design issues that the Space Shuttle has imposed on technicians performing maintenance and inspection operations. The Space Shuttle was not expected to require the extensive maintenance it undergoes between flights. As a result, extensive, costly resources have been expended on workarounds and modifications to accommodate ground processing personnel. Consideration of basic human factors principles for design of maintenance is essential during the design phase of future space vehicles, facilities, and equipment. Simulation will be needed to test and validate designs before implementation.

Validating a Geographical Image Retrieval System.

ERIC Educational Resources Information Center

Zhu, Bin; Chen, Hsinchun

2000-01-01

Summarizes a prototype geographical image retrieval system that demonstrates how to integrate image processing and information analysis techniques to support large-scale content-based image retrieval. Describes an experiment to validate the performance of this image retrieval system against that of human subjects by examining similarity analysis…

Human impact parameterization in global hydrological models improves estimates of monthly discharges and hydrological extremes: a multi-model validation study

NASA Astrophysics Data System (ADS)

Veldkamp, Ted; Ward, Philip; de Moel, Hans; Aerts, Jeroen; Muller Schmied, Hannes; Portmann, Felix; Zhao, Fang; Gerten, Dieter; Masaki, Yoshimitsu; Pokhrel, Yadu; Satoh, Yusuke; Gosling, Simon; Zaherpour, Jamal; Wada, Yoshihide

2017-04-01

Human impacts on freshwater resources and hydrological features form the core of present-day water related hazards, like flooding, droughts, water scarcity, and water quality issues. Driven by the societal and scientific needs to correctly model such water related hazards a fair amount of resources has been invested over the past decades to represent human activities and their interactions with the hydrological cycle in global hydrological models (GHMs). Use of these GHMs - including the human dimension - is widespread, especially in water resources research. Evaluation or comparative assessments of the ability of such GHMs to represent real-world hydrological conditions are, unfortunately, however often limited to (near-)natural river basins. Such studies are, therefore, not able to test the model representation of human activities and its associated impact on estimates of freshwater resources or assessments of hydrological extremes. Studies that did perform a validation exercise - including the human dimension and looking into managed catchments - either focused only on one hydrological model, and/or incorporated only a few data points (i.e. river basins) for validation. To date, a comprehensive comparative analysis that evaluates whether and where incorporating the human dimension actually improves the performance of different GHMs with respect to their representation of real-world hydrological conditions and extremes is missing. The absence of such study limits the potential benchmarking of GHMs and their outcomes in hydrological hazard and risk assessments significantly, potentially hampering incorporation of GHMs and their modelling results in actual policy making and decision support with respect to water resources management. To address this issue, we evaluate in this study the performance of five state-of-the-art GHMs that include anthropogenic activities in their modelling scheme, with respect to their representation of monthly discharges and hydrological

Mentoring Human Performance - 12480

DOE Office of Scientific and Technical Information (OSTI.GOV)

Geis, John A.; Haugen, Christian N.

2012-07-01

Although the positive effects of implementing a human performance approach to operations can be hard to quantify, many organizations and industry areas are finding tangible benefits to such a program. Recently, a unique mentoring program was established and implemented focusing on improving the performance of managers, supervisors, and work crews, using the principles of Human Performance Improvement (HPI). The goal of this mentoring was to affect behaviors and habits that reliably implement the principles of HPI to ensure continuous improvement in implementation of an Integrated Safety Management System (ISMS) within a Conduct of Operations framework. Mentors engaged with personnel inmore » a one-on-one, or one-on-many dialogue, which focused on what behaviors were observed, what factors underlie the behaviors, and what changes in behavior could prevent errors or events, and improve performance. A senior management sponsor was essential to gain broad management support. A clear charter and management plan describing the goals, objectives, methodology, and expected outcomes was established. Mentors were carefully selected with senior management endorsement. Mentors were assigned to projects and work teams based on the following three criteria: 1) knowledge of the work scope; 2) experience in similar project areas; and 3) perceived level of trust they would have with project management, supervision, and work teams. This program was restructured significantly when the American Reinvestment and Recovery Act (ARRA) and the associated funding came to an end. The program was restructured based on an understanding of the observations, attributed successes and identified shortfalls, and the consolidation of those lessons. Mentoring the application of proven methods for improving human performance was shown effective at increasing success in day-to-day activities and increasing confidence and level of skill of supervisors. While mentoring program effectiveness is

Predictive validity of pre-admission assessments on medical student performance

PubMed Central

Dabaliz, Al-Awwab; Kaadan, Samy; Dabbagh, M. Marwan; Barakat, Abdulaziz; Shareef, Mohammad Abrar; Al-Tannir, Mohamad; Obeidat, Akef

2017-01-01

Objectives To examine the predictive validity of pre-admission variables on students’ performance in a medical school in Saudi Arabia.  Methods In this retrospective study, we collected admission and college performance data for 737 students in preclinical and clinical years. Data included high school scores and other standardized test scores, such as those of the National Achievement Test and the General Aptitude Test. Additionally, we included the scores of the Test of English as a Foreign Language (TOEFL) and the International English Language Testing System (IELTS) exams. Those datasets were then compared with college performance indicators, namely the cumulative Grade Point Average (cGPA) and progress test, using multivariate linear regression analysis. Results In preclinical years, both the National Achievement Test (p=0.04, B=0.08) and TOEFL (p=0.017, B=0.01) scores were positive predictors of cGPA, whereas the General Aptitude Test (p=0.048, B=-0.05) negatively predicted cGPA. Moreover, none of the pre-admission variables were predictive of progress test performance in the same group. On the other hand, none of the pre-admission variables were predictive of cGPA in clinical years. Overall, cGPA strongly predict-ed students’ progress test performance (p<0.001 and B=19.02). Conclusions Only the National Achievement Test and TOEFL significantly predicted performance in preclinical years. However, these variables do not predict progress test performance, meaning that they do not predict the functional knowledge reflected in the progress test. We report various strengths and deficiencies in the current medical college admission criteria, and call for employing more sensitive and valid ones that predict student performance and functional knowledge, especially in the clinical years. PMID:29176032

Validated hydrophilic interaction LC-MS/MS method for simultaneous quantification of dacarbazine and 5-amino-4-imidazole-carboxamide in human plasma.

PubMed

Liu, Yanhong; Zhang, Weihua; Yang, Yuhui

2008-10-19

A hydrophilic interaction high performance liquid chromatography-tandem mass spectrometric method has been developed and validated for simultaneous quantification of dacarbazine (DTIC) and its terminal metabolite, 5-amino-4-imidazole-carboxamide (AIC) in human plasma. The plasma samples are first extracted by a C8+SCX mixed-mode 96-well plate to extend the extraction stability of DTIC and AIC. The extracted residues are further cleaned by a primary and secondary amine (PSA) adsorbent for minimization of matrix effect. Analyses are done on an Amide-80 HPLC column coupled to a tandem mass spectrometer fitted with an atmospheric pressure turbo ion spray ionization interface in the positive-ion mode. Both DTIC and AIC have reproducible retention times on the Amide-80 HPLC column. This type of column not only has an excellent column life (over 4000 injections), but also has zero carryover effect. The injection volume should be limited at 10 microL or less to avoid the peak splitting. The validated concentration ranges are from 0.5 to 500 ng/mL for DTIC and from 2.0 to 500 ng/mL for AIC. The validated method has been successfully applied to determine the pharmacokinetic profiles for human patients receiving DTIC infusions.

Modeling and Quantification of Team Performance in Human Reliability Analysis for Probabilistic Risk Assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jeffrey C. JOe; Ronald L. Boring

Probabilistic Risk Assessment (PRA) and Human Reliability Assessment (HRA) are important technical contributors to the United States (U.S.) Nuclear Regulatory Commission’s (NRC) risk-informed and performance based approach to regulating U.S. commercial nuclear activities. Furthermore, all currently operating commercial NPPs in the U.S. are required by federal regulation to be staffed with crews of operators. Yet, aspects of team performance are underspecified in most HRA methods that are widely used in the nuclear industry. There are a variety of "emergent" team cognition and teamwork errors (e.g., communication errors) that are 1) distinct from individual human errors, and 2) important to understandmore » from a PRA perspective. The lack of robust models or quantification of team performance is an issue that affects the accuracy and validity of HRA methods and models, leading to significant uncertainty in estimating HEPs. This paper describes research that has the objective to model and quantify team dynamics and teamwork within NPP control room crews for risk informed applications, thereby improving the technical basis of HRA, which improves the risk-informed approach the NRC uses to regulate the U.S. commercial nuclear industry.« less

On the Validity of Beer-Lambert Law and its Significance for Sunscreens.

PubMed

Herzog, Bernd; Schultheiss, Amélie; Giesinger, Jochen

2018-03-01

The sun protection factor (SPF) is the most important quantity to characterize the performance of sunscreens. As the standard method for its determination is based on clinical trials involving irradiation of human volunteers, calculations of sunscreen performance have become quite popular to reduce the number of in vivo studies. Such simulations imply the calculation of UV transmittance of the sunscreen film using the amounts and spectroscopic properties of the UV absorbers employed, and presuppose the validity of the Beer-Lambert law. As sunscreen films on human skin can contain considerable concentrations of UV absorbers, it is questioned whether the Beer-Lambert law is still valid for these systems. The results of this work show that the validity of the Beer-Lambert law is still given at the high concentrations at which UV absorbers occur in sunscreen films on human skin. © 2017 The American Society of Photobiology.

Human Resource Orientation and Corporate Performance.

ERIC Educational Resources Information Center

Lam, Long W.; White, Louis P.

1998-01-01

A study of 14 manufacturing firms found significantly better financial performance among those that strongly emphasized recruitment, compensation, and training and development (a human resource orientation). Human resource development that helped sustain competence combined with that orientation to form a valuable competitive advantage. (SK)

Advanced Video Analysis Needs for Human Performance Evaluation

NASA Technical Reports Server (NTRS)

Campbell, Paul D.

1994-01-01

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

Concurrent determination of olanzapine, risperidone and 9-hydroxyrisperidone in human plasma by ultra performance liquid chromatography with diode array detection method: application to pharmacokinetic study.

PubMed

Siva Selva Kumar, M; Ramanathan, M

2016-02-01

A simple and sensitive ultra-performance liquid chromatography (UPLC) method has been developed and validated for simultaneous estimation of olanzapine (OLZ), risperidone (RIS) and 9-hydroxyrisperidone (9-OHRIS) in human plasma in vitro. The sample preparation was performed by simple liquid-liquid extraction technique. The analytes were chromatographed on a Waters Acquity H class UPLC system using isocratic mobile phase conditions at a flow rate of 0.3 mL/min and Acquity UPLC BEH shield RP18 column maintained at 40°C. Quantification was performed on a photodiode array detector set at 277 nm and clozapine was used as internal standard (IS). OLZ, RIS, 9-OHRIS and IS retention times were found to be 0.9, 1.4, .1.8 and 3.1 min, respectively, and the total run time was 4 min. The method was validated for selectivity, specificity, recovery, linearity, accuracy, precision and sample stability. The calibration curve was linear over the concentration range 1-100 ng/mL for OLZ, RIS and 9-OHRIS. Intra- and inter-day precisions for OLZ, RIS and 9-OHRIS were found to be good with the coefficient of variation <6.96%, and the accuracy ranging from 97.55 to 105.41%, in human plasma. The validated UPLC method was successfully applied to the pharmacokinetic study of RIS and 9-OHRIS in human plasma. Copyright © 2015 John Wiley & Sons, Ltd.

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Berman, Andrea; Chmielewski, Cynthia

1996-01-01

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

Short Duration Bioastronautics Investigation 1904: Human Factors Assessment of Vibration Effects on Visual Performance during Launch

NASA Technical Reports Server (NTRS)

Thompson, Shelby; Holden, Kritina; Ebert, Douglas; Root, Phillip; Adelstein, Bernard; Jones, Jeffery

2009-01-01

represent an efficient and focused problem solving approach. This project provided (a) immediate data for developing preliminary human performance vibration requirements; (b) flight validated inputs for ongoing and future ground-based research; and (c) preliminary information related to Orion display format design.

Determination of Flurbiprofen in Human Plasma by High-Performance Liquid Chromatography.

PubMed

Yilmaz, Bilal; Erdem, Ali Fuat

2015-10-01

A simple high-performance liquid chromatography method has been developed for determination of flurbiprofen in human plasma. The method was validated on an Ace C18 column using UV detection. The mobile phase was acetonitrile-0.05 M potassium dihydrogen phosphate solution (60:40, v/v) adjusted to pH 3.5 with phosphoric acid. The calibration curve was linear between the concentration range of 0.10-5.0 μg/mL. Intra- and inter-day precision values for flurbiprofen in plasma were <4.47, and accuracy (relative error) was better than 3.67%. The extraction recoveries of flurbiprofen from human plasma were between 93.0 and 98.9%. The limits of detection and quantification of flurbiprofen were 0.03 and 0.10 μg/mL, respectively. In addition, this assay was applied to determine the pharmacokinetic parameters of flurbiprofen in six healthy Turkish volunteers who had been given 100 mg flurbiprofen. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Validation of an integrative mathematical model of dehydration and rehydration in virtual humans.

PubMed

Pruett, W Andrew; Clemmer, John S; Hester, Robert L

2016-11-01

Water homeostasis is one of the body's most critical tasks. Physical challenges to the body, including exercise and surgery, almost always coordinate with some change in water handling reflecting the changing needs of the body. Vasopressin is the most important hormone that contributes to short-term water homeostasis. By manipulating vascular tone and regulating water reabsorption in the collecting duct of the kidneys, vasopressin can mediate the retention or loss of fluids quickly. In this study, we validated HumMod, an integrative mathematical model of human physiology, against six different challenges to water homeostasis with special attention to the secretion of vasopressin and maintenance of electrolyte balance. The studies chosen were performed in normal men and women, and represent a broad spectrum of perturbations. HumMod successfully replicated the experimental results, remaining within 1 standard deviation of the experimental means in 138 of 161 measurements. Only three measurements lay outside of the second standard deviation. Observations were made on serum osmolarity, serum vasopressin concentration, serum sodium concentration, urine osmolarity, serum protein concentration, hematocrit, and cumulative water intake following dehydration. This validation suggests that HumMod can be used to understand water homeostasis under a variety of conditions. © 2016 The Authors. Physiological Reports published by Wiley Periodicals, Inc. on behalf of The Physiological Society and the American Physiological Society.

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017

Aversive pavlovian responses affect human instrumental motor performance.

PubMed

Rigoli, Francesco; Pavone, Enea Francesco; Pezzulo, Giovanni

2012-01-01

IN NEUROSCIENCE AND PSYCHOLOGY, AN INFLUENTIAL PERSPECTIVE DISTINGUISHES BETWEEN TWO KINDS OF BEHAVIORAL CONTROL: instrumental (habitual and goal-directed) and Pavlovian. Understanding the instrumental-Pavlovian interaction is fundamental for the comprehension of decision-making. Animal studies (as those using the negative auto-maintenance paradigm), have demonstrated that Pavlovian mechanisms can have maladaptive effects on instrumental performance. However, evidence for a similar effect in humans is scarce. In addition, the mechanisms modulating the impact of Pavlovian responses on instrumental performance are largely unknown, both in human and non-human animals. The present paper describes a behavioral experiment investigating the effects of Pavlovian conditioned responses on performance in humans, focusing on the aversive domain. Results showed that Pavlovian responses influenced human performance, and, similar to animal studies, could have maladaptive effects. In particular, Pavlovian responses either impaired or increased performance depending on modulator variables such as threat distance, task controllability, punishment history, amount of training, and explicit punishment expectancy. Overall, these findings help elucidating the computational mechanisms underlying the instrumental-Pavlovian interaction, which might be at the base of apparently irrational phenomena in economics, social behavior, and psychopathology.

Aversive Pavlovian Responses Affect Human Instrumental Motor Performance

PubMed Central

Rigoli, Francesco; Pavone, Enea Francesco; Pezzulo, Giovanni

2012-01-01

In neuroscience and psychology, an influential perspective distinguishes between two kinds of behavioral control: instrumental (habitual and goal-directed) and Pavlovian. Understanding the instrumental-Pavlovian interaction is fundamental for the comprehension of decision-making. Animal studies (as those using the negative auto-maintenance paradigm), have demonstrated that Pavlovian mechanisms can have maladaptive effects on instrumental performance. However, evidence for a similar effect in humans is scarce. In addition, the mechanisms modulating the impact of Pavlovian responses on instrumental performance are largely unknown, both in human and non-human animals. The present paper describes a behavioral experiment investigating the effects of Pavlovian conditioned responses on performance in humans, focusing on the aversive domain. Results showed that Pavlovian responses influenced human performance, and, similar to animal studies, could have maladaptive effects. In particular, Pavlovian responses either impaired or increased performance depending on modulator variables such as threat distance, task controllability, punishment history, amount of training, and explicit punishment expectancy. Overall, these findings help elucidating the computational mechanisms underlying the instrumental-Pavlovian interaction, which might be at the base of apparently irrational phenomena in economics, social behavior, and psychopathology. PMID:23060738

Validity and reliability of a novel measure of activity performance and participation.

PubMed

Murgatroyd, Phil; Karimi, Leila

2016-01-01

To develop and evaluate an innovative clinician-rated measure, which produces global numerical ratings of activity performance and participation. Repeated measures study with 48 community-dwelling participants investigating clinical sensibility, comprehensiveness, practicality, inter-rater reliability, responsiveness, sensitivity and concurrent validity with Barthel Index. Important clinimetric characteristics including comprehensiveness and ease of use were rated >8/10 by clinicians. Inter-rater reliability was excellent on the summary scores (intraclass correlation of 0.95-0.98). There was good evidence that the new outcome measure distinguished between known high and low functional scoring groups, including both responsiveness to change and sensitivity at the same time point in numerous tests. Concurrent validity with the Barthel Index was fair to high (Spearman Rank Order Correlation 0.32-0.85, p > 0.05). The new measure's summary scores were nearly twice as responsive to change compared with the Barthel Index. Other more detailed data could also be generated by the new measure. The Activity Performance Measure is an innovative outcome instrument that showed good clinimetric qualities in this initial study. Some of the results were strong, given the sample size, and further trial and evaluation is appropriate. Implications for Rehabilitation The Activity Performance Measure is an innovative outcome measure covering activity performance and participation. In an initial evaluation, it showed good clinimetric qualities including responsiveness to change, sensitivity, practicality, clinical sensibility, item coverage, inter-rater reliability and concurrent validity with the Barthel Index. Further trial and evaluation is appropriate.

Discovery and validation of cell cycle arrest biomarkers in human acute kidney injury

PubMed Central

2013-01-01

Introduction Acute kidney injury (AKI) can evolve quickly and clinical measures of function often fail to detect AKI at a time when interventions are likely to provide benefit. Identifying early markers of kidney damage has been difficult due to the complex nature of human AKI, in which multiple etiologies exist. The objective of this study was to identify and validate novel biomarkers of AKI. Methods We performed two multicenter observational studies in critically ill patients at risk for AKI - discovery and validation. The top two markers from discovery were validated in a second study (Sapphire) and compared to a number of previously described biomarkers. In the discovery phase, we enrolled 522 adults in three distinct cohorts including patients with sepsis, shock, major surgery, and trauma and examined over 300 markers. In the Sapphire validation study, we enrolled 744 adult subjects with critical illness and without evidence of AKI at enrollment; the final analysis cohort was a heterogeneous sample of 728 critically ill patients. The primary endpoint was moderate to severe AKI (KDIGO stage 2 to 3) within 12 hours of sample collection. Results Moderate to severe AKI occurred in 14% of Sapphire subjects. The two top biomarkers from discovery were validated. Urine insulin-like growth factor-binding protein 7 (IGFBP7) and tissue inhibitor of metalloproteinases-2 (TIMP-2), both inducers of G1 cell cycle arrest, a key mechanism implicated in AKI, together demonstrated an AUC of 0.80 (0.76 and 0.79 alone). Urine [TIMP-2]·[IGFBP7] was significantly superior to all previously described markers of AKI (P <0.002), none of which achieved an AUC >0.72. Furthermore, [TIMP-2]·[IGFBP7] significantly improved risk stratification when added to a nine-variable clinical model when analyzed using Cox proportional hazards model, generalized estimating equation, integrated discrimination improvement or net reclassification improvement. Finally, in sensitivity analyses [TIMP-2]�

Development and validation of a virtual reality simulator: human factors input to interventional radiology training.

PubMed

Johnson, Sheena Joanne; Guediri, Sara M; Kilkenny, Caroline; Clough, Peter J

2011-12-01

This study developed and validated a virtual reality (VR) simulator for use by interventional radiologists. Research in the area of skill acquisition reports practice as essential to become a task expert. Studies on simulation show skills learned in VR can be successfully transferred to a real-world task. Recently, with improvements in technology, VR simulators have been developed to allow complex medical procedures to be practiced without risking the patient. Three studies are reported. In Study I, 35 consultant interventional radiologists took part in a cognitive task analysis to empirically establish the key competencies of the Seldinger procedure. In Study 2, 62 participants performed one simulated procedure, and their performance was compared by expertise. In Study 3, the transferability of simulator training to a real-world procedure was assessed with 14 trainees. Study I produced 23 key competencies that were implemented as performance measures in the simulator. Study 2 showed the simulator had both face and construct validity, although some issues were identified. Study 3 showed the group that had undergone simulator training received significantly higher mean performance ratings on a subsequent patient procedure. The findings of this study support the centrality of validation in the successful design of simulators and show the utility of simulators as a training device. The studies show the key elements of a validation program for a simulator. In addition to task analysis and face and construct validities, the authors highlight the importance of transfer of training in validation studies.

Simultaneous quantification of acetaminophen and five acetaminophen metabolites in human plasma and urine by high-performance liquid chromatography-electrospray ionization-tandem mass spectrometry: Method validation and application to a neonatal pharmacokinetic study.

PubMed

Cook, Sarah F; King, Amber D; van den Anker, John N; Wilkins, Diana G

2015-12-15

Drug metabolism plays a key role in acetaminophen (paracetamol)-induced hepatotoxicity, and quantification of acetaminophen metabolites provides critical information about factors influencing susceptibility to acetaminophen-induced hepatotoxicity in clinical and experimental settings. The aims of this study were to develop, validate, and apply high-performance liquid chromatography-electrospray ionization-tandem mass spectrometry (HPLC-ESI-MS/MS) methods for simultaneous quantification of acetaminophen, acetaminophen-glucuronide, acetaminophen-sulfate, acetaminophen-glutathione, acetaminophen-cysteine, and acetaminophen-N-acetylcysteine in small volumes of human plasma and urine. In the reported procedures, acetaminophen-d4 and acetaminophen-d3-sulfate were utilized as internal standards (IS). Analytes and IS were recovered from human plasma (10μL) by protein precipitation with acetonitrile. Human urine (10μL) was prepared by fortification with IS followed only by sample dilution. Calibration concentration ranges were tailored to literature values for each analyte in each biological matrix. Prepared samples from plasma and urine were analyzed under the same HPLC-ESI-MS/MS conditions, and chromatographic separation was achieved through use of an Agilent Poroshell 120 EC-C18 column with a 20-min run time per injected sample. The analytes could be accurately and precisely quantified over 2.0-3.5 orders of magnitude. Across both matrices, mean intra- and inter-assay accuracies ranged from 85% to 112%, and intra- and inter-assay imprecision did not exceed 15%. Validation experiments included tests for specificity, recovery and ionization efficiency, inter-individual variability in matrix effects, stock solution stability, and sample stability under a variety of storage and handling conditions (room temperature, freezer, freeze-thaw, and post-preparative). The utility and suitability of the reported procedures were illustrated by analysis of pharmacokinetic samples

Quantitative MR Imaging of Hepatic Steatosis: Validation in Ex Vivo Human Livers

PubMed Central

Bannas, Peter; Kramer, Harald; Hernando, Diego; Agni, Rashmi; Cunningham, Ashley M.; Mandal, Rakesh; Motosugi, Utaroh; Sharma, Samir D.; del Rio, Alejandro Munoz; Fernandez, Luis; Reeder, Scott B.

2015-01-01

Emerging magnetic resonance imaging (MRI) biomarkers of hepatic steatosis have demonstrated tremendous promise for accurate quantification of hepatic triglyceride concentration. These methods quantify the “proton density fat-fraction” (PDFF), which reflects the concentration of triglycerides in tissue. Previous in vivo studies have compared MRI-PDFF with histologic steatosis grading for assessment of hepatic steatosis. However, the correlation of MRI-PDFF with the underlying hepatic triglyceride content remained unknown. The aim of this ex vivo study was to validate the accuracy of MRI-PDFF as an imaging biomarker of hepatic steatosis. Using ex vivo human livers, we compared MRI-PDFF with magnetic resonance spectroscopy-PDFF (MRS-PDFF), biochemical triglyceride extraction and histology as three independent reference standards. A secondary aim was to compare the precision of MRI-PDFF relative to biopsy for the quantification of hepatic steatosis. MRI-PDFF was prospectively performed at 1.5T in 13 explanted human livers. We performed co-localized paired evaluation of liver fat content in all nine Couinaud segments using single-voxel MRS-PDFF (n=117), tissue wedges for biochemical triglyceride extraction (n=117), and five core biopsies performed in each segment for histologic grading (n=585). Accuracy of MRI-PDFF was assessed through linear regression with MRS-PDFF, triglyceride extraction and histology. Intra-observer agreement, inter-observer agreement and repeatability of MRI-PDFF and histologic grading were assessed through Bland-Altman analyses. MRI-PDFF showed an excellent correlation with MRS-PDFF (r=0.984; CI: 0.978–0.989) and strong correlation with histology (r=0.850; CI: 0.791–0.894) and triglyceride extraction (r=0.871; CI: 0.818–0.909). Intra-observer agreement, inter-observer agreement and repeatability showed a significantly smaller variance for MRI-PDFF than for histologic steatosis grading (all p<0.001). Conclusion MRI-PDFF is an accurate

Development and Validation of the Appearance and Performance Enhancing Drug Use Schedule

PubMed Central

Langenbucher, James W.; Lai, Justine Karmin; Loeb, Katharine L.; Hollander, Eric

2011-01-01

Appearance-and-performance enhancing drug (APED) use is a form of drug use that includes use of a wide range of substances such as anabolic-androgenic steroids (AASs) and associated behaviors including intense exercise and dietary control. To date, there are no reliable or valid measures of the core features of APED use. The present study describes the development and psychometric evaluation of the Appearance and Performance Enhancing Drug Use Schedule (APEDUS) which is a semi-structured interview designed to assess the spectrum of drug use and related features of APED use. Eighty-five current APED using men and women (having used an illicit APED in the past year and planning to use an illicit APED in the future) completed the APEDUS and measures of convergent and divergent validity. Inter-rater agreement, scale reliability, one-week test-retest reliability, convergent and divergent validity, and construct validity were evaluated for each of the APEDUS scales. The APEDUS is a modular interview with 10 sections designed to assess the core drug and non-drug phenomena associated with APED use. All scales and individual items demonstrated high inter-rater agreement and reliability. Individual scales significantly correlated with convergent measures (DSM-IV diagnoses, aggression, impulsivity, eating disorder pathology) and were uncorrelated with a measure of social desirability. APEDUS subscale scores were also accurate measures of AAS dependence. The APEDUS is a reliable and valid measure of APED phenomena and an accurate measure of the core pathology associated with APED use. Issues with assessing APED use are considered and future research considered. PMID:21640487

Applying lessons learned to enhance human performance and reduce human error for ISS operations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nelson, W.R.

1998-09-01

A major component of reliability, safety, and mission success for space missions is ensuring that the humans involved (flight crew, ground crew, mission control, etc.) perform their tasks and functions as required. This includes compliance with training and procedures during normal conditions, and successful compensation when malfunctions or unexpected conditions occur. A very significant issue that affects human performance in space flight is human error. Human errors can invalidate carefully designed equipment and procedures. If certain errors combine with equipment failures or design flaws, mission failure or loss of life can occur. The control of human error during operation ofmore » the International Space Station (ISS) will be critical to the overall success of the program. As experience from Mir operations has shown, human performance plays a vital role in the success or failure of long duration space missions. The Department of Energy`s Idaho National Engineering and Environmental Laboratory (INEEL) is developed a systematic approach to enhance human performance and reduce human errors for ISS operations. This approach is based on the systematic identification and evaluation of lessons learned from past space missions such as Mir to enhance the design and operation of ISS. This paper describes previous INEEL research on human error sponsored by NASA and how it can be applied to enhance human reliability for ISS.« less

Development and Validation of a Simple High Performance Liquid Chromatography/UV Method for Simultaneous Determination of Urinary Uric Acid, Hypoxanthine, and Creatinine in Human Urine.

PubMed

Wijemanne, Nimanthi; Soysa, Preethi; Wijesundara, Sulochana; Perera, Hemamali

2018-01-01

Uric acid and hypoxanthine are produced in the catabolism of purine. Abnormal urinary levels of these products are associated with many diseases and therefore it is necessary to have a simple and rapid method to detect them. Hence, we report a simple reverse phase high performance liquid chromatography (HPLC/UV) technique, developed and validated for simultaneous analysis of uric acid, hypoxanthine, and creatinine in human urine. Urine was diluted appropriately and eluted with C-18 column 100 mm × 4.6 mm with a C-18 precolumn 25 mm × 4.6 mm in series. Potassium phosphate buffer (20 mM, pH 7.25) at a flow rate of 0.40 mL/min was employed as the solvent and peaks were detected at 235 nm. Tyrosine was used as the internal standard. The experimental conditions offered a good separation of analytes without interference of endogenous substances. The calibration curves were linear for all test compounds with a regression coefficient, r 2 > 0.99. Uric acid, creatinine, tyrosine, and hypoxanthine were eluted at 5.2, 6.1, 7.2, and 8.3 min, respectively. Intraday and interday variability were less than 4.6% for all the analytes investigated and the recovery ranged from 98 to 102%. The proposed HPLC procedure is a simple, rapid, and low cost method with high accuracy with minimum use of organic solvents. This method was successfully applied for the determination of creatinine, hypoxanthine, and uric acid in human urine.

An ecologically valid performance-based social functioning assessment battery for schizophrenia.

PubMed

Shi, Chuan; He, Yi; Cheung, Eric F C; Yu, Xin; Chan, Raymond C K

2013-12-30

Psychiatrists pay more attention to the social functioning outcome of schizophrenia nowadays. How to evaluate the real world function among schizophrenia is a challenging task due to culture difference, there is no such kind of instrument in terms of the Chinese setting. This study aimed to report the validation of an ecologically valid performance-based everyday functioning assessment for schizophrenia, namely the Beijing Performance-based Functional Ecological Test (BJ-PERFECT). Fifty community-dwelling adults with schizophrenia and 37 healthy controls were recruited. Fifteen of the healthy controls were re-tested one week later. All participants were administered the University of California, San Diego, Performance-based Skill Assessment-Brief version (UPSA-B) and the MATRICS Consensus Cognitive Battery (MCCB). The finalized assessment included three subdomains: transportation, financial management and work ability. The test-retest and inter-rater reliabilities were good. The total score significantly correlated with the UPSA-B. The performance of individuals with schizophrenia was significantly more impaired than healthy controls, especially in the domain of work ability. Among individuals with schizophrenia, functional outcome was influenced by premorbid functioning, negative symptoms and neurocognition such as processing speed, visual learning and attention/vigilance. © 2013 Elsevier Ireland Ltd. All rights reserved.

Development and validation of a liquid chromatography-isotope dilution tandem mass spectrometry for determination of olanzapine in human plasma and its application to bioavailability study.

PubMed

Zhang, Meng-Qi; Jia, Jing-Ying; Lu, Chuan; Liu, Gang-Yi; Yu, Cheng-Yin; Gui, Yu-Zhou; Liu, Yun; Liu, Yan-Mei; Wang, Wei; Li, Shui-Jun; Yu, Chen

2010-06-01

A simple, reliable and sensitive liquid chromatography-isotope dilution mass spectrometry (LC-ID/MS) was developed and validated for quantification of olanzapine in human plasma. Plasma samples (50 microL) were extracted with tert-butyl methyl ether and isotope-labeled internal standard (olanzapine-D3) was used. The chromatographic separation was performed on XBridge Shield RP 18 (100 mm x 2.1 mm, 3.5 microm, Waters). An isocratic program was used at a flow rate of 0.4 m x min(-1) with mobile phase consisting of acetonitrile and ammonium buffer (pH 8). The protonated ions of analytes were detected in positive ionization by multiple reactions monitoring (MRM) mode. The plasma method, with a lower limit of quantification (LLOQ) of 0.1 ng x mL(-1), demonstrated good linearity over a range of 0.1 - 30 ng x mL(-1) of olanzapine. Specificity, linearity, accuracy, precision, recovery, matrix effect and stability were evaluated during method validation. The validated method was successfully applied to analyzing human plasma samples in bioavailability study.

Theory Development and Convergence of Human Resource Fields: Implications for Human Performance Technology

ERIC Educational Resources Information Center

Cho, Yonjoo; Yoon, Seung Won

2010-01-01

This study examines major theory developments in human resource (HR) fields and discusses implications for human performance technology (HPT). Differentiated HR fields are converging to improve organizational performance through knowledge-based innovations. Ruona and Gibson (2004) made a similar observation and analyzed the historical evolution…

Agreement between Computerized and Human Assessment of Performance on the Ruff Figural Fluency Test

PubMed Central

Elderson, Martin F.; Pham, Sander; van Eersel, Marlise E. A.; Wolffenbuttel, Bruce H. R.; Kok, Johan; Gansevoort, Ron T.; Tucha, Oliver; van der Klauw, Melanie M.; Slaets, Joris P. J.

2016-01-01

The Ruff Figural Fluency Test (RFFT) is a sensitive test for nonverbal fluency suitable for all age groups. However, assessment of performance on the RFFT is time-consuming and may be affected by interrater differences. Therefore, we developed computer software specifically designed to analyze performance on the RFFT by automated pattern recognition. The aim of this study was to compare assessment by the new software with conventional assessment by human raters. The software was developed using data from the Lifelines Cohort Study and validated in an independent cohort of the Prevention of Renal and Vascular End Stage Disease (PREVEND) study. The total study population included 1,761 persons: 54% men; mean age (SD), 58 (10) years. All RFFT protocols were assessed by the new software and two independent human raters (criterion standard). The mean number of unique designs (SD) was 81 (29) and the median number of perseverative errors (interquartile range) was 9 (4 to 16). The intraclass correlation coefficient (ICC) between the computerized and human assessment was 0.994 (95%CI, 0.988 to 0.996; p<0.001) and 0.991 (95%CI, 0.990 to 0.991; p<0.001) for the number of unique designs and perseverative errors, respectively. The mean difference (SD) between the computerized and human assessment was -1.42 (2.78) and +0.02 (1.94) points for the number of unique designs and perseverative errors, respectively. This was comparable to the agreement between two independent human assessments: ICC, 0.995 (0.994 to 0.995; p<0.001) and 0.985 (0.982 to 0.988; p<0.001), and mean difference (SD), -0.44 (2.98) and +0.56 (2.36) points for the number of unique designs and perseverative errors, respectively. We conclude that the agreement between the computerized and human assessment was very high and comparable to the agreement between two independent human assessments. Therefore, the software is an accurate tool for the assessment of performance on the RFFT. PMID:27661083

Validation of an in vitro digestive system for studying macronutrient decomposition in humans.

PubMed

Kopf-Bolanz, Katrin A; Schwander, Flurina; Gijs, Martin; Vergères, Guy; Portmann, Reto; Egger, Lotti

2012-02-01

The digestive process transforms nutrients and bioactive compounds contained in food to physiologically active compounds. In vitro digestion systems have proven to be powerful tools for understanding and monitoring the complex transformation processes that take place during digestion. Moreover, the investigation of the physiological effects of certain nutrients demands an in vitro digestive process that is close to human physiology. In this study, human digestion was simulated with a 3-step in vitro process that was validated in depth by choosing pasteurized milk as an example of a complex food matrix. The evolution and decomposition of the macronutrients was followed over the entire digestive process to the level of intestinal enterocyte action, using protein and peptide analysis by SDS-PAGE, reversed-phase HPLC, size exclusion HPLC, and liquid chromatography-MS. The mean peptide size after in vitro digestion of pasteurized milk was 5-6 amino acids (AA). Interestingly, mostly essential AA (93.6%) were released during in vitro milk digestion, a significantly different relative distribution compared to the total essential AA concentration of bovine milk (44.5%). All TG were degraded to FFA and monoacylglycerols. Herein, we present a human in vitro digestion model validated for its ability to degrade the macronutrients of dairy products comparable to physiological ranges. It is suited to be used in combination with a human intestinal cell culture system, allowing ex vivo bioavailability measurements and assessment of the bioactive properties of food components.

Validating Performance Level Descriptors (PLDs) for the AP® Environmental Science Exam

ERIC Educational Resources Information Center

Reshetar, Rosemary; Kaliski, Pamela; Chajewski, Michael; Lionberger, Karen

2012-01-01

This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

Validation and clinical utility of the executive function performance test in persons with traumatic brain injury.

PubMed

Baum, C M; Wolf, T J; Wong, A W K; Chen, C H; Walker, K; Young, A C; Carlozzi, N E; Tulsky, D S; Heaton, R K; Heinemann, A W

2017-07-01

This study examined the relationships between the Executive Function Performance Test (EFPT), the NIH Toolbox Cognitive Function tests, and neuropsychological executive function measures in 182 persons with traumatic brain injury (TBI) and 46 controls to evaluate construct, discriminant, and predictive validity. Construct validity: There were moderate correlations between the EFPT and the NIH Toolbox Crystallized (r = -.479), Fluid Tests (r = -.420), and Total Composite Scores (r = -.496). Discriminant validity: Significant differences were found in the EFPT total and sequence scores across control, complicated mild/moderate, and severe TBI groups. We found differences in the organisation score between control and severe, and between mild and severe TBI groups. Both TBI groups had significantly lower scores in safety and judgement than controls. Compared to the controls, the severe TBI group demonstrated significantly lower performance on all instrumental activities of daily living (IADL) tasks. Compared to the mild TBI group, the controls performed better on the medication task, the severe TBI group performed worse in the cooking and telephone tasks. Predictive validity: The EFPT predicted the self-perception of independence measured by the TBI-QOL (beta = -0.49, p < .001) for the severe TBI group. Overall, these data support the validity of the EFPT for use in individuals with TBI.

Economics of human performance and systems total ownership cost.

PubMed

Onkham, Wilawan; Karwowski, Waldemar; Ahram, Tareq Z

2012-01-01

Financial costs of investing in people is associated with training, acquisition, recruiting, and resolving human errors have a significant impact on increased total ownership costs. These costs can also affect the exaggerate budgets and delayed schedules. The study of human performance economical assessment in the system acquisition process enhances the visibility of hidden cost drivers which support program management informed decisions. This paper presents the literature review of human total ownership cost (HTOC) and cost impacts on overall system performance. Economic value assessment models such as cost benefit analysis, risk-cost tradeoff analysis, expected value of utility function analysis (EV), growth readiness matrix, multi-attribute utility technique, and multi-regressions model were introduced to reflect the HTOC and human performance-technology tradeoffs in terms of the dollar value. The human total ownership regression model introduces to address the influencing human performance cost component measurement. Results from this study will increase understanding of relevant cost drivers in the system acquisition process over the long term.

Applying lessons learned to enhance human performance and reduce human error for ISS operations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nelson, W.R.

1999-01-01

A major component of reliability, safety, and mission success for space missions is ensuring that the humans involved (flight crew, ground crew, mission control, etc.) perform their tasks and functions as required. This includes compliance with training and procedures during normal conditions, and successful compensation when malfunctions or unexpected conditions occur. A very significant issue that affects human performance in space flight is human error. Human errors can invalidate carefully designed equipment and procedures. If certain errors combine with equipment failures or design flaws, mission failure or loss of life can occur. The control of human error during operation ofmore » the International Space Station (ISS) will be critical to the overall success of the program. As experience from Mir operations has shown, human performance plays a vital role in the success or failure of long duration space missions. The Department of Energy{close_quote}s Idaho National Engineering and Environmental Laboratory (INEEL) is developing a systematic approach to enhance human performance and reduce human errors for ISS operations. This approach is based on the systematic identification and evaluation of lessons learned from past space missions such as Mir to enhance the design and operation of ISS. This paper will describe previous INEEL research on human error sponsored by NASA and how it can be applied to enhance human reliability for ISS. {copyright} {ital 1999 American Institute of Physics.}« less

Validation of a sensitive LC/MS/MS method for the determination of telaprevir and its R-isomer in human plasma.

PubMed

Chen, Xinhui; Bushman, Lane R; McAllister, Kevin J; Anderson, Peter L; Kiser, Jennifer J

2014-12-01

The purpose of this study was to validate a reversed-phase high-performance liquid chromatographic (HPLC), tandem mass spectrometry (MS/MS) assay for the determination of telaprevir and its R-diastereomer (VRT-127394) in acidified and nonacidified human plasma. The chromatographic baseline separation of telaprevir and telaprevir-R was performed on a Waters XBridge(TM) BEH Shield C18 , 2.1 × 75 mm column with a 2.5 µm particle size, under isocratic conditions consisting of a mobile phase of 50:45:5 water-acetonitrile-isopropanol with 1% ammonia at 0.2 mL/min. This method utilized a stable isotope internal standard with 11 deuterium atoms on the structure of the telaprevir molecule (telaprevir-d11). An internal standard for the telaprevir-R (telaprevir-R-d11) was also prepared by incubating telaprevir-d11 in basic solution, which facilitated isomer inter-conversion. The detection and quantitation of telaprevir, telaprevir-R, telaprevir-IS and telaprevir-R-IS was achieved by positive ion electrospray (ESI+) MS/MS detection. The assay quantifiable limit was 5.0 ng/mL when 0.100 mL of acidified human plasma was extracted. Accuracy and precision were validated over the calibration range of 5.0-5000 ng/mL. It was demonstrated using patient samples that, contrary to previous recommendations, quantitation of telaprevir does not require acidified plasma. Copyright © 2014 John Wiley & Sons, Ltd.

The prone bridge test: Performance, validity, and reliability among older and younger adults.

PubMed

Bohannon, Richard W; Steffl, Michal; Glenney, Susan S; Green, Michelle; Cashwell, Leah; Prajerova, Kveta; Bunn, Jennifer

2018-04-01

The prone bridge maneuver, or plank, has been viewed as a potential alternative to curl-ups for assessing trunk muscle performance. The purpose of this study was to assess prone bridge test performance, validity, and reliability among younger and older adults. Sixty younger (20-35 years old) and 60 older (60-79 years old) participants completed this study. Groups were evenly divided by sex. Participants completed surveys regarding physical activity and abdominal exercise participation. Height, weight, body mass index (BMI), and waist circumference were measured. On two occasions, 5-9 days apart, participants held a prone bridge until volitional exhaustion or until repeated technique failure. Validity was examined using data from the first session: convergent validity by calculating correlations between survey responses, anthropometrics, and prone bridge time, known groups validity by using an ANOVA comparing bridge times of younger and older adults and of men and women. Test-retest reliability was examined by using a paired t-test to compare prone bridge times for Session1 and Session 2. Furthermore, an intraclass correlation coefficient (ICC) was used to characterize relative reliability and minimal detectable change (MDC 95% ) was used to describe absolute reliability. The mean prone bridge time was 145.3 ± 71.5 s, and was positively correlated with physical activity participation (p ≤ 0.001) and negatively correlated with BMI and waist circumference (p ≤ 0.003). Younger participants had significantly longer plank times than older participants (p = 0.003). The ICC between testing sessions was 0.915. The prone bridge test is a valid and reliable measure for evaluating abdominal performance in both younger and older adults. Copyright © 2017 Elsevier Ltd. All rights reserved.

Correlation between human observer performance and model observer performance in differential phase contrast CT

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, Ke; Garrett, John; Chen, Guang-Hong

2013-11-15

Purpose: With the recently expanding interest and developments in x-ray differential phase contrast CT (DPC-CT), the evaluation of its task-specific detection performance and comparison with the corresponding absorption CT under a given radiation dose constraint become increasingly important. Mathematical model observers are often used to quantify the performance of imaging systems, but their correlations with actual human observers need to be confirmed for each new imaging method. This work is an investigation of the effects of stochastic DPC-CT noise on the correlation of detection performance between model and human observers with signal-known-exactly (SKE) detection tasks.Methods: The detectabilities of different objectsmore » (five disks with different diameters and two breast lesion masses) embedded in an experimental DPC-CT noise background were assessed using both model and human observers. The detectability of the disk and lesion signals was then measured using five types of model observers including the prewhitening ideal observer, the nonprewhitening (NPW) observer, the nonprewhitening observer with eye filter and internal noise (NPWEi), the prewhitening observer with eye filter and internal noise (PWEi), and the channelized Hotelling observer (CHO). The same objects were also evaluated by four human observers using the two-alternative forced choice method. The results from the model observer experiment were quantitatively compared to the human observer results to assess the correlation between the two techniques.Results: The contrast-to-detail (CD) curve generated by the human observers for the disk-detection experiments shows that the required contrast to detect a disk is inversely proportional to the square root of the disk size. Based on the CD curves, the ideal and NPW observers tend to systematically overestimate the performance of the human observers. The NPWEi and PWEi observers did not predict human performance well either, as the slopes of

Predictive Validity of National Basketball Association Draft Combine on Future Performance.

PubMed

Teramoto, Masaru; Cross, Chad L; Rieger, Randall H; Maak, Travis G; Willick, Stuart E

2018-02-01

Teramoto, M, Cross, CL, Rieger, RH, Maak, TG, and Willick, SE. Predictive validity of national basketball association draft combine on future performance. J Strength Cond Res 32(2): 396-408, 2018-The National Basketball Association (NBA) Draft Combine is an annual event where prospective players are evaluated in terms of their athletic abilities and basketball skills. Data collected at the Combine should help NBA teams select right the players for the upcoming NBA draft; however, its value for predicting future performance of players has not been examined. This study investigated predictive validity of the NBA Draft Combine on future performance of basketball players. We performed a principal component analysis (PCA) on the 2010-2015 Combine data to reduce correlated variables (N = 234), a correlation analysis on the Combine data and future on-court performance to examine relationships (maximum pairwise N = 217), and a robust principal component regression (PCR) analysis to predict first-year and 3-year on-court performance from the Combine measures (N = 148 and 127, respectively). Three components were identified within the Combine data through PCA (= Combine subscales): length-size, power-quickness, and upper-body strength. As per the correlation analysis, the individual Combine items for anthropometrics, including height without shoes, standing reach, weight, wingspan, and hand length, as well as the Combine subscale of length-size, had positive, medium-to-large-sized correlations (r = 0.313-0.545) with defensive performance quantified by Defensive Box Plus/Minus. The robust PCR analysis showed that the Combine subscale of length-size was a predictor most significantly associated with future on-court performance (p ≤ 0.05), including Win Shares, Box Plus/Minus, and Value Over Replacement Player, followed by upper-body strength. In conclusion, the NBA Draft Combine has value for predicting future performance of players.

Development, Testing, and Validation of a Model-Based Tool to Predict Operator Responses in Unexpected Workload Transitions

NASA Technical Reports Server (NTRS)

Sebok, Angelia; Wickens, Christopher; Sargent, Robert

2015-01-01

One human factors challenge is predicting operator performance in novel situations. Approaches such as drawing on relevant previous experience, and developing computational models to predict operator performance in complex situations, offer potential methods to address this challenge. A few concerns with modeling operator performance are that models need to realistic, and they need to be tested empirically and validated. In addition, many existing human performance modeling tools are complex and require that an analyst gain significant experience to be able to develop models for meaningful data collection. This paper describes an effort to address these challenges by developing an easy to use model-based tool, using models that were developed from a review of existing human performance literature and targeted experimental studies, and performing an empirical validation of key model predictions.

Performance validity testing in neuropsychology: a clinical guide, critical review, and update on a rapidly evolving literature.

PubMed

Lippa, Sara M

2018-04-01

Over the past two decades, there has been much research on measures of response bias and myriad measures have been validated in a variety of clinical and research samples. This critical review aims to guide clinicians through the use of performance validity tests (PVTs) from test selection and administration through test interpretation and feedback. Recommended cutoffs and relevant test operating characteristics are presented. Other important issues to consider during test selection, administration, interpretation, and feedback are discussed including order effects, coaching, impact on test data, and methods to combine measures and improve predictive power. When interpreting performance validity measures, neuropsychologists must use particular caution in cases of dementia, low intelligence, English as a second language/minority cultures, or low education. PVTs provide valuable information regarding response bias and, under the right circumstances, can provide excellent evidence of response bias. Only after consideration of the entire clinical picture, including validity test performance, can concrete determinations regarding the validity of test data be made.

Empirical Performance of Cross-Validation With Oracle Methods in a Genomics Context

PubMed Central

Martinez, Josue G.; Carroll, Raymond J.; Müller, Samuel; Sampson, Joshua N.; Chatterjee, Nilanjan

2012-01-01

When employing model selection methods with oracle properties such as the smoothly clipped absolute deviation (SCAD) and the Adaptive Lasso, it is typical to estimate the smoothing parameter by m-fold cross-validation, for example, m = 10. In problems where the true regression function is sparse and the signals large, such cross-validation typically works well. However, in regression modeling of genomic studies involving Single Nucleotide Polymorphisms (SNP), the true regression functions, while thought to be sparse, do not have large signals. We demonstrate empirically that in such problems, the number of selected variables using SCAD and the Adaptive Lasso, with 10-fold cross-validation, is a random variable that has considerable and surprising variation. Similar remarks apply to non-oracle methods such as the Lasso. Our study strongly questions the suitability of performing only a single run of m-fold cross-validation with any oracle method, and not just the SCAD and Adaptive Lasso. PMID:22347720

Empirical Performance of Cross-Validation With Oracle Methods in a Genomics Context.

PubMed

Martinez, Josue G; Carroll, Raymond J; Müller, Samuel; Sampson, Joshua N; Chatterjee, Nilanjan

2011-11-01

When employing model selection methods with oracle properties such as the smoothly clipped absolute deviation (SCAD) and the Adaptive Lasso, it is typical to estimate the smoothing parameter by m-fold cross-validation, for example, m = 10. In problems where the true regression function is sparse and the signals large, such cross-validation typically works well. However, in regression modeling of genomic studies involving Single Nucleotide Polymorphisms (SNP), the true regression functions, while thought to be sparse, do not have large signals. We demonstrate empirically that in such problems, the number of selected variables using SCAD and the Adaptive Lasso, with 10-fold cross-validation, is a random variable that has considerable and surprising variation. Similar remarks apply to non-oracle methods such as the Lasso. Our study strongly questions the suitability of performing only a single run of m-fold cross-validation with any oracle method, and not just the SCAD and Adaptive Lasso.

Porcine Tricuspid Valve Anatomy and Human Compatibility: Relevance for Preclinical Validation of Novel Valve Interventions.

PubMed

Waziri, Farhad; Lyager Nielsen, Sten; Michael Hasenkam, John

2016-09-01

Tricuspid regurgitation may be a precursor for heart failure, reduced functional capacity, and poor survival. A human compatible experimental model is required to understand the pathophysiology of the tricuspid valve disease as a basis for validating novel tricuspid valve interventions before clinical use. The study aim was to evaluate and compare the tricuspid valve anatomy of porcine and human hearts. The anatomy of the tricuspid valve and the surrounding structures that affect the valve during a cardiac cycle were examined in detail in 100 fresh and 19 formalin-fixed porcine hearts obtained from Danish Landrace pigs (body weight 80 kg). All valvular dimensions were compared with human data acquired from literature sources. No difference was seen in the tricuspid annulus circumference between porcine and human hearts (13.0 ± 1.2 cm versus 13.5 ± 1.5 cm; p = NS), or in valve area (5.7 ± 1.6 cm2 versus 5.6 ± 1.0 cm2; p = NS). The majority of chordae types exhibited a larger chordal length and thickness in human hearts compared to porcine hearts. In both species, the anterior papillary muscle (PM) was larger than other PMs in the right ventricle, but muscle length varied greatly (range: 5.2-40.3 mm) and was significantly different in pigs and in humans (12.2 ± 3.2 mm versus 19.2 mm; p <0.001). The porcine tricuspid valve was determined to be a valid model for preclinical animal studies, despite various anatomic differences being noted between porcine and human hearts.

Content and Face Validation of a Curriculum for Ultrasonic Propulsion of Calculi in a Human Renal Model

PubMed Central

Dunmire, Barbrina; Cunitz, Bryan W.; He, Xuemei; Sorensen, Mathew D.; Harper, Jonathan D.; Bailey, Michael R.; Lendvay, Thomas S.

2014-01-01

Abstract Purpose: Ultrasonic propulsion to reposition urinary tract calculi requires knowledge about ultrasound image capture, device manipulation, and interpretation. The purpose of this study was to validate a cognitive and technical skills curriculum to teach urologists ultrasonic propulsion to reposition kidney stones in tissue phantoms. Materials and Methods: Ten board-certified urologists recruited from a single institution underwent a didactic session on renal ultrasound imaging. Subjects completed technical skills modules in tissue phantoms, including kidney imaging, pushing a stone through a translucent maze, and repositioning a lower pole calyceal stone. Objective cognitive and technical performance metrics were recorded. Subjects completed a questionnaire to ascertain face and content validity on a five-point Likert scale. Results: Eight urologists (80%) had never attended a previous ultrasound course, and nine (90%) performed renal ultrasounds less frequently than every 6 months. Mean cognitive skills scores improved from 55% to 91% (p<0.0001) on pre- and post-didactic tests. In the kidney phantom, 10 subjects (100%) repositioned the lower pole calyceal stone to at least the lower pole infundibulum, while 9 (90%) successfully repositioned the stone to the renal pelvis. A mean±SD (15.7±13.3) pushes were required to complete the task over an average of 4.6±2.2 minutes. Urologists rated the curriculum's effectiveness and realism as a training tool at a mean score of 4.6/5.0 and 4.1/5.0, respectively. Conclusions: The curriculum for ultrasonic propulsion is effective and useful for training urologists with limited ultrasound proficiency in stone repositioning technique. Further studies in animate and human models will be required to assess predictive validity. PMID:24228719

Content and face validation of a curriculum for ultrasonic propulsion of calculi in a human renal model.

PubMed

Hsi, Ryan S; Dunmire, Barbrina; Cunitz, Bryan W; He, Xuemei; Sorensen, Mathew D; Harper, Jonathan D; Bailey, Michael R; Lendvay, Thomas S

2014-04-01

Ultrasonic propulsion to reposition urinary tract calculi requires knowledge about ultrasound image capture, device manipulation, and interpretation. The purpose of this study was to validate a cognitive and technical skills curriculum to teach urologists ultrasonic propulsion to reposition kidney stones in tissue phantoms. Ten board-certified urologists recruited from a single institution underwent a didactic session on renal ultrasound imaging. Subjects completed technical skills modules in tissue phantoms, including kidney imaging, pushing a stone through a translucent maze, and repositioning a lower pole calyceal stone. Objective cognitive and technical performance metrics were recorded. Subjects completed a questionnaire to ascertain face and content validity on a five-point Likert scale. Eight urologists (80%) had never attended a previous ultrasound course, and nine (90%) performed renal ultrasounds less frequently than every 6 months. Mean cognitive skills scores improved from 55% to 91% (p<0.0001) on pre- and post-didactic tests. In the kidney phantom, 10 subjects (100%) repositioned the lower pole calyceal stone to at least the lower pole infundibulum, while 9 (90%) successfully repositioned the stone to the renal pelvis. A mean±SD (15.7±13.3) pushes were required to complete the task over an average of 4.6±2.2 minutes. Urologists rated the curriculum's effectiveness and realism as a training tool at a mean score of 4.6/5.0 and 4.1/5.0, respectively. The curriculum for ultrasonic propulsion is effective and useful for training urologists with limited ultrasound proficiency in stone repositioning technique. Further studies in animate and human models will be required to assess predictive validity.

NASA-STD-7009 Guidance Document for Human Health and Performance Models and Simulations

NASA Technical Reports Server (NTRS)

Walton, Marlei; Mulugeta, Lealem; Nelson, Emily S.; Myers, Jerry G.

2014-01-01

Rigorous verification, validation, and credibility (VVC) processes are imperative to ensure that models and simulations (MS) are sufficiently reliable to address issues within their intended scope. The NASA standard for MS, NASA-STD-7009 (7009) [1] was a resultant outcome of the Columbia Accident Investigation Board (CAIB) to ensure MS are developed, applied, and interpreted appropriately for making decisions that may impact crew or mission safety. Because the 7009 focus is engineering systems, a NASA-STD-7009 Guidance Document is being developed to augment the 7009 and provide information, tools, and techniques applicable to the probabilistic and deterministic biological MS more prevalent in human health and performance (HHP) and space biomedical research and operations.

A Framework for Performing Verification and Validation in Reuse Based Software Engineering

NASA Technical Reports Server (NTRS)

Addy, Edward A.

1997-01-01

Verification and Validation (V&V) is currently performed during application development for many systems, especially safety-critical and mission- critical systems. The V&V process is intended to discover errors, especially errors related to critical processing, as early as possible during the development process. The system application provides the context under which the software artifacts are validated. This paper describes a framework that extends V&V from an individual application system to a product line of systems that are developed within an architecture-based software engineering environment. This framework includes the activities of traditional application-level V&V, and extends these activities into domain engineering and into the transition between domain engineering and application engineering. The framework includes descriptions of the types of activities to be performed during each of the life-cycle phases, and provides motivation for the activities.

NASA Human Health and Performance Information Architecture Panel

NASA Technical Reports Server (NTRS)

Johnson-Throop, Kathy; Kadwa, Binafer; VanBaalen, Mary

2014-01-01

The Human Health and Performance (HH&P) Directorate at NASA's Johnson Space Center has a mission to enable optimization of human health and performance throughout all phases of spaceflight. All HH&P functions are ultimately aimed at achieving this mission. Our activities enable mission success, optimizing human health and productivity in space before, during, and after the actual spaceflight experience of our crews, and include support for ground-based functions. Many of our spaceflight innovations also provide solutions for terrestrial challenges, thereby enhancing life on Earth.

Predicting space telerobotic operator training performance from human spatial ability assessment

NASA Astrophysics Data System (ADS)

Liu, Andrew M.; Oman, Charles M.; Galvan, Raquel; Natapoff, Alan

2013-11-01

Our goal was to determine whether existing tests of spatial ability can predict an astronaut's qualification test performance after robotic training. Because training astronauts to be qualified robotics operators is so long and expensive, NASA is interested in tools that can predict robotics performance before training begins. Currently, the Astronaut Office does not have a validated tool to predict robotics ability as part of its astronaut selection or training process. Commonly used tests of human spatial ability may provide such a tool to predict robotics ability. We tested the spatial ability of 50 active astronauts who had completed at least one robotics training course, then used logistic regression models to analyze the correlation between spatial ability test scores and the astronauts' performance in their evaluation test at the end of the training course. The fit of the logistic function to our data is statistically significant for several spatial tests. However, the prediction performance of the logistic model depends on the criterion threshold assumed. To clarify the critical selection issues, we show how the probability of correct classification vs. misclassification varies as a function of the mental rotation test criterion level. Since the costs of misclassification are low, the logistic models of spatial ability and robotic performance are reliable enough only to be used to customize regular and remedial training. We suggest several changes in tracking performance throughout robotics training that could improve the range and reliability of predictive models.

Does human capital matter? A meta-analysis of the relationship between human capital and firm performance.

PubMed

Crook, T Russell; Todd, Samuel Y; Combs, James G; Woehr, David J; Ketchen, David J

2011-05-01

Theory at both the micro and macro level predicts that investments in superior human capital generate better firm-level performance. However, human capital takes time and money to develop or acquire, which potentially offsets its positive benefits. Indeed, extant tests appear equivocal regarding its impact. To clarify what is known, we meta-analyzed effects drawn from 66 studies of the human capital-firm performance relationship and investigated 3 moderators suggested by resource-based theory. We found that human capital relates strongly to performance, especially when the human capital in question is not readily tradable in labor markets and when researchers use operational performance measures that are not subject to profit appropriation. Our results suggest that managers should invest in programs that increase and retain firm-specific human capital.

Personality and organizational influences on aerospace human performance

NASA Technical Reports Server (NTRS)

Helmreich, Robert L.

1989-01-01

Individual and organizational influences on performance in aerospace environments are discussed. A model of personality with demonstrated validity is described along with reasons why personality's effects on performance have been underestimated. Organizational forces including intergroup conflict and coercive pressures are also described. It is suggested that basic and applied research in analog situations is needed to provide necessary guidance for planning future space missions.

A model of fluid and solute exchange in the human: validation and implications.

PubMed

Bert, J L; Gyenge, C C; Bowen, B D; Reed, R K; Lund, T

2000-11-01

In order to understand better the complex, dynamic behaviour of the redistribution and exchange of fluid and solutes administered to normal individuals or to those with acute hypovolemia, mathematical models are used in addition to direct experimental investigation. Initial validation of a model developed by our group involved data from animal experiments (Gyenge, C.C., Bowen, B.D., Reed, R.K. & Bert, J.L. 1999b. Am J Physiol 277 (Heart Circ Physiol 46), H1228-H1240). For a first validation involving humans, we compare the results of simulations with a wide range of different types of data from two experimental studies. These studies involved administration of normal saline or hypertonic saline with Dextran to both normal and 10% haemorrhaged subjects. We compared simulations with data including the dynamic changes in plasma and interstitial fluid volumes VPL and VIT respectively, plasma and interstitial colloid osmotic pressures PiPL and PiIT respectively, haematocrit (Hct), plasma solute concentrations and transcapillary flow rates. The model predictions were overall in very good agreement with the wide range of experimental results considered. Based on the conditions investigated, the model was also validated for humans. We used the model both to investigate mechanisms associated with the redistribution and transport of fluid and solutes administered following a mild haemorrhage and to speculate on the relationship between the timing and amount of fluid infusions and subsequent blood volume expansion.

Validation of an immortalized human (hBMEC) in vitro blood-brain barrier model.

PubMed

Eigenmann, Daniela Elisabeth; Jähne, Evelyn Andrea; Smieško, Martin; Hamburger, Matthias; Oufir, Mouhssin

2016-03-01

We recently established and optimized an immortalized human in vitro blood-brain barrier (BBB) model based on the hBMEC cell line. In the present work, we validated this mono-culture 24-well model with a representative series of drug substances which are known to cross or not to cross the BBB. For each individual compound, a quantitative UHPLC-MS/MS method in Ringer HEPES buffer was developed and validated according to current regulatory guidelines, with respect to selectivity, precision, and reliability. Various biological and analytical challenges were met during method validation, highlighting the importance of careful method development. The positive controls antipyrine, caffeine, diazepam, and propranolol showed mean endothelial permeability coefficients (P e) in the range of 17-70 × 10(-6) cm/s, indicating moderate to high BBB permeability when compared to the barrier integrity marker sodium fluorescein (mean P e 3-5 × 10(-6) cm/s). The negative controls atenolol, cimetidine, and vinblastine showed mean P e values < 10 × 10(-6) cm/s, suggesting low permeability. In silico calculations were in agreement with in vitro data. With the exception of quinidine (P-glycoprotein inhibitor and substrate), BBB permeability of all control compounds was correctly predicted by this new, easy, and fast to set up human in vitro BBB model. Addition of retinoic acid and puromycin did not increase transendothelial electrical resistance (TEER) values of the BBB model.

HDF-EOS 5 Validator

NASA Technical Reports Server (NTRS)

Ullman, Richard; Bane, Bob; Yang, Jingli

2008-01-01

A computer program partly automates the task of determining whether an HDF-EOS 5 file is valid in that it conforms to specifications for such characteristics as attribute names, dimensionality of data products, and ranges of legal data values. ["HDF-EOS" and variants thereof are defined in "Converting EOS Data From HDF-EOS to netCDF" (GSC-15007-1), which is the first of several preceding articles in this issue of NASA Tech Briefs.] Previously, validity of a file was determined in a tedious and error-prone process in which a person examined human-readable dumps of data-file-format information. The present software helps a user to encode the specifications for an HDFEOS 5 file, and then inspects the file for conformity with the specifications: First, the user writes the specifications in Extensible Markup Language (XML) by use of a document type definition (DTD) that is part of the program. Next, the portion of the program (denoted the validator) that performs the inspection is executed, using, as inputs, the specifications in XML and the HDF-EOS 5 file to be validated. Finally, the user examines the output of the validator.

Validation of the Turkish Cervical Cancer and Human Papilloma Virus Awareness Questionnaire.

PubMed

Özdemir, E; Kısa, S

2016-09-01

The aim of this study was to determine the validity and reliability of the 'Cervical Cancer and Human Papilloma Virus Awareness Questionnaire' among fertility age women by adapting the scale into Turkish. Cervical cancer is the fourth most commonly form seen among women. Death from cervical cancer ranks third among causes and is one of the most preventable forms of cancer. This cross-sectional study included 360 women from three family health centres between January 5 and June 25, 2014. Internal consistency showed that the Kuder-Richardson 21 reliability coefficient in the first part was 0.60, Cronbach's alpha reliability coefficient was 0.61 in the second part. The Kaiser-Meyer-Olkin value of the items on the scale was 0.712. The Barlett test was significant. The confirmatory factor analysis indicated that the model matched the data adequately. This study shows that the Turkish version of the instrument is a valid and reliable tool to evaluate knowledge, perceptions and preventive behaviours of women regarding human papilloma virus and cervical cancer. Nurses who work in the clinical and primary care settings need to screen, detect and refer women who may be at risk from cervical cancer. © 2016 International Council of Nurses.

Information flow between interacting human brains: Identification, validation, and relationship to social expertise.

PubMed

Bilek, Edda; Ruf, Matthias; Schäfer, Axel; Akdeniz, Ceren; Calhoun, Vince D; Schmahl, Christian; Demanuele, Charmaine; Tost, Heike; Kirsch, Peter; Meyer-Lindenberg, Andreas

2015-04-21

Social interactions are fundamental for human behavior, but the quantification of their neural underpinnings remains challenging. Here, we used hyperscanning functional MRI (fMRI) to study information flow between brains of human dyads during real-time social interaction in a joint attention paradigm. In a hardware setup enabling immersive audiovisual interaction of subjects in linked fMRI scanners, we characterize cross-brain connectivity components that are unique to interacting individuals, identifying information flow between the sender's and receiver's temporoparietal junction. We replicate these findings in an independent sample and validate our methods by demonstrating that cross-brain connectivity relates to a key real-world measure of social behavior. Together, our findings support a central role of human-specific cortical areas in the brain dynamics of dyadic interactions and provide an approach for the noninvasive examination of the neural basis of healthy and disturbed human social behavior with minimal a priori assumptions.

Development and validation of two liquid chromatography-tandem mass spectrometry methods for the determination of silibinin and silibinin hemisuccinate in human plasma.

PubMed

Sala, Federica; Albares, Pablo; Colovic, Milena; Persiani, Stefano; Rovati, Lucio C

2014-01-15

To investigate the pharmacokinetics of silibinin and silibinin hemisuccinate in human plasma, two high-performance liquid chromatography-tandem mass spectrometry (HPLC-MS/MS) methods were developed and validated. The methods require a small volume of sample (100μL), and the recovery of the analytes was complete with a good reproducibility (CV% 1.7-9.5), after a simple protein precipitation. Naringenin was used as internal standard. The chromatographic methods provided a good separation of diastereoisomers A and B of both silibinin and silibinin hemisuccinate onto a Chromolith Performance RP18e 100mm×3mm column, with a resolution of peaks from plasma matrix in less than 6min. The methods precision values expressed as CV% were always ≤6.2% and the accuracy was always well within the acceptable 15% range. Quantification was performed on a triple-quadrupole tandem mass spectrometer by Selected Reaction Monitoring (SRM) mode, in a negative ion mode, via electrospray ionization (ESI). The lower limit of quantitation was set at 5.0ng/mL (silibinin) and 25.0ng/mL (silibinin hemisuccinate), and the linearity was validated up to 1000.0 and 12,500.0ng/mL, for silibinin and silibinin hemisuccinate, respectively, with correlation coefficients (R(2)) of 0.991 or better. The methods were suitable for pharmacokinetic studies and were successfully applied to human plasma samples from subjects treated intravenously with Legalon(®) SIL at the dose of 20mg/kg, expressed as silibinin. Copyright © 2013 Elsevier B.V. All rights reserved.

PBPK modeling for PFOS and PFOA: validation with human experimental data.

PubMed

Fàbrega, Francesc; Kumar, Vikas; Schuhmacher, Marta; Domingo, José L; Nadal, Martí

2014-10-15

In recent years, because of the potential human toxicity, concern on perfluoroalkyl substances (PFASs) has increased notably with special attention to perfluorooctanoic acid (PFOA) and perfluorooctane sulfonate (PFOS). Unfortunately, there is currently an important knowledge gap on the burdens of these chemicals in most human tissues, as the reported studies have been mainly focused on plasma. In order to overcome these limitations, the use of physiologically-based pharmacokinetic (PBPK) models has been extended. The present study was aimed at testing an existing PBPK model for their predictability of PFOS and PFOA in a new case-study, and also to adapt it to estimate the PFAS content in human tissue compartments. Model validation was conducted by means of PFOA and PFOS concentrations in food and human drinking water from Tarragona County (Catalonia, Spain), and being the predicted results compared with those experimentally found in human tissues (blood, liver, kidney, liver and brain) of subjects from the same area of study. The use of human-derived partition coefficient (Pk) data was proven as more suitable for application to this PBPK model than rat-based Pk values. However, the uncertainty and variability of the data are still too high to get conclusive results. Consequently, further efforts should be carried out to reduce parametric uncertainty of PBPK models. More specifically, a deeper knowledge on the distribution of PFOA and PFOS within the human body should be obtained by enlarging the number of biological monitoring studies on PFASs. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The development, assessment and validation of virtual reality for human anatomy instruction

NASA Technical Reports Server (NTRS)

Marshall, Karen Benn

1996-01-01

This research project seeks to meet the objective of science training by developing, assessing, validating and utilizing VR as a human anatomy training medium. Current anatomy instruction is primarily in the form of lectures and usage of textbooks. In ideal situations, anatomic models, computer-based instruction, and cadaver dissection are utilized to augment traditional methods of instruction. At many institutions, lack of financial resources limits anatomy instruction to textbooks and lectures. However, human anatomy is three-dimensional, unlike the one-dimensional depiction found in textbooks and the two-dimensional depiction found on the computer. Virtual reality allows one to step through the computer screen into a 3-D artificial world. The primary objective of this project is to produce a virtual reality application of the abdominopelvic region of a human cadaver that can be taken back to the classroom. The hypothesis is that an immersive learning environment affords quicker anatomic recognition and orientation and a greater level of retention in human anatomy instruction. The goal is to augment not replace traditional modes of instruction.

A novel cuffless device for self-measurement of blood pressure: concept, performance and clinical validation.

PubMed

Boubouchairopoulou, N; Kollias, A; Chiu, B; Chen, B; Lagou, S; Anestis, P; Stergiou, G S

2017-07-01

A pocket-size cuffless electronic device for self-measurement of blood pressure (BP) has been developed (Freescan, Maisense Inc., Zhubei, Taiwan). The device estimates BP within 10 s using three embedded electrodes and one force sensor that is applied over the radial pulse to evaluate the pulse wave. Before use, basic anthropometric characteristics are recorded on the device, and individualized initial calibration is required based on a standard BP measurement performed using an upper-arm BP monitor. The device performance in providing valid BP readings was evaluated in 313 normotensive and hypertensive adults in three study phases during which the device sensor was upgraded. A formal validation study of a prototype device against mercury sphygmomanometer was performed according to the American National Standards Institute/Association for the Advancement of Medical Instrumentation/International Organization for Standardization (ANSI/AAMI/ISO) 2013 protocol. The test device succeeded in obtaining a valid BP measurement (three successful readings within up to five attempts) in 55-72% of the participants, which reached 87% with device sensor upgrade. For the validation study, 125 adults were recruited and 85 met the protocol requirements for inclusion. The mean device-observers BP difference was 3.2±6.7 (s.d.) mm Hg for systolic and 2.6±4.6 mm Hg for diastolic BP (criterion 1). The estimated s.d. (inter-subject variability) were 5.83 and 4.17 mm Hg respectively (criterion 2). These data suggest that this prototype cuffless BP monitor provides valid self-measurements in the vast majority of adults, and satisfies the BP measurement accuracy criteria of the ANSI/AAMI/ISO 2013 validation protocol.

Analytical Performance Modeling and Validation of Intel’s Xeon Phi Architecture

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chunduri, Sudheer; Balaprakash, Prasanna; Morozov, Vitali

Modeling the performance of scientific applications on emerging hardware plays a central role in achieving extreme-scale computing goals. Analytical models that capture the interaction between applications and hardware characteristics are attractive because even a reasonably accurate model can be useful for performance tuning before the hardware is made available. In this paper, we develop a hardware model for Intel’s second-generation Xeon Phi architecture code-named Knights Landing (KNL) for the SKOPE framework. We validate the KNL hardware model by projecting the performance of mini-benchmarks and application kernels. The results show that our KNL model can project the performance with prediction errorsmore » of 10% to 20%. The hardware model also provides informative recommendations for code transformations and tuning.« less

Quantitative detection of caffeine in human skin by confocal Raman spectroscopy--A systematic in vitro validation study.

PubMed

Franzen, Lutz; Anderski, Juliane; Windbergs, Maike

2015-09-01

For rational development and evaluation of dermal drug delivery, the knowledge of rate and extent of substance penetration into the human skin is essential. However, current analytical procedures are destructive, labor intense and lack a defined spatial resolution. In this context, confocal Raman microscopy bares the potential to overcome current limitations in drug depth profiling. Confocal Raman microscopy already proved its suitability for the acquisition of qualitative penetration profiles, but a comprehensive investigation regarding its suitability for quantitative measurements inside the human skin is still missing. In this work, we present a systematic validation study to deploy confocal Raman microscopy for quantitative drug depth profiling in human skin. After we validated our Raman microscopic setup, we successfully established an experimental procedure that allows correlating the Raman signal of a model drug with its controlled concentration in human skin. To overcome current drawbacks in drug depth profiling, we evaluated different modes of peak correlation for quantitative Raman measurements and offer a suitable operating procedure for quantitative drug depth profiling in human skin. In conclusion, we successfully demonstrate the potential of confocal Raman microscopy for quantitative drug depth profiling in human skin as valuable alternative to destructive state-of-the-art techniques. Copyright © 2015 Elsevier B.V. All rights reserved.

Specificity rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures.

PubMed

Gasquoine, Philip G; Weimer, Amy A; Amador, Arnoldo

2017-04-01

To measure specificity as failure rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures: (a) the language format Reliable Digit Span; (b) visual-perceptual format Test of Memory Malingering; and (c) visual-perceptual format Dot Counting, using optimal/suboptimal effort cut scores developed for monolingual, English-speakers. Participants were 61 consecutive referrals, aged between 18 and 65 years, with <16 years of education who were subjectively bilingual (confirmed via formal assessment) and chose the language of assessment, Spanish or English, for the performance validity tests. Failure rates were 38% for Reliable Digit Span, 3% for the Test of Memory Malingering, and 7% for Dot Counting. For Reliable Digit Span, the failure rates for Spanish (46%) and English (31%) languages of administration did not differ significantly. Optimal/suboptimal effort cut scores derived for monolingual English-speakers can be used with Spanish/English bilinguals when using the visual-perceptual format Test of Memory Malingering and Dot Counting. The high failure rate for Reliable Digit Span suggests it should not be used as a performance validity measure with Spanish/English bilinguals, irrespective of the language of test administration, Spanish or English.

Determination of efavirenz in human dried blood spots by reversed-phase high-performance liquid chromatography with UV detection.

PubMed

Hoffman, Justin T; Rossi, Steven S; Espina-Quinto, Rowena; Letendre, Scott; Capparelli, Edmund V

2013-04-01

Previously published methods for determination of efavirenz (EFV) in human dried blood spots (DBS) use costly and complex liquid chromatography/mass spectrometry. We describe the validation and evaluation of a simple and inexpensive high-performance liquid chromatography method for EFV quantification in human DBS and dried plasma spots (DPS), using ultraviolet detection appropriate for resource-limited settings. One hundred microliters of heparinized whole blood or plasma were spotted onto blood collection cards, dried, punched, and eluted. Eluates are injected onto a C-18 reversed phase high-performance liquid chromatography column. EFV is separated isocratically using a potassium phosphate and acetonitrile mobile phase. Ultraviolet detection is at 245 nm. Quantitation is by use of external calibration standards. Following validation, the method was evaluated using whole blood and plasma from HIV-positive patients undergoing EFV therapy. Mean recovery of drug from DBS is 91.5%. The method is linear over the validated concentration range of 0.3125-20.0 μg/mL. A good correlation (Spearman r = 0.96) between paired plasma and DBS EFV concentrations from the clinical samples was observed, and hematocrit level was not found to be a significant determinant of the EFV DBS level. The mean observed C DBS/C plasma ratio was 0.68. A good correlation (Spearman r = 0.96) between paired plasma and DPS EFV concentrations from the clinical samples was observed. The mean percent deviation of DPS samples from plasma samples is 1.68%. Dried whole blood spot or dried plasma spot sampling is well suited for monitoring EFV therapy in resource-limited settings, particularly when high sensitivity is not essential.

User's Manual for Data for Validating Models for PV Module Performance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Marion, W.; Anderberg, A.; Deline, C.

2014-04-01

This user's manual describes performance data measured for flat-plate photovoltaic (PV) modules installed in Cocoa, Florida, Eugene, Oregon, and Golden, Colorado. The data include PV module current-voltage curves and associated meteorological data for approximately one-year periods. These publicly available data are intended to facilitate the validation of existing models for predicting the performance of PV modules, and for the development of new and improved models. For comparing different modeling approaches, using these public data will provide transparency and more meaningful comparisons of the relative benefits.

Human factors with nonhumans - Factors that affect computer-task performance

NASA Technical Reports Server (NTRS)

Washburn, David A.

1992-01-01

There are two general strategies that may be employed for 'doing human factors research with nonhuman animals'. First, one may use the methods of traditional human factors investigations to examine the nonhuman animal-to-machine interface. Alternatively, one might use performance by nonhuman animals as a surrogate for or model of performance by a human operator. Each of these approaches is illustrated with data in the present review. Chronic ambient noise was found to have a significant but inconsequential effect on computer-task performance by rhesus monkeys (Macaca mulatta). Additional data supported the generality of findings such as these to humans, showing that rhesus monkeys are appropriate models of human psychomotor performance. It is argued that ultimately the interface between comparative psychology and technology will depend on the coordinated use of both strategies of investigation.

Design and Validation of an Infrared Badal Optometer for Laser Speckle (IBOLS)

PubMed Central

Teel, Danielle F. W.; Copland, R. James; Jacobs, Robert J.; Wells, Thad; Neal, Daniel R.; Thibos, Larry N.

2009-01-01

Purpose To validate the design of an infrared wavefront aberrometer with a Badal optometer employing the principle of laser speckle generated by a spinning disk and infrared light. The instrument was designed for subjective meridional refraction in infrared light by human patients. Methods Validation employed a model eye with known refractive error determined with an objective infrared wavefront aberrometer. The model eye was used to produce a speckle pattern on an artificial retina with controlled amounts of ametropia introduced with auxiliary ophthalmic lenses. A human observer performed the psychophysical task of observing the speckle pattern (with the aid of a video camera sensitive to infrared radiation) formed on the artificial retina. Refraction was performed by adjusting the vergence of incident light with the Badal optometer to nullify the motion of laser speckle. Validation of the method was performed for different levels of spherical ametropia and for various configurations of an astigmatic model eye. Results Subjective measurements of meridional refractive error over the range −4D to + 4D agreed with astigmatic refractive errors predicted by the power of the model eye in the meridian of motion of the spinning disk. Conclusions Use of a Badal optometer to control laser speckle is a valid method for determining subjective refractive error at infrared wavelengths. Such an instrument will be useful for comparing objective measures of refractive error obtained for the human eye with autorefractors and wavefront aberrometers that employ infrared radiation. PMID:18772719

OPTIMIZATION AND VALIDATION OF HPLC METHOD FOR TETRAMETHRIN DETERMINATION IN HUMAN SHAMPOO FORMULATION.

PubMed

Zeric Stosic, Marina Z; Jaksic, Sandra M; Stojanov, Igor M; Apic, Jelena B; Ratajac, Radomir D

2016-11-01

High-performance liquid chromatography (HPLC) method with diode array detection (DAD) were optimized and validated for separation and determination of tetramethrin in an antiparasitic human shampoo. In order to optimize separation conditions, two different columns, different column oven temperatures, as well as mobile phase composition and ratio, were tested. Best separation was achieved on the Supelcosil TM LC-18- DB column (4.6 x 250 mm), particle size 5 jim, with mobile phase methanol : water (78 : 22, v/v) at a flow rate of 0.8 mL/min and at temperature of 30⁰C. The detection wavelength of the detector was set at 220 nm. Under the optimum chromatographic conditions, standard calibration curve was measured with good linearity [r2 = 0.9997]. Accuracy of the method defined as a mean recovery of tetramethrin from shampoo matrix was 100.09%. The advantages of this method are that it can easily be used for the routine analysis of drug tetramethrin in pharmaceutical formulas and in all pharmaceutical researches involving tetramethrin.

Validation and application of a high-performance liquid chromatography-tandem mass spectrometric method for simultaneous quantification of lopinavir and ritonavir in human plasma using semi-automated 96-well liquid-liquid extraction.

PubMed

Wang, Perry G; Wei, Jack S; Kim, Grace; Chang, Min; El-Shourbagy, Tawakol

2006-10-20

Kaletra is an important antiretroviral drug, which has been developed by Abbott Laboratories. It is composed of lopinavir (low-pin-a-veer) and ritonavir (ri-toe-na-veer). Both have been proved to be human immunodeficiency virus (HIV) protease inhibitors and have substantially reduced the morbidity and mortality associated with HIV-1 infection. We have developed and validated an assay, using liquid chromatography coupled with atmospheric pressure chemical ionization tandem mass spectrometry (LC/MS/MS), for the routine quantification of lopinavir and ritonavir in human plasma, in which lopinavir and ritonavir can be simultaneously analyzed with high throughput. The sample preparation consisted of liquid-liquid extraction with a mixture of hexane: ethyl acetate (1:1, v/v), using 100 microL of plasma. Chromatographic separation was performed on a Waters Symmetry C(18) column (150 mm x 3.9 mm, particle size 5 microm) with reverse-phase isocratic using mobile phase of 70:30 (v/v) acetonitrile: 2 mM ammonium acetate aqueous solution containing 0.01% formic acid (v/v) at a flow rate of 1.0 mL/min. A Waters symmetry C(18) guard column (20 mm x 3.9 mm, particle size 5 microm) was connected prior to the analytical column, and a guard column back wash was performed to reduce the analytical column contamination using a mixture of tetrahydrofuran (THF), methanol and water (45:45:10, v/v/v). The analytical run was 4 min. The use of a 96-well plate autosampler allowed a batch size up to 73 study samples. A triple-quadrupole mass spectrometer was operated in a positive ion mode and multiple reaction monitoring (MRM) was used for drug quantification. The method was validated over the concentration ranges of 19-5,300 ng/mL for lopinavir and 11-3,100 ng/mL for ritonavir. A-86093 was used as an internal standard (I.S.). The relative standard deviation (RSD) were <6% for both lopinavir and ritonavir. Mean accuracies were between the designed limits (+/-15%). The robust and rapid LC

Information flow between interacting human brains: Identification, validation, and relationship to social expertise

PubMed Central

Bilek, Edda; Ruf, Matthias; Schäfer, Axel; Akdeniz, Ceren; Calhoun, Vince D.; Schmahl, Christian; Demanuele, Charmaine; Tost, Heike; Kirsch, Peter; Meyer-Lindenberg, Andreas

2015-01-01

Social interactions are fundamental for human behavior, but the quantification of their neural underpinnings remains challenging. Here, we used hyperscanning functional MRI (fMRI) to study information flow between brains of human dyads during real-time social interaction in a joint attention paradigm. In a hardware setup enabling immersive audiovisual interaction of subjects in linked fMRI scanners, we characterize cross-brain connectivity components that are unique to interacting individuals, identifying information flow between the sender’s and receiver’s temporoparietal junction. We replicate these findings in an independent sample and validate our methods by demonstrating that cross-brain connectivity relates to a key real-world measure of social behavior. Together, our findings support a central role of human-specific cortical areas in the brain dynamics of dyadic interactions and provide an approach for the noninvasive examination of the neural basis of healthy and disturbed human social behavior with minimal a priori assumptions. PMID:25848050

Integrative Annotation of 21,037 Human Genes Validated by Full-Length cDNA Clones

PubMed Central

Imanishi, Tadashi; Itoh, Takeshi; Suzuki, Yutaka; O'Donovan, Claire; Fukuchi, Satoshi; Koyanagi, Kanako O; Barrero, Roberto A; Tamura, Takuro; Yamaguchi-Kabata, Yumi; Tanino, Motohiko; Yura, Kei; Miyazaki, Satoru; Ikeo, Kazuho; Homma, Keiichi; Kasprzyk, Arek; Nishikawa, Tetsuo; Hirakawa, Mika; Thierry-Mieg, Jean; Thierry-Mieg, Danielle; Ashurst, Jennifer; Jia, Libin; Nakao, Mitsuteru; Thomas, Michael A; Mulder, Nicola; Karavidopoulou, Youla; Jin, Lihua; Kim, Sangsoo; Yasuda, Tomohiro; Lenhard, Boris; Eveno, Eric; Suzuki, Yoshiyuki; Yamasaki, Chisato; Takeda, Jun-ichi; Gough, Craig; Hilton, Phillip; Fujii, Yasuyuki; Sakai, Hiroaki; Tanaka, Susumu; Amid, Clara; Bellgard, Matthew; Bonaldo, Maria de Fatima; Bono, Hidemasa; Bromberg, Susan K; Brookes, Anthony J; Bruford, Elspeth; Carninci, Piero; Chelala, Claude; Couillault, Christine; de Souza, Sandro J.; Debily, Marie-Anne; Devignes, Marie-Dominique; Dubchak, Inna; Endo, Toshinori; Estreicher, Anne; Eyras, Eduardo; Fukami-Kobayashi, Kaoru; R. Gopinath, Gopal; Graudens, Esther; Hahn, Yoonsoo; Han, Michael; Han, Ze-Guang; Hanada, Kousuke; Hanaoka, Hideki; Harada, Erimi; Hashimoto, Katsuyuki; Hinz, Ursula; Hirai, Momoki; Hishiki, Teruyoshi; Hopkinson, Ian; Imbeaud, Sandrine; Inoko, Hidetoshi; Kanapin, Alexander; Kaneko, Yayoi; Kasukawa, Takeya; Kelso, Janet; Kersey, Paul; Kikuno, Reiko; Kimura, Kouichi; Korn, Bernhard; Kuryshev, Vladimir; Makalowska, Izabela; Makino, Takashi; Mano, Shuhei; Mariage-Samson, Regine; Mashima, Jun; Matsuda, Hideo; Mewes, Hans-Werner; Minoshima, Shinsei; Nagai, Keiichi; Nagasaki, Hideki; Nagata, Naoki; Nigam, Rajni; Ogasawara, Osamu; Ohara, Osamu; Ohtsubo, Masafumi; Okada, Norihiro; Okido, Toshihisa; Oota, Satoshi; Ota, Motonori; Ota, Toshio; Otsuki, Tetsuji; Piatier-Tonneau, Dominique; Poustka, Annemarie; Ren, Shuang-Xi; Saitou, Naruya; Sakai, Katsunaga; Sakamoto, Shigetaka; Sakate, Ryuichi; Schupp, Ingo; Servant, Florence; Sherry, Stephen; Shiba, Rie; Shimizu, Nobuyoshi; Shimoyama, Mary; Simpson, Andrew J; Soares, Bento; Steward, Charles; Suwa, Makiko; Suzuki, Mami; Takahashi, Aiko; Tamiya, Gen; Tanaka, Hiroshi; Taylor, Todd; Terwilliger, Joseph D; Unneberg, Per; Veeramachaneni, Vamsi; Watanabe, Shinya; Wilming, Laurens; Yasuda, Norikazu; Yoo, Hyang-Sook; Stodolsky, Marvin; Makalowski, Wojciech; Go, Mitiko; Nakai, Kenta; Takagi, Toshihisa; Kanehisa, Minoru; Sakaki, Yoshiyuki; Quackenbush, John; Okazaki, Yasushi; Hayashizaki, Yoshihide; Hide, Winston; Chakraborty, Ranajit; Nishikawa, Ken; Sugawara, Hideaki; Tateno, Yoshio; Chen, Zhu; Oishi, Michio; Tonellato, Peter; Apweiler, Rolf; Okubo, Kousaku; Wagner, Lukas; Wiemann, Stefan; Strausberg, Robert L; Isogai, Takao; Auffray, Charles; Nomura, Nobuo; Sugano, Sumio

2004-01-01

The human genome sequence defines our inherent biological potential; the realization of the biology encoded therein requires knowledge of the function of each gene. Currently, our knowledge in this area is still limited. Several lines of investigation have been used to elucidate the structure and function of the genes in the human genome. Even so, gene prediction remains a difficult task, as the varieties of transcripts of a gene may vary to a great extent. We thus performed an exhaustive integrative characterization of 41,118 full-length cDNAs that capture the gene transcripts as complete functional cassettes, providing an unequivocal report of structural and functional diversity at the gene level. Our international collaboration has validated 21,037 human gene candidates by analysis of high-quality full-length cDNA clones through curation using unified criteria. This led to the identification of 5,155 new gene candidates. It also manifested the most reliable way to control the quality of the cDNA clones. We have developed a human gene database, called the H-Invitational Database (H-InvDB; http://www.h-invitational.jp/). It provides the following: integrative annotation of human genes, description of gene structures, details of novel alternative splicing isoforms, non-protein-coding RNAs, functional domains, subcellular localizations, metabolic pathways, predictions of protein three-dimensional structure, mapping of known single nucleotide polymorphisms (SNPs), identification of polymorphic microsatellite repeats within human genes, and comparative results with mouse full-length cDNAs. The H-InvDB analysis has shown that up to 4% of the human genome sequence (National Center for Biotechnology Information build 34 assembly) may contain misassembled or missing regions. We found that 6.5% of the human gene candidates (1,377 loci) did not have a good protein-coding open reading frame, of which 296 loci are strong candidates for non-protein-coding RNA genes. In

Enhanced high-performance liquid chromatography method for the determination of retinoic acid in plasma. Development, optimization and validation.

PubMed

Teglia, Carla M; Gil García, María D; Galera, María Martínez; Goicoechea, Héctor C

2014-08-01

When determining endogenous compounds in biological samples, the lack of blank or analyte-free matrix samples involves the use of alternative strategies for calibration and quantitation. This article deals with the development, optimization and validation of a high performance liquid chromatography method for the determination of retinoic acid in plasma, obtaining at the same time information about its isomers, taking into account the basal concentration of these endobiotica. An experimental design was used for the optimization of three variables: mobile phase composition, flow rate and column temperature through a central composite design. Four responses were selected for optimization purposes (area under the peaks, quantity of peaks, analysis time and resolution between the first principal peak and the following one). The optimum conditions resulted in a mobile phase consisting of methanol 83.4% (v/v), acetonitrile 0.6% (v/v) and acid aqueous solution 16.0% (v/v); flow rate of 0.68 mL min(-1) and an column temperature of 37.10 °C. Detection was performed at 350 nm by a diode array detector. The method was validated following a holistic approach that included not only the classical parameters related to method performance but also the robustness and the expected proportion of acceptable results lying inside predefined acceptability intervals, i.e., the uncertainty of measurements. The method validation results indicated a high selectivity and good precision characteristics that were studied at four concentration levels, with RSD less than 5.0% for retinoic acid (less than 7.5% for the LOQ concentration level), in intra and inter-assay precision studies. Linearity was proved for a range from 0.00489 to 15.109 ng mL(-1) of retinoic acid and the recovery, which was studied at four different fortification levels in phuman plasma samples, varied from 99.5% to 106.5% for retinoic acid. The applicability of the method was demonstrated by determining retinoic acid and

Validation of an enzyme-linked immunosorbent assay developed for measuring cortisol concentration in human saliva and serum for its applicability to analyze cortisol in pig saliva.

PubMed

Thomsson, Ola; Ström-Holst, Bodil; Sjunnesson, Ylva; Bergqvist, Ann-Sofi

2014-09-06

The purpose of this study was to validate a commercially available enzyme-linked immunosorbent assay (ELISA) developed for measuring free cortisol in human saliva and total cortisol concentration in diluted human serum, for its applicability in measuring cortisol concentration in pig saliva. Collection of saliva is less stressful than e.g. blood sampling, and is a non-invasive method. Saliva was collected by allowing sows to chew on cotton swabs held by forceps. Thereafter, the swabs were centrifuged to retrieve the saliva. The ELISA was performed according to instructions provided by the manufacturer. To validate the ELISA, determination of the intra-assay coefficient of variation (CV), inter-assay CV, recovery, linearity and parallelism was performed. The intra-assay CV was below 10% and inter-assay CV below 15% for samples of high, medium and low cortisol concentrations. The mean recovery was 117% and the linearity and parallelism showed an r2-value of 0.994 and 0.993, respectively. For biological assessment of induced social stress, two saliva samples were collected in the morning from 6 primiparous and 21 multiparous sows. One sample was collected when the sows were individually housed in a farrowing pen and a second sample was collected when the sows were group housed. The primiparous sows had a significant higher cortisol concentration compared to the multiparous sows when group housed. The results obtained in this validation study indicate that the ELISA is suitable for measuring cortisol concentration in porcine saliva.

Noncredible cognitive performance at clinical evaluation of adult ADHD: An embedded validity indicator in a visuospatial working memory test.

PubMed

Fuermaier, Anselm B M; Tucha, Oliver; Koerts, Janneke; Lange, Klaus W; Weisbrod, Matthias; Aschenbrenner, Steffen; Tucha, Lara

2017-12-01

The assessment of performance validity is an essential part of the neuropsychological evaluation of adults with attention-deficit/hyperactivity disorder (ADHD). Most available tools, however, are inaccurate regarding the identification of noncredible performance. This study describes the development of a visuospatial working memory test, including a validity indicator for noncredible cognitive performance of adults with ADHD. Visuospatial working memory of adults with ADHD (n = 48) was first compared to the test performance of healthy individuals (n = 48). Furthermore, a simulation design was performed including 252 individuals who were randomly assigned to either a control group (n = 48) or to 1 of 3 simulation groups who were requested to feign ADHD (n = 204). Additional samples of 27 adults with ADHD and 69 instructed simulators were included to cross-validate findings from the first samples. Adults with ADHD showed impaired visuospatial working memory performance of medium size as compared to healthy individuals. Simulation groups committed significantly more errors and had shorter response times as compared to patients with ADHD. Moreover, binary logistic regression analysis was carried out to derive a validity index that optimally differentiates between true and feigned ADHD. ROC analysis demonstrated high classification rates of the validity index, as shown in excellent specificity (95.8%) and adequate sensitivity (60.3%). The visuospatial working memory test as presented in this study therefore appears sensitive in indicating cognitive impairment of adults with ADHD. Furthermore, the embedded validity index revealed promising results concerning the detection of noncredible cognitive performance of adults with ADHD. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Research opportunities in human behavior and performance

NASA Technical Reports Server (NTRS)

Christensen, J. M. (Editor); Talbot, J. M. (Editor)

1985-01-01

Extant information on the subject of psychological aspects of manned space flight are reviewed; NASA's psychology research program is examined; significant gaps in knowledge are identified; and suggestions are offered for future research program planning. Issues of human behavior and performance related to the United States space station, to the space shuttle program, and to both near and long term problems of a generic nature in applicable disciplines of psychology are considered. Topics covered include: (1) human performance requirements for a 90 day mission; (2) human perceptual, cognitive, and motor capabilities and limitations in space; (3) crew composition, individual competencies, crew competencies, selection criteria, and special training; (4) environmental factors influencing behavior; (5) psychosocial aspects of multiperson space crews in long term missions; (6) career determinants in NASA; (7) investigational methodology and equipment; and (8) psychological support.

An evaluation of NASA's program in human factors research: Aircrew-vehicle system interaction

NASA Technical Reports Server (NTRS)

1982-01-01

Research in human factors in the aircraft cockpit and a proposed program augmentation were reviewed. The dramatic growth of microprocessor technology makes it entirely feasible to automate increasingly more functions in the aircraft cockpit; the promise of improved vehicle performance, efficiency, and safety through automation makes highly automated flight inevitable. An organized data base and validated methodology for predicting the effects of automation on human performance and thus on safety are lacking and without such a data base and validated methodology for analyzing human performance, increased automation may introduce new risks. Efforts should be concentrated on developing methods and techniques for analyzing man machine interactions, including human workload and prediction of performance.

Development of task network models of human performance in microgravity

NASA Technical Reports Server (NTRS)

Diaz, Manuel F.; Adam, Susan

1992-01-01

This paper discusses the utility of task-network modeling for quantifying human performance variability in microgravity. The data are gathered for: (1) improving current methodologies for assessing human performance and workload in the operational space environment; (2) developing tools for assessing alternative system designs; and (3) developing an integrated set of methodologies for the evaluation of performance degradation during extended duration spaceflight. The evaluation entailed an analysis of the Remote Manipulator System payload-grapple task performed on many shuttle missions. Task-network modeling can be used as a tool for assessing and enhancing human performance in man-machine systems, particularly for modeling long-duration manned spaceflight. Task-network modeling can be directed toward improving system efficiency by increasing the understanding of basic capabilities of the human component in the system and the factors that influence these capabilities.

Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation

PubMed Central

Delorenzi, Mauro

2014-01-01

Background With the large amount of biological data that is currently publicly available, many investigators combine multiple data sets to increase the sample size and potentially also the power of their analyses. However, technical differences (“batch effects”) as well as differences in sample composition between the data sets may significantly affect the ability to draw generalizable conclusions from such studies. Focus The current study focuses on the construction of classifiers, and the use of cross-validation to estimate their performance. In particular, we investigate the impact of batch effects and differences in sample composition between batches on the accuracy of the classification performance estimate obtained via cross-validation. The focus on estimation bias is a main difference compared to previous studies, which have mostly focused on the predictive performance and how it relates to the presence of batch effects. Data We work on simulated data sets. To have realistic intensity distributions, we use real gene expression data as the basis for our simulation. Random samples from this expression matrix are selected and assigned to group 1 (e.g., ‘control’) or group 2 (e.g., ‘treated’). We introduce batch effects and select some features to be differentially expressed between the two groups. We consider several scenarios for our study, most importantly different levels of confounding between groups and batch effects. Methods We focus on well-known classifiers: logistic regression, Support Vector Machines (SVM), k-nearest neighbors (kNN) and Random Forests (RF). Feature selection is performed with the Wilcoxon test or the lasso. Parameter tuning and feature selection, as well as the estimation of the prediction performance of each classifier, is performed within a nested cross-validation scheme. The estimated classification performance is then compared to what is obtained when applying the classifier to independent data. PMID:24967636

Validation of instrumentation to monitor dynamic performance of olympic weightlifters.

PubMed

Bruenger, Adam J; Smith, Sarah L; Sands, William A; Leigh, Michael R

2007-05-01

The purpose of this study was to validate the accuracy and reliability of the Weightlifting Video Overlay System (WVOS) used by coaches and sport biomechanists at the United States Olympic Training Center. Static trials with the bar set at specific positions and dynamic trials of a power snatch were performed. Static and dynamic values obtained by the WVOS were compared with values obtained by tape measure and standard video kinematic analysis. Coordinate positions (horizontal [X] and vertical [Y]) were compared on both ends (left and right) of the bar. Absolute technical error of measurement between WVOS and kinematic values were calculated (0.97 cm [left X], 0.98 cm [right X], 0.88 cm [left Y], and 0.53 cm [right Y]) for the static data. Pearson correlations for all dynamic trials exceeded r = 0.88. The greatest discrepancies between the 2 measuring systems were found to occur when there was twisting of the bar during the performance. This error was probably due to the location on the bar where the coordinates were measured. The WVOS appears to provide accurate position information when compared with standard kinematics; however, care must be taken in evaluating position measurements if there is a significant amount of twisting in the movement. The WVOS appears to be reliable and valid within reasonable error limits for the determination of weightlifting movement technique.

Application of objective clinical human reliability analysis (OCHRA) in assessment of technical performance in laparoscopic rectal cancer surgery.

PubMed

Foster, J D; Miskovic, D; Allison, A S; Conti, J A; Ockrim, J; Cooper, E J; Hanna, G B; Francis, N K

2016-06-01

Laparoscopic rectal resection is technically challenging, with outcomes dependent upon technical performance. No robust objective assessment tool exists for laparoscopic rectal resection surgery. This study aimed to investigate the application of the objective clinical human reliability analysis (OCHRA) technique for assessing technical performance of laparoscopic rectal surgery and explore the validity and reliability of this technique. Laparoscopic rectal cancer resection operations were described in the format of a hierarchical task analysis. Potential technical errors were defined. The OCHRA technique was used to identify technical errors enacted in videos of twenty consecutive laparoscopic rectal cancer resection operations from a single site. The procedural task, spatial location, and circumstances of all identified errors were logged. Clinical validity was assessed through correlation with clinical outcomes; reliability was assessed by test-retest. A total of 335 execution errors identified, with a median 15 per operation. More errors were observed during pelvic tasks compared with abdominal tasks (p < 0.001). Within the pelvis, more errors were observed during dissection on the right side than the left (p = 0.03). Test-retest confirmed reliability (r = 0.97, p < 0.001). A significant correlation was observed between error frequency and mesorectal specimen quality (r s = 0.52, p = 0.02) and with blood loss (r s = 0.609, p = 0.004). OCHRA offers a valid and reliable method for evaluating technical performance of laparoscopic rectal surgery.

Human problem solving performance in a fault diagnosis task

NASA Technical Reports Server (NTRS)

Rouse, W. B.

1978-01-01

It is proposed that humans in automated systems will be asked to assume the role of troubleshooter or problem solver and that the problems which they will be asked to solve in such systems will not be amenable to rote solution. The design of visual displays for problem solving in such situations is considered, and the results of two experimental investigations of human problem solving performance in the diagnosis of faults in graphically displayed network problems are discussed. The effects of problem size, forced-pacing, computer aiding, and training are considered. Results indicate that human performance deviates from optimality as problem size increases. Forced-pacing appears to cause the human to adopt fairly brute force strategies, as compared to those adopted in self-paced situations. Computer aiding substantially lessens the number of mistaken diagnoses by performing the bookkeeping portions of the task.

Human performance on the temporal bisection task.

PubMed

Kopec, Charles D; Brody, Carlos D

2010-12-01

The perception and processing of temporal information are tasks the brain must continuously perform. These include measuring the duration of stimuli, storing duration information in memory, recalling such memories, and comparing two durations. How the brain accomplishes these tasks, however, is still open for debate. The temporal bisection task, which requires subjects to compare temporal stimuli to durations held in memory, is perfectly suited to address these questions. Here we perform a meta-analysis of human performance on the temporal bisection task collected from 148 experiments spread across 18 independent studies. With this expanded data set we are able to show that human performance on this task contains a number of significant peculiarities, which in total no single model yet proposed has been able to explain. Here we present a simple 2-step decision model that is capable of explaining all the idiosyncrasies seen in the data. Copyright © 2010 Elsevier Inc. All rights reserved.

Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

PubMed

Shackelford, Stacy; Garofalo, Evan; Shalin, Valerie; Pugh, Kristy; Chen, Hegang; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin F

2015-07-01

Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular

A Framework for Human Performance Criteria for Advanced Reactor Operational Concepts

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jacques V Hugo; David I Gertman; Jeffrey C Joe

2014-08-01

This report supports the determination of new Operational Concept models needed in support of the operational design of new reactors. The objective of this research is to establish the technical bases for human performance and human performance criteria frameworks, models, and guidance for operational concepts for advanced reactor designs. The report includes a discussion of operating principles for advanced reactors, the human performance issues and requirements for human performance based upon work domain analysis and current regulatory requirements, and a description of general human performance criteria. The major findings and key observations to date are that there is some operatingmore » experience that informs operational concepts for baseline designs for SFR and HGTRs, with the Experimental Breeder Reactor-II (EBR-II) as a best-case predecessor design. This report summarizes the theoretical and operational foundations for the development of a framework and model for human performance criteria that will influence the development of future Operational Concepts. The report also highlights issues associated with advanced reactor design and clarifies and codifies the identified aspects of technology and operating scenarios.« less

Validating the BISON fuel performance code to integral LWR experiments

DOE PAGES

Williamson, R. L.; Gamble, K. A.; Perez, D. M.; ...

2016-03-24

BISON is a modern finite element-based nuclear fuel performance code that has been under development at the Idaho National Laboratory (INL) since 2009. The code is applicable to both steady and transient fuel behavior and has been used to analyze a variety of fuel forms in 1D spherical, 2D axisymmetric, or 3D geometries. Code validation is underway and is the subject of this study. A brief overview of BISON’s computational framework, governing equations, and general material and behavioral models is provided. BISON code and solution verification procedures are described, followed by a summary of the experimental data used to datemore » for validation of Light Water Reactor (LWR) fuel. Validation comparisons focus on fuel centerline temperature, fission gas release, and rod diameter both before and following fuel-clad mechanical contact. Comparisons for 35 LWR rods are consolidated to provide an overall view of how the code is predicting physical behavior, with a few select validation cases discussed in greater detail. Our results demonstrate that 1) fuel centerline temperature comparisons through all phases of fuel life are very reasonable with deviations between predictions and experimental data within ±10% for early life through high burnup fuel and only slightly out of these bounds for power ramp experiments, 2) accuracy in predicting fission gas release appears to be consistent with state-of-the-art modeling and with the involved uncertainties and 3) comparison of rod diameter results indicates a tendency to overpredict clad diameter reduction early in life, when clad creepdown dominates, and more significantly overpredict the diameter increase late in life, when fuel expansion controls the mechanical response. In the initial rod diameter comparisons they were unsatisfactory and have lead to consideration of additional separate effects experiments to better understand and predict clad and fuel mechanical behavior. Results from this study are being used to

Integrated Summary Report: Validation of Two Binding Assays Using Human Recombinant Estrogen Receptor Alpha (hrERa)

EPA Science Inventory

This Integrated Summary Report (ISR) summarizes, in a single document, the results from an international multi-laboratory validation study conducted for two in vitro estrogen receptor (ER) binding assays. These assays both use human recombinant estrogen receptor, alpha subtype (h...

Validation of the INCEPT: A Multisource Feedback Tool for Capturing Different Perspectives on Physicians' Professional Performance.

PubMed

van der Meulen, Mirja W; Boerebach, Benjamin C M; Smirnova, Alina; Heeneman, Sylvia; Oude Egbrink, Mirjam G A; van der Vleuten, Cees P M; Arah, Onyebuchi A; Lombarts, Kiki M J M H

2017-01-01

Multisource feedback (MSF) instruments are used to and must feasibly provide reliable and valid data on physicians' performance from multiple perspectives. The "INviting Co-workers to Evaluate Physicians Tool" (INCEPT) is a multisource feedback instrument used to evaluate physicians' professional performance as perceived by peers, residents, and coworkers. In this study, we report on the validity, reliability, and feasibility of the INCEPT. The performance of 218 physicians was assessed by 597 peers, 344 residents, and 822 coworkers. Using explorative and confirmatory factor analyses, multilevel regression analyses between narrative and numerical feedback, item-total correlations, interscale correlations, Cronbach's α and generalizability analyses, the psychometric qualities, and feasibility of the INCEPT were investigated. For all respondent groups, three factors were identified, although constructed slightly different: "professional attitude," "patient-centeredness," and "organization and (self)-management." Internal consistency was high for all constructs (Cronbach's α ≥ 0.84 and item-total correlations ≥ 0.52). Confirmatory factor analyses indicated acceptable to good fit. Further validity evidence was given by the associations between narrative and numerical feedback. For reliable total INCEPT scores, three peer, two resident and three coworker evaluations were needed; for subscale scores, evaluations of three peers, three residents and three to four coworkers were sufficient. The INCEPT instrument provides physicians performance feedback in a valid and reliable way. The number of evaluations to establish reliable scores is achievable in a regular clinical department. When interpreting feedback, physicians should consider that respondent groups' perceptions differ as indicated by the different item clustering per performance factor.

Development and validation of a simple and robust method for arsenic speciation in human urine using HPLC/ICP-MS.

PubMed

Sen, Indranil; Zou, Wei; Alvaran, Josephine; Nguyen, Linda; Gajek, Ryszard; She, Jianwen

2015-01-01

In order to better distinguish the different toxic inorganic and organic forms of arsenic (As) exposure in individuals, we have developed and validated a simple and robust analytical method for determining the following six As species in human urine: arsenous (III) acid (As-III), As (V) acid, monomethylarsonic acid, dimethylarsinic acid, arsenobetaine (AsB), and arsenocholine. In this method, human urine is diluted using a pH 5.8 buffer, separation is performed using an anion exchange column with isocratic HPLC, and detection is achieved using inductively coupled plasma-MS. The method uses a single mobile phase consisting of low concentrations of both phosphate buffer (5 mM) and ammonium nitrate salt (5 mM) at pH 9.0; this minimizes the column equilibration time and overcomes challenges with separation between AsB and As-III. In addition, As-III oxidation is prevented by degassing the sample preparation buffer at pH 5.8, degassing the mobile phase online at pH 9.0, and by the use of low temperature (-70 °C) and flip-cap airtight tubes for long term storage of samples. The method was validated using externally provided reference samples. Results were in agreement with target values at varying concentrations and successfully passed external performance test criteria. Internal QC samples were prepared and repeatedly analyzed to assess the method's long-term precision, and further analyses were completed on anonymous donor urine to assess the quality of the method's baseline separation. Results from analyses of external reference samples agreed with target values at varying concentrations, and results from precision studies yielded absolute CV values of 3-14% and recovery from 82 to 115% for the six As species. Analysis of anonymous donor urine confirmed the well-resolved baseline separation capabilities of the method for real participant samples.

Studies on Antiretroviral Drug Concentrations in Breast Milk: Validation of a Liquid Chromatography–Tandem Mass Spectrometric Method for the Determination of 7 Anti-Human Immunodeficiency Virus Medications

PubMed Central

Rezk, Naser L.; White, Nicole; Bridges, Arlene S.; Abdel-Megeed, Mohamed F.; Mohamed, Tarek M.; Moselhy, Said S.; Kashuba, Angela D. M.

2010-01-01

Studying the pharmacokinetics of antiretroviral drugs in breast milk has important implications for the health of both the mother and the infant, particularly in resource-poor countries. Breast milk is a highly complex biological matrix, yet it is necessary to develop and validate methods in this matrix, which simultaneously measure multiple analytes, as women may be taking any number of drug combinations to combat human immunodeficiency virus infection. Here, we report a novel extraction method coupled to high-performance liquid chromatography and tandem mass spectrometry for the accurate, precise, and specific measurement of 7 antiretroviral drugs currently prescribed to infected mothers. Using 200 µL of human breast milk, simultaneous quantification of lamivudine (3TC), stavudine (d4T), zidovudine (ZDV), nevirapine (NVP), nelfinavir (NFV), ritonavir, and lopinavir was validated over the range of 10–10,000 ng/mL. Intraday accuracy and precision for all analytes were 99.3% and 5.0 %, respectively. Interday accuracy and precision were 99.4 % and 7.8%, respectively. Cross-assay validation with UV detection was performed using clinical breast milk samples, and the results of the 2 assays were in good agreement (P = 0.0001, r = 0.97). Breast milk to plasma concentration ratios for the different antiretroviral drugs were determined as follows: 3TC = 2.96, d4T = 1.73, ZDV = 1.17, NVP = 0.82, and NFV = 0.21. PMID:18758393

Human genetics as a model for target validation: finding new therapies for diabetes.

PubMed

Thomsen, Soren K; Gloyn, Anna L

2017-06-01

Type 2 diabetes is a global epidemic with major effects on healthcare expenditure and quality of life. Currently available treatments are inadequate for the prevention of comorbidities, yet progress towards new therapies remains slow. A major barrier is the insufficiency of traditional preclinical models for predicting drug efficacy and safety. Human genetics offers a complementary model to assess causal mechanisms for target validation. Genetic perturbations are 'experiments of nature' that provide a uniquely relevant window into the long-term effects of modulating specific targets. Here, we show that genetic discoveries over the past decades have accurately predicted (now known) therapeutic mechanisms for type 2 diabetes. These findings highlight the potential for use of human genetic variation for prospective target validation, and establish a framework for future applications. Studies into rare, monogenic forms of diabetes have also provided proof-of-principle for precision medicine, and the applicability of this paradigm to complex disease is discussed. Finally, we highlight some of the limitations that are relevant to the use of genome-wide association studies (GWAS) in the search for new therapies for diabetes. A key outstanding challenge is the translation of GWAS signals into disease biology and we outline possible solutions for tackling this experimental bottleneck.

Development and Validation of a Rating Scale for Wind Jazz Improvisation Performance

ERIC Educational Resources Information Center

Smith, Derek T.

2009-01-01

The purpose of this study was to construct and validate a rating scale for collegiate wind jazz improvisation performance. The 14-item Wind Jazz Improvisation Evaluation Scale (WJIES) was constructed and refined through a facet-rational approach to scale development. Five wind jazz students and one professional jazz educator were asked to record…

Drugs and human performance fact sheets

DOT National Transportation Integrated Search

2004-03-01

A panel of international experts on drug-impaired driving met in Seattle during August 2000 to review developments in the field of drugs and human performance over the last 10 years; to identify the specific effects that both illicit and prescription...

Drugs and human performance fact sheets.

DOT National Transportation Integrated Search

2014-04-01

A panel of international experts on drug-impaired driving met in Seattle during August 2000 to review developments in the field of drugs and human performance over the last 10 years; to identify the specific effects that both illicit and prescription...

New Metacognitive Model for Human Performance Technology

ERIC Educational Resources Information Center

Turner, John R.

2011-01-01

Addressing metacognitive functions has been shown to improve performance at the individual, team, group, and organizational levels. Metacognition is beginning to surface as an added cognate discipline for the field of human performance technology (HPT). Advances from research in the fields of cognition and metacognition offer a place for HPT to…

Development and validation of primary human myometrial cell culture models to study pregnancy and labour.

PubMed

Mosher, Andrea A; Rainey, Kelly J; Bolstad, Seunghwa S; Lye, Stephen J; Mitchell, Bryan F; Olson, David M; Wood, Stephen L; Slater, Donna M

2013-01-01

The development of the in vitro cell culture model has greatly facilitated the ability to study gene expression and regulation within human tissues. Within the human uterus, the upper (fundal) segment and the lower segment may provide distinct functions throughout pregnancy and during labour. We have established primary cultured human myometrial cells, isolated from both upper and lower segment regions of the pregnant human uterus, and validated them for the purpose of studying human pregnancy and labour. The specific objectives of this study were to monitor the viability and characterize the expression profile using selected cellular, contractile and pregnancy associated markers in the primary cultured human myometrial cells. Labour has been described as an inflammatory process; therefore, the ability of these cells to respond to an inflammatory stimulus was also investigated. Myometrial cells isolated from paired upper segment (US) and lower segment (LS) biopsies, obtained from women undergoing Caesarean section deliveries at term prior to the onset of labour, were used to identify expression of; α smooth muscle actin, calponin, caldesmon, connexin 43, cyclo-oxygenase-2 (COX-2), oxytocin receptor, tropomyosin and vimentin, by RT-PCR and/or immunocytochemistry. Interleukin (IL)-1β was used to treat cells, subsequently expression of COX-2 mRNA and release of interleukin-8 (CXCL8), were measured. ANOVA followed by Bonferroni's multiple comparisons test was performed. We demonstrate that US and LS human myometrial cells stably express all markers examined to at least passage ten (p10). Connexin 43, COX-2 and vimentin mRNA expression were significantly higher in LS cells compared to US cells. Both cell populations respond to IL-1β, demonstrated by a robust release of CXCL8 and increased expression of COX-2 mRNA from passage one (p1) through to p10. Isolated primary myometrial cells maintain expression of smooth muscle and pregnancy-associated markers and retain

Performance assessment of human resource by integration of HSE and ergonomics and EFQM management system.

PubMed

Sadegh Amalnick, Mohsen; Zarrin, Mansour

2017-03-13

Purpose The purpose of this paper is to present an integrated framework for performance evaluation and analysis of human resource (HR) with respect to the factors of health, safety, environment and ergonomics (HSEE) management system, and also the criteria of European federation for quality management (EFQM) as one of the well-known business excellence models. Design/methodology/approach In this study, an intelligent algorithm based on adaptive neuro-fuzzy inference system (ANFIS) along with fuzzy data envelopment analysis (FDEA) are developed and employed to assess the performance of the company. Furthermore, the impact of the factors on the company's performance as well as their strengths and weaknesses are identified by conducting a sensitivity analysis on the results. Similarly, a design of experiment is performed to prioritize the factors in the order of importance. Findings The results show that EFQM model has a far greater impact upon the company's performance than HSEE management system. According to the obtained results, it can be argued that integration of HSEE and EFQM leads to the performance improvement in the company. Practical implications In current study, the required data for executing the proposed framework are collected via valid questionnaires which are filled in by the staff of an aviation industry located in Tehran, Iran. Originality/value Managing HR performance results in improving usability, maintainability and reliability and finally in a significant reduction in the commercial aviation accident rate. Also, study of factors affecting HR performance authorities participate in developing systems in order to help operators better manage human error. This paper for the first time presents an intelligent framework based on ANFIS, FDEA and statistical tests for HR performance assessment and analysis with the ability of handling uncertainty and vagueness existing in real world environment.

PASTIS: Bayesian extrasolar planet validation - I. General framework, models, and performance

NASA Astrophysics Data System (ADS)

Díaz, R. F.; Almenara, J. M.; Santerne, A.; Moutou, C.; Lethuillier, A.; Deleuil, M.

2014-06-01

A large fraction of the smallest transiting planet candidates discovered by the Kepler and CoRoT space missions cannot be confirmed by a dynamical measurement of the mass using currently available observing facilities. To establish their planetary nature, the concept of planet validation has been advanced. This technique compares the probability of the planetary hypothesis against that of all reasonably conceivable alternative false positive (FP) hypotheses. The candidate is considered as validated if the posterior probability of the planetary hypothesis is sufficiently larger than the sum of the probabilities of all FP scenarios. In this paper, we present PASTIS, the Planet Analysis and Small Transit Investigation Software, a tool designed to perform a rigorous model comparison of the hypotheses involved in the problem of planet validation, and to fully exploit the information available in the candidate light curves. PASTIS self-consistently models the transit light curves and follow-up observations. Its object-oriented structure offers a large flexibility for defining the scenarios to be compared. The performance is explored using artificial transit light curves of planets and FPs with a realistic error distribution obtained from a Kepler light curve. We find that data support the correct hypothesis strongly only when the signal is high enough (transit signal-to-noise ratio above 50 for the planet case) and remain inconclusive otherwise. PLAnetary Transits and Oscillations of stars (PLATO) shall provide transits with high enough signal-to-noise ratio, but to establish the true nature of the vast majority of Kepler and CoRoT transit candidates additional data or strong reliance on hypotheses priors is needed.

Development and validation of sensitive LC-MS/MS assays for quantification of HP-β-CD in human plasma and CSF

PubMed Central

Jiang, Hui; Sidhu, Rohini; Fujiwara, Hideji; De Meulder, Marc; de Vries, Ronald; Gong, Yong; Kao, Mark; Porter, Forbes D.; Yanjanin, Nicole M.; Carillo-Carasco, Nuria; Xu, Xin; Ottinger, Elizabeth; Woolery, Myra; Ory, Daniel S.; Jiang, Xuntian

2014-01-01

2-Hydroxypropyl-β-cyclodextrin (HP-β-CD), a widely used excipient for drug formulation, has emerged as an investigational new drug for the treatment of Niemann-Pick type C1 (NPC1) disease, a neurodegenerative cholesterol storage disorder. Development of a sensitive quantitative LC-MS/MS assay to monitor the pharmacokinetics (PKs) of HP-β-CD required for clinical trials has been challenging owing to the dispersity of the HP-β-CD. To support a phase 1 clinical trial for ICV delivery of HP-β-CD in NPC1 patients, novel methods for quantification of HP-β-CD in human plasma and cerebrospinal fluid (CSF) using LC-MS/MS were developed and validated: a 2D-LC-in-source fragmentation-MS/MS (2D-LC-IF-MS/MS) assay and a reversed phase ultra performance LC-MS/MS (RP-UPLC-MS/MS) assay. In both assays, protein precipitation and “dilute and shoot” procedures were used to process plasma and CSF, respectively. The assays were fully validated and in close agreement, and allowed determination of PK parameters for HP-β-CD. The LC-MS/MS methods are ∼100-fold more sensitive than the current HPLC assay, and were successfully employed to analyze HP-β-CD in human plasma and CSF samples to support the phase 1 clinical trial of HP-β-CD in NPC1 patients. PMID:24868096

The Reliability and Validity of Protocols for the Assessment of Endurance Sports Performance: An Updated Review

ERIC Educational Resources Information Center

Stevens, Christopher John; Dascombe, Ben James

2015-01-01

Sports performance testing is one of the most common and important measures used in sport science. Performance testing protocols must have high reliability to ensure any changes are not due to measurement error or inter-individual differences. High validity is also important to ensure test performance reflects true performance. Time-trial…

Real-time remote scientific model validation

NASA Technical Reports Server (NTRS)

Frainier, Richard; Groleau, Nicolas

1994-01-01

This paper describes flight results from the use of a CLIPS-based validation facility to compare analyzed data from a space life sciences (SLS) experiment to an investigator's preflight model. The comparison, performed in real-time, either confirms or refutes the model and its predictions. This result then becomes the basis for continuing or modifying the investigator's experiment protocol. Typically, neither the astronaut crew in Spacelab nor the ground-based investigator team are able to react to their experiment data in real time. This facility, part of a larger science advisor system called Principal Investigator in a Box, was flown on the space shuttle in October, 1993. The software system aided the conduct of a human vestibular physiology experiment and was able to outperform humans in the tasks of data integrity assurance, data analysis, and scientific model validation. Of twelve preflight hypotheses associated with investigator's model, seven were confirmed and five were rejected or compromised.

Foundation Heat Exchanger Final Report: Demonstration, Measured Performance, and Validated Model and Design Tool

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hughes, Patrick; Im, Piljae

2012-04-01

exchanger (FHX) has been coined to refer exclusively to ground heat exchangers installed in the overcut around the basement walls. The primary technical challenge undertaken by this project was the development and validation of energy performance models and design tools for FHX. In terms of performance modeling and design, ground heat exchangers in other construction excavations (e.g., utility trenches) are no different from conventional HGHX, and models and design tools for HGHX already exist. This project successfully developed and validated energy performance models and design tools so that FHX or hybrid FHX/HGHX systems can be engineered with confidence, enabling this technology to be applied in residential and light commercial buildings. The validated energy performance model also addresses and solves another problem, the longstanding inadequacy in the way ground-building thermal interaction is represented in building energy models, whether or not there is a ground heat exchanger nearby. Two side-by-side, three-level, unoccupied research houses with walkout basements, identical 3,700 ft{sup 2} floor plans, and hybrid FHX/HGHX systems were constructed to provide validation data sets for the energy performance model and design tool. The envelopes of both houses are very energy efficient and airtight, and the HERS ratings of the homes are 44 and 45 respectively. Both houses are mechanically ventilated with energy recovery ventilators, with space conditioning provided by water-to-air heat pumps with 2 ton nominal capacities. Separate water-to-water heat pumps with 1.5 ton nominal capacities were used for water heating. In these unoccupied research houses, human impact on energy use (hot water draw, etc.) is simulated to match the national average. At House 1 the hybrid FHX/HGHX system was installed in 300 linear feet of excavation, and 60% of that was construction excavation (needed to construct the home). At House 2 the hybrid FHX/HGHX system was installed in 360 feet of

Securing Valid Information for Evaluation of Job Performance of the University Faculty.

ERIC Educational Resources Information Center

Donavan, Bruce

Approaches to obtaining valid information for evaluating faculty and the issue of alcoholism and job performance are addressed. Among the complications to this undertaking is the existence of an invalid self-perception on the part of faculty that they are not employees of the institution, and a tolerance among faculty for deviance or eccentricity.…

RELIABILITY AND VALIDITY OF AN ACCELEROMETRIC SYSTEM FOR ASSESSING VERTICAL JUMPING PERFORMANCE

PubMed Central

Laffaye, G.; Taiar, R.

2014-01-01

The validity of an accelerometric system (Myotest©) for assessing vertical jump height, vertical force and power, leg stiffness and reactivity index was examined. 20 healthy males performed 3ד5 hops in place”, 3ד1 squat jump” and 3× “1 countermovement jump” during 2 test-retest sessions. The variables were simultaneously assessed using an accelerometer and a force platform at a frequency of 0.5 and 1 kHz, respectively. Both reliability and validity of the accelerometric system were studied. No significant differences between test and retest data were found (p < 0.05), showing a high level of reliability. Besides, moderate to high intraclass correlation coefficients (ICCs) (from 0.74 to 0.96) were obtained for all variables whereas weak to moderate ICCs (from 0.29 to 0.79) were obtained for force and power during the countermovement jump. With regards to validity, the difference between the two devices was not significant for 5 hops in place height (1.8 cm), force during squat (-1.4 N · kg−1) and countermovement (0.1 N · kg−1) jumps, leg stiffness (7.8 kN · m−1) and reactivity index (0.4). So, the measurements of these variables with this accelerometer are valid, which is not the case for the other variables. The main causes of non-validity for velocity, power and contact time assessment are temporal biases of the takeoff and touchdown moments detection. PMID:24917690

The effects of a human patient simulator vs. a CD-ROM on performance.

PubMed

Johnson, Don; Corrigan, Theresa; Gulickson, Gary; Holshouser, Elizabeth; Johnson, Sabine

2012-10-01

Military health care personnel need to have skills relative to caring for patients on the battlefield. No studies have compared the two teaching strategies of using the human patient simulator (HPS) and a CD-ROM in caring for combat injuries. The objective of this study was to determine if there were statistically significant differences in HPS and CD-ROM educational strategies relative to caring for patients who have trauma. A pretest/post-test prospective experimental design was used. Anesthesia students were randomly assigned to one of three groups: HPS, CD-ROM, or a control group. A valid and reliable instrument, Combat Performance, was used to evaluate the participant's ability to give care to trauma patients. A repeated analysis of variance and a least significant difference post hoc test were used to analyze the data. The HPS group performed better than the CD-ROM and control groups relative to performance (p = 0.001). There was no difference between the CD-ROM and control group (p = 0.171). We speculate that the HPS group performed better than the CD-ROM group because of the realism. In this study, the HPS method of instruction was a more effective method of teaching than the CD-ROM approach.

Symptom and performance validity with veterans assessed for attention-deficit/hyperactivity disorder (ADHD).

PubMed

Shura, Robert D; Denning, John H; Miskey, Holly M; Rowland, Jared A

2017-12-01

Little is known about attention-deficit/hyperactivity disorder (ADHD) in veterans. Practice standards recommend the use of both symptom and performance validity measures in any assessment, and there are salient external incentives associated with ADHD evaluation (stimulant medication access and academic accommodations). The purpose of this study was to evaluate symptom and performance validity measures in a clinical sample of veterans presenting for specialty ADHD evaluation. Patients without a history of a neurocognitive disorder and for whom data were available on all measures (n = 114) completed a clinical interview structured on DSM-5 ADHD symptoms, the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF), and the Test of Memory Malingering Trial 1 (TOMM1) as part of a standardized ADHD diagnostic evaluation. Veterans meeting criteria for ADHD were not more likely to overreport symptoms on the MMPI-2-RF nor to fail TOMM1 (score ≤ 41) compared with those who did not meet criteria. Those who overreported symptoms did not endorse significantly more ADHD symptoms; however, those who failed TOMM1 did report significantly more ADHD symptoms (g = 0.90). In the total sample, 19.3% failed TOMM1, 44.7% overreported on the MMPI-2-RF, and 8.8% produced both an overreported MMPI-2-RF and invalid TOMM1. F-r had the highest correlation to TOMM1 scores (r = -.30). These results underscore the importance of assessing both symptom and performance validity in a clinical ADHD evaluation with veterans. In contrast to certain other conditions (e.g., mild traumatic brain injury), ADHD as a diagnosis is not related to higher rates of invalid report/performance in veterans. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Embedded measures of performance validity using verbal fluency tests in a clinical sample.

PubMed

Sugarman, Michael A; Axelrod, Bradley N

2015-01-01

The objective of this study was to determine to what extent verbal fluency measures can be used as performance validity indicators during neuropsychological evaluation. Participants were clinically referred for neuropsychological evaluation in an urban-based Veteran's Affairs hospital. Participants were placed into 2 groups based on their objectively evaluated effort on performance validity tests (PVTs). Individuals who exhibited credible performance (n = 431) failed 0 PVTs, and those with poor effort (n = 192) failed 2 or more PVTs. All participants completed the Controlled Oral Word Association Test (COWAT) and Animals verbal fluency measures. We evaluated how well verbal fluency scores could discriminate between the 2 groups. Raw scores and T scores for Animals discriminated between the credible performance and poor-effort groups with 90% specificity and greater than 40% sensitivity. COWAT scores had lower sensitivity for detecting poor effort. A combination of FAS and Animals scores into logistic regression models yielded acceptable group classification, with 90% specificity and greater than 44% sensitivity. Verbal fluency measures can yield adequate detection of poor effort during neuropsychological evaluation. We provide suggested cut points and logistic regression models for predicting the probability of poor effort in our clinical setting and offer suggested cutoff scores to optimize sensitivity and specificity.

Designing the future: NBIC technologies and human performance enhancement.

PubMed

Canton, James

2004-05-01

Never before has any civilization had the unique opportunity to enhance human performance on the scale that we will face in the near future. The convergence of nanotechnology, biotechnology, information technology, and cognitive science (NBIC) is creating a set of powerful tools that have the potential to significantly enhance human performance as well as transform society, science, economics, and human evolution. As the NBIC convergence becomes more understood, the possibility that we may be able to enhance human performance in the three domains of therapy, augmentation, and designed evolution will become anticipated and even expected. In addition, NBIC convergence represents entirely new challenges for scientists, policymakers, and business leaders who will have, for the first time, vast new and powerful tools to shape markets, societies, and lifestyles. The emergence of NBIC convergence will challenge us in new ways to balance risk and return, threat and opportunity, and social responsibility and competitive advantage as we step into the 21st century.

Human Mars Ascent Vehicle Performance Sensitivities

NASA Technical Reports Server (NTRS)

Polsgrove, Tara P.; Thomas, Herbert D.

2016-01-01

Human Mars mission architecture studies have shown that the ascent vehicle mass drives performance requirements for the descent and in-space transportation elements. Understanding the sensitivity of Mars ascent vehicle (MAV) mass to various mission and vehicle design choices enables overall transportation system optimization. This paper presents the results of a variety of sensitivity trades affecting MAV performance including: landing site latitude, target orbit, initial thrust to weight ratio, staging options, specific impulse, propellant type and engine design.

Human Factors Considerations for Performance-Based Navigation

NASA Technical Reports Server (NTRS)

Barhydt, Richard; Adams, Catherine A.

2006-01-01

A transition toward a performance-based navigation system is currently underway in both the United States and around the world. Performance-based navigation incorporates Area Navigation (RNAV) and Required Navigation Performance (RNP) procedures that do not rely on the location of ground-based navigation aids. These procedures offer significant benefits to both operators and air traffic managers. Under sponsorship from the Federal Aviation Administration (FAA), the National Aeronautics and Space Administration (NASA) has undertaken a project to document human factors issues that have emerged during RNAV and RNP operations and propose areas for further consideration. Issues were found to include aspects of air traffic control and airline procedures, aircraft systems, and procedure design. Major findings suggest the need for human factors-specific instrument procedure design guidelines. Ongoing industry and government activities to address air-ground communication terminology, procedure design improvements, and chart-database commonality are strongly encouraged.

Construct validity of individual and summary performance metrics associated with a computer-based laparoscopic simulator.

PubMed

Rivard, Justin D; Vergis, Ashley S; Unger, Bertram J; Hardy, Krista M; Andrew, Chris G; Gillman, Lawrence M; Park, Jason

2014-06-01

Computer-based surgical simulators capture a multitude of metrics based on different aspects of performance, such as speed, accuracy, and movement efficiency. However, without rigorous assessment, it may be unclear whether all, some, or none of these metrics actually reflect technical skill, which can compromise educational efforts on these simulators. We assessed the construct validity of individual performance metrics on the LapVR simulator (Immersion Medical, San Jose, CA, USA) and used these data to create task-specific summary metrics. Medical students with no prior laparoscopic experience (novices, N = 12), junior surgical residents with some laparoscopic experience (intermediates, N = 12), and experienced surgeons (experts, N = 11) all completed three repetitions of four LapVR simulator tasks. The tasks included three basic skills (peg transfer, cutting, clipping) and one procedural skill (adhesiolysis). We selected 36 individual metrics on the four tasks that assessed six different aspects of performance, including speed, motion path length, respect for tissue, accuracy, task-specific errors, and successful task completion. Four of seven individual metrics assessed for peg transfer, six of ten metrics for cutting, four of nine metrics for clipping, and three of ten metrics for adhesiolysis discriminated between experience levels. Time and motion path length were significant on all four tasks. We used the validated individual metrics to create summary equations for each task, which successfully distinguished between the different experience levels. Educators should maintain some skepticism when reviewing the plethora of metrics captured by computer-based simulators, as some but not all are valid. We showed the construct validity of a limited number of individual metrics and developed summary metrics for the LapVR. The summary metrics provide a succinct way of assessing skill with a single metric for each task, but require further validation.

Bridging the gap between computation and clinical biology: validation of cable theory in humans

PubMed Central

Finlay, Malcolm C.; Xu, Lei; Taggart, Peter; Hanson, Ben; Lambiase, Pier D.

2013-01-01

Introduction: Computerized simulations of cardiac activity have significantly contributed to our understanding of cardiac electrophysiology, but techniques of simulations based on patient-acquired data remain in their infancy. We sought to integrate data acquired from human electrophysiological studies into patient-specific models, and validated this approach by testing whether electrophysiological responses to sequential premature stimuli could be predicted in a quantitatively accurate manner. Methods: Eleven patients with structurally normal hearts underwent electrophysiological studies. Semi-automated analysis was used to reconstruct activation and repolarization dynamics for each electrode. This S2 extrastimuli data was used to inform individualized models of cardiac conduction, including a novel derivation of conduction velocity restitution. Activation dynamics of multiple premature extrastimuli were then predicted from this model and compared against measured patient data as well as data derived from the ten-Tusscher cell-ionic model. Results: Activation dynamics following a premature S3 were significantly different from those after an S2. Patient specific models demonstrated accurate prediction of the S3 activation wave, (Pearson's R2 = 0.90, median error 4%). Examination of the modeled conduction dynamics allowed inferences into the spatial dispersion of activation delay. Further validation was performed against data from the ten-Tusscher cell-ionic model, with our model accurately recapitulating predictions of repolarization times (R2 = 0.99). Conclusions: Simulations based on clinically acquired data can be used to successfully predict complex activation patterns following sequential extrastimuli. Such modeling techniques may be useful as a method of incorporation of clinical data into predictive models. PMID:24027527

TU-FG-209-11: Validation of a Channelized Hotelling Observer to Optimize Chest Radiography Image Processing for Nodule Detection: A Human Observer Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sanchez, A; Little, K; Chung, J

Purpose: To validate the use of a Channelized Hotelling Observer (CHO) model for guiding image processing parameter selection and enable improved nodule detection in digital chest radiography. Methods: In a previous study, an anthropomorphic chest phantom was imaged with and without PMMA simulated nodules using a GE Discovery XR656 digital radiography system. The impact of image processing parameters was then explored using a CHO with 10 Laguerre-Gauss channels. In this work, we validate the CHO’s trend in nodule detectability as a function of two processing parameters by conducting a signal-known-exactly, multi-reader-multi-case (MRMC) ROC observer study. Five naive readers scored confidencemore » of nodule visualization in 384 images with 50% nodule prevalence. The image backgrounds were regions-of-interest extracted from 6 normal patient scans, and the digitally inserted simulated nodules were obtained from phantom data in previous work. Each patient image was processed with both a near-optimal and a worst-case parameter combination, as determined by the CHO for nodule detection. The same 192 ROIs were used for each image processing method, with 32 randomly selected lung ROIs per patient image. Finally, the MRMC data was analyzed using the freely available iMRMC software of Gallas et al. Results: The image processing parameters which were optimized for the CHO led to a statistically significant improvement (p=0.049) in human observer AUC from 0.78 to 0.86, relative to the image processing implementation which produced the lowest CHO performance. Conclusion: Differences in user-selectable image processing methods on a commercially available digital radiography system were shown to have a marked impact on performance of human observers in the task of lung nodule detection. Further, the effect of processing on humans was similar to the effect on CHO performance. Future work will expand this study to include a wider range of detection/classification tasks and

An Inventory Battery to Predict Navy and Marine Corps Recruiter Performance: Development and Validation

DTIC Science & Technology

1979-05-01

Cross-Validation Strategies to Diferent Sections of the Predictor Batery ..................... 27 Personality Scales . . . . . . . . . . . . 0. . a...he generated several performance indices on the basis of assumptions about the recruiting environment and geographical differences in production

Reliability and validity of functional performance tests in dancers with hip dysfunction.

PubMed

Kivlan, Benjamin R; Carcia, Christopher R; Clemente, F Richard; Phelps, Amy L; Martin, Robroy L

2013-08-01

Quasi-experimental, repeated measures. Functional performance tests that identify hip joint impairments and assess the effect of intervention have not been adequately described for dancers. The purpose of this study was to examine the reliability and validity of hop and balance tests among a group of dancers with musculoskeletal pain in the hip region. NINETEEN FEMALE DANCERS (AGE: 18.90±1.11 years; height: 164.85±6.95 cm; weight: 60.37±8.29 kg) with unilateral hip pain were assessed utilizing the cross-over reach, medial triple hop, lateral triple hop, and cross-over hop tests on two occasions, 2 days apart. Test-retest reliability and comparisons between the involved and uninvolved side for each respective test were determined. Intra-class correlation coefficients for the functional performance tests ranged from 0.89-0.96. The cross-over reach test had a SEM of 2.79 cm and a MDC of 7.73 cm. The medial and lateral triple hop tests had SEM values of 7.51 cm and 8.17 cm, and MDC values of 20.81 cm and 22.62 cm, respectively. The SEM was 0.15 seconds and the MDC was 0.42 seconds for the cross-over hop test. Performance on the medial triple hop test was significantly less on the involved side (370.21±38.26 cm) compared to the uninvolved side (388.05±41.49 cm); t(18) = -4.33, p<0.01. The side-to-side comparisons of the cross-over reach test (involved mean=61.68±10.9 cm; uninvolved mean=61.69±8.63 cm); t(18) = -0.004, p=0.99, lateral triple hop test (involved mean=306.92±35.79 cm; uninvolved mean=310.68±24.49 cm); t(18) = -0.55, p=0.59, and cross-over hop test (involved mean=2.49±0.34 seconds; uninvolved mean= 2.61±0.42 seconds; t(18) = -1.84, p=0.08) were not statistically different between sides. The functional performance tests used in this study can be reliably performed on dancers with unilateral hip pain. The medial triple hop test was the only functional performance test with evidence of validity in side-to-side comparisons. These results suggest that

RELIABILITY AND VALIDITY OF FUNCTIONAL PERFORMANCE TESTS IN DANCERS WITH HIP DYSFUNCTION

PubMed Central

Carcia, Christopher R.; Clemente, F. Richard; Phelps, Amy L.; Martin, RobRoy L.

2013-01-01

Study Design: Quasi-experimental, repeated measures. Purpose/Background: Functional performance tests that identify hip joint impairments and assess the effect of intervention have not been adequately described for dancers. The purpose of this study was to examine the reliability and validity of hop and balance tests among a group of dancers with musculoskeletal pain in the hip region. Methods: Nineteen female dancers (age: 18.90±1.11 years; height: 164.85±6.95 cm; weight: 60.37±8.29 kg) with unilateral hip pain were assessed utilizing the cross-over reach, medial triple hop, lateral triple hop, and cross-over hop tests on two occasions, 2 days apart. Test-retest reliability and comparisons between the involved and uninvolved side for each respective test were determined. Results: Intra-class correlation coefficients for the functional performance tests ranged from 0.89-0.96. The cross-over reach test had a SEM of 2.79 cm and a MDC of 7.73 cm. The medial and lateral triple hop tests had SEM values of 7.51 cm and 8.17 cm, and MDC values of 20.81 cm and 22.62 cm, respectively. The SEM was 0.15 seconds and the MDC was 0.42 seconds for the cross-over hop test. Performance on the medial triple hop test was significantly less on the involved side (370.21±38.26 cm) compared to the uninvolved side (388.05±41.49 cm); t(18) = −4.33, p<0.01. The side-to-side comparisons of the cross-over reach test (involved mean=61.68±10.9 cm; uninvolved mean=61.69±8.63 cm); t(18) = −0.004, p=0.99, lateral triple hop test (involved mean=306.92±35.79 cm; uninvolved mean=310.68±24.49 cm); t(18) = −0.55, p=0.59, and cross-over hop test (involved mean=2.49±0.34 seconds; uninvolved mean= 2.61±0.42 seconds; t(18) = −1.84, p=0.08) were not statistically different between sides. Conclusion: The functional performance tests used in this study can be reliably performed on dancers with unilateral hip pain. The medial triple hop test was the only functional performance test with

Stanford/NASA-Ames Center of Excellence in model-based human performance

NASA Technical Reports Server (NTRS)

Wandell, Brian A.

1990-01-01

The human operator plays a critical role in many aeronautic and astronautic missions. The Stanford/NASA-Ames Center of Excellence in Model-Based Human Performance (COE) was initiated in 1985 to further our understanding of the performance capabilities and performance limits of the human component of aeronautic and astronautic projects. Support from the COE is devoted to those areas of experimental and theoretical work designed to summarize and explain human performance by developing computable performance models. The ultimate goal is to make these computable models available to other scientists for use in design and evaluation of aeronautic and astronautic instrumentation. Within vision science, two topics have received particular attention. First, researchers did extensive work analyzing the human ability to recognize object color relatively independent of the spectral power distribution of the ambient lighting (color constancy). The COE has supported a number of research papers in this area, as well as the development of a substantial data base of surface reflectance functions, ambient illumination functions, and an associated software package for rendering and analyzing image data with respect to these spectral functions. Second, the COE supported new empirical studies on the problem of selecting colors for visual display equipment to enhance human performance in discrimination and recognition tasks.

A validation framework for brain tumor segmentation.

PubMed

Archip, Neculai; Jolesz, Ferenc A; Warfield, Simon K

2007-10-01

We introduce a validation framework for the segmentation of brain tumors from magnetic resonance (MR) images. A novel unsupervised semiautomatic brain tumor segmentation algorithm is also presented. The proposed framework consists of 1) T1-weighted MR images of patients with brain tumors, 2) segmentation of brain tumors performed by four independent experts, 3) segmentation of brain tumors generated by a semiautomatic algorithm, and 4) a software tool that estimates the performance of segmentation algorithms. We demonstrate the validation of the novel segmentation algorithm within the proposed framework. We show its performance and compare it with existent segmentation. The image datasets and software are available at http://www.brain-tumor-repository.org/. We present an Internet resource that provides access to MR brain tumor image data and segmentation that can be openly used by the research community. Its purpose is to encourage the development and evaluation of segmentation methods by providing raw test and image data, human expert segmentation results, and methods for comparing segmentation results.

Determination of a novel nonfluorinated quinolone, nemonoxacin, in human feces and its glucuronide conjugate in human urine and feces by high-performance liquid chromatography-triple quadrupole mass spectrometry.

PubMed

He, Gaoli; Guo, Beining; Yu, Jicheng; Zhang, Jing; Wu, Xiaojie; Cao, Guoying; Shi, Yaoguo; Tsai, Cheng-Yuan

2015-05-01

Three methods were developed and validated for determination of nemonoxacin in human feces and its major metabolite, nemonoxacin acyl-β- d-glucuronide, in human urine and feces. Nemonoxacin was extracted by liquid-liquid extraction in feces homogenate samples and nemonoxacin acyl-β- d-glucuronide by a solid-phase extraction procedure for pretreatment of both urine and feces homogenate sample. Separation was performed on a C18 reversed-phase column under isocratic elution with the mobile phase consisting of acetonitrile and 0.1% formic acid. Both analytes were determined by liquid chromatography-tandem mass spectrometry with positive electrospray ionization in selected reaction monitoring mode and gatifloxacin as the internal standard. The lower limit of quantitation (LLOQ) of nemonoxacin in feces was 0.12 µg/g and the calibration curve was linear in the concentration range of 0.12-48.00 µg/g. The LLOQ of the metabolite was 0.0010 µg/mL and 0.03 µg/g in urine and feces matrices, while the linear range was 0.0010-0.2000 µg/mL and 0.03-3.00 µg/g, respectively. Validation included selectivity, accuracy, precision, linearity, recovery, matrix effect, carryover, dilution integrity and stability, indicating that the methods can quantify the corresponding analytes with excellent reliability. The validated methods were successfully applied to an absolute bioavailability clinical study of nemonoxacin malate capsule. Copyright © 2014 John Wiley & Sons, Ltd.

Reproducibility, Reliability, and Validity of Fuchsin-Based Beads for the Evaluation of Masticatory Performance.

PubMed

Sánchez-Ayala, Alfonso; Farias-Neto, Arcelino; Vilanova, Larissa Soares Reis; Costa, Marina Abrantes; Paiva, Ana Clara Soares; Carreiro, Adriana da Fonte Porto; Mestriner-Junior, Wilson

2016-08-01

Rehabilitation of masticatory function is inherent to prosthodontics; however, despite the various techniques for evaluating oral comminution, the methodological suitability of these has not been completely studied. The aim of this study was to determine the reproducibility, reliability, and validity of a test food based on fuchsin beads for masticatory function assessment. Masticatory performance was evaluated in 20 dentate subjects (mean age, 23.3 years) using two kinds of test foods and methods: fuchsin beads and ultraviolet-visible spectrophotometry, and silicone cubes and multiple sieving as gold standard. Three examiners conducted five masticatory performance trials with each test food. Reproducibility of the results from both test foods was separately assessed using the intraclass correlation coefficient (ICC). Reliability and validity of fuchsin bead data were measured by comparing the average mean of absolute differences and the measurement means, respectively, regarding silicone cube data using the paired Student's t-test (α = 0.05). Intraexaminer and interexaminer ICC for the fuchsin bead values were 0.65 and 0.76 (p < 0.001), respectively; those for the silicone cubes values were 0.93 and 0.91 (p < 0.001), respectively. Reliability revealed intraexaminer (p < 0.001) and interexaminer (p < 0.05) differences between the average means of absolute differences of each test foods. Validity also showed differences between the measurement means of each test food (p < 0.001). Intra- and interexaminer reproducibility of the test food based on fuchsin beads for evaluation of masticatory performance were good and excellent, respectively; however, the reliability and validity were low, because fuchsin beads do not measure the grinding capacity of masticatory function as silicone cubes do; instead, this test food describes the crushing potential of teeth. Thus, the two kinds of test foods evaluate different properties of masticatory capacity, confirming fushsin

Automated Essay Scoring versus Human Scoring: A Correlational Study

ERIC Educational Resources Information Center

Wang, Jinhao; Brown, Michelle Stallone

2008-01-01

The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance.…

Validation of a CD1b tetramer assay for studies of human mycobacterial infection or vaccination.

PubMed

Layton, Erik D; Yu, Krystle K Q; Smith, Malisa T; Scriba, Thomas J; De Rosa, Stephen C; Seshadri, Chetan

2018-07-01

CD1 tetramers loaded with lipid antigens facilitate the identification of rare lipid-antigen specific T cells present in human blood and tissue. Because CD1 proteins are structurally non-polymorphic, these tetramers can be applied to genetically diverse human populations, unlike MHC-I and MHC-II tetramers. However, there are no standardized assays to quantify and characterize lipid antigen-specific T cells present within clinical samples. We incorporated CD1b tetramers loaded with the mycobacterial lipid glucose monomycolate (GMM) into a multi-parameter flow cytometry assay. Using a GMM-specific T-cell line, we demonstrate that the assay is linear, reproducible, repeatable, precise, accurate, and has a limit of detection of approximately 0.007%. Having formally validated this assay, we performed a cross-sectional study of healthy U.S. controls and South African adolescents with and without latent tuberculosis infection (LTBI). We show that GMM-specific T cells are specifically detected in South African subjects with LTBI and not in U.S. healthy controls. This assay can be expanded to include additional tetramers or phenotypic markers to characterize GMM-specific T cells in studies of mycobacterial infection, disease, or vaccination. Copyright © 2018 Elsevier B.V. All rights reserved.

Development, construct validity and test-retest reliability of a field-based wheelchair mobility performance test for wheelchair basketball.

PubMed

de Witte, Annemarie M H; Hoozemans, Marco J M; Berger, Monique A M; van der Slikke, Rienk M A; van der Woude, Lucas H V; Veeger, Dirkjan H E J

2018-01-01

The aim of this study was to develop and describe a wheelchair mobility performance test in wheelchair basketball and to assess its construct validity and reliability. To mimic mobility performance of wheelchair basketball matches in a standardised manner, a test was designed based on observation of wheelchair basketball matches and expert judgement. Forty-six players performed the test to determine its validity and 23 players performed the test twice for reliability. Independent-samples t-tests were used to assess whether the times needed to complete the test were different for classifications, playing standards and sex. Intraclass correlation coefficients (ICC) were calculated to quantify reliability of performance times. Males performed better than females (P < 0.001, effect size [ES] = -1.26) and international men performed better than national men (P < 0.001, ES = -1.62). Performance time of low (≤2.5) and high (≥3.0) classification players was borderline not significant with a moderate ES (P = 0.06, ES = 0.58). The reliability was excellent for overall performance time (ICC = 0.95). These results show that the test can be used as a standardised mobility performance test to validly and reliably assess the capacity in mobility performance of elite wheelchair basketball athletes. Furthermore, the described methodology of development is recommended for use in other sports to develop sport-specific tests.

Validating Human Behavioral Models for Combat Simulations Using Techniques for the Evaluation of Human Performance

DTIC Science & Technology

2004-01-01

Cognitive Task Analysis Abstract As Department of Defense (DoD) leaders rely more on modeling and simulation to provide information on which to base...capabilities and intent. Cognitive Task Analysis (CTA) Cognitive Task Analysis (CTA) is an extensive/detailed look at tasks and subtasks performed by a...Domain Analysis and Task Analysis: A Difference That Matters. In Cognitive Task Analysis , edited by J. M. Schraagen, S.

Validating the Use of pPerformance Risk Indices for System-Level Risk and Maturity Assessments

NASA Astrophysics Data System (ADS)

Holloman, Sherrica S.

With pressure on the U.S. Defense Acquisition System (DAS) to reduce cost overruns and schedule delays, system engineers' performance is only as good as their tools. Recent literature details a need for 1) objective, analytical risk quantification methodologies over traditional subjective qualitative methods -- such as, expert judgment, and 2) mathematically rigorous system-level maturity assessments. The Mahafza, Componation, and Tippett (2005) Technology Performance Risk Index (TPRI) ties the assessment of technical performance to the quantification of risk of unmet performance; however, it is structured for component- level data as input. This study's aim is to establish a modified TPRI with systems-level data as model input, and then validate the modified index with actual system-level data from the Department of Defense's (DoD) Major Defense Acquisition Programs (MDAPs). This work's contribution is the establishment and validation of the System-level Performance Risk Index (SPRI). With the introduction of the SPRI, system-level metrics are better aligned, allowing for better assessment, tradeoff and balance of time, performance and cost constraints. This will allow system engineers and program managers to ultimately make better-informed system-level technical decisions throughout the development phase.

Ketones and Human Performance.

PubMed

Scott, Jonathan M; Deuster, Patricia A

Everyone is seeking nutritional strategies that might benefit performance. One approach receiving much attention is ketones, or ketosis. Ketones are very simple compounds made of hydrogen, carbon, and oxygen, and ketosis is a metabolic state whereby the body uses predominantly ketones. Ketosis can be achieved by fasting for longer than 72 hours or by following a very lowcarbohydrate, high-fat diet (ketogenic diet) for several days to weeks. Alternatively, ketone supplements purportedly induce ketosis rapidly and do not require strict adherence to any specific type of diet; however, much of the touted benefits are anecdotal. A potential role for ketosis as a performance enhancer was first introduced in 1983 with the idea that chronic ketosis without caloric restriction could preserve submaximal exercise capability by sparing glycogen or conserving the limited carbohydrate stores. Few human studies on the effects of a ketogenic diet on performance have yielded positive results, and most studies have yielded equivocal or null results, and a few negative results. Many questions about ketones relevant to Special Operations Forces (SOF) remain unanswered. At present, a ketogenic diet and/or a ketone supplement do not appear confer performance benefits for SOF. Instead, Operators should engage with their unit dietitian to develop individualized nutritional strategies based on unique mission requirements. The authors review the concept of a ketogenic diet, describe some potential benefits and risks of ketosis, review the performance literature and how to measure ketone status, and then summarize the landscape in 2017. 2017.

Validation study of human figure drawing test in a Colombian school children population.

PubMed

Vélez van Meerbeke, Alberto; Sandoval-Garcia, Carolina; Ibáñez, Milciades; Talero-Gutiérrez, Claudia; Fiallo, Dolly; Halliday, Karen

2011-05-01

The aim of this article was to assess the validity of the emotional and developmental components of the Koppitz human figure drawing test. 2420 children's drawings available in a database resulting from a previous cross sectional study designed to determine the prevalence of neurological diseases in children between 0 and 12 years old in Bogota schools were evaluated. They were scored using the criteria proposed by Koppitz, and classified into 16 groups according to age, gender, and presence/absence of learning or attention problems. The overall results were then compared with the normative study to assess whether descriptive parameters of the two populations were significantly different. There were no significant differences associated with presence/absence of learning and attention disorders or school attended within the overall sample. An Interrater reliability test has been made to assure the homogeneity of scoring by the evaluator team. There were significant differences between this population and that of the original study. New scoring tables contextualized for our population based on the frequency of appearance in this sample are presented. We can conclude that various ethnic, social, and cultural factors can influence the way children draw the human figure. It is thus important to establish local reference values to adequately distinguish between normality and abnormality. The new scoring tables proposed here should be followed up with a clinical study to corroborate their validity.

Predictive performance models and multiple task performance

NASA Technical Reports Server (NTRS)

Wickens, Christopher D.; Larish, Inge; Contorer, Aaron

1989-01-01

Five models that predict how performance of multiple tasks will interact in complex task scenarios are discussed. The models are shown in terms of the assumptions they make about human operator divided attention. The different assumptions about attention are then empirically validated in a multitask helicopter flight simulation. It is concluded from this simulation that the most important assumption relates to the coding of demand level of different component tasks.

Minimizing Human Risk: Human Performance Models in the Human Factors and Behavioral Performance Element

NASA Technical Reports Server (NTRS)

Gore, Brian F.

2017-01-01

Human space exploration has never been more exciting than it is today. Human presence to outer worlds is becoming a reality as humans are leveraging much of our prior knowledge to the new mission of going to Mars. Exploring the solar system at greater distances from Earth than ever before will possess some unique challenges, which can be overcome thanks to the advances in modeling and simulation technologies. The National Aeronautics and Space Administration (NASA) is at the forefront of exploring our solar system. NASA's Human Research Program (HRP) focuses on discovering the best methods and technologies that support safe and productive human space travel in the extreme and harsh space environment. HRP uses various methods and approaches to answer questions about the impact of long duration missions on the human in space including: gravitys impact on the human body, isolation and confinement on the human, hostile environments impact on the human, space radiation, and how the distance is likely to impact the human. Predictive models are included in the HRP research portfolio as these models provide valuable insights into human-system operations. This paper will provide an overview of NASA's HRP and will present a number of projects that have used modeling and simulation to provide insights into human-system issues (e.g. automation, habitat design, schedules) in anticipation of space exploration.

Aircraft Wake Vortex Spacing System (AVOSS) Performance Update and Validation Study

NASA Technical Reports Server (NTRS)

Rutishauser, David K.; OConnor, Cornelius J.

2001-01-01

An analysis has been performed on data generated from the two most recent field deployments of the Aircraft Wake VOrtex Spacing System (AVOSS). The AVOSS provides reduced aircraft spacing criteria for wake vortex avoidance as compared to the FAA spacing applied under Instrument Flight Rules (IFR). Several field deployments culminating in a system demonstration at Dallas Fort Worth (DFW) International Airport in the summer of 2000 were successful in showing a sound operational concept and the system's potential to provide a significant benefit to airport operations. For DFW, a predicted average throughput increase of 6% was observed. This increase implies 6 or 7 more aircraft on the ground in a one-hour period for DFW operations. Several studies of performance correlations to system configuration options, design options, and system inputs are also reported. The studies focus on the validation performance of the system.

Development and validation of a reversed-phase fluorescence HPLC method for determination of bucillamine in human plasma using pre-column derivatization with monobromobimane.

PubMed

Lee, Kang Choon; Chun, Young Goo; Kim, Insoo; Shin, Beom Soo; Park, Eun-Seok; Yoo, Sun Dong; Youn, Yu Seok

2009-07-15

A simple, specific and sensitive derivatization with monobromobimane (mBrB) and the corresponding HPLC-fluorescence quantitation method for the analysis of bucillamine in human plasma was developed and validated. The analytical procedure involves a simple protein precipitation, pre-column fluorescence derivatization, and separation by reversed-phase high performance liquid chromatography (RP-HPLC). The calibration curve showed good linearity over a wide concentration range (50 ng/mL to 10 microg/mL) in human plasma (r(2)=0.9998). The lower limit of quantitation (LLOQ) was 50 ng/mL. The average precision and accuracy at LLOQ were within 6.3% and 107.6%, respectively. This method was successfully applied to a pharmacokinetic study after oral administration of a dose (300 mg) of bucillamine to 20 healthy Korean volunteers.

Generation and validation of PAX7 reporter lines from human iPS cells using CRISPR/Cas9 technology.

PubMed

Wu, Jianbo; Hunt, Samuel D; Xue, Haipeng; Liu, Ying; Darabi, Radbod

2016-03-01

Directed differentiation of iPS cells toward various tissue progenitors has been the focus of recent research. Therefore, generation of tissue-specific reporter iPS cell lines provides better understanding of developmental stages in iPS cells. This technical report describes an efficient strategy for generation and validation of knock-in reporter lines in human iPS cells using the Cas9-nickase system. Here, we have generated a knock-in human iPS cell line for the early myogenic lineage specification gene of PAX7. By introduction of site-specific double-stranded breaks (DSB) in the genomic locus of PAX7 using CRISPR/Cas9 nickase pairs, a 2A-GFP reporter with selection markers has been incorporated before the stop codon of the PAX7 gene at the last exon. After positive and negative selection, single cell-derived human iPS clones have been isolated and sequenced for in-frame positioning of the reporter construct. Finally, by using a nuclease-dead Cas9 activator (dCas9-VP160) system, the promoter region of PAX7 has been targeted for transient gene induction to validate the GFP reporter activity. This was confirmed by flow cytometry analysis and immunostaining for PAX7 and GFP. This technical report provides a practical guideline for generation and validation of knock-in reporters using CRISPR/Cas9 system. Published by Elsevier B.V.

Development and validation of a ultra high performance liquid chromatography-tandem mass spectrometric method for the direct detection of formoterol in human urine.

PubMed

Sardela, V F; Deventer, K; Pereira, H M G; de Aquino Neto, F R; Van Eenoo, P

2012-11-01

Formoterol is a long acting β(2)-agonist and has proven to be a very effective bronchodilating agent. Hence it is frequently applied therapeutically for the treatment of asthma. Because β(2)-agonists might be misused in sports for the stimulatory effects and for growth-promoting action their use is restricted. Since January 2012, formoterol is prohibited in urinary concentrations higher than 30 ng/mL. The objective of this study was to develop and validate a simple and robust ultra high performance liquid chromatographic-tandem mass spectrometric (UHPLC-MS/MS) method for the direct quantification of formoterol in urine. Sample preparation was limited to an enzymatic hydrolysis step after which 2 μL was injected in the chromatographic system. Chromatography was performed on a C(8)-column using gradient conditions. The mobile phase consisted of water/methanol (H(2)O/MeOH) both containing 0.1% acetic acid (HOAc) and 1mM ammonium acetate (NH(4)OAc). Calibration curve were constructed between 15 and 60 ng/mL. Validation data showed bias of 1.3% and imprecision of 5.4% at the threshold. Ion suppression/enhancement never exceeded 7%. Calculating measurement uncertainty showed proof of applicability of the method. Stability of formoterol was also investigated at 56 °C (accelerated stability test) at pH 1.0/5.2/7.0 and 9.5. At the physiological pH values of 5.2 and 7.0, formoterol showed good stability. At pH 1.0 and 9.5 significant degradation was observed. Copyright © 2012 Elsevier B.V. All rights reserved.

Human Engineering Modeling and Performance Lab Study Project

NASA Technical Reports Server (NTRS)

Oliva-Buisson, Yvette J.

2014-01-01

The HEMAP (Human Engineering Modeling and Performance) Lab is a joint effort between the Industrial and Human Engineering group and the KAVE (Kennedy Advanced Visualiations Environment) group. The lab consists of sixteen camera system that is used to capture human motions and operational tasks, through te use of a Velcro suit equipped with sensors, and then simulate these tasks in an ergonomic software package know as Jac, The Jack software is able to identify the potential risk hazards.

CRYOSAT-2: POST Launch Performance of SIRAL-2 and its Calibration/validation

NASA Astrophysics Data System (ADS)

Cullen, Robert

1. INTRODUCTION The main payload of CryoSat-2 [1], SIRAL (Synthetic interferometric radar altimeter), is a Ku band pulse-width limited radar altimeter which transmits pulses at a high pulse repetition frequency thus making received echoes phase coherent and suitable for azimuth processing [2]. The azimuth processing in conjunction with correction for slant range improves along track resolution to about 250 meters which is a significant improvement over traditional pulse-width limited systems such as Envisat RA-2, [3]. CryoSat-2 will be launched on 25th February 2010 and this paper describes the pre and post launch measures of CryoSat/SIRAL performance and the status of mission validation planning. 2. SIRAL PERFORMANCE: INTERNAL AND EXTERNAL CALIBRATION Phase coherent pulse-width limited radar altimeters such as SIRAL-2 pose a new challenge when considering a strategy for calibration. Along with the need to generate the well under-stood corrections for transfer function amplitude with respect to frequency, gain and instrument path delay there is also a need to provide corrections for transfer function phase with respect to frequency and AGC setting, phase variation across bursts of pulses. Furthermore, since some components of these radars are temperature sensitive one needs to be careful when the decid-ing how often calibrations are performed whilst not impacting mission performance. Several internal calibration ground processors have been developed to model imperfections within the CryoSat-2 radar altimeter (SIRAL-2) hardware and reduce their effect from the science data stream via the use of calibration correction auxiliary products within the ground segment. We present the methods and results used to model and remove imperfections and describe the baseline for usage of SIRAL-2 calibration modes during the commissioning phase and the op-erational exploitation phases of the mission. Additionally we present early results derived from external calibration of SIRAL

MRM validation of targeted nonglycosylated peptides from N-glycoprotein biomarkers using direct trypsin digestion of undepleted human plasma.

PubMed

Lee, Ju Yeon; Kim, Jin Young; Cheon, Mi Hee; Park, Gun Wook; Ahn, Yeong Hee; Moon, Myeong Hee; Yoo, Jong Shin

2014-02-26

A rapid, simple, and reproducible MRM-based validation method for serological glycoprotein biomarkers in clinical use was developed by targeting the nonglycosylated tryptic peptides adjacent to N-glycosylation sites. Since changes in protein glycosylation are known to be associated with a variety of diseases, glycoproteins have been major targets in biomarker discovery. We previously found that nonglycosylated tryptic peptides adjacent to N-glycosylation sites differed in concentration between normal and hepatocellular carcinoma (HCC) plasma due to differences in steric hindrance of the glycan moiety in N-glycoproteins to tryptic digestion (Lee et al., 2011). To increase the feasibility and applicability of clinical validation of biomarker candidates (nonglycosylated tryptic peptides), we developed a method to effectively monitor nonglycosylated tryptic peptides from a large number of plasma samples and to reduce the total analysis time with maximizing the effect of steric hindrance by the glycans during digestion of glycoproteins. The AUC values of targeted nonglycosylated tryptic peptides were excellent (0.955 for GQYCYELDEK, 0.880 for FEDGVLDPDYPR and 0.907 for TEDTIFLR), indicating that these could be effective biomarkers for hepatocellular carcinoma. This method provides the necessary throughput required to validate glycoprotein biomarkers, as well as quantitative accuracy for human plasma analysis, and should be amenable to clinical use. Difficulties in verifying and validating putative protein biomarkers are often caused by complex sample preparation procedures required to determine their concentrations in a large number of plasma samples. To solve the difficulties, we developed MRM-based protein biomarker assays that greatly reduce complex, time-consuming, and less reproducible sample pretreatment steps in plasma for clinical implementation. First, we used undepleted human plasma samples without any enrichment procedures. Using nanoLC/MS/MS, we targeted

Social Performance Cues Induce Behavioral Flexibility in Humans

PubMed Central

Toelch, Ulf; Bruce, Matthew J.; Meeus, Marius T. H.; Reader, Simon M.

2011-01-01

Behavioral flexibility allows individuals to react to environmental changes, but changing established behavior carries costs, with unknown benefits. Individuals may thus modify their behavioral flexibility according to the prevailing circumstances. Social information provided by the performance level of others provides one possible cue to assess the potential benefits of changing behavior, since out-performance in similar circumstances indicates that novel behaviors (innovations) are potentially useful. We demonstrate that social performance cues, in the form of previous players’ scores in a problem-solving computer game, influence behavioral flexibility. Participants viewed only performance indicators, not the innovative behavior of others. While performance cues (high, low, or no scores) had little effect on innovation discovery rates, participants that viewed high scores increased their utilization of innovations, allowing them to exploit the virtual environment more effectively than players viewing low or no scores. Perceived conspecific performance can thus shape human decisions to adopt novel traits, even when the traits employed cannot be copied. This simple mechanism, social performance feedback, could be a driver of both the facultative adoption of innovations and cumulative cultural evolution, processes critical to human success. PMID:21811477

Supervised Machine Learning Algorithms Can Classify Open-Text Feedback of Doctor Performance With Human-Level Accuracy.

PubMed

Gibbons, Chris; Richards, Suzanne; Valderas, Jose Maria; Campbell, John

2017-03-15

Machine learning techniques may be an effective and efficient way to classify open-text reports on doctor's activity for the purposes of quality assurance, safety, and continuing professional development. The objective of the study was to evaluate the accuracy of machine learning algorithms trained to classify open-text reports of doctor performance and to assess the potential for classifications to identify significant differences in doctors' professional performance in the United Kingdom. We used 1636 open-text comments (34,283 words) relating to the performance of 548 doctors collected from a survey of clinicians' colleagues using the General Medical Council Colleague Questionnaire (GMC-CQ). We coded 77.75% (1272/1636) of the comments into 5 global themes (innovation, interpersonal skills, popularity, professionalism, and respect) using a qualitative framework. We trained 8 machine learning algorithms to classify comments and assessed their performance using several training samples. We evaluated doctor performance using the GMC-CQ and compared scores between doctors with different classifications using t tests. Individual algorithm performance was high (range F score=.68 to .83). Interrater agreement between the algorithms and the human coder was highest for codes relating to "popular" (recall=.97), "innovator" (recall=.98), and "respected" (recall=.87) codes and was lower for the "interpersonal" (recall=.80) and "professional" (recall=.82) codes. A 10-fold cross-validation demonstrated similar performance in each analysis. When combined together into an ensemble of multiple algorithms, mean human-computer interrater agreement was .88. Comments that were classified as "respected," "professional," and "interpersonal" related to higher doctor scores on the GMC-CQ compared with comments that were not classified (P<.05). Scores did not vary between doctors who were rated as popular or innovative and those who were not rated at all (P>.05). Machine learning

Supervised Machine Learning Algorithms Can Classify Open-Text Feedback of Doctor Performance With Human-Level Accuracy

PubMed Central

2017-01-01

Background Machine learning techniques may be an effective and efficient way to classify open-text reports on doctor’s activity for the purposes of quality assurance, safety, and continuing professional development. Objective The objective of the study was to evaluate the accuracy of machine learning algorithms trained to classify open-text reports of doctor performance and to assess the potential for classifications to identify significant differences in doctors’ professional performance in the United Kingdom. Methods We used 1636 open-text comments (34,283 words) relating to the performance of 548 doctors collected from a survey of clinicians’ colleagues using the General Medical Council Colleague Questionnaire (GMC-CQ). We coded 77.75% (1272/1636) of the comments into 5 global themes (innovation, interpersonal skills, popularity, professionalism, and respect) using a qualitative framework. We trained 8 machine learning algorithms to classify comments and assessed their performance using several training samples. We evaluated doctor performance using the GMC-CQ and compared scores between doctors with different classifications using t tests. Results Individual algorithm performance was high (range F score=.68 to .83). Interrater agreement between the algorithms and the human coder was highest for codes relating to “popular” (recall=.97), “innovator” (recall=.98), and “respected” (recall=.87) codes and was lower for the “interpersonal” (recall=.80) and “professional” (recall=.82) codes. A 10-fold cross-validation demonstrated similar performance in each analysis. When combined together into an ensemble of multiple algorithms, mean human-computer interrater agreement was .88. Comments that were classified as “respected,” “professional,” and “interpersonal” related to higher doctor scores on the GMC-CQ compared with comments that were not classified (P<.05). Scores did not vary between doctors who were rated as popular or

Reliability and validity of the test of incremental respiratory endurance measures of inspiratory muscle performance in COPD.

PubMed

Formiga, Magno F; Roach, Kathryn E; Vital, Isabel; Urdaneta, Gisel; Balestrini, Kira; Calderon-Candelario, Rafael A; Campos, Michael A; Cahalin, Lawrence P

2018-01-01

The Test of Incremental Respiratory Endurance (TIRE) provides a comprehensive assessment of inspiratory muscle performance by measuring maximal inspiratory pressure (MIP) over time. The integration of MIP over inspiratory duration (ID) provides the sustained maximal inspiratory pressure (SMIP). Evidence on the reliability and validity of these measurements in COPD is not currently available. Therefore, we assessed the reliability, responsiveness and construct validity of the TIRE measures of inspiratory muscle performance in subjects with COPD. Test-retest reliability, known-groups and convergent validity assessments were implemented simultaneously in 81 male subjects with mild to very severe COPD. TIRE measures were obtained using the portable PrO2 device, following standard guidelines. All TIRE measures were found to be highly reliable, with SMIP demonstrating the strongest test-retest reliability with a nearly perfect intraclass correlation coefficient (ICC) of 0.99, while MIP and ID clustered closely together behind SMIP with ICC values of about 0.97. Our findings also demonstrated known-groups validity of all TIRE measures, with SMIP and ID yielding larger effect sizes when compared to MIP in distinguishing between subjects of different COPD status. Finally, our analyses confirmed convergent validity for both SMIP and ID, but not MIP. The TIRE measures of MIP, SMIP and ID have excellent test-retest reliability and demonstrated known-groups validity in subjects with COPD. SMIP and ID also demonstrated evidence of moderate convergent validity and appear to be more stable measures in this patient population than the traditional MIP.

Validation of a Performance Assessment Instrument in Problem-Based Learning Tutorials Using Two Cohorts of Medical Students

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2016-01-01

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism.…

Development and validation of sensitive LC-MS/MS assays for quantification of HP-β-CD in human plasma and CSF.

PubMed

Jiang, Hui; Sidhu, Rohini; Fujiwara, Hideji; De Meulder, Marc; de Vries, Ronald; Gong, Yong; Kao, Mark; Porter, Forbes D; Yanjanin, Nicole M; Carillo-Carasco, Nuria; Xu, Xin; Ottinger, Elizabeth; Woolery, Myra; Ory, Daniel S; Jiang, Xuntian

2014-07-01

2-Hydroxypropyl-β-cyclodextrin (HP-β-CD), a widely used excipient for drug formulation, has emerged as an investigational new drug for the treatment of Niemann-Pick type C1 (NPC1) disease, a neurodegenerative cholesterol storage disorder. Development of a sensitive quantitative LC-MS/MS assay to monitor the pharmacokinetics (PKs) of HP-β-CD required for clinical trials has been challenging owing to the dispersity of the HP-β-CD. To support a phase 1 clinical trial for ICV delivery of HP-β-CD in NPC1 patients, novel methods for quantification of HP-β-CD in human plasma and cerebrospinal fluid (CSF) using LC-MS/MS were developed and validated: a 2D-LC-in-source fragmentation-MS/MS (2D-LC-IF-MS/MS) assay and a reversed phase ultra performance LC-MS/MS (RP-UPLC-MS/MS) assay. In both assays, protein precipitation and "dilute and shoot" procedures were used to process plasma and CSF, respectively. The assays were fully validated and in close agreement, and allowed determination of PK parameters for HP-β-CD. The LC-MS/MS methods are ∼100-fold more sensitive than the current HPLC assay, and were successfully employed to analyze HP-β-CD in human plasma and CSF samples to support the phase 1 clinical trial of HP-β-CD in NPC1 patients. Copyright © 2014 by the American Society for Biochemistry and Molecular Biology, Inc.

Validating a biometric authentication system: sample size requirements.

PubMed

Dass, Sarat C; Zhu, Yongfang; Jain, Anil K

2006-12-01

Authentication systems based on biometric features (e.g., fingerprint impressions, iris scans, human face images, etc.) are increasingly gaining widespread use and popularity. Often, vendors and owners of these commercial biometric systems claim impressive performance that is estimated based on some proprietary data. In such situations, there is a need to independently validate the claimed performance levels. System performance is typically evaluated by collecting biometric templates from n different subjects, and for convenience, acquiring multiple instances of the biometric for each of the n subjects. Very little work has been done in 1) constructing confidence regions based on the ROC curve for validating the claimed performance levels and 2) determining the required number of biometric samples needed to establish confidence regions of prespecified width for the ROC curve. To simplify the analysis that address these two problems, several previous studies have assumed that multiple acquisitions of the biometric entity are statistically independent. This assumption is too restrictive and is generally not valid. We have developed a validation technique based on multivariate copula models for correlated biometric acquisitions. Based on the same model, we also determine the minimum number of samples required to achieve confidence bands of desired width for the ROC curve. We illustrate the estimation of the confidence bands as well as the required number of biometric samples using a fingerprint matching system that is applied on samples collected from a small population.

Investigation of human-robot interface performance in household environments

NASA Astrophysics Data System (ADS)

Cremer, Sven; Mirza, Fahad; Tuladhar, Yathartha; Alonzo, Rommel; Hingeley, Anthony; Popa, Dan O.

2016-05-01

Today, assistive robots are being introduced into human environments at an increasing rate. Human environments are highly cluttered and dynamic, making it difficult to foresee all necessary capabilities and pre-program all desirable future skills of the robot. One approach to increase robot performance is semi-autonomous operation, allowing users to intervene and guide the robot through difficult tasks. To this end, robots need intuitive Human-Machine Interfaces (HMIs) that support fine motion control without overwhelming the operator. In this study we evaluate the performance of several interfaces that balance autonomy and teleoperation of a mobile manipulator for accomplishing several household tasks. Our proposed HMI framework includes teleoperation devices such as a tablet, as well as physical interfaces in the form of piezoresistive pressure sensor arrays. Mobile manipulation experiments were performed with a sensorized KUKA youBot, an omnidirectional platform with a 5 degrees of freedom (DOF) arm. The pick and place tasks involved navigation and manipulation of objects in household environments. Performance metrics included time for task completion and position accuracy.

The construct and criterion validity of the multi-source feedback process to assess physician performance: a meta-analysis

PubMed Central

Al Ansari, Ahmed; Donnon, Tyrone; Al Khalifa, Khalid; Darwish, Abdulla; Violato, Claudio

2014-01-01

Background The purpose of this study was to conduct a meta-analysis on the construct and criterion validity of multi-source feedback (MSF) to assess physicians and surgeons in practice. Methods In this study, we followed the guidelines for the reporting of observational studies included in a meta-analysis. In addition to PubMed and MEDLINE databases, the CINAHL, EMBASE, and PsycINFO databases were searched from January 1975 to November 2012. All articles listed in the references of the MSF studies were reviewed to ensure that all relevant publications were identified. All 35 articles were independently coded by two authors (AA, TD), and any discrepancies (eg, effect size calculations) were reviewed by the other authors (KA, AD, CV). Results Physician/surgeon performance measures from 35 studies were identified. A random-effects model of weighted mean effect size differences (d) resulted in: construct validity coefficients for the MSF system on physician/surgeon performance across different levels in practice ranged from d=0.14 (95% confidence interval [CI] 0.40–0.69) to d=1.78 (95% CI 1.20–2.30); construct validity coefficients for the MSF on physician/surgeon performance on two different occasions ranged from d=0.23 (95% CI 0.13–0.33) to d=0.90 (95% CI 0.74–1.10); concurrent validity coefficients for the MSF based on differences in assessor group ratings ranged from d=0.50 (95% CI 0.47–0.52) to d=0.57 (95% CI 0.55–0.60); and predictive validity coefficients for the MSF on physician/surgeon performance across different standardized measures ranged from d=1.28 (95% CI 1.16–1.41) to d=1.43 (95% CI 0.87–2.00). Conclusion The construct and criterion validity of the MSF system is supported by small to large effect size differences based on the MSF process and physician/surgeon performance across different clinical and nonclinical domain measures. PMID:24600300

Human performance cognitive-behavioral modeling: a benefit for occupational safety.

PubMed

Gore, Brian F

2002-01-01

Human Performance Modeling (HPM) is a computer-aided job analysis software methodology used to generate predictions of complex human-automation integration and system flow patterns with the goal of improving operator and system safety. The use of HPM tools has recently been increasing due to reductions in computational cost, augmentations in the tools' fidelity, and usefulness in the generated output. An examination of an Air Man-machine Integration Design and Analysis System (Air MIDAS) model evaluating complex human-automation integration currently underway at NASA Ames Research Center will highlight the importance to occupational safety of considering both cognitive and physical aspects of performance when researching human error.

Human performance cognitive-behavioral modeling: a benefit for occupational safety

NASA Technical Reports Server (NTRS)

Gore, Brian F.

2002-01-01

Human Performance Modeling (HPM) is a computer-aided job analysis software methodology used to generate predictions of complex human-automation integration and system flow patterns with the goal of improving operator and system safety. The use of HPM tools has recently been increasing due to reductions in computational cost, augmentations in the tools' fidelity, and usefulness in the generated output. An examination of an Air Man-machine Integration Design and Analysis System (Air MIDAS) model evaluating complex human-automation integration currently underway at NASA Ames Research Center will highlight the importance to occupational safety of considering both cognitive and physical aspects of performance when researching human error.

Human performance modeling for system of systems analytics :soldier fatigue.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lawton, Craig R.; Campbell, James E.; Miller, Dwight Peter

2005-10-01

The military has identified Human Performance Modeling (HPM) as a significant requirement and challenge of future systems modeling and analysis initiatives as can be seen in the Department of Defense's (DoD) Defense Modeling and Simulation Office's (DMSO) Master Plan (DoD 5000.59-P 1995). To this goal, the military is currently spending millions of dollars on programs devoted to HPM in various military contexts. Examples include the Human Performance Modeling Integration (HPMI) program within the Air Force Research Laboratory, which focuses on integrating HPMs with constructive models of systems (e.g. cockpit simulations) and the Navy's Human Performance Center (HPC) established in Septembermore » 2003. Nearly all of these initiatives focus on the interface between humans and a single system. This is insufficient in the era of highly complex network centric SoS. This report presents research and development in the area of HPM in a system-of-systems (SoS). Specifically, this report addresses modeling soldier fatigue and the potential impacts soldier fatigue can have on SoS performance.« less

Energy expenditure evaluation in humans and non-human primates by SenseWear Armband. Validation of energy expenditure evaluation by SenseWear Armband by direct comparison with indirect calorimetry.

PubMed

Casiraghi, Francesca; Lertwattanarak, Raweewan; Luzi, Livio; Chavez, Alberto O; Davalli, Alberto M; Naegelin, Terry; Comuzzie, Anthony G; Frost, Patricia; Musi, Nicolas; Folli, Franco

2013-01-01

The purpose of this study was to compare and validate the use of SenseWear Armband (SWA) placed on the arm (SWA ARM) and on the back (SWA BACK) in healthy humans during resting and a cycle-ergometer exercise and to evaluate the SWA to estimate Resting Energy Expenditure (REE) and Total Energy Expenditure (TEE) in healthy baboons. We studied 26 (15F/11M) human subjects wearing SWA in two different anatomical sites (arm and back) during resting and a cycle-ergometer test and directly compared these results with indirect calorimetry evaluation (IC), performed at the same time. We then inserted the SWA in a metabolic jacket for baboons and evaluated the TEE and REE in free living condition for 6 days in 21 (8F/13M) non-human primates. In humans we found a good correlation between SWA place on the ARM and on the BACK with IC during the resting experiment (1.1±0.3 SWAs, 1±0.2 IC kcal/min) and a slight underestimation in the SWAs data compared with IC during the cycle-ergometer exercise (5±1.9 SWA ARM, 4.5±1.5 SWA BACK and 5.4±2.1 IC kcal/min). In the non-human primate (baboons) experiment SWA estimated a TEE of 0.54±0.009 kcal/min during free living and a REE of 0.82±0.06 kcal/min. SWA, an extremely simple and inexpensive apparatus, provides quite accurate measurements of energy expenditure in humans and in baboons. Energy expenditure data obtained with SWA are highly correlated with the data obtained with "gold standard", IC, in humans.

Applied Chaos Level Test for Validation of Signal Conditions Underlying Optimal Performance of Voice Classification Methods.

PubMed

Liu, Boquan; Polce, Evan; Sprott, Julien C; Jiang, Jack J

2018-05-17

The purpose of this study is to introduce a chaos level test to evaluate linear and nonlinear voice type classification method performances under varying signal chaos conditions without subjective impression. Voice signals were constructed with differing degrees of noise to model signal chaos. Within each noise power, 100 Monte Carlo experiments were applied to analyze the output of jitter, shimmer, correlation dimension, and spectrum convergence ratio. The computational output of the 4 classifiers was then plotted against signal chaos level to investigate the performance of these acoustic analysis methods under varying degrees of signal chaos. A diffusive behavior detection-based chaos level test was used to investigate the performances of different voice classification methods. Voice signals were constructed by varying the signal-to-noise ratio to establish differing signal chaos conditions. Chaos level increased sigmoidally with increasing noise power. Jitter and shimmer performed optimally when the chaos level was less than or equal to 0.01, whereas correlation dimension was capable of analyzing signals with chaos levels of less than or equal to 0.0179. Spectrum convergence ratio demonstrated proficiency in analyzing voice signals with all chaos levels investigated in this study. The results of this study corroborate the performance relationships observed in previous studies and, therefore, demonstrate the validity of the validation test method. The presented chaos level validation test could be broadly utilized to evaluate acoustic analysis methods and establish the most appropriate methodology for objective voice analysis in clinical practice.

Reliability, validity and description of timed performance of the Jebsen-Taylor Test in patients with muscular dystrophies.

PubMed

Artilheiro, Mariana Cunha; Fávero, Francis Meire; Caromano, Fátima Aparecida; Oliveira, Acary de Souza Bulle; Carvas, Nelson; Voos, Mariana Callil; Sá, Cristina Dos Santos Cardoso de

2017-12-08

The Jebsen-Taylor Test evaluates upper limb function by measuring timed performance on everyday activities. The test is used to assess and monitor the progression of patients with Parkinson disease, cerebral palsy, stroke and brain injury. To analyze the reliability, internal consistency and validity of the Jebsen-Taylor Test in people with Muscular Dystrophy and to describe and classify upper limb timed performance of people with Muscular Dystrophy. Fifty patients with Muscular Dystrophy were assessed. Non-dominant and dominant upper limb performances on the Jebsen-Taylor Test were filmed. Two raters evaluated timed performance for inter-rater reliability analysis. Test-retest reliability was investigated by using intraclass correlation coefficients. Internal consistency was assessed using the Cronbach alpha. Construct validity was conducted by comparing the Jebsen-Taylor Test with the Performance of Upper Limb. The internal consistency of Jebsen-Taylor Test was good (Cronbach's α=0.98). A very high inter-rater reliability (0.903-0.999), except for writing with an Intraclass correlation coefficient of 0.772-1.000. Strong correlations between the Jebsen-Taylor Test and the Performance of Upper Limb Module were found (rho=-0.712). The Jebsen-Taylor Test is a reliable and valid measure of timed performance for people with Muscular Dystrophy. Copyright © 2017 Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia. Publicado por Elsevier Editora Ltda. All rights reserved.

NASA Human Health and Performance Center (NHHPC)

NASA Technical Reports Server (NTRS)

Davis, Jeffery R.

2010-01-01

This slide presentation reviews the purpose, potential members and participants of the NASA Human Health and Performance Center (NHHPC). Included in the overview is a brief description of the administration and current activities of the NHHPC.

What Do HPT Consultants Do for Performance Analysis?

ERIC Educational Resources Information Center

Kang, Sung

2017-01-01

This study was conducted to contribute to the field of Human Performance Technology (HPT) through the validation of the performance analysis process of the International Society for Performance Improvement (ISPI) HPT model, the most representative and frequently utilized process model in the HPT field. The study was conducted using content…

Valid and reliable authentic assessment of culminating student performance in the biomedical sciences.

PubMed

Oh, Deborah M; Kim, Joshua M; Garcia, Raymond E; Krilowicz, Beverly L

2005-06-01

There is increasing pressure, both from institutions central to the national scientific mission and from regional and national accrediting agencies, on natural sciences faculty to move beyond course examinations as measures of student performance and to instead develop and use reliable and valid authentic assessment measures for both individual courses and for degree-granting programs. We report here on a capstone course developed by two natural sciences departments, Biological Sciences and Chemistry/Biochemistry, which engages students in an important culminating experience, requiring synthesis of skills and knowledge developed throughout the program while providing the departments with important assessment information for use in program improvement. The student work products produced in the course, a written grant proposal, and an oral summary of the proposal, provide a rich source of data regarding student performance on an authentic assessment task. The validity and reliability of the instruments and the resulting student performance data were demonstrated by collaborative review by content experts and a variety of statistical measures of interrater reliability, including percentage agreement, intraclass correlations, and generalizability coefficients. The high interrater reliability reported when the assessment instruments were used for the first time by a group of external evaluators suggests that the assessment process and instruments reported here will be easily adopted by other natural science faculty.

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

PubMed

Nadkarni, Lindsay D; Roskind, Cindy G; Auerbach, Marc A; Calhoun, Aaron W; Adler, Mark D; Kessler, David O

2018-04-01

The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Validity of linear encoder measurement of sit-to-stand performance power in older people.

PubMed

Lindemann, U; Farahmand, P; Klenk, J; Blatzonis, K; Becker, C

2015-09-01

To investigate construct validity of linear encoder measurement of sit-to-stand performance power in older people by showing associations with relevant functional performance and physiological parameters. Cross-sectional study. Movement laboratory of a geriatric rehabilitation clinic. Eighty-eight community-dwelling, cognitively unimpaired older women (mean age 78 years). Sit-to-stand performance power and leg power were assessed using a linear encoder and the Nottingham Power Rig, respectively. Gait speed was measured on an instrumented walkway. Maximum quadriceps and hand grip strength were assessed using dynamometers. Mid-thigh muscle cross-sectional area of both legs was measured using magnetic resonance imaging. Associations of sit-to-stand performance power with power assessed by the Nottingham Power Rig, maximum gait speed and muscle cross-sectional area were r=0.646, r=0.536 and r=0.514, respectively. A linear regression model explained 50% of the variance in sit-to-stand performance power including muscle cross-sectional area (p=0.001), maximum gait speed (p=0.002), and power assessed by the Nottingham Power Rig (p=0.006). Construct validity of linear encoder measurement of sit-to-stand power was shown at functional level and morphological level for older women. This measure could be used in routine clinical practice as well as in large-scale studies. DRKS00003622. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

ICP-MS/MS-Based Ionomics: A Validated Methodology to Investigate the Biological Variability of the Human Ionome.

PubMed

Konz, Tobias; Migliavacca, Eugenia; Dayon, Loïc; Bowman, Gene; Oikonomidi, Aikaterini; Popp, Julius; Rezzi, Serge

2017-05-05

We here describe the development, validation and application of a quantitative methodology for the simultaneous determination of 29 elements in human serum using state-of-the-art inductively coupled plasma triple quadrupole mass spectrometry (ICP-MS/MS). This new methodology offers high-throughput elemental profiling using simple dilution of minimal quantity of serum samples. We report the outcomes of the validation procedure including limits of detection/quantification, linearity of calibration curves, precision, recovery and measurement uncertainty. ICP-MS/MS-based ionomics was used to analyze human serum of 120 older adults. Following a metabolomic data mining approach, the generated ionome profiles were subjected to principal component analysis revealing gender and age-specific differences. The ionome of female individuals was marked by higher levels of calcium, phosphorus, copper and copper to zinc ratio, while iron concentration was lower with respect to male subjects. Age was associated with lower concentrations of zinc. These findings were complemented with additional readouts to interpret micronutrient status including ceruloplasmin, ferritin and inorganic phosphate. Our data supports a gender-specific compartmentalization of the ionome that may reflect different bone remodelling in female individuals. Our ICP-MS/MS methodology enriches the panel of validated "Omics" approaches to study molecular relationships between the exposome and the ionome in relation with nutrition and health.

Human resource management and performance in healthcare organisations.

PubMed

Harris, Claire; Cortvriend, Penny; Hyde, Paula

2007-01-01

The purpose of this paper is to compare the evidence from a range of reviews concerned with the links between human resource management (HRM) and performance. The aim of the paper is to review this diverse literature, and to derive human resource (HR) implications for healthcare researchers, policy makers and managers. Recent reviews of the human resource management and performance literature are examined, in addition to the inclusion of a previously unpublished review. Their methods, HRM focus, findings and recommendations are contrasted in order to produce this review. The paper finds that relationships have been found between a range of HRM practices, policies systems and performance. Despite being an important concern for HR professionals, there is little research exploring the link between HRM and performance in the health sector. The paper sees that recent studies have found HRM practices to be associated with patient outcomes such as mortality, yet they yield little information regarding the processes through which HRM affects individual performance and its consequent impact on patient care. The use of approaches that seek to gain an understanding of workers' interpretations of their experience, i.e. the psychological process through which HRM can affect individual performance, may shed some light on how these processes work in practice. The paper shows that increasing autonomy for healthcare organisations in the UK, i.e. Foundation Trusts, may offer increased opportunity for locally tailored HR systems and practices. The paper presents findings drawn from a review of previous research on a subject of increasing relevance to HR researchers and practitioners in healthcare organisations. The paper indicates alternative approaches to research and practice in light of extant research.

Reliability and validity of an accele-rometric system for assessing vertical jumping performance.

PubMed

Choukou, M-A; Laffaye, G; Taiar, R

2014-03-01

The validity of an accelerometric system (Myotest©) for assessing vertical jump height, vertical force and power, leg stiffness and reactivity index was examined. 20 healthy males performed 3×"5 hops in place", 3×"1 squat jump" and 3× "1 countermovement jump" during 2 test-retest sessions. The variables were simultaneously assessed using an accelerometer and a force platform at a frequency of 0.5 and 1 kHz, respectively. Both reliability and validity of the accelerometric system were studied. No significant differences between test and retest data were found (p < 0.05), showing a high level of reliability. Besides, moderate to high intraclass correlation coefficients (ICCs) (from 0.74 to 0.96) were obtained for all variables whereas weak to moderate ICCs (from 0.29 to 0.79) were obtained for force and power during the countermovement jump. With regards to validity, the difference between the two devices was not significant for 5 hops in place height (1.8 cm), force during squat (-1.4 N · kg(-1)) and countermovement (0.1 N · kg(-1)) jumps, leg stiffness (7.8 kN · m(-1)) and reactivity index (0.4). So, the measurements of these variables with this accelerometer are valid, which is not the case for the other variables. The main causes of non-validity for velocity, power and contact time assessment are temporal biases of the takeoff and touchdown moments detection.

Toward Realism in Human Performance Simulation

DTIC Science & Technology

2004-01-01

toward the development of improved human-like performance of synthetic agents. However, several serious problems continue to challenge researchers and... developers . Developers have insufficient behavioral knowledge. To date, models of emotivity and behavior that have been commercialized still tend...Bindiganavale, 1999). There has even been significant development of architectures to produce animated characters that react appropriately to a small

Validating and Verifying Biomathematical Models of Human Fatigue

NASA Technical Reports Server (NTRS)

Martinez, Siera Brooke; Quintero, Luis Ortiz; Flynn-Evans, Erin

2015-01-01

Airline pilots experience acute and chronic sleep deprivation, sleep inertia, and circadian desynchrony due to the need to schedule flight operations around the clock. This sleep loss and circadian desynchrony gives rise to cognitive impairments, reduced vigilance and inconsistent performance. Several biomathematical models, based principally on patterns observed in circadian rhythms and homeostatic drive, have been developed to predict a pilots levels of fatigue or alertness. These models allow for the Federal Aviation Administration (FAA) and commercial airlines to make decisions about pilot capabilities and flight schedules. Although these models have been validated in a laboratory setting, they have not been thoroughly tested in operational environments where uncontrolled factors, such as environmental sleep disrupters, caffeine use and napping, may impact actual pilot alertness and performance. We will compare the predictions of three prominent biomathematical fatigue models (McCauley Model, Harvard Model, and the privately-sold SAFTE-FAST Model) to actual measures of alertness and performance. We collected sleep logs, movement and light recordings, psychomotor vigilance task (PVT), and urinary melatonin (a marker of circadian phase) from 44 pilots in a short-haul commercial airline over one month. We will statistically compare with the model predictions to lapses on the PVT and circadian phase. We will calculate the sensitivity and specificity of each model prediction under different scheduling conditions. Our findings will aid operational decision-makers in determining the reliability of each model under real-world scheduling situations.

Reliability and validity of the test of incremental respiratory endurance measures of inspiratory muscle performance in COPD

PubMed Central

Formiga, Magno F; Roach, Kathryn E; Vital, Isabel; Urdaneta, Gisel; Balestrini, Kira; Calderon-Candelario, Rafael A

2018-01-01

Purpose The Test of Incremental Respiratory Endurance (TIRE) provides a comprehensive assessment of inspiratory muscle performance by measuring maximal inspiratory pressure (MIP) over time. The integration of MIP over inspiratory duration (ID) provides the sustained maximal inspiratory pressure (SMIP). Evidence on the reliability and validity of these measurements in COPD is not currently available. Therefore, we assessed the reliability, responsiveness and construct validity of the TIRE measures of inspiratory muscle performance in subjects with COPD. Patients and methods Test–retest reliability, known-groups and convergent validity assessments were implemented simultaneously in 81 male subjects with mild to very severe COPD. TIRE measures were obtained using the portable PrO2 device, following standard guidelines. Results All TIRE measures were found to be highly reliable, with SMIP demonstrating the strongest test–retest reliability with a nearly perfect intraclass correlation coefficient (ICC) of 0.99, while MIP and ID clustered closely together behind SMIP with ICC values of about 0.97. Our findings also demonstrated known-groups validity of all TIRE measures, with SMIP and ID yielding larger effect sizes when compared to MIP in distinguishing between subjects of different COPD status. Finally, our analyses confirmed convergent validity for both SMIP and ID, but not MIP. Conclusion The TIRE measures of MIP, SMIP and ID have excellent test–retest reliability and demonstrated known-groups validity in subjects with COPD. SMIP and ID also demonstrated evidence of moderate convergent validity and appear to be more stable measures in this patient population than the traditional MIP. PMID:29805255

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation

PubMed Central

Chen, Quan; Tsai, Sang-Bing; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-01

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees’ low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees’ job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice. PMID:29301375

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation.

PubMed

Chen, Quan; Tsai, Sang-Bing; Zhai, Yuming; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-03

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees' low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees' job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice.

Development and validation of age-dependent FE human models of a mid-sized male thorax.

PubMed

El-Jawahri, Raed E; Laituri, Tony R; Ruan, Jesse S; Rouhana, Stephen W; Barbat, Saeed D

2010-11-01

The increasing number of people over 65 years old (YO) is an important research topic in the area of impact biomechanics, and finite element (FE) modeling can provide valuable support for related research. There were three objectives of this study: (1) Estimation of the representative age of the previously-documented Ford Human Body Model (FHBM) -- an FE model which approximates the geometry and mass of a mid-sized male, (2) Development of FE models representing two additional ages, and (3) Validation of the resulting three models to the extent possible with respect to available physical tests. Specifically, the geometry of the model was compared to published data relating rib angles to age, and the mechanical properties of different simulated tissues were compared to a number of published aging functions. The FHBM was determined to represent a 53-59 YO mid-sized male. The aforementioned aging functions were used to develop FE models representing two additional ages: 35 and 75 YO. The rib model was validated against human rib specimens and whole rib tests, under different loading conditions, with and without modeled fracture. In addition, the resulting three age-dependent models were validated by simulating cadaveric tests of blunt and sled impacts. The responses of the models, in general, were within the cadaveric response corridors. When compared to peak responses from individual cadavers similar in size and age to the age-dependent models, some responses were within one standard deviation of the test data. All the other responses, but one, were within two standard deviations.

Development and validation of a web-based questionnaire for surveying the health and working conditions of high-performance marine craft populations.

PubMed

de Alwis, Manudul Pahansen; Lo Martire, Riccardo; Äng, Björn O; Garme, Karl

2016-06-20

High-performance marine craft crews are susceptible to various adverse health conditions caused by multiple interactive factors. However, there are limited epidemiological data available for assessment of working conditions at sea. Although questionnaire surveys are widely used for identifying exposures, outcomes and associated risks with high accuracy levels, until now, no validated epidemiological tool exists for surveying occupational health and performance in these populations. To develop and validate a web-based questionnaire for epidemiological assessment of occupational and individual risk exposure pertinent to the musculoskeletal health conditions and performance in high-performance marine craft populations. A questionnaire for investigating the association between work-related exposure, performance and health was initially developed by a consensus panel under four subdomains, viz. demography, lifestyle, work exposure and health and systematically validated by expert raters for content relevance and simplicity in three consecutive stages, each iteratively followed by a consensus panel revision. The item content validity index (I-CVI) was determined as the proportion of experts giving a rating of 3 or 4. The scale content validity index (S-CVI/Ave) was computed by averaging the I-CVIs for the assessment of the questionnaire as a tool. Finally, the questionnaire was pilot tested. The S-CVI/Ave increased from 0.89 to 0.96 for relevance and from 0.76 to 0.94 for simplicity, resulting in 36 items in the final questionnaire. The pilot test confirmed the feasibility of the questionnaire. The present study shows that the web-based questionnaire fulfils previously published validity acceptance criteria and is therefore considered valid and feasible for the empirical surveying of epidemiological aspects among high-performance marine craft crews and similar populations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted

Development and validation of a web-based questionnaire for surveying the health and working conditions of high-performance marine craft populations

PubMed Central

de Alwis, Manudul Pahansen; Lo Martire, Riccardo; Äng, Björn O; Garme, Karl

2016-01-01

Background High-performance marine craft crews are susceptible to various adverse health conditions caused by multiple interactive factors. However, there are limited epidemiological data available for assessment of working conditions at sea. Although questionnaire surveys are widely used for identifying exposures, outcomes and associated risks with high accuracy levels, until now, no validated epidemiological tool exists for surveying occupational health and performance in these populations. Aim To develop and validate a web-based questionnaire for epidemiological assessment of occupational and individual risk exposure pertinent to the musculoskeletal health conditions and performance in high-performance marine craft populations. Method A questionnaire for investigating the association between work-related exposure, performance and health was initially developed by a consensus panel under four subdomains, viz. demography, lifestyle, work exposure and health and systematically validated by expert raters for content relevance and simplicity in three consecutive stages, each iteratively followed by a consensus panel revision. The item content validity index (I-CVI) was determined as the proportion of experts giving a rating of 3 or 4. The scale content validity index (S-CVI/Ave) was computed by averaging the I-CVIs for the assessment of the questionnaire as a tool. Finally, the questionnaire was pilot tested. Results The S-CVI/Ave increased from 0.89 to 0.96 for relevance and from 0.76 to 0.94 for simplicity, resulting in 36 items in the final questionnaire. The pilot test confirmed the feasibility of the questionnaire. Conclusions The present study shows that the web-based questionnaire fulfils previously published validity acceptance criteria and is therefore considered valid and feasible for the empirical surveying of epidemiological aspects among high-performance marine craft crews and similar populations. PMID:27324717

Ecological Development and Validation of a Music Performance Rating Scale for Five Instrument Families

ERIC Educational Resources Information Center

Wrigley, William J.; Emmerson, Stephen B.

2013-01-01

This study investigated ways to improve the quality of music performance evaluation in an effort to address the accountability imperative in tertiary music education. An enhanced scientific methodology was employed incorporating ecological validity and using recognized qualitative methods involving grounded theory and quantitative methods…

A review of human factors challenges of complex adaptive systems: discovering and understanding chaos in human performance.

PubMed

Karwowski, Waldemar

2012-12-01

In this paper, the author explores a need for a greater understanding of the true nature of human-system interactions from the perspective of the theory of complex adaptive systems, including the essence of complexity, emergent properties of system behavior, nonlinear systems dynamics, and deterministic chaos. Human performance, more often than not, constitutes complex adaptive phenomena with emergent properties that exhibit nonlinear dynamical (chaotic) behaviors. The complexity challenges in the design and management of contemporary work systems, including service systems, are explored. Examples of selected applications of the concepts of nonlinear dynamics to the study of human physical performance are provided. Understanding and applications of the concepts of theory of complex adaptive and dynamical systems should significantly improve the effectiveness of human-centered design efforts of a large system of systems. Performance of many contemporary work systems and environments may be sensitive to the initial conditions and may exhibit dynamic nonlinear properties and chaotic system behaviors. Human-centered design of emergent human-system interactions requires application of the theories of nonlinear dynamics and complex adaptive system. The success of future human-systems integration efforts requires the fusion of paradigms, knowledge, design principles, and methodologies of human factors and ergonomics with those of the science of complex adaptive systems as well as modern systems engineering.

Mental State Assessment and Validation Using Personalized Physiological Biometrics

PubMed Central

Patel, Aashish N.; Howard, Michael D.; Roach, Shane M.; Jones, Aaron P.; Bryant, Natalie B.; Robinson, Charles S. H.; Clark, Vincent P.; Pilly, Praveen K.

2018-01-01

Mental state monitoring is a critical component of current and future human-machine interfaces, including semi-autonomous driving and flying, air traffic control, decision aids, training systems, and will soon be integrated into ubiquitous products like cell phones and laptops. Current mental state assessment approaches supply quantitative measures, but their only frame of reference is generic population-level ranges. What is needed are physiological biometrics that are validated in the context of task performance of individuals. Using curated intake experiments, we are able to generate personalized models of three key biometrics as useful indicators of mental state; namely, mental fatigue, stress, and attention. We demonstrate improvements to existing approaches through the introduction of new features. Furthermore, addressing the current limitations in assessing the efficacy of biometrics for individual subjects, we propose and employ a multi-level validation scheme for the biometric models by means of k-fold cross-validation for discrete classification and regression testing for continuous prediction. The paper not only provides a unified pipeline for extracting a comprehensive mental state evaluation from a parsimonious set of sensors (only EEG and ECG), but also demonstrates the use of validation techniques in the absence of empirical data. Furthermore, as an example of the application of these models to novel situations, we evaluate the significance of correlations of personalized biometrics to the dynamic fluctuations of accuracy and reaction time on an unrelated threat detection task using a permutation test. Our results provide a path toward integrating biometrics into augmented human-machine interfaces in a judicious way that can help to maximize task performance.

Mental State Assessment and Validation Using Personalized Physiological Biometrics.

PubMed

Patel, Aashish N; Howard, Michael D; Roach, Shane M; Jones, Aaron P; Bryant, Natalie B; Robinson, Charles S H; Clark, Vincent P; Pilly, Praveen K

2018-01-01

Mental state monitoring is a critical component of current and future human-machine interfaces, including semi-autonomous driving and flying, air traffic control, decision aids, training systems, and will soon be integrated into ubiquitous products like cell phones and laptops. Current mental state assessment approaches supply quantitative measures, but their only frame of reference is generic population-level ranges. What is needed are physiological biometrics that are validated in the context of task performance of individuals. Using curated intake experiments, we are able to generate personalized models of three key biometrics as useful indicators of mental state; namely, mental fatigue, stress, and attention. We demonstrate improvements to existing approaches through the introduction of new features. Furthermore, addressing the current limitations in assessing the efficacy of biometrics for individual subjects, we propose and employ a multi-level validation scheme for the biometric models by means of k -fold cross-validation for discrete classification and regression testing for continuous prediction. The paper not only provides a unified pipeline for extracting a comprehensive mental state evaluation from a parsimonious set of sensors (only EEG and ECG), but also demonstrates the use of validation techniques in the absence of empirical data. Furthermore, as an example of the application of these models to novel situations, we evaluate the significance of correlations of personalized biometrics to the dynamic fluctuations of accuracy and reaction time on an unrelated threat detection task using a permutation test. Our results provide a path toward integrating biometrics into augmented human-machine interfaces in a judicious way that can help to maximize task performance.

Development and validation of a high-performance liquid chromatography method for determination of lisinopril in human plasma by magnetic solid-phase extraction and pre-column derivatization.

PubMed

Rastkari, Noushin; Ahmadkhaniha, Reza

2018-03-01

A sensitive, reliable and simple HPLC method was developed for the determination of lisinopril in human plasma. The method consists of extraction and clean-up steps based on magnetic solid-phase extraction and pre-column derivatization with a fluorescent reagent. The mobile phase consisted of a mixture of methanol-sodium dihydrogen phosphate (pH 3.0; 0.005 m; 75:25, v/v). The flow rate was set at 0.7 mL/min. Fluorescence detection was performed at 470nm excitation and 530nm emission wavelengths. Total chromatography run time was 5 min. The average extraction recovery of lisinopril and fluvoxamine (internal standard) was ≥82.8%. The limits of detection and quantification were determined as 1 and 3 ng/mL respectively. The method exhibited a linear calibration line over the concentration range of 3-1000 ng/mL with coefficient of determination (r 2 ) of ≥0.98. The within-run and between-run precisions were satisfactory with values of CV of 1.8-12.8% (accuracy from 99.2 to 94.7%) and 2.4-13.7% (accuracy from 99.5 to 92.2%), respectively. These developments led to considerable improvement in method sensitivity and reliability. The method was validated according to the US Food and Drug Administration guidelines. Therefore, it can be considered as a suitable method for determination of lisinopril in plasma samples. Copyright © 2017 John Wiley & Sons, Ltd.

Biomonitoring of 21 endocrine disrupting chemicals in human hair samples using ultra-high performance liquid chromatography-tandem mass spectrometry.

PubMed

Rodríguez-Gómez, R; Martín, J; Zafra-Gómez, A; Alonso, E; Vílchez, J L; Navalón, A

2017-02-01

Rapid industrial growth has increased human exposure to a large variety of chemicals with adverse health effects. These industrial chemicals are usually present in the environment, foods, beverages, clothes and personal care products. Among these compounds, endocrine disrupting chemicals (EDCs) have raised concern over the last years. In the present work, the determination of 21 EDCs in human hair samples is proposed. An analytical method based on the digestion of the samples with a mixture of acetic acid/methanol (20:80, v/v) followed by a solid-liquid microextraction and analysis by ultra-high performance liquid chromatography-tandem mass spectrometry (UHPLC-MS/MS) was developed and validated. The most influential parameters affecting the extraction method were optimized. The method was validated using matrix-matched calibration and recovery assays. Limits of detection ranged from 0.2 to 4 ng g -1 , limits of quantification from 0.5 to 12 ng g -1 , and inter- and intra-day variability was under 15% in all cases. Recovery rates for spiked samples ranged from 92.1 to 113.8%. The method was applied for the determination of the selected compounds in human hair. Samples were collected weekly from six randomly selected volunteers (three men and three women) over a three-month period. All the analyzed samples tested positive for at least one of the analyzed compounds. Copyright © 2016 Elsevier Ltd. All rights reserved.

Relationship between alertness, performance, and body temperature in humans.

PubMed

Wright, Kenneth P; Hull, Joseph T; Czeisler, Charles A

2002-12-01

Body temperature has been reported to influence human performance. Performance is reported to be better when body temperature is high/near its circadian peak and worse when body temperature is low/near its circadian minimum. We assessed whether this relationship between performance and body temperature reflects the regulation of both the internal biological timekeeping system and/or the influence of body temperature on performance independent of circadian phase. Fourteen subjects participated in a forced desynchrony protocol allowing assessment of the relationship between body temperature and performance while controlling for circadian phase and hours awake. Most neurobehavioral measures varied as a function of internal biological time and duration of wakefulness. A number of performance measures were better when body temperature was elevated, including working memory, subjective alertness, visual attention, and the slowest 10% of reaction times. These findings demonstrate that an increased body temperature, associated with and independent of internal biological time, is correlated with improved performance and alertness. These results support the hypothesis that body temperature modulates neurobehavioral function in humans.

Relationship between alertness, performance, and body temperature in humans

NASA Technical Reports Server (NTRS)

Wright, Kenneth P Jr; Hull, Joseph T.; Czeisler, Charles A.

2002-01-01

Body temperature has been reported to influence human performance. Performance is reported to be better when body temperature is high/near its circadian peak and worse when body temperature is low/near its circadian minimum. We assessed whether this relationship between performance and body temperature reflects the regulation of both the internal biological timekeeping system and/or the influence of body temperature on performance independent of circadian phase. Fourteen subjects participated in a forced desynchrony protocol allowing assessment of the relationship between body temperature and performance while controlling for circadian phase and hours awake. Most neurobehavioral measures varied as a function of internal biological time and duration of wakefulness. A number of performance measures were better when body temperature was elevated, including working memory, subjective alertness, visual attention, and the slowest 10% of reaction times. These findings demonstrate that an increased body temperature, associated with and independent of internal biological time, is correlated with improved performance and alertness. These results support the hypothesis that body temperature modulates neurobehavioral function in humans.

A Cross-Cultural Investigation of Human Performance Technology Interventions

ERIC Educational Resources Information Center

Vadivelu, Ramaswamy N.

2010-01-01

Human Performance Technology (HPT) is a field of practice that has evolved from advancements in organizational development, instructional design, strategic human resource management and cognitive psychology. As globalization and trends like outsourcing and off-shoring start to dominate the way organizations grow, HPT practitioners are managing the…

Overview of the HFM-181 Symposium Programme, Medical Technology Repurposed to Enhance Human Performance

DTIC Science & Technology

2009-10-01

BIO -INSPIRED HUMAN PERFORMANCE ENHANCEMENT 3.1 Biological performance currently outside of the bounds of the human species HPE opportunities may...strategies to preferentially burn fat in weight reduction (85). 3.2 Bio -inspired opportunities for human performance There are many interesting...solutions to assist human performance Nonmedical applications of bio -inspired engineering and computing technologies are a recognized priority in

Development and validation of a high performance liquid chromatographic method for the determination of oxcarbazepine and its main metabolites in human plasma and cerebrospinal fluid and its application to pharmacokinetic study.

PubMed

Kimiskidis, Vasilios; Spanakis, Marios; Niopas, Ioannis; Kazis, Dimitrios; Gabrieli, Chrysi; Kanaze, Feras Imad; Divanoglou, Daniil

2007-01-17

An isocratic reversed-phase HPLC-UV procedure for the determination of oxcarbazepine and its main metabolites 10-hydroxy-10,11-dihydrocarbamazepine and 10,11-dihydroxy-trans-10,11-dihydrocarbamazepine in human plasma and cerebrospinal fluid has been developed and validated. After addition of bromazepam as internal standard, the analytes were isolated from plasma and cerebrospinal fluid by liquid-liquid extraction. Separation was achieved on a X-TERRA C18 column using a mobile phase composed of 20 mM KH(2)PO(4), acetonitrile, and n-octylamine (76:24:0.05, v/v/v) at 40 degrees C and detected at 237 nm. The described assay was validated in terms of linearity, accuracy, precision, recovery and lower limit of quantification according to the FDA validation guidelines. Calibration curves were linear with a coefficient of variation (r) greater than 0.998. Accuracy ranged from 92.3% to 106.0% and precision was between 2.3% and 8.2%. The method has been applied to plasma and cerebrospinal fluid samples obtained from patients treated with oxcarbazepine, both in monotherapy and adjunctive therapy.

Assessing Discriminative Performance at External Validation of Clinical Prediction Models

PubMed Central

Nieboer, Daan; van der Ploeg, Tjeerd; Steyerberg, Ewout W.

2016-01-01

Introduction External validation studies are essential to study the generalizability of prediction models. Recently a permutation test, focusing on discrimination as quantified by the c-statistic, was proposed to judge whether a prediction model is transportable to a new setting. We aimed to evaluate this test and compare it to previously proposed procedures to judge any changes in c-statistic from development to external validation setting. Methods We compared the use of the permutation test to the use of benchmark values of the c-statistic following from a previously proposed framework to judge transportability of a prediction model. In a simulation study we developed a prediction model with logistic regression on a development set and validated them in the validation set. We concentrated on two scenarios: 1) the case-mix was more heterogeneous and predictor effects were weaker in the validation set compared to the development set, and 2) the case-mix was less heterogeneous in the validation set and predictor effects were identical in the validation and development set. Furthermore we illustrated the methods in a case study using 15 datasets of patients suffering from traumatic brain injury. Results The permutation test indicated that the validation and development set were homogenous in scenario 1 (in almost all simulated samples) and heterogeneous in scenario 2 (in 17%-39% of simulated samples). Previously proposed benchmark values of the c-statistic and the standard deviation of the linear predictors correctly pointed at the more heterogeneous case-mix in scenario 1 and the less heterogeneous case-mix in scenario 2. Conclusion The recently proposed permutation test may provide misleading results when externally validating prediction models in the presence of case-mix differences between the development and validation population. To correctly interpret the c-statistic found at external validation it is crucial to disentangle case-mix differences from incorrect

Assessing Discriminative Performance at External Validation of Clinical Prediction Models.

PubMed

Nieboer, Daan; van der Ploeg, Tjeerd; Steyerberg, Ewout W

2016-01-01

External validation studies are essential to study the generalizability of prediction models. Recently a permutation test, focusing on discrimination as quantified by the c-statistic, was proposed to judge whether a prediction model is transportable to a new setting. We aimed to evaluate this test and compare it to previously proposed procedures to judge any changes in c-statistic from development to external validation setting. We compared the use of the permutation test to the use of benchmark values of the c-statistic following from a previously proposed framework to judge transportability of a prediction model. In a simulation study we developed a prediction model with logistic regression on a development set and validated them in the validation set. We concentrated on two scenarios: 1) the case-mix was more heterogeneous and predictor effects were weaker in the validation set compared to the development set, and 2) the case-mix was less heterogeneous in the validation set and predictor effects were identical in the validation and development set. Furthermore we illustrated the methods in a case study using 15 datasets of patients suffering from traumatic brain injury. The permutation test indicated that the validation and development set were homogenous in scenario 1 (in almost all simulated samples) and heterogeneous in scenario 2 (in 17%-39% of simulated samples). Previously proposed benchmark values of the c-statistic and the standard deviation of the linear predictors correctly pointed at the more heterogeneous case-mix in scenario 1 and the less heterogeneous case-mix in scenario 2. The recently proposed permutation test may provide misleading results when externally validating prediction models in the presence of case-mix differences between the development and validation population. To correctly interpret the c-statistic found at external validation it is crucial to disentangle case-mix differences from incorrect regression coefficients.

Energy Expenditure Evaluation in Humans and Non-Human Primates by SenseWear Armband. Validation of Energy Expenditure Evaluation by SenseWear Armband by Direct Comparison with Indirect Calorimetry

PubMed Central

Casiraghi, Francesca; Chavez, Alberto O.; Davalli, Alberto M.; Naegelin, Terry; Comuzzie, Anthony G.; Frost, Patricia; Musi, Nicolas; Folli, Franco

2013-01-01

Introduction The purpose of this study was to compare and validate the use of SenseWear Armband (SWA) placed on the arm (SWA ARM) and on the back (SWA BACK) in healthy humans during resting and a cycle-ergometer exercise and to evaluate the SWA to estimate Resting Energy Expenditure (REE) and Total Energy Expenditure (TEE) in healthy baboons. Methods We studied 26 (15F/11M) human subjects wearing SWA in two different anatomical sites (arm and back) during resting and a cycle-ergometer test and directly compared these results with indirect calorimetry evaluation (IC), performed at the same time. We then inserted the SWA in a metabolic jacket for baboons and evaluated the TEE and REE in free living condition for 6 days in 21 (8F/13M) non-human primates. Results In humans we found a good correlation between SWA place on the ARM and on the BACK with IC during the resting experiment (1.1±0.3 SWAs, 1±0.2 IC kcal/min) and a slight underestimation in the SWAs data compared with IC during the cycle-ergometer exercise (5±1.9 SWA ARM, 4.5±1.5 SWA BACK and 5.4±2.1 IC kcal/min). In the non-human primate (baboons) experiment SWA estimated a TEE of 0.54±0.009 kcal/min during free living and a REE of 0.82±0.06 kcal/min. Conclusion SWA, an extremely simple and inexpensive apparatus, provides quite accurate measurements of energy expenditure in humans and in baboons. Energy expenditure data obtained with SWA are highly correlated with the data obtained with “gold standard”, IC, in humans. PMID:24069218

The Human Performance Envelope: Past Research, Present Activities and Future Directions

NASA Technical Reports Server (NTRS)

Edwards, Tamsyn

2017-01-01

Air traffic controllers (ATCOs) must maintain a consistently high level of human performance in order to maintain flight safety and efficiency. In current control environments, performance-influencing factors such as workload, fatigue and situation awareness can co-occur, and interact, to effect performance. However, multifactor influences and the association with performance are under-researched. This study utilized a high fidelity human in the loop enroute air traffic control simulation to investigate the relationship between workload, situation awareness and ATCO performance. The study aimed to replicate and extend Edwards, Sharples, Wilson and Kirwans (2012) previous study and confirm multifactor interactions with a participant sample of ex-controllers. The study also aimed to extend Edwards et als previous research by comparing multifactor relationships across 4 automation conditions. Results suggest that workload and SA may interact to produce a cumulative impact on controller performance, although the effect of the interaction on performance may be dependent on the context and amount of automation present. Findings have implications for human-automation teaming in air traffic control, and the potential prediction and support of ATCO performance.

Validated liquid chromatography-tandem mass spectrometry method for quantitative determination of dauricine in human plasma and its application to pharmacokinetic study.

PubMed

Liu, Xiaoying; Liu, Qian; Wang, Dongmei; Wang, Xueya; Zhang, Peng; Xu, Haiyan; Zhao, Hui; Zhao, Huaiqing

2010-05-01

A highly sensitive and selective LC-MS/MS method was developed and validated for the determination of dauricine in human plasma, using protopine as internal standard (IS). The analyte and IS were extracted by liquid-liquid extraction and analyzed by LC-MS/MS. Chromatographic separation was performed on Agilent TC-C(18) column with a mobile phase of methanol-water-glacial acetic acid (60:40:0.8, v/v/v) at a flow rate of 0.7 mL/min. Detection was performed on a triple quadrupole tandem mass spectrum by multiple reaction monitoring (MRM) mode using the electrospray ionization technique in positive mode. The method was linear over the concentration range of 1-200 ng/mL. The lower limit of quantification (LLOQ) was 1 ng/mL in human plasma with acceptable precision and accuracy. The intra- and inter-day precision was less than 5.9% determined from quality control (QC) samples at concentrations of 2.0, 20.0 and 160 ng/mL, and the accuracy was within +/-9.9%. This method was successfully applied for the evaluation of pharmacokinetics of dauricine after oral doses of 100, 300 and 600 mg phenolic alkaloids of menispermum dauricum tablet (PAMDT) to 12 Chinese healthy volunteers. 2010 Elsevier B.V. All rights reserved.

Humans on the International Space Station-How Research, Operations, and International Collaboration are Leading to New Understanding of Human Physiology and Performance in Microgravity

NASA Technical Reports Server (NTRS)

Ronbinson, Julie A.; Harm, Deborah L.

2009-01-01

As the International Space Station (ISS) nears completion, and full international utilization is achieved, we are at a scientific crossroads. ISS is the premier location for research aimed at understanding the effects of microgravity on the human body. For applications to future human exploration, it is key for validation, quantification, and mitigation of a wide variety of spaceflight risks to health and human performance. Understanding and mitigating these risks is the focus of NASA s Human Research Program. However, NASA s approach to defining human research objectives is only one of many approaches within the ISS international partnership (including Roscosmos, the European Space Agency, the Canadian Space Agency, and the Japan Aerospace Exploration Agency). Each of these agencies selects and implements their own ISS research, with independent but related objectives for human and life sciences research. Because the science itself is also international and collaborative, investigations that are led by one ISS partner also often include cooperative scientists from around the world. The operation of the ISS generates significant additional data that is not directly linked to specific investigations. Such data comes from medical monitoring of crew members, life support and radiation monitoring, and from the systems that have been implemented to protect the health of the crew (such as exercise hardware). We provide examples of these international synergies in human research on ISS and highlight key early accomplishments that derive from these broad interfaces. Taken as a whole, the combination of diverse research objectives, operational data, international sharing of research resources on ISS, and scientific collaboration provide a robust research approach and capability that no one partner could achieve alone.

Prevalence of Invalid Performance on Baseline Testing for Sport-Related Concussion by Age and Validity Indicator.

PubMed

Abeare, Christopher A; Messa, Isabelle; Zuccato, Brandon G; Merker, Bradley; Erdodi, Laszlo

2018-03-12

Estimated base rates of invalid performance on baseline testing (base rates of failure) for the management of sport-related concussion range from 6.1% to 40.0%, depending on the validity indicator used. The instability of this key measure represents a challenge in the clinical interpretation of test results that could undermine the utility of baseline testing. To determine the prevalence of invalid performance on baseline testing and to assess whether the prevalence varies as a function of age and validity indicator. This retrospective, cross-sectional study included data collected between January 1, 2012, and December 31, 2016, from a clinical referral center in the Midwestern United States. Participants included 7897 consecutively tested, equivalently proportioned male and female athletes aged 10 to 21 years, who completed baseline neurocognitive testing for the purpose of concussion management. Baseline assessment was conducted with the Immediate Postconcussion Assessment and Cognitive Testing (ImPACT), a computerized neurocognitive test designed for assessment of concussion. Base rates of failure on published ImPACT validity indicators were compared within and across age groups. Hypotheses were developed after data collection but prior to analyses. Of the 7897 study participants, 4086 (51.7%) were male, mean (SD) age was 14.71 (1.78) years, 7820 (99.0%) were primarily English speaking, and the mean (SD) educational level was 8.79 (1.68) years. The base rate of failure ranged from 6.4% to 47.6% across individual indicators. Most of the sample (55.7%) failed at least 1 of 4 validity indicators. The base rate of failure varied considerably across age groups (117 of 140 [83.6%] for those aged 10 years to 14 of 48 [29.2%] for those aged 21 years), representing a risk ratio of 2.86 (95% CI, 2.60-3.16; P < .001). The results for base rate of failure were surprisingly high overall and varied widely depending on the specific validity indicator and the age of the

Development and validation of a new dynamic computer-controlled model of the human stomach and small intestine.

PubMed

Guerra, Aurélie; Denis, Sylvain; le Goff, Olivier; Sicardi, Vincent; François, Olivier; Yao, Anne-Françoise; Garrait, Ghislain; Manzi, Aimé Pacifique; Beyssac, Eric; Alric, Monique; Blanquet-Diot, Stéphanie

2016-06-01

For ethical, regulatory, and economic reasons, in vitro human digestion models are increasingly used as an alternative to in vivo assays. This study aims to present the new Engineered Stomach and small INtestine (ESIN) model and its validation for pharmaceutical applications. This dynamic computer-controlled system reproduces, according to in vivo data, the complex physiology of the human stomach and small intestine, including pH, transit times, chyme mixing, digestive secretions, and passive absorption of digestion products. Its innovative design allows a progressive meal intake and the differential gastric emptying of solids and liquids. The pharmaceutical behavior of two model drugs (paracetamol immediate release form and theophylline sustained release tablet) was studied in ESIN during liquid digestion. The results were compared to those found with a classical compendial method (paddle apparatus) and in human volunteers. Paracetamol and theophylline tablets showed similar absorption profiles in ESIN and in healthy subjects. For theophylline, a level A in vitro-in vivo correlation could be established between the results obtained in ESIN and in humans. Interestingly, using a pharmaceutical basket, the swelling and erosion of the theophylline sustained release form was followed during transit throughout ESIN. ESIN emerges as a relevant tool for pharmaceutical studies but once further validated may find many other applications in nutritional, toxicological, and microbiological fields. Biotechnol. Bioeng. 2016;113: 1325-1335. © 2015 Wiley Periodicals, Inc. © 2015 Wiley Periodicals, Inc.

Driver kinematic and muscle responses in braking events with standard and reversible pre-tensioned restraints: validation data for human models.

PubMed

Osth, Jonas; Olafsdóttir, Jóna Marín; Davidsson, Johan; Brolin, Karin

2013-11-01

The objectives of this study are to generate validation data for human models intended for simulation of occupant kinematics in a pre-crash phase, and to evaluate the effect of an integrated safety system on driver kinematics and muscle responses. Eleven male and nine female volunteers, driving a passenger car on ordinary roads, performed maximum voluntary braking; they were also subjected to autonomous braking events with both standard and reversible pre-tensioned restraints. Kinematic data was acquired through film analysis, and surface electromyography (EMG) was recorded bilaterally for muscles in the neck, the upper extremities, and lumbar region. Maximum voluntary contractions (MVCs) were carried out in a driving posture for normalization of the EMG. Seat belt positions, interaction forces, and seat indentions were measured. During normal driving, all muscle activity was below 5% of MVC for females and 9% for males. The range of activity during steady state braking for males and females was 13-44% in the cervical and lumbar extensors, while antagonistic muscles showed a co-contraction of 2.3-19%. Seat belt pre-tension affects both the kinematic and muscle responses of drivers. In autonomous braking with standard restraints, muscle activation occurred in response to the inertial load. With pre-tensioned seat belts, EMG onset occurred earlier; between 71 ms and 176 ms after belt pre-tension. The EMG onset times decreased with repeated trials and were shorter for females than for males. With the results from this study, further improvement and validation of human models that incorporate active musculature will be made possible.

Minimizing false positive error with multiple performance validity tests: response to Bilder, Sugar, and Hellemann (2014 this issue).

PubMed

Larrabee, Glenn J

2014-01-01

Bilder, Sugar, and Hellemann (2014 this issue) contend that empirical support is lacking for use of multiple performance validity tests (PVTs) in evaluation of the individual case, differing from the conclusions of Davis and Millis (2014), and Larrabee (2014), who found no substantial increase in false positive rates using a criterion of failure of ≥ 2 PVTs and/or Symptom Validity Tests (SVTs) out of multiple tests administered. Reconsideration of data presented in Larrabee (2014) supports a criterion of ≥ 2 out of up to 7 PVTs/SVTs, as keeping false positive rates close to and in most cases below 10% in cases with bona fide neurologic, psychiatric, and developmental disorders. Strategies to minimize risk of false positive error are discussed, including (1) adjusting individual PVT cutoffs or criterion for number of PVTs failed, for examinees who have clinical histories placing them at risk for false positive identification (e.g., severe TBI, schizophrenia), (2) using the history of the individual case to rule out conditions known to result in false positive errors, (3) using normal performance in domains mimicked by PVTs to show that sufficient native ability exists for valid performance on the PVT(s) that have been failed, and (4) recognizing that as the number of PVTs/SVTs failed increases, the likelihood of valid clinical presentation decreases, with a corresponding increase in the likelihood of invalid test performance and symptom report.

Human performance evaluation in dual-axis critical task tracking

NASA Technical Reports Server (NTRS)

Ritchie, M. L.; Nataraj, N. S.

1975-01-01

A dual axis tracking using a multiloop critical task was set up to evaluate human performance. The effects of control stick variation and display formats are evaluated. A secondary loading was used to measure the degradation in tracking performance.

Validation of a dilute and shoot method for quantification of 12 elements by inductively coupled plasma tandem mass spectrometry in human milk and in cow milk preparations.

PubMed

Dubascoux, Stéphane; Andrey, Daniel; Vigo, Mario; Kastenmayer, Peter; Poitevin, Eric

2018-09-01

Nutritional information about human milk is essential as early human growth and development have been closely linked to the status and requirements of several macro- and micro-elements. However, methods addressing whole mineral profiling in human milk have been scarce due in part to their technical complexities to accurately and simultaneously measure the concentration of micro- and macro-trace elements in low volume of human milk. In the present study, a single laboratory validation has been performed using a "dilute and shoot" approach for the quantification of sodium (Na), magnesium (Mg), phosphorus (P), potassium (K), calcium (Ca), manganese (Mn), iron (Fe), copper (Cu), zinc (Zn), selenium (Se), molybdenum (Mo) and iodine (I), in both human milk and milk preparations. Performances in terms of limits of detection and quantification, of repeatability, reproducibility and trueness have been assessed and verified using various reference or certified materials. For certified human milk sample (NIST 1953), recoveries obtained for reference or spiked values are ranged from 93% to 108% (except for Mn at 151%). This robust method using new technology ICP-MS/MS without high pressure digestion is adapted to both routinely and rapidly analyze human milk micro-sample (i.e. less than 250 μL) in the frame of clinical trials but also to be extended to the mineral profiling of milk preparations like infant formula and adult nutritionals. Copyright © 2018 Elsevier GmbH. All rights reserved.

Augmenting team cognition in human-automation teams performing in complex operational environments.

PubMed

Cuevas, Haydee M; Fiore, Stephen M; Caldwell, Barrett S; Strater, Laura

2007-05-01

There is a growing reliance on automation (e.g., intelligent agents, semi-autonomous robotic systems) to effectively execute increasingly cognitively complex tasks. Successful team performance for such tasks has become even more dependent on team cognition, addressing both human-human and human-automation teams. Team cognition can be viewed as the binding mechanism that produces coordinated behavior within experienced teams, emerging from the interplay between each team member's individual cognition and team process behaviors (e.g., coordination, communication). In order to better understand team cognition in human-automation teams, team performance models need to address issues surrounding the effect of human-agent and human-robot interaction on critical team processes such as coordination and communication. Toward this end, we present a preliminary theoretical framework illustrating how the design and implementation of automation technology may influence team cognition and team coordination in complex operational environments. Integrating constructs from organizational and cognitive science, our proposed framework outlines how information exchange and updating between humans and automation technology may affect lower-level (e.g., working memory) and higher-level (e.g., sense making) cognitive processes as well as teams' higher-order "metacognitive" processes (e.g., performance monitoring). Issues surrounding human-automation interaction are discussed and implications are presented within the context of designing automation technology to improve task performance in human-automation teams.

Development and Validation of HPLC Method for Determination of Crocetin, a constituent of Saffron, in Human Serum Samples.

PubMed

Mohammadpour, Amir Hooshang; Ramezani, Mohammad; Tavakoli Anaraki, Nasim; Malaekeh-Nikouei, Bizhan; Amel Farzad, Sara; Hosseinzadeh, Hossein

2013-01-01

The present study reports the development and validation of a sensitive and rapid extraction method beside high performance liquid chromatographic method for the determination of crocetin in human serum. The HPLC method was carried out by using a C18 reversed-phase column and a mobile phase composed of methanol/water/acetic acid (85:14.5:0.5 v/v/v) at the flow rate of 0.8 ml/min. The UV detector was set at 423 nm and 13-cis retinoic acid was used as the internal standard. Serum samples were pretreated with solid-phase extraction using Bond Elut C18 (200mg) cartridges or with direct precipitation using acetonitrile. The calibration curves were linear over the range of 0.05-1.25 µg/ml for direct precipitation method and 0.5-5 µg/ml for solid-phase extraction. The mean recoveries of crocetin over a concentration range of 0.05-5 µg/ml serum for direct precipitation method and 0.5-5 µg/ml for solid-phase extraction were above 70 % and 60 %, respectively. The intraday coefficients of variation were 0.37- 2.6% for direct precipitation method and 0.64 - 5.43% for solid-phase extraction. The inter day coefficients of variation were 1.69 - 6.03% for direct precipitation method and 5.13-12.74% for solid-phase extraction, respectively. The lower limit of quantification for crocetin was 0.05 µg/ml for direct precipitation method and 0.5 µg/ml for solid-phase extraction. The validated direct precipitation method for HPLC satisfied all of the criteria that were necessary for a bioanalytical method and could reliably quantitate crocetin in human serum for future clinical pharmacokinetic study.

Development and Validation of HPLC Method for Determination of Crocetin, a constituent of Saffron, in Human Serum Samples

PubMed Central

Mohammadpour, Amir Hooshang; Ramezani, Mohammad; Tavakoli Anaraki, Nasim; Malaekeh-Nikouei, Bizhan; Amel Farzad, Sara; Hosseinzadeh, Hossein

2013-01-01

Objective(s): The present study reports the development and validation of a sensitive and rapid extraction method beside high performance liquid chromatographic method for the determination of crocetin in human serum. Materials and Methods: The HPLC method was carried out by using a C18 reversed-phase column and a mobile phase composed of methanol/water/acetic acid (85:14.5:0.5 v/v/v) at the flow rate of 0.8 ml/min. The UV detector was set at 423 nm and 13-cis retinoic acid was used as the internal standard. Serum samples were pretreated with solid-phase extraction using Bond Elut C18 (200mg) cartridges or with direct precipitation using acetonitrile. Results: The calibration curves were linear over the range of 0.05-1.25 µg/ml for direct precipitation method and 0.5-5 µg/ml for solid-phase extraction. The mean recoveries of crocetin over a concentration range of 0.05-5 µg/ml serum for direct precipitation method and 0.5-5 µg/ml for solid-phase extraction were above 70 % and 60 %, respectively. The intraday coefficients of variation were 0.37- 2.6% for direct precipitation method and 0.64 - 5.43% for solid-phase extraction. The inter day coefficients of variation were 1.69 – 6.03% for direct precipitation method and 5.13-12.74% for solid-phase extraction, respectively. The lower limit of quantification for crocetin was 0.05 µg/ml for direct precipitation method and 0.5 µg/ml for solid-phase extraction. Conclusion: The validated direct precipitation method for HPLC satisfied all of the criteria that were necessary for a bioanalytical method and could reliably quantitate crocetin in human serum for future clinical pharmacokinetic study. PMID:23638292

Human factors engineering verification and validation for APR1400 computerized control room

DOE Office of Scientific and Technical Information (OSTI.GOV)

Shin, Y. C.; Moon, H. K.; Kim, J. H.

2006-07-01

This paper introduces the Advanced Power Reactor 1400 (APR1400) HFE V and V activities the Korea Hydro Nuclear Plant Co. LTD. (KHNP) has performed for the last 10 years and some of the lessons learned through these activities. The features of APR1400 main control room include large display panel, redundant compact workstations, computer-based procedure, and safety console. Several iterations of human factors evaluations have been performed from small scale proof of concept tests to large scale integrated system tests for identifying human engineering deficiencies in the human system interface design. Evaluations in the proof of concept test were focused onmore » checking the presence of any show stopper problems in the design concept. Later evaluations were mostly for finding design problems and for assuring the resolution of human factors issues of advanced control room. The results of design evaluations were useful not only for refining the control room design, but also for licensing the standard design. Several versions of APR1400 mock-ups with dynamic simulation models of currently operating Korea Standard Nuclear Plant (KSNP) have been used for the evaluations with the participation of operators from KSNP plants. (authors)« less

Future Performance Trend Indicators: A Current Value Approach to Human Resources Accounting. Report III. Multivariate Predictions of Organizational Performance Across Time.

ERIC Educational Resources Information Center

Pecorella, Patricia A.; Bowers, David G.

Multiple regression in a double cross-validated design was used to predict two performance measures (total variable expense and absence rate) by multi-month period in five industrial firms. The regressions do cross-validate, and produce multiple coefficients which display both concurrent and predictive effects, peaking 18 months to two years…

CryoSat-2: Post launch performance of SIRAL-2 and its calibration/validation

NASA Astrophysics Data System (ADS)

Cullen, Robert; Francis, Richard; Davidson, Malcolm; Wingham, Duncan

2010-05-01

1. INTRODUCTION The main payload of CryoSat-2 [1], SIRAL (Synthetic interferometric radar altimeter), is a Ku band pulse-width limited radar altimeter which transmits pulses at a high pulse repetition frequency thus making received echoes phase coherent and suitable for azimuth processing [2]. The azimuth processing in conjunction with correction for slant range improves along track resolution to about 250 meters which is a significant improvement over traditional pulse-width limited systems such as Envisat RA-2, [3]. CryoSat-2 will be launched on 25th February 2010 and this paper describes the pre and post launch measures of CryoSat/SIRAL performance and the status of mission validation planning. 2. SIRAL PERFORMANCE: INTERNAL AND EXTERNAL CALIBRATION Phase coherent pulse-width limited radar altimeters such as SIRAL-2 pose a new challenge when considering a strategy for calibration. Along with the need to generate the well understood corrections for transfer function amplitude with respect to frequency, gain and instrument path delay there is also a need to provide corrections for transfer function phase with respect to frequency and AGC setting, phase variation across bursts of pulses. Furthermore, since some components of these radars are temperature sensitive one needs to be careful when the deciding how often calibrations are performed whilst not impacting mission performance. Several internal calibration ground processors have been developed to model imperfections within the CryoSat-2 radar altimeter (SIRAL-2) hardware and reduce their effect from the science data stream via the use of calibration correction auxiliary products within the ground segment. We present the methods and results used to model and remove imperfections and describe the baseline for usage of SIRAL-2 calibration modes during the commissioning phase and the operational exploitation phases of the mission. Additionally we present early results derived from external calibration of SIRAL via

Validation of an immunoassay to measure plasminogen-activator inhibitor-1 concentrations in human saliva

PubMed Central

Zhang, Xi; Dimeski, Goce; Punyadeera, Chamindie

2014-01-01

Introduction: We have previously shown that the concentrations of D-dimer are significantly elevated in saliva compared with plasma. Saliva offers several advantages compared with blood analysis. We hypothesised that human saliva contains plasminogen activator inhibitor-1 (PAI-1) and that the concentrations are not affected by the time of saliva collection. The aim was to adopt and validate an immunoassay to quantify PAI-1 concentrations in saliva and to determine whether saliva collection time has an influence in the measurement. Materials and methods: Two saliva samples (morning and afternoon) from the same day were collected from healthy subjects (N = 40) who have had no underlying heart conditions. A customized AlphaLISA® immunoassay (PerkinElmer®, MA, USA) was adopted and used to quantify PAI-1 concentrations. We validated the analytical performance of the customized immunoassay by calculating recovery of known amount of analyte spiked in saliva. Results: The recovery (95.03%), intra- (8.59%) and inter-assay (7.52%) variations were within the acceptable ranges. The median salivary PAI-1 concentrations were 394 pg/mL (interquartile ranges (IQR) 243.4–833.1 pg/mL) in the morning and 376 (129.1–615.4) pg/mL in the afternoon and the plasma concentration was 59,000 (24,000–110,000) pg/mL. Salivary PAI-1 did not correlate with plasma (P = 0.812). Conclusions: The adopted immunoassay produced acceptable assay sensitivity and specificity. The data demonstrated that saliva contains PAI-1 and that its concentration is not affected by the time of saliva collection. There is no correlation between salivary and plasma PAI-1 concentrations. Further studies are required to demonstrate the utility of salivary PAI-1 in CVD risk factor studies. PMID:24969919

Determination of Efavirenz in Human Dried Blood Spots by Reversed-Phase High Performance Liquid Chromatography with UV Detection

PubMed Central

Hoffman, Justin T; Rossi, Steven S; Espina-Quinto, Rowena; Letendre, Scott; Capparelli, Edmund V

2013-01-01

Background Previously published methods for determination of efavirenz (EFV) in human dried blood spots (DBS) employ costly and complex liquid chromatography/mass spectrometry. We describe the validation and evaluation of a simple and inexpensive high-performance liquid chromatography (HPLC) method for EFV quantification in human DBS and dried plasma spots (DPS), using ultraviolet (UV) detection appropriate for resource-limited settings. Methods 100μl of heparinized whole blood or plasma were spotted onto blood collection cards, dried, punched, and eluted. Eluates are injected onto a C-18 reversed phase HPLC column. EFV is separated isocratically using a potassium phosphate and ACN mobile phase. UV detection is at 245nm. Quantitation is by use of external calibration standards. Following validation, the method was evaluated using whole blood and plasma from HIV-positive patients undergoing EFV therapy. Results Mean recovery of drug from dried blood spots is 91.5%. The method is linear over the validated concentration range of 0.3125 – 20.0μg/mL. A good correlation (Spearman r=0.96) between paired plasma and DBS EFV concentrations from the clinical samples was observed, and hematocrit level was not found to be a significant determinant of the EFV DBS level. The mean observed CDBS/Cplasma ratio was 0.68. A good correlation (Spearman r=0.96) between paired plasma and DPS EFV concentrations from the clinical samples was observed. The mean percent deviation of DPS samples from plasma samples is 1.68%. Conclusions Dried whole blood spot or dried plasma spot sampling is well suited for monitoring EFV therapy in resource limited settings, particularly when high sensitivity is not essential. PMID:23503446

Assessing the validity and reliability of the Malagasy version of Oral Impacts on Daily Performance (OIDP): a cross-sectional study.

PubMed

Razanamihaja, Noeline; Ranivoharilanto, Eva

2017-01-01

Evaluating health needs includes measures of the impact of state of health on the quality of life. This entails evaluating the psychosocial aspects of health. To achieve this, several tools for measuring the quality of life related to oral health have been developed. However, it is vital to evaluate the psychometric properties of these tools so they can be used in a new context and on a new population. The purpose of this study was to evaluate the reliability and validity of the Malagasy version of a questionnaire for studying the impacts of oral-dental health on daily activities (Oral Impacts on Daily Performance), and analyse the interrelations between the scores obtained and the oral health indicators. A cross-sectional study was performed for the transcultural adaptation of the Oral Impacts on Daily Performance questionnaire forward translated and back-translated from English to Malagasy and from Malagasy to English, respectively. The psychometric characteristics of the Malagasy version of the Oral Impacts on Daily Performance were then evaluated in terms of internal reliability, test-retest, and construct, criteria and discriminant validity. Four hundred and six adults responded in face-to-face interviews to the Malagasy version of the Oral Impacts on Daily Performance questionnaire. Nearly 74% of the participants indicated impacts of their oral health on their performance in their daily lives during the 6 months prior to the survey. The activities most affected were: "smiling", "eating" and "sleeping and relaxing". Cronbach's alpha was 0.87. The construct validity was demonstrated by a significant association between the Oral Impacts on Daily Performance scores and the subjective evaluation of oral health ( p <0.001). Discriminant validity was demonstrated by the fact that the Oral Impacts on Daily Performance scores were significantly higher in subjects with more than ten missing teeth, compared to those with fewer than ten missing teeth ( p  < 0

Active imaging system performance model for target acquisition

NASA Astrophysics Data System (ADS)

Espinola, Richard L.; Teaney, Brian; Nguyen, Quang; Jacobs, Eddie L.; Halford, Carl E.; Tofsted, David H.

2007-04-01

The U.S. Army RDECOM CERDEC Night Vision & Electronic Sensors Directorate has developed a laser-range-gated imaging system performance model for the detection, recognition, and identification of vehicle targets. The model is based on the established US Army RDECOM CERDEC NVESD sensor performance models of the human system response through an imaging system. The Java-based model, called NVLRG, accounts for the effect of active illumination, atmospheric attenuation, and turbulence effects relevant to LRG imagers, such as speckle and scintillation, and for the critical sensor and display components. This model can be used to assess the performance of recently proposed active SWIR systems through various trade studies. This paper will describe the NVLRG model in detail, discuss the validation of recent model components, present initial trade study results, and outline plans to validate and calibrate the end-to-end model with field data through human perception testing.

[Validation of three screening tests used for early detection of cervical cancer].

PubMed

Rodriguez-Reyes, Esperanza Rosalba; Cerda-Flores, Ricardo M; Quiñones-Pérez, Juan M; Cortés-Gutiérrez, Elva I

2008-01-01

to evaluate the validity (sensitivity, specificity, and accuracy) of three screening methods used in the early detection of the cervical carcinoma versus the histopathology diagnosis. a selected sample of 107 women attended in the Opportune Detection of Cervicouterine Cancer Program in the Hospital de Zona 46, Instituto Mexicano del Seguro Social in Durango, during the 2003 was included. The application of Papa-nicolaou, acetic acid test, and molecular detection of human papillomavirus, and histopatholgy diagnosis were performed in all the patients at the time of the gynecological exam. The detection and tipification of the human papillomavirus was performed by polymerase chain reaction (PCR) and analysis of polymorphisms of length of restriction fragments (RFLP). Histopathology diagnosis was considered the gold standard. The evaluation of the validity was carried out by the Bayesian method for diagnosis test. the positive cases for acetic acid test, Papanicolaou, and PCR were 47, 22, and 19. The accuracy values were 0.70, 0.80 and 0.99, respectively. since the molecular method showed a greater validity in the early detection of the cervical carcinoma we considered of vital importance its implementation in suitable programs of Opportune Detection of Cervicouterino Cancer Program in Mexico. However, in order to validate this conclusion, cross-sectional studies in different region of country must be carried out.

Selecting Tasks for Evaluating Human Performance as a Function of Gravity

NASA Technical Reports Server (NTRS)

Norcross, Jason R.; Gernhardt, Michael L.

2011-01-01

A challenge in understanding human performance as a function of gravity is determining which tasks to research. Initial studies began with treadmill walking, which was easy to quantify and control. However, with the development of pressurized rovers, it is less important to optimize human performance for ambulation as pressurized rovers will likely perform gross translation for them. Future crews are likely to spend much of their extravehicular activity (EVA) performing geology, construction,a nd maintenance type tasks. With these types of tasks, people have different performance strategies, and it is often difficult to quantify the task and measure steady-state metabolic rates or perform biomechanical analysis. For many of these types of tasks, subjective feedback may be the only data that can be collected. However, subjective data may not fully support a rigorous scientific comparison of human performance across different gravity levels and suit factors. NASA would benefit from having a wide variety of quantifiable tasks that allow human performance comparison across different conditions. In order to determine which tasks will effectively support scientific studies, many different tasks and data analysis techniques will need to be employed. Many of these tasks and techniques will not be effective, but some will produce quantifiable results that are sensitive enough to show performance differences. One of the primary concerns related to EVA performance is metabolic rate. The higher the metabolic rate, the faster the astronaut will exhaust consumables. The focus of this poster will be on how different tasks affect metabolic rate across different gravity levels.

An Investigation of Human Performance Model Validation

DTIC Science & Technology

2005-03-01

of design decisions, what the costs and benefits are for each of the stages of analysis options. On the ’benefits’ side, the manager needs to know...confidence. But we also want to know that we are not expending any more effort (and other costs ) than necessary to ensure that the right decision is...supported at each stage. Ultimately, we want to enable SBA managers to have confidence that they are selecting the right HPM tools and using them correctly in

Model performance evaluation (validation and calibration) in model-based studies of therapeutic interventions for cardiovascular diseases : a review and suggested reporting framework.

PubMed

Haji Ali Afzali, Hossein; Gray, Jodi; Karnon, Jonathan

2013-04-01

Decision analytic models play an increasingly important role in the economic evaluation of health technologies. Given uncertainties around the assumptions used to develop such models, several guidelines have been published to identify and assess 'best practice' in the model development process, including general modelling approach (e.g., time horizon), model structure, input data and model performance evaluation. This paper focuses on model performance evaluation. In the absence of a sufficient level of detail around model performance evaluation, concerns regarding the accuracy of model outputs, and hence the credibility of such models, are frequently raised. Following presentation of its components, a review of the application and reporting of model performance evaluation is presented. Taking cardiovascular disease as an illustrative example, the review investigates the use of face validity, internal validity, external validity, and cross model validity. As a part of the performance evaluation process, model calibration is also discussed and its use in applied studies investigated. The review found that the application and reporting of model performance evaluation across 81 studies of treatment for cardiovascular disease was variable. Cross-model validation was reported in 55 % of the reviewed studies, though the level of detail provided varied considerably. We found that very few studies documented other types of validity, and only 6 % of the reviewed articles reported a calibration process. Considering the above findings, we propose a comprehensive model performance evaluation framework (checklist), informed by a review of best-practice guidelines. This framework provides a basis for more accurate and consistent documentation of model performance evaluation. This will improve the peer review process and the comparability of modelling studies. Recognising the fundamental role of decision analytic models in informing public funding decisions, the proposed

Assessment of performance validity in the Stroop Color and Word Test in mild traumatic brain injury patients: a criterion-groups validation design.

PubMed

Guise, Brian J; Thompson, Matthew D; Greve, Kevin W; Bianchini, Kevin J; West, Laura

2014-03-01

The current study assessed performance validity on the Stroop Color and Word Test (Stroop) in mild traumatic brain injury (TBI) using criterion-groups validation. The sample consisted of 77 patients with a reported history of mild TBI. Data from 42 moderate-severe TBI and 75 non-head-injured patients with other clinical diagnoses were also examined. TBI patients were categorized on the basis of Slick, Sherman, and Iverson (1999) criteria for malingered neurocognitive dysfunction (MND). Classification accuracy is reported for three indicators (Word, Color, and Color-Word residual raw scores) from the Stroop across a range of injury severities. With false-positive rates set at approximately 5%, sensitivity was as high as 29%. The clinical implications of these findings are discussed. © 2012 The British Psychological Society.

Establishing the reliability and concurrent validity of physical performance tests using virtual reality equipment for community-dwelling healthy elders.

PubMed

Griswold, David; Rockwell, Kyle; Killa, Carri; Maurer, Michael; Landgraff, Nancy; Learman, Ken

2015-01-01

The aim of this study was to determine the reliability and concurrent validity of commonly used physical performance tests using the OmniVR Virtual Rehabilitation System for healthy community-dwelling elders. Participants (N = 40) were recruited by the authors and were screened for eligibility. The initial method of measurement was randomized to either virtual reality (VR) or clinically based measures (CM). Physical performance tests included the five times sit to stand, Timed Up and Go (TUG), Forward Functional Reach (FFR) and 30-s stand test. A random number generator determined the testing order. The test-re-test reliability for the VR and CM was determined. Furthermore, concurrent validity was determined using a Pearson product moment correlation (Pearson r). The VR demonstrated excellent reliability for 5 × STS intraclass correlation coefficient (ICC) = 0.931(3,1), FFR ICC = 0.846(3,1) and the TUG ICC = 0.944(3,1). The concurrent validity data for the VR and CM (ICC 3, k) were moderate for FFR ICC = 0.682, excellent 5 × STS ICC = 0.889 and excellent for the TUG ICC = 0.878. The concurrent validity of the 30-s stand test was good ICC = 0.735(3,1). This study supports the use of VR equipment for measuring physical performance tests in the clinic for healthy community-dwelling elders. Virtual reality equipment is not only used to treat balance impairments but it is also used to measure and determine physical impairments through the use of physical performance tests. Virtual reality equipment is a reliable and valid tool for collecting physical performance data for the 5 × STS, FFR, TUG and 30-s stand test for healthy community-dwelling elders.