Towards a Better Understanding of the Legibility Bias in Performance Assessments: The Case of Gender-Based Inferences

ERIC Educational Resources Information Center

Greifeneder, Rainer; Zelt, Sarah; Seele, Tim; Bottenberg, Konstantin; Alt, Alexander

2012-01-01

Background: Handwriting legibility systematically biases evaluations in that highly legible handwriting results in more positive evaluations than less legible handwriting. Because performance assessments in educational contexts are not only based on computerized or multiple choice tests but often include the evaluation of handwritten work samples,…

Wavelet-based compression of pathological images for telemedicine applications

NASA Astrophysics Data System (ADS)

Chen, Chang W.; Jiang, Jianfei; Zheng, Zhiyong; Wu, Xue G.; Yu, Lun

2000-05-01

In this paper, we present the performance evaluation of wavelet-based coding techniques as applied to the compression of pathological images for application in an Internet-based telemedicine system. We first study how well suited the wavelet-based coding is as it applies to the compression of pathological images, since these images often contain fine textures that are often critical to the diagnosis of potential diseases. We compare the wavelet-based compression with the DCT-based JPEG compression in the DICOM standard for medical imaging applications. Both objective and subjective measures have been studied in the evaluation of compression performance. These studies are performed in close collaboration with expert pathologists who have conducted the evaluation of the compressed pathological images and communication engineers and information scientists who designed the proposed telemedicine system. These performance evaluations have shown that the wavelet-based coding is suitable for the compression of various pathological images and can be integrated well with the Internet-based telemedicine systems. A prototype of the proposed telemedicine system has been developed in which the wavelet-based coding is adopted for the compression to achieve bandwidth efficient transmission and therefore speed up the communications between the remote terminal and the central server of the telemedicine system.

Analytically Quantifying Gains in the Test and Evaluation Process through Capabilities-Based Analysis

DTIC Science & Technology

2011-09-01

Evaluation Process through Capabilities-Based Analysis 5. FUNDING NUMBERS 6. AUTHOR(S) Eric J. Lednicky 7. PERFORMING ORGANIZATION NAME(S) AND...ADDRESS(ES) Naval Postgraduate School Monterey, CA 93943-5000 8. PERFORMING ORGANIZATION REPORT NUMBER 9. SPONSORING /MONITORING AGENCY NAME(S...14 C. MEASURES OF EFFECTIVENESS / MEASURES OF PERFORMANCE

Mining Formative Evaluation Rules Using Web-Based Learning Portfolios for Web-Based Learning Systems

ERIC Educational Resources Information Center

Chen, Chih-Ming; Hong, Chin-Ming; Chen, Shyuan-Yi; Liu, Chao-Yu

2006-01-01

Learning performance assessment aims to evaluate what knowledge learners have acquired from teaching activities. Objective technical measures of learning performance are difficult to develop, but are extremely important for both teachers and learners. Learning performance assessment using learning portfolios or web server log data is becoming an…

Development, evaluation and application of performance-based brake testing technologies field test : executive summary

DOT National Transportation Integrated Search

1999-09-01

This report presents the results of the field test portion of the Development, Evaluation, and Application of Performance-Based Brake Testing Technologies sponsored by the Federal Highway Administrations (FHWA) Office of Motor Carriers.

Rule based design of conceptual models for formative evaluation

NASA Technical Reports Server (NTRS)

Moore, Loretta A.; Chang, Kai; Hale, Joseph P.; Bester, Terri; Rix, Thomas; Wang, Yaowen

1994-01-01

A Human-Computer Interface (HCI) Prototyping Environment with embedded evaluation capability has been investigated. This environment will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. This environment, which allows for rapid prototyping and evaluation of graphical interfaces, includes the following four components: (1) a HCI development tool; (2) a low fidelity simulator development tool; (3) a dynamic, interactive interface between the HCI and the simulator; and (4) an embedded evaluator that evaluates the adequacy of a HCI based on a user's performance. The embedded evaluation tool collects data while the user is interacting with the system and evaluates the adequacy of an interface based on a user's performance. This paper describes the design of conceptual models for the embedded evaluation system using a rule-based approach.

Rule based design of conceptual models for formative evaluation

NASA Technical Reports Server (NTRS)

Moore, Loretta A.; Chang, Kai; Hale, Joseph P.; Bester, Terri; Rix, Thomas; Wang, Yaowen

1994-01-01

A Human-Computer Interface (HCI) Prototyping Environment with embedded evaluation capability has been investigated. This environment will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. This environment, which allows for rapid prototyping and evaluation of graphical interfaces, includes the following four components: (1) a HCI development tool, (2) a low fidelity simulator development tool, (3) a dynamic, interactive interface between the HCI and the simulator, and (4) an embedded evaluator that evaluates the adequacy of a HCI based on a user's performance. The embedded evaluation tool collects data while the user is interacting with the system and evaluates the adequacy of an interface based on a user's performance. This paper describes the design of conceptual models for the embedded evaluation system using a rule-based approach.

Evaluating Web-Based Learning and Instruction (WBLI): A Case Study and Framework for Evaluation.

ERIC Educational Resources Information Center

Michalski, Greg V.

The purpose of this paper is to suggest an alternative approach to perform relevant and useful evaluations of Web-based learning and instruction (WBLI) that will accommodate performance and keep pace with the growing capabilities of the Internet. Discussion includes the advantages of WBLI, multimedia and streaming use in WBLI, building the…

The Practical Concept of an Evaluator and Its Use in the Design of Training Systems.

ERIC Educational Resources Information Center

Gibbons, Andrew S.; Rogers, Dwayne H.

1991-01-01

The evaluator is an instructional system product that provides practice, testing capability, and feedback in a way not yet seen in computer-assisted instruction. Training methods using an evaluator contain scenario-based simulation exercises, followed by a critique of performance. A focus on competency-based education and performance makes the…

Evaluating the Effect of Learning Style and Student Background on Self-Assessment Accuracy

ERIC Educational Resources Information Center

Alaoutinen, Satu

2012-01-01

This study evaluates a new taxonomy-based self-assessment scale and examines factors that affect assessment accuracy and course performance. The scale is based on Bloom's Revised Taxonomy and is evaluated by comparing students' self-assessment results with course performance in a programming course. Correlation has been used to reveal possible…

Classroom Teacher's Performance-Based Evaluation Form (CTPBEF) for Public Education Schools in the State of Kuwait: A Framework

ERIC Educational Resources Information Center

Al-Shammari, Zaid; Yawkey, Thomas D.

2008-01-01

This investigation using Grounded Theory focuses on developing, designing and testing out an evaluation method used as a framework for this study. This framework evolved into the instrument entitled, "Classroom Teacher's Performance Based Evaluation Form (CTPBEF)". This study shows the processes and procedures used in CTPBEF's…

Advanced Video Analysis Needs for Human Performance Evaluation

NASA Technical Reports Server (NTRS)

Campbell, Paul D.

1994-01-01

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

Use of cognitive task analysis to guide the development of performance-based assessments for intraoperative decision making.

PubMed

Pugh, Carla M; DaRosa, Debra A

2013-10-01

There is a paucity of performance-based assessments that focus on intraoperative decision making. The purpose of this article is to review the performance outcomes and usefulness of two performance-based assessments that were developed using cognitive task analysis (CTA) frameworks. Assessment-A used CTA to create a "think aloud" oral examination that was administered while junior residents (PGY 1-2's, N = 69) performed a porcine-based laparoscopic cholecystectomy. Assessment-B used CTA to create a simulation-based, formative assessment of senior residents' (PGY 4-5's, N = 29) decision making during a laparoscopic ventral hernia repair. In addition to survey-based assessments of usefulness, a multiconstruct evaluation was performed using eight variables. When comparing performance outcomes, both approaches revealed major deficiencies in residents' intraoperative decision-making skills. Multiconstruct evaluation of the two CTA approaches revealed assessment method advantages for five of the eight evaluation areas: (1) Cognitive Complexity, (2) Content Quality, (3) Content Coverage, (4) Meaningfulness, and (5) Transfer and Generalizability. The two CTA performance assessments were useful in identifying significant training needs. While there are pros and cons to each approach, the results serve as a useful blueprint for program directors seeking to develop performance-based assessments for intraoperative decision making. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

OWL2 benchmarking for the evaluation of knowledge based systems.

PubMed

Khan, Sher Afgun; Qadir, Muhammad Abdul; Abbas, Muhammad Azeem; Afzal, Muhammad Tanvir

2017-01-01

OWL2 semantics are becoming increasingly popular for the real domain applications like Gene engineering and health MIS. The present work identifies the research gap that negligible attention has been paid to the performance evaluation of Knowledge Base Systems (KBS) using OWL2 semantics. To fulfil this identified research gap, an OWL2 benchmark for the evaluation of KBS is proposed. The proposed benchmark addresses the foundational blocks of an ontology benchmark i.e. data schema, workload and performance metrics. The proposed benchmark is tested on memory based, file based, relational database and graph based KBS for performance and scalability measures. The results show that the proposed benchmark is able to evaluate the behaviour of different state of the art KBS on OWL2 semantics. On the basis of the results, the end users (i.e. domain expert) would be able to select a suitable KBS appropriate for his domain.

Evaluating the performance of a fault detection and diagnostic system for vapor compression equipment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Breuker, M.S.; Braun, J.E.

This paper presents a detailed evaluation of the performance of a statistical, rule-based fault detection and diagnostic (FDD) technique presented by Rossi and Braun (1997). Steady-state and transient tests were performed on a simple rooftop air conditioner over a range of conditions and fault levels. The steady-state data without faults were used to train models that predict outputs for normal operation. The transient data with faults were used to evaluate FDD performance. The effect of a number of design variables on FDD sensitivity for different faults was evaluated and two prototype systems were specified for more complete evaluation. Good performancemore » was achieved in detecting and diagnosing five faults using only six temperatures (2 input and 4 output) and linear models. The performance improved by about a factor of two when ten measurements (three input and seven output) and higher order models were used. This approach for evaluating and optimizing the performance of the statistical, rule-based FDD technique could be used as a design and evaluation tool when applying this FDD method to other packaged air-conditioning systems. Furthermore, the approach could also be modified to evaluate the performance of other FDD methods.« less

Overall Performance Evaluation of Tubular Scraper Conveyors Using a TOPSIS-Based Multiattribute Decision-Making Method

PubMed Central

Yao, Yanping; Kou, Ziming; Meng, Wenjun; Han, Gang

2014-01-01

Properly evaluating the overall performance of tubular scraper conveyors (TSCs) can increase their overall efficiency and reduce economic investments, but such methods have rarely been studied. This study evaluated the overall performance of TSCs based on the technique for order of preference by similarity to ideal solution (TOPSIS). Three conveyors of the same type produced in the same factory were investigated. Their scraper space, material filling coefficient, and vibration coefficient of the traction components were evaluated. A mathematical model of the multiattribute decision matrix was constructed; a weighted judgment matrix was obtained using the DELPHI method. The linguistic positive-ideal solution (LPIS), the linguistic negative-ideal solution (LNIS), and the distance from each solution to the LPIS and the LNIS, that is, the approximation degrees, were calculated. The optimal solution was determined by ordering the approximation degrees for each solution. The TOPSIS-based results were compared with the measurement results provided by the manufacturer. The ordering result based on the three evaluated parameters was highly consistent with the result provided by the manufacturer. The TOPSIS-based method serves as a suitable evaluation tool for the overall performance of TSCs. It facilitates the optimal deployment of TSCs for industrial purposes. PMID:24991646

A mechanistic-empirical approach for evaluating the effect of diamond grinding and thin overlay on predicted pavement performance.

DOT National Transportation Integrated Search

2016-04-01

Advancements in pavement management practice require evaluating the performance of pavement preservation treatments using performance-related characteristics. However, state highway agencies face the challenge of developing performance-based relation...

Assessing the Promise of Standards-Based Performance Evaluation for Principals: Results from a Randomized Trial

ERIC Educational Resources Information Center

Kimball, Steven Miller; Milanowski, Anthony; McKinney, Sarah A.

2009-01-01

Principals (N = 76) in a large western U.S. school district were randomly assigned to be evaluated using either a new standards-based system or to continue with the old system. It was hypothesized that principals evaluated with the new system would report clearer performance expectations, better feedback, greater fairness and system satisfaction,…

Performance of Northeastern United States wood species treated with copper based preservatives: 10 year above-ground decking evaluation

Treesearch

S. T. Lebow; S. A. Halverson

2015-01-01

Research was conducted to evaluate the decking performance of northeastern United States wood species treated with copper based preservatives. Decking specimens were treated with one of four wood preservatives and exposed near Madison, Wisconsin. Specimens were evaluated for biological attack and dimensional stability. After 10 years, none of the preservative treated...

Performance evaluation of TDT soil water content and watermark soil water potential sensors

USDA-ARS?s Scientific Manuscript database

This study evaluated the performance of digitized Time Domain Transmissometry (TDT) soil water content sensors (Acclima, Inc., Meridian, ID) and resistance-based soil water potential sensors (Watermark 200, Irrometer Company, Inc., Riverside, CA) in two soils. The evaluation was performed by compar...

The Politics of Teacher Reform in Florida: Analyzing Causal Narratives Surrounding State Adoption of Performance-Based Evaluations, Performance Pay, and Tenure Elimination

ERIC Educational Resources Information Center

Harrison, Christopher; Cohen-Vogel, Lora

2012-01-01

Following a multiyear debate, Florida lawmakers passed the "Student Success Act" in March 2011, introducing some of the most sweeping educational reforms in the state's history--the introduction of teacher evaluation systems based on value-added modeling, mandatory "performance pay" for teachers, and the elimination of…

Evaluation of g seat augmentation of fixed-base/moving base simulation for transport landings under two visually imposed runway width conditions

NASA Technical Reports Server (NTRS)

Parrish, R. V.; Steinmetz, G. G.

1983-01-01

Vertical-motion cues supplied by a g-seat to augment platform motion cues in the other five degrees of freedom were evaluated in terms of their effect on objective performance measures obtained during simulated transport landings under visual conditions. In addition to evaluating the effects of the vertical cueing, runway width and magnification effects were investigated. The g-seat was evaluated during fixed base and moving-base operations. Although performance with the g-seat only improved slightly over that with fixed-base operation, combined g-seat platform operation showed no improvement over improvement over platform-only operation. When one runway width at one magnification factor was compared with another width at a different factor, the visual results indicated that the runway width probably had no effect on pilot-vehicle performance. The new performance differences that were detected may be more readily attributed to the extant (existing throughout) increase in vertical velocity induced by the magnification factor used to change the runway width, rather than to the width itself.

A Java-based fMRI processing pipeline evaluation system for assessment of univariate general linear model and multivariate canonical variate analysis-based pipelines.

PubMed

Zhang, Jing; Liang, Lichen; Anderson, Jon R; Gatewood, Lael; Rottenberg, David A; Strother, Stephen C

2008-01-01

As functional magnetic resonance imaging (fMRI) becomes widely used, the demands for evaluation of fMRI processing pipelines and validation of fMRI analysis results is increasing rapidly. The current NPAIRS package, an IDL-based fMRI processing pipeline evaluation framework, lacks system interoperability and the ability to evaluate general linear model (GLM)-based pipelines using prediction metrics. Thus, it can not fully evaluate fMRI analytical software modules such as FSL.FEAT and NPAIRS.GLM. In order to overcome these limitations, a Java-based fMRI processing pipeline evaluation system was developed. It integrated YALE (a machine learning environment) into Fiswidgets (a fMRI software environment) to obtain system interoperability and applied an algorithm to measure GLM prediction accuracy. The results demonstrated that the system can evaluate fMRI processing pipelines with univariate GLM and multivariate canonical variates analysis (CVA)-based models on real fMRI data based on prediction accuracy (classification accuracy) and statistical parametric image (SPI) reproducibility. In addition, a preliminary study was performed where four fMRI processing pipelines with GLM and CVA modules such as FSL.FEAT and NPAIRS.CVA were evaluated with the system. The results indicated that (1) the system can compare different fMRI processing pipelines with heterogeneous models (NPAIRS.GLM, NPAIRS.CVA and FSL.FEAT) and rank their performance by automatic performance scoring, and (2) the rank of pipeline performance is highly dependent on the preprocessing operations. These results suggest that the system will be of value for the comparison, validation, standardization and optimization of functional neuroimaging software packages and fMRI processing pipelines.

Performance evaluation methodology for historical document image binarization.

PubMed

Ntirogiannis, Konstantinos; Gatos, Basilis; Pratikakis, Ioannis

2013-02-01

Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization evaluation methodology for historical handwritten/machine-printed document images. In the proposed evaluation scheme, the recall and precision evaluation measures are properly modified using a weighting scheme that diminishes any potential evaluation bias. Additional performance metrics of the proposed evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based evaluation measures demonstrate the validity of the proposed evaluation scheme.

Performance evaluation method of electric energy data acquire system based on combination of subjective and objective weights

NASA Astrophysics Data System (ADS)

Gao, Chen; Ding, Zhongan; Deng, Bofa; Yan, Shengteng

2017-10-01

According to the characteristics of electric energy data acquire system (EEDAS), considering the availability of each index data and the connection between the index integrity, establishing the performance evaluation index system of electric energy data acquire system from three aspects as master station system, communication channel, terminal equipment. To determine the comprehensive weight of each index based on triangular fuzzy number analytic hierarchy process with entropy weight method, and both subjective preference and objective attribute are taken into consideration, thus realize the performance comprehensive evaluation more reasonable and reliable. Example analysis shows that, by combination with analytic hierarchy process (AHP) and triangle fuzzy numbers (TFN) to establish comprehensive index evaluation system based on entropy method, the evaluation results not only convenient and practical, but also more objective and accurate.

Systems Analysis Of Advanced Coal-Based Power Plants

NASA Technical Reports Server (NTRS)

Ferrall, Joseph F.; Jennings, Charles N.; Pappano, Alfred W.

1988-01-01

Report presents appraisal of integrated coal-gasification/fuel-cell power plants. Based on study comparing fuel-cell technologies with each other and with coal-based alternatives and recommends most promising ones for research and development. Evaluates capital cost, cost of electricity, fuel consumption, and conformance with environmental standards. Analyzes sensitivity of cost of electricity to changes in fuel cost, to economic assumptions, and to level of technology. Recommends further evaluation of integrated coal-gasification/fuel-cell integrated coal-gasification/combined-cycle, and pulverized-coal-fired plants. Concludes with appendixes detailing plant-performance models, subsystem-performance parameters, performance goals, cost bases, plant-cost data sheets, and plant sensitivity to fuel-cell performance.

Evaluation of hybrid binder for use in surface mixtures in Florida : final report, June 2009.

DOT National Transportation Integrated Search

2009-06-01

Binder and mixture tests were performed to evaluate the relative performance of a PG 67-22 base binder and six other commercially available binders produced by modifying the same base binder with the following modifiers: one Styrene Butadiene Styrene...

Is Performance Feedback for Educators an Evidence-Based Practice? A Systematic Review and Evaluation Based on Single-Case Research

ERIC Educational Resources Information Center

Fallon, Lindsay M.; Collier-Meek, Melissa A.; Maggin, Daniel M.; Sanetti, Lisa M. H.; Johnson, Austin H.

2015-01-01

Optimal levels of treatment fidelity, a critical moderator of intervention effectiveness, are often difficult to sustain in applied settings. It is unknown whether performance feedback, a widely researched method for increasing educators' treatment fidelity, is an evidence-based practice. The purpose of this review was to evaluate the current…

Study on evaluation index system of operational performance of municipal wastewater treatment plants in China

NASA Astrophysics Data System (ADS)

Xiaoxin, Zhang; Jin, Huang; Ling, Lin; Yan, Li

2018-05-01

According to the undeveloped evaluation method for the operational performance of the municipal wastewater treatment plants, this paper analyzes the policies related to sewage treatment industry based on the investigation of the municipal wastewater treatment plants. The applicable evaluation method for the operational performance was proposed from environmental protection performance, resources and energy consumption, technical and economic performance, production management and main equipment, providing a reliable basis for scientific evaluation of the operation as well as improving the operational performance of municipal wastewater treatment plant.

Evaluating Preclinical Medical Students by Using Computer-Based Problem-Solving Examinations.

ERIC Educational Resources Information Center

Stevens, Ronald H.; And Others

1989-01-01

A study to determine the feasibility of creating and administering computer-based problem-solving examinations for evaluating second-year medical students in immunology and to determine how students would perform on these tests relative to their performances on concurrently administered objective and essay examinations is described. (Author/MLW)

Evaluation of Performance and Perceptions of Electronic vs. Paper Multiple-Choice Exams

ERIC Educational Resources Information Center

Washburn, Shannon; Herman, James; Stewart, Randolph

2017-01-01

In the veterinary professional curriculum, methods of examination in many courses are transitioning from the traditional paper-based exams to electronic-based exams. Therefore, a controlled trial to evaluate the impact of testing methodology on examination performance in a veterinary physiology course was designed and implemented. Formalized…

Performance Evaluation of Extension Education Centers in Universities Based on the Balanced Scorecard

ERIC Educational Resources Information Center

Wu, Hung-Yi; Lin, Yi-Kuei; Chang, Chi-Hsiang

2011-01-01

This study aims at developing a set of appropriate performance evaluation indices mainly based on balanced scorecard (BSC) for extension education centers in universities by utilizing multiple criteria decision making (MCDM). Through literature reviews and experts who have real practical experiences in extension education, adequate performance…

A Performance-Based Method of Student Evaluation

ERIC Educational Resources Information Center

Nelson, G. E.; And Others

1976-01-01

The Problem Oriented Medical Record (which allows practical definition of the behavioral terms thoroughness, reliability, sound analytical sense, and efficiency as they apply to the identification and management of patient problems) provides a vehicle to use in performance based type evaluation. A test-run use of the record is reported. (JT)

Nonprocess solvent use in the furniture refinishing and repair industry: Evaluation of alternative chemical strippers. Final report, September 1993-December 1994

DOE Office of Scientific and Technical Information (OSTI.GOV)

Turner, S.L.

1996-02-01

The report gives results of an evaluation of the feasibility of using alternatives to high volatile organic compound/hazardous air pollutant (VOC/HAP) solvent-based, chemical strippers that are currently used in the furniture repair and refinishing industry to remove both traditional high-VOC lacquer and emerging, low-VOC, wood furniture coatings. Objectives of the research were to: (1) conduct a laboratory evaluation of the performance of five alternative chemical stripper formulations and compare their performance to that of a traditional solvent-based chemical stripper formulation on three coatings types found on wood furniture substrates, and (2) assess, in a furniture refinishing facility, the use ofmore » the best performing alternative chemical stripper on traditional furniture coatings and new emerging low-VOC furniture coatings. Alternative chemical strippers were evaluated based on their stripping effectiveness compare to a methylene-chloride-based stripper.« less

A Two-Stage Multi-Agent Based Assessment Approach to Enhance Students' Learning Motivation through Negotiated Skills Assessment

ERIC Educational Resources Information Center

Chadli, Abdelhafid; Bendella, Fatima; Tranvouez, Erwan

2015-01-01

In this paper we present an Agent-based evaluation approach in a context of Multi-agent simulation learning systems. Our evaluation model is based on a two stage assessment approach: (1) a Distributed skill evaluation combining agents and fuzzy sets theory; and (2) a Negotiation based evaluation of students' performance during a training…

Performance evaluation of the insurance companies based on AHP

NASA Astrophysics Data System (ADS)

Lu, Manhong; Zhu, Kunping

2018-04-01

With the entry of foreign capital, China's insurance industry is under increasing pressure of competition. The performance of a company is the external manifestation of its comprehensive strength. Therefore, the establishment of a scientific evaluation system is of practical significance for the insurance companies. In this paper, based on the financial and non-financial indicators of the companies, the performance evaluation system is constructed by means of the analytic hierarchy process (AHP). In the system, the weights of the indicators which represent the impact on the performance of the companies will be calculated by the process. The evaluation system is beneficial for the companies to realize their own strengths and weaknesses, so as to take steps to enhance the core competitiveness of the companies.

Performance Evaluation of Counter-Based Dynamic Load Balancing Schemes for Massive Contingency Analysis with Different Computing Environments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, Yousu; Huang, Zhenyu; Chavarría-Miranda, Daniel

Contingency analysis is a key function in the Energy Management System (EMS) to assess the impact of various combinations of power system component failures based on state estimation. Contingency analysis is also extensively used in power market operation for feasibility test of market solutions. High performance computing holds the promise of faster analysis of more contingency cases for the purpose of safe and reliable operation of today’s power grids with less operating margin and more intermittent renewable energy sources. This paper evaluates the performance of counter-based dynamic load balancing schemes for massive contingency analysis under different computing environments. Insights frommore » the performance evaluation can be used as guidance for users to select suitable schemes in the application of massive contingency analysis. Case studies, as well as MATLAB simulations, of massive contingency cases using the Western Electricity Coordinating Council power grid model are presented to illustrate the application of high performance computing with counter-based dynamic load balancing schemes.« less

Evaluating the Implementation of Performance Improvement Training: The E[superscript 3] Process for Success

ERIC Educational Resources Information Center

Larbi-Apau, Josephine A.; Moseley, James L.

2008-01-01

This article provides a comprehensive approach to careful review and evaluation of the implementation of performance training intervention. It discusses the E[superscript 3] process for success, a basic framework for evaluating the implementation phase of a training program implemented as a broad-based performance improvement strategy. The intent…

Building an Evaluative Culture: The Key to Effective Evaluation and Results Management

ERIC Educational Resources Information Center

Mayne, John

2009-01-01

As many reviews of results-based performance systems have noted, a weak evaluative culture in an organization undermines attempts at building an effective evaluation and/or results management regime. This article sets out what constitutes a strong evaluative culture where information on performance results is deliberately sought in order to learn…

Blind Source Parameters for Performance Evaluation of Despeckling Filters.

PubMed

Biradar, Nagashettappa; Dewal, M L; Rohit, ManojKumar; Gowre, Sanjaykumar; Gundge, Yogesh

2016-01-01

The speckle noise is inherent to transthoracic echocardiographic images. A standard noise-free reference echocardiographic image does not exist. The evaluation of filters based on the traditional parameters such as peak signal-to-noise ratio, mean square error, and structural similarity index may not reflect the true filter performance on echocardiographic images. Therefore, the performance of despeckling can be evaluated using blind assessment metrics like the speckle suppression index, speckle suppression and mean preservation index (SMPI), and beta metric. The need for noise-free reference image is overcome using these three parameters. This paper presents a comprehensive analysis and evaluation of eleven types of despeckling filters for echocardiographic images in terms of blind and traditional performance parameters along with clinical validation. The noise is effectively suppressed using the logarithmic neighborhood shrinkage (NeighShrink) embedded with Stein's unbiased risk estimation (SURE). The SMPI is three times more effective compared to the wavelet based generalized likelihood estimation approach. The quantitative evaluation and clinical validation reveal that the filters such as the nonlocal mean, posterior sampling based Bayesian estimation, hybrid median, and probabilistic patch based filters are acceptable whereas median, anisotropic diffusion, fuzzy, and Ripplet nonlinear approximation filters have limited applications for echocardiographic images.

Blind Source Parameters for Performance Evaluation of Despeckling Filters

PubMed Central

Biradar, Nagashettappa; Dewal, M. L.; Rohit, ManojKumar; Gowre, Sanjaykumar; Gundge, Yogesh

2016-01-01

The speckle noise is inherent to transthoracic echocardiographic images. A standard noise-free reference echocardiographic image does not exist. The evaluation of filters based on the traditional parameters such as peak signal-to-noise ratio, mean square error, and structural similarity index may not reflect the true filter performance on echocardiographic images. Therefore, the performance of despeckling can be evaluated using blind assessment metrics like the speckle suppression index, speckle suppression and mean preservation index (SMPI), and beta metric. The need for noise-free reference image is overcome using these three parameters. This paper presents a comprehensive analysis and evaluation of eleven types of despeckling filters for echocardiographic images in terms of blind and traditional performance parameters along with clinical validation. The noise is effectively suppressed using the logarithmic neighborhood shrinkage (NeighShrink) embedded with Stein's unbiased risk estimation (SURE). The SMPI is three times more effective compared to the wavelet based generalized likelihood estimation approach. The quantitative evaluation and clinical validation reveal that the filters such as the nonlocal mean, posterior sampling based Bayesian estimation, hybrid median, and probabilistic patch based filters are acceptable whereas median, anisotropic diffusion, fuzzy, and Ripplet nonlinear approximation filters have limited applications for echocardiographic images. PMID:27298618

Validating the ACE Model for Evaluating Student Performance Using a Teaching-Learning Process Based on Computational Modeling Systems

ERIC Educational Resources Information Center

Louzada, Alexandre Neves; Elia, Marcos da Fonseca; Sampaio, Fábio Ferrentini; Vidal, Andre Luiz Pestana

2014-01-01

The aim of this work is to adapt and test, in a Brazilian public school, the ACE model proposed by Borkulo for evaluating student performance as a teaching-learning process based on computational modeling systems. The ACE model is based on different types of reasoning involving three dimensions. In addition to adapting the model and introducing…

An evaluation of performance-arts based HIV-prevention events in London with 13- 16-year-olds.

PubMed

Campbell, Tomás; Bath, Michael; Bradbear, Rachel; Cottle, Justine; Parrett, Neil

2009-09-01

The London borough of Newham is ethnically diverse and is one of the poorest regions in the UK. Rates of teenage pregnancy, sexually transmitted infections (STIs) and HIV are high compared to the rest of the country. One strand of the local school-based HIV-prevention programme for young people utilizes performance arts as a tool for HIV education and prevention. This study evaluated HIV knowledge, confidence and intention to use a condom in two groups of 13- 16-year-olds who had participated in performance-based events. Group 1 (n = 14) participated in a six-week programme of performance arts-based HIV education and prevention workshops, which culminated in a theatre-based performance. Group 2 (n = 65) were audience members who attended the performance. Participants completed a short questionnaire containing both qualitative and quantitative items. Qualitative data suggested that the participants had learned about condoms and their efficacy in preventing acquisition of HIV and sexually transmitted diseases. Quantitative results indicated that after participation in the events, respondents had more information about HIV and condom use; were more confident that they could insist on condom use with partners; and planned to use condoms in the future. There was a statistically significant difference between Groups 1 and 2 but because of the small numbers in Group 1 this result should be interpreted cautiously. Performance-based HIV-prevention activities may be a useful way to deliver HIV-prevention messages to young people. This evaluation will form the basis of a more systematic and robust evaluation of future events.

Performance evaluation of extension education centers in universities based on the balanced scorecard.

PubMed

Wu, Hung-Yi; Lin, Yi-Kuei; Chang, Chi-Hsiang

2011-02-01

This study aims at developing a set of appropriate performance evaluation indices mainly based on balanced scorecard (BSC) for extension education centers in universities by utilizing multiple criteria decision making (MCDM). Through literature reviews and experts who have real practical experiences in extension education, adequate performance evaluation indices have been selected and then utilizing the decision making trial and evaluation laboratory (DEMATEL) and analytic network process (ANP), respectively, further establishes the causality between the four BSC perspectives as well as the relative weights between evaluation indices. According to this previous result, an empirical analysis of the performance evaluation of extension education centers of three universities at Taoyuan County in Taiwan is illustrated by applying VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR). From the analysis results, it indicates that "Learning and growth" is the significant influential factor and it would affect the other three perspectives. In addition, it is discovered that "Internal process" perspective as well as "Financial" perspective play important roles in the performance evaluation of extension education centers. The top three key performance indices are "After-sales service", "Turnover volume", and "Net income". The proposed evaluation model could be considered as a reference for extension education centers in universities to prioritize their improvements on the key performance indices after performing VIKOR analyses. 2010 Elsevier Ltd. All rights reserved.

Development and implementation of an independence rating scale and evaluation process for nursing orientation of new graduates.

PubMed

Durkin, Gregory J

2010-01-01

A wide variety of evaluation formats are available for new graduate nurses, but most of them are single-point evaluation tools that do not provide a clear picture of progress for orientee or educator. This article describes the development of a Web-based evaluation tool that combines learning taxonomies with the Synergy model into a rating scale based on independent performance. The evaluation tool and process provides open 24/7 access to evaluation documentation for members of the orientation team, demystifying the process and clarifying expectations. The implementation of the tool has proven to be transformative in the perceptions of evaluation and performance expectations of new graduates. This tool has been successful at monitoring progress, altering education, and opening dialogue about performance for over 125 new graduate nurses since inception.

Analysis on mechanics response of long-life asphalt pavement at moist hot heavy loading area

NASA Astrophysics Data System (ADS)

Xu, Xinquan; Li, Hao; Wu, Chuanhai; Li, Shanqiang

2018-04-01

Based on the durability of semi-rigid base asphalt pavement test road in Guangdong Yunluo expressway, by comparing the mechanics response of modified semi-rigid base, RCC base and inverted semi-rigid base with the state of continuous, using four unit five parameter model to evaluate rut depth of asphalt pavement structure, and through commonly used fatigue life prediction model to evaluate fatigue performance of three types of asphalt pavement structure. Theoretical calculation and four years tracking observation results of test road show that rut depth of modified semi-rigid base asphalt pavement is the minimum, the road performance is the best, and the fatigue performance is the optimal.

Skylab program earth resources experiment package sensor performance evaluation, volume 1, (S190A)

NASA Technical Reports Server (NTRS)

Kenney, G. P.

1975-01-01

The results of S190A sensor performance evaluation are summarized based on data presented by all contributors to the sensor performance evaluation interim reports. Techniques used in sensor performance evaluation are discussed. Topics discussed include: performance degradation identified during the Skylab missions, S190A and EREP system anomalies that affected S190A performance, and the performance achieved, in terms of pertinent S190A parameters. Additional analyses include final performance analyses completed after submittal of the SL4 interim sensor performance evaluation reports, including completion of detailed analyses of basic performance parameters initiated during the interim report periods and consolidation analyses to reduce independent mission data (SL2, SL3, and SL4) to determine overall performance realized during all three Skylab missions.

Proposed evaluation framework for assessing operator performance with multisensor displays

NASA Technical Reports Server (NTRS)

Foyle, David C.

1992-01-01

Despite aggressive work on the development of sensor fusion algorithms and techniques, no formal evaluation procedures have been proposed. Based on existing integration models in the literature, an evaluation framework is developed to assess an operator's ability to use multisensor, or sensor fusion, displays. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The operator's performance with the sensor fusion display can be compared to the models' predictions based on the operator's performance when viewing the original sensor displays prior to fusion. This allows for the determination as to when a sensor fusion system leads to: 1) poorer performance than one of the original sensor displays (clearly an undesirable system in which the fused sensor system causes some distortion or interference); 2) better performance than with either single sensor system alone, but at a sub-optimal (compared to the model predictions) level; 3) optimal performance (compared to model predictions); or, 4) super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays. An experiment demonstrating the usefulness of the proposed evaluation framework is discussed.

48 CFR 2452.216-70 - Estimated cost, base fee and award fee.

Code of Federal Regulations, 2010 CFR

2010-10-01

...] increments on the schedule set forth in the Performance Evaluation Plan established by the government. The amount payable shall be based on the progress toward completion of contract tasks as determined by the... payments of the award fee in accordance with the schedule established in the Performance Evaluation Plan...

The Evaluation of Teachers' Job Performance Based on Total Quality Management (TQM)

ERIC Educational Resources Information Center

Shahmohammadi, Nayereh

2017-01-01

This study aimed to evaluate teachers' job performance based on total quality management (TQM) model. This was a descriptive survey study. The target population consisted of all primary school teachers in Karaj (N = 2917). Using Cochran formula and simple random sampling, 340 participants were selected as sample. A total quality management…

Mobile Formative Assessment Tool Based on Data Mining Techniques for Supporting Web-Based Learning

ERIC Educational Resources Information Center

Chen, Chih-Ming; Chen, Ming-Chuan

2009-01-01

Current trends clearly indicate that online learning has become an important learning mode. However, no effective assessment mechanism for learning performance yet exists for e-learning systems. Learning performance assessment aims to evaluate what learners learned during the learning process. Traditional summative evaluation only considers final…

An Evaluation Model for Competency Based Teacher Preparatory Programs.

ERIC Educational Resources Information Center

Denton, Jon J.

This discussion describes an evaluation model designed to complement a curriculum development project, the primary goal of which is to structure a performance based program for preservice teachers. Data collected from the implementation of this four-phase model can be used to make decisions for developing and changing performance objectives and…

Development of a model performance-based sign sheeting specification based on the evaluation of nighttime traffic signs using legibility and eye-tracker data.

DOT National Transportation Integrated Search

2010-09-01

This project focused on the evaluation of traffic sign sheeting performance in terms of meeting the nighttime : driver needs. The goal was to develop a nighttime driver needs specification for traffic signs. The : researchers used nighttime sign legi...

Convergent Validity Evidence regarding the Validity of the Chilean Standards-Based Teacher Evaluation System

ERIC Educational Resources Information Center

Santelices, Maria Veronica; Taut, Sandy

2011-01-01

This paper describes convergent validity evidence regarding the mandatory, standards-based Chilean national teacher evaluation system (NTES). The study examined whether NTES identifies--and thereby rewards or punishes--the "right" teachers as high- or low-performing. We collected in-depth teaching performance data on a sample of 58…

An Evaluation of shore-based radio direction finding

DOT National Transportation Integrated Search

1978-09-30

This report describes an evaluation of Radio Direction Finding (RDF) techniques for shore-based position location performed by the Transportation Systems Center (TSC). The evaluation consisted of the following three phases: (1) A preliminary survey t...

Central Data Processing System (CDPS) user's manual: Solar heating and cooling program

NASA Technical Reports Server (NTRS)

1976-01-01

The software and data base management system required to assess the performance of solar heating and cooling systems installed at multiple sites is presented. The instrumentation data associated with these systems is collected, processed, and presented in a form which supported continuity of performance evaluation across all applications. The CDPS consisted of three major elements: communication interface computer, central data processing computer, and performance evaluation data base. Users of the performance data base were identified, and procedures for operation, and guidelines for software maintenance were outlined. The manual also defined the output capabilities of the CDPS in support of external users of the system.

Performance evaluation of structure based and ligand based virtual screening methods on ten selected anti-cancer targets.

PubMed

Ramasamy, Thilagavathi; Selvam, Chelliah

2015-10-15

Virtual screening has become an important tool in drug discovery process. Structure based and ligand based approaches are generally used in virtual screening process. To date, several benchmark sets for evaluating the performance of the virtual screening tool are available. In this study, our aim is to compare the performance of both structure based and ligand based virtual screening methods. Ten anti-cancer targets and their corresponding benchmark sets from 'Demanding Evaluation Kits for Objective In silico Screening' (DEKOIS) library were selected. X-ray crystal structures of protein-ligand complexes were selected based on their resolution. Openeye tools such as FRED, vROCS were used and the results were carefully analyzed. At EF1%, vROCS produced better results but at EF5% and EF10%, both FRED and ROCS produced almost similar results. It was noticed that the enrichment factor values were decreased while going from EF1% to EF5% and EF10% in many cases. Published by Elsevier Ltd.

Study on corporate social responsibility evaluation system based on stakeholder theory

NASA Astrophysics Data System (ADS)

Ma, J.; Deng, Liming

2011-10-01

The issue of Corporate Social Responsibility (CSR) has been attracting the attention from many disciplines such as economics, management, laws, sociality and philosophy since last century. The purpose of this study is to explore the impact of CSR on performance and develop a CSR evaluation system. Building on the definition of CSR and Stakeholder theory, this article built a path-relationship model of CSR and business operation performance. The paper also constructed CSR evaluation system based on KLD index, GRJ report, CSR accounting account, SA8000, ISO14000 etc. The research provides a basis for future studies about the relationship between CSR and business performance and shed some light on the evaluation of CSR practices.

Use of an objective structured clinical exam (OSCE) for early identification of communication skills deficits in interns.

PubMed

Goldhamer, Mary Ellen J; Cohen, Amy; Brooks, Michelle; Macklin, Eric A; Co, John Patrick T; Weinstein, Debra

2018-01-01

There is limited information about whether OSCE during GME orientation can identify trainee communication deficits before these become evident via clinical performance evaluations. Ninety-seven interns matriculating to eight residency programs in six specialties at four hospitals participated in a nine-station communication skills OSCE. Ratings were based on the "Kalamazoo, adapted" communication skills checklist. Possible association with intern performance evaluations was assessed by repeated-measures logistic regression and ROC curves were generated. The mean OSCE score was 4.08 ± 0.27 with a range of 3.3-4.6. Baseline OSCE scores were associated with subsequent communication concerns recorded by faculty, based on 1591 evaluations. A 0.1-unit decrease in the OSCE communication score was associated with an 18% higher odds of being identified with a communication concern by faculty evaluation (odds ratio 1.18, 95% CI 1.01-1.36, p = 0.034). ROC curves did not demonstrate a "cut-off" score (AUC= 0.558). Non-faculty evaluators were 3-5 times more likely than faculty evaluators to identify communication deficits, based on 1900 evaluations. Lower OSCE performance was associated with faculty communication concerns on performance evaluations; however, a "cut-off" score was not demonstrated that could identify trainees for potential early intervention. Multi-source evaluation also identified trainees with communication skills deficits.

An Analysis of Critical Issues in Korean Teacher Evaluation Systems

ERIC Educational Resources Information Center

Choi, Hee Jun; Park, Ji-Hye

2016-01-01

Korea has used three different teacher evaluation systems since the 1960s: teacher performance rating, teacher performance-based pay and teacher evaluation for professional development. A number of studies have focused on an analysis of each evaluation system in terms of its advent, development, advantages and disadvantages, but these studies have…

The performance evaluation model of mining project founded on the weight optimization entropy value method

NASA Astrophysics Data System (ADS)

Mao, Chao; Chen, Shou

2017-01-01

According to the traditional entropy value method still have low evaluation accuracy when evaluating the performance of mining projects, a performance evaluation model of mineral project founded on improved entropy is proposed. First establish a new weight assignment model founded on compatible matrix analysis of analytic hierarchy process (AHP) and entropy value method, when the compatibility matrix analysis to achieve consistency requirements, if it has differences between subjective weights and objective weights, moderately adjust both proportions, then on this basis, the fuzzy evaluation matrix for performance evaluation. The simulation experiments show that, compared with traditional entropy and compatible matrix analysis method, the proposed performance evaluation model of mining project based on improved entropy value method has higher accuracy assessment.

Development of a model performance-based sign sheeting specification based on the evaluation of nighttime traffic signs using legibility and eye-tracker data : data and analyses.

DOT National Transportation Integrated Search

2010-09-01

This report presents data and technical analyses for Texas Department of Transportation Project 0-5235. This : project focused on the evaluation of traffic sign sheeting performance in terms of meeting the nighttime : driver needs. The goal was to de...

Knee extension isometric torque production differences based on verbal motivation given to introverted and extroverted female children.

PubMed

McWhorter, J Wesley; Landers, Merrill; Young, Daniel; Puentedura, E Louie; Hickman, Robbin A; Brooksby, Candi; Liveratti, Marc; Taylor, Lisa

2011-08-01

To date, little research has been conducted to test the efficacy of different forms of motivation based on a female child's personality type. The purpose of this study was to evaluate the ability of female children to perform a maximal knee extension isometric torque test with varying forms of motivation, based on the child's personality type (introvert vs. extrovert). The subjects were asked to perform a maximal isometric knee extension test under three different conditions: 1) with no verbal motivation, 2) with verbal motivation from the evaluator only, and 3) with verbal motivation from a group of their peers and the evaluator combined. A 2×3 mixed ANOVA was significant for an interaction (F 2,62=17.530; p<0.0005). Post hoc testing for the introverted group showed that scores without verbal motivation were significantly higher than with verbal motivation from the evaluator or the evaluator plus the peers. The extroverted group revealed that scores with verbal motivation from the evaluator or the evaluator plus the peers were significantly higher than without verbal motivation. Results suggest that verbal motivation has a varying effect on isometric knee extension torque production in female children with different personality types. Extroverted girls perform better with motivation, whereas introverted girls perform better without motivation from others.

Noninvasive evaluation system of fractured bone based on speckle interferometry

NASA Astrophysics Data System (ADS)

Yamanada, Shinya; Murata, Shigeru; Tanaka, Yohsuke

2010-11-01

This paper presents a noninvasive evaluation system of fractured bone based on speckle interferometry using a modified evaluation index for higher performance, and the experiments are carried out to examine the feasibility in evaluating bone fracture healing and the influence of some system parameters on the performance. From experimental results, it is shown that the presence of fractured part of bone and the state of bone fracture healing are successfully estimated by observing fine speckle fringes on the object surface. The proposed evaluation index also can successfully express the difference between the cases with cut and without it. Since most system parameters are found not to affect the performance of the present technique, the present technique is expected to be applied to various patients that have considerable individual variability.

Associations of Physical Fitness and Academic Performance among Schoolchildren

ERIC Educational Resources Information Center

Van Dusen, Duncan P.; Kelder, Steven H.; Kohl, Harold W., III; Ranjit, Nalini; Perry, Cheryl L.

2011-01-01

Background: Public schools provide opportunities for physical activity and fitness surveillance, but are evaluated and funded based on students' academic performance, not their physical fitness. Empirical research evaluating the connections between fitness and academic performance is needed to justify curriculum allocations to physical activity…

Sensor fusion display evaluation using information integration models in enhanced/synthetic vision applications

NASA Technical Reports Server (NTRS)

Foyle, David C.

1993-01-01

Based on existing integration models in the psychological literature, an evaluation framework is developed to assess sensor fusion displays as might be implemented in an enhanced/synthetic vision system. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The pilot's performance with the sensor fusion image is compared to models' predictions based on the pilot's performance when viewing the original component sensor images prior to fusion. This allows for the determination as to when a sensor fusion system leads to: poorer performance than one of the original sensor displays, clearly an undesirable system in which the fused sensor system causes some distortion or interference; better performance than with either single sensor system alone, but at a sub-optimal level compared to model predictions; optimal performance compared to model predictions; or, super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays.

Chitosan solutions as injectable systems for dermal filler applications: Rheological characterization and biological evidence.

PubMed

Halimi, C; Montembault, A; Guerry, A; Delair, T; Viguier, E; Fulchiron, R; David, L

2015-01-01

A new generation of dermal filler for wrinkle filler based on chitosan was compared to current hyaluronic acid-based dermal fillers by using a new rheological performance criterion based on viscosity during injection related to Newtonian viscosity. In addition an in vivo evaluation was performed for preclinical evidence of chitosan use as dermal filler. In this way, biocompatibility and dermis reconstruction was evaluated on a pig model.

Performance Evaluation of Glottal Inverse Filtering Algorithms Using a Physiologically Based Articulatory Speech Synthesizer

DTIC Science & Technology

2017-01-05

1 Performance Evaluation of Glottal Inverse Filtering Algorithms Using a Physiologically Based Articulatory Speech Synthesizer Yu-Ren Chien, Daryush...D. Mehta, Member, IEEE, Jón Guðnason, Matías Zañartu, Member, IEEE, and Thomas F. Quatieri, Fellow, IEEE Abstract—Glottal inverse filtering aims to...of inverse filtering performance has been challenging due to the practical difficulty in measuring the true glottal signals while speech signals are

Performance Evaluation and Online Realization of Data-driven Normalization Methods Used in LC/MS based Untargeted Metabolomics Analysis.

PubMed

Li, Bo; Tang, Jing; Yang, Qingxia; Cui, Xuejiao; Li, Shuang; Chen, Sijie; Cao, Quanxing; Xue, Weiwei; Chen, Na; Zhu, Feng

2016-12-13

In untargeted metabolomics analysis, several factors (e.g., unwanted experimental &biological variations and technical errors) may hamper the identification of differential metabolic features, which requires the data-driven normalization approaches before feature selection. So far, ≥16 normalization methods have been widely applied for processing the LC/MS based metabolomics data. However, the performance and the sample size dependence of those methods have not yet been exhaustively compared and no online tool for comparatively and comprehensively evaluating the performance of all 16 normalization methods has been provided. In this study, a comprehensive comparison on these methods was conducted. As a result, 16 methods were categorized into three groups based on their normalization performances across various sample sizes. The VSN, the Log Transformation and the PQN were identified as methods of the best normalization performance, while the Contrast consistently underperformed across all sub-datasets of different benchmark data. Moreover, an interactive web tool comprehensively evaluating the performance of 16 methods specifically for normalizing LC/MS based metabolomics data was constructed and hosted at http://server.idrb.cqu.edu.cn/MetaPre/. In summary, this study could serve as a useful guidance to the selection of suitable normalization methods in analyzing the LC/MS based metabolomics data.

Performance Evaluation and Online Realization of Data-driven Normalization Methods Used in LC/MS based Untargeted Metabolomics Analysis

PubMed Central

Li, Bo; Tang, Jing; Yang, Qingxia; Cui, Xuejiao; Li, Shuang; Chen, Sijie; Cao, Quanxing; Xue, Weiwei; Chen, Na; Zhu, Feng

2016-01-01

In untargeted metabolomics analysis, several factors (e.g., unwanted experimental & biological variations and technical errors) may hamper the identification of differential metabolic features, which requires the data-driven normalization approaches before feature selection. So far, ≥16 normalization methods have been widely applied for processing the LC/MS based metabolomics data. However, the performance and the sample size dependence of those methods have not yet been exhaustively compared and no online tool for comparatively and comprehensively evaluating the performance of all 16 normalization methods has been provided. In this study, a comprehensive comparison on these methods was conducted. As a result, 16 methods were categorized into three groups based on their normalization performances across various sample sizes. The VSN, the Log Transformation and the PQN were identified as methods of the best normalization performance, while the Contrast consistently underperformed across all sub-datasets of different benchmark data. Moreover, an interactive web tool comprehensively evaluating the performance of 16 methods specifically for normalizing LC/MS based metabolomics data was constructed and hosted at http://server.idrb.cqu.edu.cn/MetaPre/. In summary, this study could serve as a useful guidance to the selection of suitable normalization methods in analyzing the LC/MS based metabolomics data. PMID:27958387

Fuzzy comprehensive evaluation for grid-connected performance of integrated distributed PV-ES systems

NASA Astrophysics Data System (ADS)

Lv, Z. H.; Li, Q.; Huang, R. W.; Liu, H. M.; Liu, D.

2016-08-01

Based on the discussion about topology structure of integrated distributed photovoltaic (PV) power generation system and energy storage (ES) in single or mixed type, this paper focuses on analyzing grid-connected performance of integrated distributed photovoltaic and energy storage (PV-ES) systems, and proposes a comprehensive evaluation index system. Then a multi-level fuzzy comprehensive evaluation method based on grey correlation degree is proposed, and the calculations for weight matrix and fuzzy matrix are presented step by step. Finally, a distributed integrated PV-ES power generation system connected to a 380 V low voltage distribution network is taken as the example, and some suggestions are made based on the evaluation results.

Evaluating the effectiveness of performance based pavement marking maintenance contracts in Texas.

DOT National Transportation Integrated Search

2014-01-01

Performance-based pavement marking maintenance contracts (PBPMMCs) are one of the latest : mechanisms used to maintain adequate pavement marking performance levels. TxDOT has issued two : PBPMMCs, but the effectiveness of these contracts as compared ...

Evaluation of in-situ thermal energy storage for lunar based solar dynamic systems

NASA Technical Reports Server (NTRS)

Crane, Roger A.

1991-01-01

A practical lunar based thermal energy storage system, based on locally available materials, could significantly reduce transportation requirements and associated costs of a continuous, solar derived power system. The concept reported here is based on a unique, in-situ approach to thermal energy storage. The proposed design is examined to assess the problems of start-up and the requirements for attainment of stable operation. The design remains, at this stage, partially conceptional in nature, but certain aspects of the design, bearing directly on feasibility, are examined in some detail. Specifically included is an engineering evaluation of the projected thermal performance of this system. Both steady state and start-up power requirements are evaluated and the associated thermal losses are evaluated as a basis for establishing potential system performance.

Learning from Evaluation by Peer Team: A Case Study of a Family Counselling Organization

ERIC Educational Resources Information Center

Muniute-Cobb, Eivina I.; Alfred, Mary V.

2010-01-01

This qualitative study explores how employees learn from Team Primacy Concept-based employee evaluation and how they use the feedback in performing their jobs. Team Primacy Concept-based evaluation is a type of multirater evaluation. The distinctive characteristic of such evaluation is its peer feedback component during which the employee's…

An Evaluation of the Performance Diagnostic Checklist-Human Services (PDC-HS) Across Domains.

PubMed

Wilder, David A; Lipschultz, Joshua; Gehrman, Chana

2018-06-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to assess the environmental variables that contribute to poor employee performance in human service settings. Although the PDC-HS has been shown to effectively identify variables contributing to problematic performance, interventions based on only two of the four PDC-HS domains have been evaluated to date. In addition, the extent to which PDC-HS-indicated interventions are more effective than nonindicated interventions for two domains remains unclear. In the current study, we administered the PDC-HS to supervisors to assess the variables contributing to infrequent teaching of verbal operants and use of a timer by therapists at a center-based autism treatment program. Each of the four PDC-HS domains was identified as contributing to poor performance for at least one therapist. We then evaluated PDC-HS-indicated interventions for each domain. In addition, to assess the predictive validity of the tool, we evaluated various nonindicated interventions prior to implementing a PDC-HS-indicated intervention for two of the four domains. Results suggest that the PDC-HS-indicated interventions were effective across all four domains and were more effective than the nonindicated interventions for the two domains for which they were evaluated. Results are discussed in terms of the utility of the PDC-HS to identify appropriate interventions to manage therapist performance in human service settings.

Evaluation methodologies for an advanced information processing system

NASA Technical Reports Server (NTRS)

Schabowsky, R. S., Jr.; Gai, E.; Walker, B. K.; Lala, J. H.; Motyka, P.

1984-01-01

The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.

Multi-objective optimization for generating a weighted multi-model ensemble

NASA Astrophysics Data System (ADS)

Lee, H.

2017-12-01

Many studies have demonstrated that multi-model ensembles generally show better skill than each ensemble member. When generating weighted multi-model ensembles, the first step is measuring the performance of individual model simulations using observations. There is a consensus on the assignment of weighting factors based on a single evaluation metric. When considering only one evaluation metric, the weighting factor for each model is proportional to a performance score or inversely proportional to an error for the model. While this conventional approach can provide appropriate combinations of multiple models, the approach confronts a big challenge when there are multiple metrics under consideration. When considering multiple evaluation metrics, it is obvious that a simple averaging of multiple performance scores or model ranks does not address the trade-off problem between conflicting metrics. So far, there seems to be no best method to generate weighted multi-model ensembles based on multiple performance metrics. The current study applies the multi-objective optimization, a mathematical process that provides a set of optimal trade-off solutions based on a range of evaluation metrics, to combining multiple performance metrics for the global climate models and their dynamically downscaled regional climate simulations over North America and generating a weighted multi-model ensemble. NASA satellite data and the Regional Climate Model Evaluation System (RCMES) software toolkit are used for assessment of the climate simulations. Overall, the performance of each model differs markedly with strong seasonal dependence. Because of the considerable variability across the climate simulations, it is important to evaluate models systematically and make future projections by assigning optimized weighting factors to the models with relatively good performance. Our results indicate that the optimally weighted multi-model ensemble always shows better performance than an arithmetic ensemble mean and may provide reliable future projections.

Pre-Service Identification of Talented Teachers through Non-Traditional Measures: A Study of the Role of Affective Variables as Predictors of Success in Student Teaching.

ERIC Educational Resources Information Center

Basom, Margaret; And Others

1994-01-01

Researchers examined relationships between the SRI Gallup Pre-Professional Teacher Interview and performance-based student teaching evaluations and between SRI Interview and California Student Achievement Test (CAT) scores. A relationship between SRI Interview scores and performance-based student teaching evaluations surfaces. CAT scores did not…

Evaluation of the Relationship between Literacy and Mathematics Skills as Assessed by Curriculum-Based Measures

ERIC Educational Resources Information Center

Rutherford-Becker, Kristy J.; Vanderwood, Michael L.

2009-01-01

The purpose of this study was to evaluate the extent that reading performance (as measured by curriculum-based measures [CBM] of oral reading fluency [ORF] and Maze reading comprehension), is related to math performance (as measured by CBM math computation and applied math). Additionally, this study examined which of the two reading measures was a…

Development and Performance Evaluation of Image-Based Robotic Waxing System for Detailing Automobiles

PubMed Central

Hsu, Bing-Cheng

2018-01-01

Waxing is an important aspect of automobile detailing, aimed at protecting the finish of the car and preventing rust. At present, this delicate work is conducted manually due to the need for iterative adjustments to achieve acceptable quality. This paper presents a robotic waxing system in which surface images are used to evaluate the quality of the finish. An RGB-D camera is used to build a point cloud that details the sheet metal components to enable path planning for a robot manipulator. The robot is equipped with a multi-axis force sensor to measure and control the forces involved in the application and buffing of wax. Images of sheet metal components that were waxed by experienced car detailers were analyzed using image processing algorithms. A Gaussian distribution function and its parameterized values were obtained from the images for use as a performance criterion in evaluating the quality of surfaces prepared by the robotic waxing system. Waxing force and dwell time were optimized using a mathematical model based on the image-based criterion used to measure waxing performance. Experimental results demonstrate the feasibility of the proposed robotic waxing system and image-based performance evaluation scheme. PMID:29757940

Development and Performance Evaluation of Image-Based Robotic Waxing System for Detailing Automobiles.

PubMed

Lin, Chi-Ying; Hsu, Bing-Cheng

2018-05-14

Waxing is an important aspect of automobile detailing, aimed at protecting the finish of the car and preventing rust. At present, this delicate work is conducted manually due to the need for iterative adjustments to achieve acceptable quality. This paper presents a robotic waxing system in which surface images are used to evaluate the quality of the finish. An RGB-D camera is used to build a point cloud that details the sheet metal components to enable path planning for a robot manipulator. The robot is equipped with a multi-axis force sensor to measure and control the forces involved in the application and buffing of wax. Images of sheet metal components that were waxed by experienced car detailers were analyzed using image processing algorithms. A Gaussian distribution function and its parameterized values were obtained from the images for use as a performance criterion in evaluating the quality of surfaces prepared by the robotic waxing system. Waxing force and dwell time were optimized using a mathematical model based on the image-based criterion used to measure waxing performance. Experimental results demonstrate the feasibility of the proposed robotic waxing system and image-based performance evaluation scheme.

Evaluation methodology for query-based scene understanding systems

NASA Astrophysics Data System (ADS)

Huster, Todd P.; Ross, Timothy D.; Culbertson, Jared L.

2015-05-01

In this paper, we are proposing a method for the principled evaluation of scene understanding systems in a query-based framework. We can think of a query-based scene understanding system as a generalization of typical sensor exploitation systems where instead of performing a narrowly defined task (e.g., detect, track, classify, etc.), the system can perform general user-defined tasks specified in a query language. Examples of this type of system have been developed as part of DARPA's Mathematics of Sensing, Exploitation, and Execution (MSEE) program. There is a body of literature on the evaluation of typical sensor exploitation systems, but the open-ended nature of the query interface introduces new aspects to the evaluation problem that have not been widely considered before. In this paper, we state the evaluation problem and propose an approach to efficiently learn about the quality of the system under test. We consider the objective of the evaluation to be to build a performance model of the system under test, and we rely on the principles of Bayesian experiment design to help construct and select optimal queries for learning about the parameters of that model.

Automatic evidence quality prediction to support evidence-based decision making.

PubMed

Sarker, Abeed; Mollá, Diego; Paris, Cécile

2015-06-01

Evidence-based medicine practice requires practitioners to obtain the best available medical evidence, and appraise the quality of the evidence when making clinical decisions. Primarily due to the plethora of electronically available data from the medical literature, the manual appraisal of the quality of evidence is a time-consuming process. We present a fully automatic approach for predicting the quality of medical evidence in order to aid practitioners at point-of-care. Our approach extracts relevant information from medical article abstracts and utilises data from a specialised corpus to apply supervised machine learning for the prediction of the quality grades. Following an in-depth analysis of the usefulness of features (e.g., publication types of articles), they are extracted from the text via rule-based approaches and from the meta-data associated with the articles, and then applied in the supervised classification model. We propose the use of a highly scalable and portable approach using a sequence of high precision classifiers, and introduce a simple evaluation metric called average error distance (AED) that simplifies the comparison of systems. We also perform elaborate human evaluations to compare the performance of our system against human judgments. We test and evaluate our approaches on a publicly available, specialised, annotated corpus containing 1132 evidence-based recommendations. Our rule-based approach performs exceptionally well at the automatic extraction of publication types of articles, with F-scores of up to 0.99 for high-quality publication types. For evidence quality classification, our approach obtains an accuracy of 63.84% and an AED of 0.271. The human evaluations show that the performance of our system, in terms of AED and accuracy, is comparable to the performance of humans on the same data. The experiments suggest that our structured text classification framework achieves evaluation results comparable to those of human performance. Our overall classification approach and evaluation technique are also highly portable and can be used for various evidence grading scales. Copyright © 2015 Elsevier B.V. All rights reserved.

Evaluation of outbreak detection performance using multi-stream syndromic surveillance for influenza-like illness in rural Hubei Province, China: a temporal simulation model based on healthcare-seeking behaviors.

PubMed

Fan, Yunzhou; Wang, Ying; Jiang, Hongbo; Yang, Wenwen; Yu, Miao; Yan, Weirong; Diwan, Vinod K; Xu, Biao; Dong, Hengjin; Palm, Lars; Nie, Shaofa

2014-01-01

Syndromic surveillance promotes the early detection of diseases outbreaks. Although syndromic surveillance has increased in developing countries, performance on outbreak detection, particularly in cases of multi-stream surveillance, has scarcely been evaluated in rural areas. This study introduces a temporal simulation model based on healthcare-seeking behaviors to evaluate the performance of multi-stream syndromic surveillance for influenza-like illness. Data were obtained in six towns of rural Hubei Province, China, from April 2012 to June 2013. A Susceptible-Exposed-Infectious-Recovered model generated 27 scenarios of simulated influenza A (H1N1) outbreaks, which were converted into corresponding simulated syndromic datasets through the healthcare-behaviors model. We then superimposed converted syndromic datasets onto the baselines obtained to create the testing datasets. Outbreak performance of single-stream surveillance of clinic visit, frequency of over the counter drug purchases, school absenteeism, and multi-stream surveillance of their combinations were evaluated using receiver operating characteristic curves and activity monitoring operation curves. In the six towns examined, clinic visit surveillance and school absenteeism surveillance exhibited superior performances of outbreak detection than over the counter drug purchase frequency surveillance; the performance of multi-stream surveillance was preferable to signal-stream surveillance, particularly at low specificity (Sp <90%). The temporal simulation model based on healthcare-seeking behaviors offers an accessible method for evaluating the performance of multi-stream surveillance.

Performance-Based Compensation: Focus on Special Education Teachers. inForum

ERIC Educational Resources Information Center

Burdette, Paula

2011-01-01

The purpose of this document is to describe states' work in the area of performance-based compensation with a focus on special educators, including how teacher evaluation informs compensation decisions, support given to local education agencies (LEAs), variables used to make compensation decisions and how performance-based compensation is funded.…

Evaluating Tasks for Performance-Based Assessments: Advice for Music Teachers

ERIC Educational Resources Information Center

Scott, Sheila

2004-01-01

Performance-based assessments allow teachers to systematically observe skills used or demonstrated by students when they create a product, construct a response, or make a presentation (McMillan 2001). These assessments are grounded in performance-based tasks that elicit students' responses in relation to the outcomes of instruction. The criteria…

Pulse Transit Time Measurement Using Seismocardiogram, Photoplethysmogram, and Acoustic Recordings: Evaluation and Comparison.

PubMed

Yang, Chenxi; Tavassolian, Negar

2018-05-01

This work proposes a novel method of pulse transit time (PTT) measurement. The proximal arterial location data are collected from seismocardiogram (SCG) recordings by placing a micro-electromechanical accelerometer on the chest wall. The distal arterial location data are recorded using an acoustic sensor placed inside the ear. The performance of distal location recordings is evaluated by comparing SCG-acoustic and SCG-photoplethysmogram (PPG) measurements. PPG and acoustic performances under motion noise are also compared. Experimental results suggest comparable performances for the acoustic-based and PPG-based devices. The feasibility of each PTT measurement method is validated for blood pressure evaluations and its limitations are analyzed.

Performance measurement: integrating quality management and activity-based cost management.

PubMed

McKeon, T

1996-04-01

The development of an activity-based management system provides a framework for developing performance measures integral to quality and cost management. Performance measures that cross operational boundaries and embrace core processes provide a mechanism to evaluate operational results related to strategic intention and internal and external customers. The author discusses this measurement process that allows managers to evaluate where they are and where they want to be, and to set a course of action that closes the gap between the two.

A Perspective on Computational Human Performance Models as Design Tools

NASA Technical Reports Server (NTRS)

Jones, Patricia M.

2010-01-01

The design of interactive systems, including levels of automation, displays, and controls, is usually based on design guidelines and iterative empirical prototyping. A complementary approach is to use computational human performance models to evaluate designs. An integrated strategy of model-based and empirical test and evaluation activities is particularly attractive as a methodology for verification and validation of human-rated systems for commercial space. This talk will review several computational human performance modeling approaches and their applicability to design of display and control requirements.

Using satellite observations in performance evaluation for regulatory air quality modeling: Comparison with ground-level measurements

NASA Astrophysics Data System (ADS)

Odman, M. T.; Hu, Y.; Russell, A.; Chai, T.; Lee, P.; Shankar, U.; Boylan, J.

2012-12-01

Regulatory air quality modeling, such as State Implementation Plan (SIP) modeling, requires that model performance meets recommended criteria in the base-year simulations using period-specific, estimated emissions. The goal of the performance evaluation is to assure that the base-year modeling accurately captures the observed chemical reality of the lower troposphere. Any significant deficiencies found in the performance evaluation must be corrected before any base-case (with typical emissions) and future-year modeling is conducted. Corrections are usually made to model inputs such as emission-rate estimates or meteorology and/or to the air quality model itself, in modules that describe specific processes. Use of ground-level measurements that follow approved protocols is recommended for evaluating model performance. However, ground-level monitoring networks are spatially sparse, especially for particulate matter. Satellite retrievals of atmospheric chemical properties such as aerosol optical depth (AOD) provide spatial coverage that can compensate for the sparseness of ground-level measurements. Satellite retrievals can also help diagnose potential model or data problems in the upper troposphere. It is possible to achieve good model performance near the ground, but have, for example, erroneous sources or sinks in the upper troposphere that may result in misleading and unrealistic responses to emission reductions. Despite these advantages, satellite retrievals are rarely used in model performance evaluation, especially for regulatory modeling purposes, due to the high uncertainty in retrievals associated with various contaminations, for example by clouds. In this study, 2007 was selected as the base year for SIP modeling in the southeastern U.S. Performance of the Community Multiscale Air Quality (CMAQ) model, at a 12-km horizontal resolution, for this annual simulation is evaluated using both recommended ground-level measurements and non-traditional satellite retrievals. Evaluation results are assessed against recommended criteria and peer studies in the literature. Further analysis is conducted, based upon these assessments, to discover likely errors in model inputs and potential deficiencies in the model itself. Correlations as well as differences in input errors and model deficiencies revealed by ground-level measurements versus satellite observations are discussed. Additionally, sensitivity analyses are employed to investigate errors in emission-rate estimates using either ground-level measurements or satellite retrievals, and the results are compared against each other considering observational uncertainties. Recommendations are made for how to effectively utilize satellite retrievals in regulatory air quality modeling.

Research, Teaching and Performance Evaluation in Academia: The Salience of Quality

ERIC Educational Resources Information Center

Cadez, Simon; Dimovski, Vlado; Zaman Groff, Maja

2017-01-01

The workload of most academics involves two main activities: research and teaching. Despite the dual nature of the work, career advancement usually chiefly depends on research performance. Since academics are rational actors, warnings are beginning to emerge that current predominantly research-based performance evaluation systems may be…

45 CFR 2516.810 - What types of evaluations are grantees and subgrantees required to perform?

Code of Federal Regulations, 2010 CFR

2010-10-01

... Welfare (Continued) CORPORATION FOR NATIONAL AND COMMUNITY SERVICE SCHOOL-BASED SERVICE-LEARNING PROGRAMS...? All grantees and subgrantees are required to perform internal evaluations which are ongoing efforts to assess performance and improve quality. Grantees and subgrantees may, but are not required to, arrange...

Defining Administrative Tasks, Evaluating Performance, and Developing Skills.

ERIC Educational Resources Information Center

Herman, Janice L.; Herman, Jerry J.

1995-01-01

To ensure high performance, administrators should develop an articulated structure and process systems approach that identifies the critical success factors (CSFs) of performance for each position; appropriate indicators and scales; and a personal-improvement plan based on last year's evaluation. Once CSFs are identified and written into the…

MEASUREMENT OF VOLATILE ORGANIC COMPOUNDS BY THE US ENVIRONMENTAL PROTECTION AGENCY COMPENDIUM METHOD TO-17 - EVALUATION OF PERFORMANCE CRITERIA

EPA Science Inventory

An evaluation of performance criteria for US Environmental Protection Agency Compendium Method TO-17 for monitoring volatile organic compounds (VOCs) in air has been accomplished. The method is a solid adsorbent-based sampling and analytical procedure including performance crit...

The Emergence of Contesting Motives for Student Feedback-Based Evaluation in Australian Higher Education

ERIC Educational Resources Information Center

Darwin, Stephen

2016-01-01

Student feedback-based evaluation performs a significant social role in framing perceptions of the quality of teaching in contemporary Australian higher education. Yet its emergence is a relatively recent phenomenon, having only been in widespread application since the mid-1980s. The early manifestations of student feedback-based evaluation came…

Catchment area-based evaluation of the AMC-dependent SCS-CN-based rainfall-runoff models

NASA Astrophysics Data System (ADS)

Mishra, S. K.; Jain, M. K.; Pandey, R. P.; Singh, V. P.

2005-09-01

Using a large set of rainfall-runoff data from 234 watersheds in the USA, a catchment area-based evaluation of the modified version of the Mishra and Singh (2002a) model was performed. The model is based on the Soil Conservation Service Curve Number (SCS-CN) methodology and incorporates the antecedent moisture in computation of direct surface runoff. Comparison with the existing SCS-CN method showed that the modified version performed better than did the existing one on the data of all seven area-based groups of watersheds ranging from 0.01 to 310.3 km2.

Performance Evaluation of Bucket based Excavating, Loading and Transport (BELT) Equipment - An OEE Approach

NASA Astrophysics Data System (ADS)

Mohammadi, Mousa; Rai, Piyush; Gupta, Suprakash

2017-03-01

Overall Equipment Effectiveness (OEE) has been used since last over two decades as a measure of performance in manufacturing industries. Unfortunately, enough, application of OEE in mining and excavation industry has not been duly adopted. In this paper an effort has been made to identify the OEE for performance evaluation of Bucket based Excavating, Loading and Transport (BELT) equipment. The conceptual model of OEE, as used in the manufacturing industries, has been revised to adapt to the BELT equipment. The revised and adapted model considered the operational time, speed and bucket capacity utilization losses as the key OEE components for evaluating the performance of BELT equipment. To illustrate the efficacy of the devised model on real-time basis, a case study was undertaken on the biggest single bucket excavating equipment - the dragline, in a large surface coal mine. One-year data was collected in order to evaluate the proposed OEE model.

[Concept extraction of graduate research by modified grounded theory approach and creating of rubric oriented to performance evaluation].

PubMed

Yasuhara, Tomohisa; Sone, Tomomichi; Kohno, Takeyuki; Ogita, Kiyokazu

2015-01-01

  A revised core curriculum model for pharmaceutical education, developed on the basis of the principles of outcome-based education, will be introduced in 2015. Inevitably, appropriate assessments of students' academic achievements will be required. Although evaluations of the cognitive domain can be carried out by paper tests, evaluation methods for the attitude domain and problem-solving abilities need to be established. From the viewpoint of quality assurance for graduates, pharmaceutical education reforms have become vital to evaluation as well as learning strategies. To evaluate student academic achievements on problem-solving abilities, authentic assessment is required. Authentic assessment is the evaluation that mimics the context tried in work and life. Specifically, direct evaluation of performances, demonstration or the learners' own work with integrated variety knowledge and skills, is required. To clarify the process of graduate research, we obtained qualitative data through focus group interviews with six teachers and analyzed the data using the modified grounded theory approach. Based on the results, we clarify the performance students should show in graduate research and create a rubric for evaluation of performance in graduate research.

26 CFR 31.3121(b)(10)-2 - Services performed by certain students in the employ of a school, college, or university, or of a...

Code of Federal Regulations, 2012 CFR

2012-04-01

... is evaluated based on all the relevant facts and circumstances related to the educational aspect of the relationship. The service aspect of the relationship is evaluated based on all the relevant facts... relationship is not affected by the fact that the services performed by the employee may have an educational...

26 CFR 31.3121(b)(10)-2 - Services performed by certain students in the employ of a school, college, or university, or of a...

Code of Federal Regulations, 2014 CFR

2014-04-01

... is evaluated based on all the relevant facts and circumstances related to the educational aspect of the relationship. The service aspect of the relationship is evaluated based on all the relevant facts... relationship is not affected by the fact that the services performed by the employee may have an educational...

Multi-Fidelity Framework for Modeling Combustion Instability

DTIC Science & Technology

2016-07-27

generated from the reduced-domain dataset. Evaluations of the framework are performed based on simplified test problems for a model rocket combustor showing...generated from the reduced-domain dataset. Evaluations of the framework are performed based on simplified test problems for a model rocket combustor...of Aeronautics and Astronautics and Associate Fellow AIAA. ‡ Professor Emeritus. § Senior Scientist, Rocket Propulsion Division and Senior Member

On Applying the Prognostic Performance Metrics

NASA Technical Reports Server (NTRS)

Saxena, Abhinav; Celaya, Jose; Saha, Bhaskar; Saha, Sankalita; Goebel, Kai

2009-01-01

Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.

Experimental evaluation of multiprocessor cache-based error recovery

NASA Technical Reports Server (NTRS)

Janssens, Bob; Fuchs, W. K.

1991-01-01

Several variations of cache-based checkpointing for rollback error recovery in shared-memory multiprocessors have been recently developed. By modifying the cache replacement policy, these techniques use the inherent redundancy in the memory hierarchy to periodically checkpoint the computation state. Three schemes, different in the manner in which they avoid rollback propagation, are evaluated. By simulation with address traces from parallel applications running on an Encore Multimax shared-memory multiprocessor, the performance effect of integrating the recovery schemes in the cache coherence protocol are evaluated. The results indicate that the cache-based schemes can provide checkpointing capability with low performance overhead but uncontrollable high variability in the checkpoint interval.

Vibration-based monitoring for performance evaluation of flexible civil structures in Japan.

PubMed

Fujino, Yozo

2018-01-01

The vibration-based monitoring of flexible civil structures and performance evaluation from this monitoring are reviewed, with an emphasis on research and practice in Japan and the author's experiences. Some new findings and unexpected vibrations from the monitoring of real bridges and buildings are reported to emphasize the importance of monitoring. Future developments and applications of vibration-based monitoring to civil infrastructure management are also described. Many examples are taken from the author's past 30 years' experience of research on bridge dynamics.

Performance evaluation of an agent-based occupancy simulation model

DOE PAGES

Luo, Xuan; Lam, Khee Poh; Chen, Yixing; ...

2017-01-17

Occupancy is an important factor driving building performance. Static and homogeneous occupant schedules, commonly used in building performance simulation, contribute to issues such as performance gaps between simulated and measured energy use in buildings. Stochastic occupancy models have been recently developed and applied to better represent spatial and temporal diversity of occupants in buildings. However, there is very limited evaluation of the usability and accuracy of these models. This study used measured occupancy data from a real office building to evaluate the performance of an agent-based occupancy simulation model: the Occupancy Simulator. The occupancy patterns of various occupant types weremore » first derived from the measured occupant schedule data using statistical analysis. Then the performance of the simulation model was evaluated and verified based on (1) whether the distribution of observed occupancy behavior patterns follows the theoretical ones included in the Occupancy Simulator, and (2) whether the simulator can reproduce a variety of occupancy patterns accurately. Results demonstrated the feasibility of applying the Occupancy Simulator to simulate a range of occupancy presence and movement behaviors for regular types of occupants in office buildings, and to generate stochastic occupant schedules at the room and individual occupant levels for building performance simulation. For future work, model validation is recommended, which includes collecting and using detailed interval occupancy data of all spaces in an office building to validate the simulated occupant schedules from the Occupancy Simulator.« less

Performance evaluation of an agent-based occupancy simulation model

DOE Office of Scientific and Technical Information (OSTI.GOV)

Luo, Xuan; Lam, Khee Poh; Chen, Yixing

Occupancy is an important factor driving building performance. Static and homogeneous occupant schedules, commonly used in building performance simulation, contribute to issues such as performance gaps between simulated and measured energy use in buildings. Stochastic occupancy models have been recently developed and applied to better represent spatial and temporal diversity of occupants in buildings. However, there is very limited evaluation of the usability and accuracy of these models. This study used measured occupancy data from a real office building to evaluate the performance of an agent-based occupancy simulation model: the Occupancy Simulator. The occupancy patterns of various occupant types weremore » first derived from the measured occupant schedule data using statistical analysis. Then the performance of the simulation model was evaluated and verified based on (1) whether the distribution of observed occupancy behavior patterns follows the theoretical ones included in the Occupancy Simulator, and (2) whether the simulator can reproduce a variety of occupancy patterns accurately. Results demonstrated the feasibility of applying the Occupancy Simulator to simulate a range of occupancy presence and movement behaviors for regular types of occupants in office buildings, and to generate stochastic occupant schedules at the room and individual occupant levels for building performance simulation. For future work, model validation is recommended, which includes collecting and using detailed interval occupancy data of all spaces in an office building to validate the simulated occupant schedules from the Occupancy Simulator.« less

Error management training and simulation education.

PubMed

Gardner, Aimee; Rich, Michelle

2014-12-01

The integration of simulation into the training of health care professionals provides context for decision making and procedural skills in a high-fidelity environment, without risk to actual patients. It was hypothesised that a novel approach to simulation-based education - error management training - would produce higher performance ratings compared with traditional step-by-step instruction. Radiology technology students were randomly assigned to participate in traditional procedural-based instruction (n = 11) or vicarious error management training (n = 11). All watched an instructional video and discussed how well each incident was handled (traditional instruction group) or identified where the errors were made (vicarious error management training). Students then participated in a 30-minute case-based simulation. Simulations were videotaped for performance analysis. Blinded experts evaluated performance using a predefined evaluation tool created specifically for the scenario. Blinded experts evaluated performance using a predefined evaluation tool created specifically for the scenario The vicarious error management group scored higher on observer-rated performance (Mean = 9.49) than students in the traditional instruction group (Mean = 9.02; p < 0.01). These findings suggest that incorporating the discussion of errors and how to handle errors during the learning session will better equip students when performing hands-on procedures and skills. This pilot study provides preliminary evidence for integrating error management skills into medical curricula and for the design of learning goals in simulation-based education. © 2014 John Wiley & Sons Ltd.

SELECTION OF ENDOCRINOLOGY SUBSPECIALTY TRAINEES: WHICH APPLICANT CHARACTERISTICS ARE ASSOCIATED WITH PERFORMANCE DURING FELLOWSHIP TRAINING?

PubMed

Natt, Neena; Chang, Alice Y; Berbari, Elie F; Kennel, Kurt A; Kearns, Ann E

2016-01-01

To determine which residency characteristics are associated with performance during endocrinology fellowship training as measured by competency-based faculty evaluation scores and faculty global ratings of trainee performance. We performed a retrospective review of interview applications from endocrinology fellows who graduated from a single academic institution between 2006 and 2013. Performance measures included competency-based faculty evaluation scores and faculty global ratings. The association between applicant characteristics and measures of performance during fellowship was examined by linear regression. The presence of a laudatory comparative statement in the residency program director's letter of recommendation (LoR) or experience as a chief resident was significantly associated with competency-based faculty evaluation scores (β = 0.22, P = .001; and β = 0.24, P = .009, respectively) and faculty global ratings (β = 0.85, P = .006; and β = 0.96, P = .015, respectively). The presence of a laudatory comparative statement in the residency program director's LoR or experience as a chief resident were significantly associated with overall performance during subspecialty fellowship training. Future studies are needed in other cohorts to determine the broader implications of these findings in the application and selection process.

Performance Evaluation of the Educational Leader (PEEL): Another Breakthrough in Competency Based Educational Administration.

ERIC Educational Resources Information Center

Metzger, Christa; Lynch, Steven B.

1974-01-01

This paper describes the Performance Evaluation of the Education Leader (PEEL) program, initiated from a study to define the competent school administrator and to develop an instrument to measure administrative competence objectively and accurately. The resulting PEEL materials include the following: (a) "Guidelines for Evaluation: The School…

Designing Scholarships to Improve College Success: Final Report on the Performance-Based Scholarship Demonstration

ERIC Educational Resources Information Center

Mayer, Alexander K.; Patel, Reshma; Rudd, Timothy; Ratledge, Alyssa

2015-01-01

Performance-based scholarships have two main goals: (1) to give students more money for college; and (2) to provide incentives for academic progress. MDRC launched the Performance-Based Scholarship (PBS) Demonstration in 2008 to evaluate the effectiveness of these scholarships in a diverse set of states, institutions, and low-income student…

Measurement issues in the evaluation of chronic disease self-management programs.

PubMed

Nolte, Sandra; Elsworth, Gerald R; Newman, Stanton; Osborne, Richard H

2013-09-01

To provide an in-depth analysis of outcome measures used in the evaluation of chronic disease self-management programs consistent with the Stanford curricula. Based on a systematic review on self-management programs, effect sizes derived from reported outcome measures are categorized according to the quality of life appraisal model developed by Schwartz and Rapkin which classifies outcomes from performance-based measures (e.g., clinical outcomes) to evaluation-based measures (e.g., emotional well-being). The majority of outcomes assessed in self-management trials are based on evaluation-based methods. Overall, effects on knowledge--the only performance-based measure observed in selected trials--are generally medium to large. In contrast, substantially more inconsistent results are found for both perception- and evaluation-based measures that mostly range between nil and small positive effects. Effectiveness of self-management interventions and resulting recommendations for health policy makers are most frequently derived from highly variable evaluation-based measures, that is, types of outcomes that potentially carry a substantial amount of measurement error and/or bias such as response shift. Therefore, decisions regarding the value and efficacy of chronic disease self-management programs need to be interpreted with care. More research, especially qualitative studies, is needed to unravel cognitive processes and the role of response shift bias in the measurement of change.

A method to evaluate process performance by integrating time and resources

NASA Astrophysics Data System (ADS)

Wang, Yu; Wei, Qingjie; Jin, Shuang

2017-06-01

The purpose of process mining is to improve the existing process of the enterprise, so how to measure the performance of the process is particularly important. However, the current research on the performance evaluation method is still insufficient. The main methods of evaluation are mainly using time or resource. These basic statistics cannot evaluate process performance very well. In this paper, a method of evaluating the performance of the process based on time dimension and resource dimension is proposed. This method can be used to measure the utilization and redundancy of resources in the process. This paper will introduce the design principle and formula of the evaluation algorithm. Then, the design and the implementation of the evaluation method will be introduced. Finally, we will use the evaluating method to analyse the event log from a telephone maintenance process and propose an optimization plan.

Correlation of Simulation Examination to Written Test Scores for Advanced Cardiac Life Support Testing: Prospective Cohort Study.

PubMed

Strom, Suzanne L; Anderson, Craig L; Yang, Luanna; Canales, Cecilia; Amin, Alpesh; Lotfipour, Shahram; McCoy, C Eric; Osborn, Megan Boysen; Langdorf, Mark I

2015-11-01

Traditional Advanced Cardiac Life Support (ACLS) courses are evaluated using written multiple-choice tests. High-fidelity simulation is a widely used adjunct to didactic content, and has been used in many specialties as a training resource as well as an evaluative tool. There are no data to our knowledge that compare simulation examination scores with written test scores for ACLS courses. To compare and correlate a novel high-fidelity simulation-based evaluation with traditional written testing for senior medical students in an ACLS course. We performed a prospective cohort study to determine the correlation between simulation-based evaluation and traditional written testing in a medical school simulation center. Students were tested on a standard acute coronary syndrome/ventricular fibrillation cardiac arrest scenario. Our primary outcome measure was correlation of exam results for 19 volunteer fourth-year medical students after a 32-hour ACLS-based Resuscitation Boot Camp course. Our secondary outcome was comparison of simulation-based vs. written outcome scores. The composite average score on the written evaluation was substantially higher (93.6%) than the simulation performance score (81.3%, absolute difference 12.3%, 95% CI [10.6-14.0%], p<0.00005). We found a statistically significant moderate correlation between simulation scenario test performance and traditional written testing (Pearson r=0.48, p=0.04), validating the new evaluation method. Simulation-based ACLS evaluation methods correlate with traditional written testing and demonstrate resuscitation knowledge and skills. Simulation may be a more discriminating and challenging testing method, as students scored higher on written evaluation methods compared to simulation.

Research on the comparison of performance-based concept and force-based concept

NASA Astrophysics Data System (ADS)

Wu, Zeyu; Wang, Dongwei

2011-03-01

There are two ideologies about structure design: force-based concept and performance-based concept. Generally, if the structure operates during elastic stage, the two philosophies usually attain the same results. But beyond that stage, the shortage of force-based method is exposed, and the merit of performance-based is displayed. Pros and cons of each strategy are listed herein, and then which structure is best suitable to each method analyzed. At last, a real structure is evaluated by adaptive pushover method to verify that performance-based method is better than force-based method.

Global chemical profiling based quality evaluation approach of rhubarb using ultra performance liquid chromatography with tandem quadrupole time-of-flight mass spectrometry.

PubMed

Zhang, Li; Liu, Haiyu; Qin, Lingling; Zhang, Zhixin; Wang, Qing; Zhang, Qingqing; Lu, Zhiwei; Wei, Shengli; Gao, Xiaoyan; Tu, Pengfei

2015-02-01

A global chemical profiling based quality evaluation approach using ultra performance liquid chromatography with tandem quadrupole time-of-flight mass spectrometry was developed for the quality evaluation of three rhubarb species, including Rheum palmatum L., Rheum tanguticum Maxim. ex Balf., and Rheum officinale Baill. Considering that comprehensive detection of chemical components is crucial for the global profile, a systemic column performance evaluation method was developed. Based on this, a Cortecs column was used to acquire the chemical profile, and Chempattern software was employed to conduct similarity evaluation and hierarchical cluster analysis. The results showed R. tanguticum could be differentiated from R. palmatum and R. officinale at the similarity value 0.65, but R. palmatum and R. officinale could not be distinguished effectively. Therefore, a common pattern based on three rhubarb species was developed to conduct the quality evaluation, and the similarity value 0.50 was set as an appropriate threshold to control the quality of rhubarb. A total of 88 common peaks were identified by their accurate mass and fragmentation, and partially verified by reference standards. Through the verification, the newly developed method could be successfully used for evaluating the holistic quality of rhubarb. It would provide a reference for the quality control of other herbal medicines. © 2014 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Subjective Performance Evaluation in the Public Sector: Evidence from School Inspections. CEE DP 135

ERIC Educational Resources Information Center

Hussain, Iftikhar

2012-01-01

Performance measurement in the public sector is largely based on objective metrics, which may be subject to gaming behaviour. This paper investigates a novel subjective performance evaluation system where independent inspectors visit schools at very short notice, publicly disclose their findings and sanction schools rated fail. First, I…

48 CFR 1852.216-77 - Award fee for end item contracts.

Code of Federal Regulations, 2010 CFR

2010-10-01

... Contractor's performance for the entire contract will be evaluated to determine total earned award fee. No award fee or base fee will be paid to the Contractor if the final award fee evaluation is “poor... the Contractor's interim performance every 6* months to monitor Contractor performance prior to...

6- And 8-Year-Olds' Performance Evaluations: Do They Differ between Self And Unknown Others?

ERIC Educational Resources Information Center

Destan, Nesrin; Spiess, Manuela A.; de Bruin, Anique; van Loon, Mariëtte; Roebers, Claudia M.

2017-01-01

The current study investigated kindergarteners and second graders' ability to monitor and evaluate their own and a virtual peer's performance in a paired-associate learning task. Participants provided confidence judgments (CJs) for their own responses and performance-based judgments (judgments provided "after" receiving feedback on their…

Credentials versus Performance: Review of the Teacher Performance Pay Research

ERIC Educational Resources Information Center

Podgursky, Michael; Springer, Matthew G.

2007-01-01

In this article we examine the economic case for merit or performance-based pay for K-12 teachers. We review several areas of germane research. The direct evaluation literature on these incentive plans is slender; highly diverse in terms of methodology, targeted populations, and programs evaluated; and primarily focused on short-run motivational…

Connecting Theory to Practice: Evaluating a Brain-Based Writing Curriculum

ERIC Educational Resources Information Center

Griffee, Dale T.

2007-01-01

This 10 week longitudinal evaluation study evaluated a brain-based learning curriculum proposed by Smilkstein (2003) by comparing student performance in a traditional basic writing curriculum with NHLP-oriented basic writing curriculum. The study included two classes each of experimental and traditional methods. Results of the data, gathered by…

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

PubMed

Raupach, Tobias; Schiekirka, Sarah; Münscher, Christian; Beißbarth, Tim; Himmel, Wolfgang; Burckhardt, Gerhard; Pukrop, Tobias

2012-01-01

Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical phase of a medical curriculum and address differences between the novel tool and traditional evaluation methods. Student self-assessments before and after completion of a teaching module were used to compute performance gains for specific learning objectives. Mean performance gains in each module were compared to student expectations before the module and data derived from a traditional evaluation tool using overall course ratings at the end of the module. A ranking of the 21 modules according to computed performance gains yielded entirely different results than module rankings based on overall course ratings. There was no significant correlation between performance gain and overall ratings. However, the latter were significantly correlated to student expectations before entering the module as well as structural and procedural parameters (Pearson's r 0.7-0.9). Performance gain computed from comparative self-assessments adds an important new dimension to course evaluation in medical education. In contrast to overall course ratings, the novel tool is less heavily confounded by construct-irrelevant factors. Thus, it appears to be more appropriate than overall course ratings in determining teaching quality and developing algorithms to guide performance-oriented resource allocation in medical education.

Effects of a Velocity-Vector Based Command Augmentation System and Synthetic Vision System Terrain Portrayal and Guidance Symbology Concepts on Single-Pilot Performance

NASA Technical Reports Server (NTRS)

Liu, Dahai; Goodrich, Kenneth H.; Peak, Bob

2010-01-01

This study investigated the effects of synthetic vision system (SVS) concepts and advanced flight controls on the performance of pilots flying a light, single-engine general aviation airplane. We evaluated the effects and interactions of two levels of terrain portrayal, guidance symbology, and flight control response type on pilot performance during the conduct of a relatively complex instrument approach procedure. The terrain and guidance presentations were evaluated as elements of an integrated primary flight display system. The approach procedure used in the study included a steeply descending, curved segment as might be encountered in emerging, required navigation performance (RNP) based procedures. Pilot performance measures consisted of flight technical performance, perceived workload, perceived situational awareness and subjective preference. The results revealed that an elevation based generic terrain portrayal significantly improved perceived situation awareness without adversely affecting flight technical performance or workload. Other factors (pilot instrument rating, control response type, and guidance symbology) were not found to significantly affect the performance measures.

Evaluation of multispectral plenoptic camera

NASA Astrophysics Data System (ADS)

Meng, Lingfei; Sun, Ting; Kosoglow, Rich; Berkner, Kathrin

2013-01-01

Plenoptic cameras enable capture of a 4D lightfield, allowing digital refocusing and depth estimation from data captured with a compact portable camera. Whereas most of the work on plenoptic camera design has been based a simplistic geometric-optics-based characterization of the optical path only, little work has been done of optimizing end-to-end system performance for a specific application. Such design optimization requires design tools that need to include careful parameterization of main lens elements, as well as microlens array and sensor characteristics. In this paper we are interested in evaluating the performance of a multispectral plenoptic camera, i.e. a camera with spectral filters inserted into the aperture plane of the main lens. Such a camera enables single-snapshot spectral data acquisition.1-3 We first describe in detail an end-to-end imaging system model for a spectrally coded plenoptic camera that we briefly introduced in.4 Different performance metrics are defined to evaluate the spectral reconstruction quality. We then present a prototype which is developed based on a modified DSLR camera containing a lenslet array on the sensor and a filter array in the main lens. Finally we evaluate the spectral reconstruction performance of a spectral plenoptic camera based on both simulation and measurements obtained from the prototype.

Evaluation of graded limestone base course on a low volume road : final report.

DOT National Transportation Integrated Search

1985-04-01

Due to decreasing supplies of native aggregate which may be incorporated into a base course, other materials need to be evaluated for constructibility and performance. To this end, a graded limestone base was constructed on a low volume road and eval...

Performance comparison of optical interference cancellation system architectures.

PubMed

Lu, Maddie; Chang, Matt; Deng, Yanhua; Prucnal, Paul R

2013-04-10

The performance of three optics-based interference cancellation systems are compared and contrasted with each other, and with traditional electronic techniques for interference cancellation. The comparison is based on a set of common performance metrics that we have developed for this purpose. It is shown that thorough evaluation of our optical approaches takes into account the traditional notions of depth of cancellation and dynamic range, along with notions of link loss and uniformity of cancellation. Our evaluation shows that our use of optical components affords performance that surpasses traditional electronic approaches, and that the optimal choice for an optical interference canceller requires taking into account the performance metrics discussed in this paper.

Rewarding Progress, Reducing Debt: Early Results from Ohio's Performance-Based Scholarship Demonstration for Low-Income Parents

ERIC Educational Resources Information Center

Cha, Paulette; Patel, Reshma

2010-01-01

This report presents early results from a rigorous evaluation of a performance-based scholarship program that was implemented at three community colleges in Ohio during the 2008-2009 academic year. The program in Ohio that is the subject of this report is part of MDRC's national Performance-Based Scholarship (PBS) Demonstration, which was launched…

The need for performance criteria in evaluating the durability of wood products

Treesearch

Stan Lebow; Bessie Woodward; Patricia Lebow; Carol Clausen

2010-01-01

Data generated from wood-product durability evaluations can be difficult to interpret. Standard methods used to evaluate the potential long-term durability of wood products often provide little guidance on interpretation of test results. Decisions on acceptable performance for standardization and code compliance are based on the judgment of reviewers or committees....

Robust Multimodal Cognitive Load Measurement

DTIC Science & Technology

2014-03-26

dimension, Hurst exponent ) of electroencephalogram (EEG) signals to evaluate changes in working memory load during the performance of a cognitive task...dimension, Hurst exponent ) of electroencephalogram (EEG) signals to evaluate changes in working memory load during the performance of a cognitive task with...approximate entropies, wavelet-based complexity measures, correlation dimension, Hurst exponent ) of electroencephalogram (EEG) signals to evaluate changes

Performance comparison of LUR and OK in PM2.5 concentration mapping: a multidimensional perspective

PubMed Central

Zou, Bin; Luo, Yanqing; Wan, Neng; Zheng, Zhong; Sternberg, Troy; Liao, Yilan

2015-01-01

Methods of Land Use Regression (LUR) modeling and Ordinary Kriging (OK) interpolation have been widely used to offset the shortcomings of PM2.5 data observed at sparse monitoring sites. However, traditional point-based performance evaluation strategy for these methods remains stagnant, which could cause unreasonable mapping results. To address this challenge, this study employs ‘information entropy’, an area-based statistic, along with traditional point-based statistics (e.g. error rate, RMSE) to evaluate the performance of LUR model and OK interpolation in mapping PM2.5 concentrations in Houston from a multidimensional perspective. The point-based validation reveals significant differences between LUR and OK at different test sites despite the similar end-result accuracy (e.g. error rate 6.13% vs. 7.01%). Meanwhile, the area-based validation demonstrates that the PM2.5 concentrations simulated by the LUR model exhibits more detailed variations than those interpolated by the OK method (i.e. information entropy, 7.79 vs. 3.63). Results suggest that LUR modeling could better refine the spatial distribution scenario of PM2.5 concentrations compared to OK interpolation. The significance of this study primarily lies in promoting the integration of point- and area-based statistics for model performance evaluation in air pollution mapping. PMID:25731103

Evaluation of a Bioabsorbable Self-Expandable Vein Stent-Base Made of Poly(L-lactide) In Vitro and In Vivo.

PubMed

Løvdal, Alexandra Liv Vest; Calve, Sarah; Yang, Shuo; Van Alstine, William; Binkert, Christoph A; Klausen, Kasper

2017-01-01

This study was designed to evaluate performance and tissue response to a self-expandable bioabsorbable vein stent-base cut from a tube with enhanced stiffness and strength in vitro and in vivo. A diamond-shaped stent-base was cut from a sequential biaxially strained poly(L-lactide) (PLLA) tube for optimized performance. The performance of the stent-base was evaluated in a finite element analysis model, and validation was attempted in vitro through a cyclic flat-plate compression and radial force measurement. The performance of the stent-base was tested in vivo using 3 sheep with 2 implants each for 2 and 3½ weeks, respectively. In vitro the stent-base showed an elliptical deformation but no fractures. In vivo the stent-base showed adequate radial force and no migration. All implanted stent-bases showed multiple fractures not only at the predicted stress zones but at all connecting points. Fragments of the caudal stent-base stayed in the vein wall indicating sufficient tissue coverage to avoid embolization of the fractured stent pieces, whereas fragments from the cranial device remaining were few. Neointima formation was confirmed histologically at 2 and 3½ weeks. A bioabsorbable self-expandable stent-base made from PLLA for large veins seems feasible, but over time, the PLLA used in this study appears too stiff and lacks the sufficient flexibility to move with the vena cava, causing multiple fractures.

Evaluation of a Bioabsorbable Self-Expandable Vein Stent-Base Made of Poly(l-lactide) In Vitro and In Vivo

DOE Office of Scientific and Technical Information (OSTI.GOV)

Løvdal, Alexandra Liv Vest, E-mail: alvlo@nanotech.dtu.dk; Calve, Sarah; Yang, Shuo

PurposeThis study was designed to evaluate performance and tissue response to a self-expandable bioabsorbable vein stent-base cut from a tube with enhanced stiffness and strength in vitro and in vivo.MethodsA diamond-shaped stent-base was cut from a sequential biaxially strained poly(l-lactide) (PLLA) tube for optimized performance. The performance of the stent-base was evaluated in a finite element analysis model, and validation was attempted in vitro through a cyclic flat-plate compression and radial force measurement. The performance of the stent-base was tested in vivo using 3 sheep with 2 implants each for 2 and 3½ weeks, respectively.ResultsIn vitro the stent-base showed anmore » elliptical deformation but no fractures. In vivo the stent-base showed adequate radial force and no migration. All implanted stent-bases showed multiple fractures not only at the predicted stress zones but at all connecting points. Fragments of the caudal stent-base stayed in the vein wall indicating sufficient tissue coverage to avoid embolization of the fractured stent pieces, whereas fragments from the cranial device remaining were few. Neointima formation was confirmed histologically at 2 and 3½ weeks.ConclusionA bioabsorbable self-expandable stent-base made from PLLA for large veins seems feasible, but over time, the PLLA used in this study appears too stiff and lacks the sufficient flexibility to move with the vena cava, causing multiple fractures.« less

Teacher Opinions on Performance Pay: Evidence from India

ERIC Educational Resources Information Center

Muralidharan, Karthik; Sundararaman, Venkatesh

2011-01-01

The practical viability of performance-based pay programs for teachers depends critically on the extent of support the idea will receive from teachers. We present evidence on teacher opinions with regard to performance-based pay from teacher interviews conducted in the context of an experimental evaluation of a program that provided…

SU-E-J-102: Performance Variations Among Clinically Available Deformable Image Registration Tools in Adaptive Radiotherapy: How Should We Evaluate and Interpret the Result?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nie, K; Pouliot, J; Smith, E

Purpose: To evaluate the performance variations in commercial deformable image registration (DIR) tools for adaptive radiation therapy. Methods: Representative plans from three different anatomical sites, prostate, head-and-neck (HN) and cranial spinal irradiation (CSI) with L-spine boost, were included. Computerized deformed CT images were first generated using virtual DIR QA software (ImSimQA) for each case. The corresponding transformations served as the “reference”. Three commercial software packages MIMVista v5.5 and MIMMaestro v6.0, VelocityAI v2.6.2, and OnQ rts v2.1.15 were tested. The warped contours and doses were compared with the “reference” and among each other. Results: The performance in transferring contours was comparablemore » among all three tools with an average DICE coefficient of 0.81 for all the organs. However, the performance of dose warping accuracy appeared to rely on the evaluation end points. Volume based DVH comparisons were not sensitive enough to illustrate all the detailed variations while isodose assessment on a slice-by-slice basis could be tedious. Point-based evaluation was over-sensitive by having up to 30% hot/cold-spot differences. If adapting the 3mm/3% gamma analysis into the evaluation of dose warping, all three algorithms presented a reasonable level of equivalency. One algorithm had over 10% of the voxels not meeting this criterion for the HN case while another showed disagreement for the CSI case. Conclusion: Overall, our results demonstrated that evaluation based only on the performance of contour transformation could not guarantee the accuracy in dose warping. However, the performance of dose warping accuracy relied on the evaluation methodologies. Nevertheless, as more DIR tools are available for clinical use, the performance could vary at certain degrees. A standard quality assurance criterion with clinical meaning should be established for DIR QA, similar to the gamma index concept, in the near future.« less

[Multifactorial method for assessing the physical work capacity of mice].

PubMed

Dubovik, B V; Bogomazov, S D

1987-01-01

Based on the swimming test according to Kiplinger, in experiments on (CBA X C57BL)F1 mice there were elaborated criteria for animal performance evaluation in the process of repeated swimming of a standard distance thus measuring power, volume of work and rate of the fatigue development in relative units. From the study of effects of sydnocarb, bemethyl and phenazepam on various parameters of physical performance of mice a conclusion was made that the proposed method provides a more informative evaluation of the pharmacological effect on physical performance of animals as compared to the methods based on the record of time of performing the load.

Historical performance evaluation of Iowa pavement treatments using data analytics : tech transfer summary.

DOT National Transportation Integrated Search

2017-01-01

Evaluate the performance of the most-used pavement treatments in Iowa by considering different parameters such as type of treatment, treatment thickness, traffic, and pavement type : Estimate a service life for each treatment based on the obs...

48 CFR 1552.216-77 - Award term incentive.

Code of Federal Regulations, 2010 CFR

2010-10-01

... performance measures for the corresponding evaluation period; or (iii) The Government notifies the contractor....216-77 Section 1552.216-77 Federal Acquisition Regulations System ENVIRONMENTAL PROTECTION AGENCY...) based on overall contractor performance as evaluated in accordance with the Clause entitled “Award Term...

Evaluating hydrological model performance using information theory-based metrics

USDA-ARS?s Scientific Manuscript database

The accuracy-based model performance metrics not necessarily reflect the qualitative correspondence between simulated and measured streamflow time series. The objective of this work was to use the information theory-based metrics to see whether they can be used as complementary tool for hydrologic m...

Field and lab evaluation of the use of lime fly ash to replace soil cement as a base course : final report.

DOT National Transportation Integrated Search

1997-09-01

This study evaluates the performance of lime/fly ash stabilized base as an alternative to soil cement stabilized base for flexible pavement systems on reconstructed highways in Louisiana. Louisiana has historically used soil cement for most flexible ...

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

Does resident ranking during recruitment accurately predict subsequent performance as a surgical resident?

PubMed

Fryer, Jonathan P; Corcoran, Noreen; George, Brian; Wang, Ed; Darosa, Debra

2012-01-01

While the primary goal of ranking applicants for surgical residency training positions is to identify the candidates who will subsequently perform best as surgical residents, the effectiveness of the ranking process has not been adequately studied. We evaluated our general surgery resident recruitment process between 2001 and 2011 inclusive, to determine if our recruitment ranking parameters effectively predicted subsequent resident performance. We identified 3 candidate ranking parameters (United States Medical Licensing Examination [USMLE] Step 1 score, unadjusted ranking score [URS], and final adjusted ranking [FAR]), and 4 resident performance parameters (American Board of Surgery In-Training Examination [ABSITE] score, PGY1 resident evaluation grade [REG], overall REG, and independent faculty rating ranking [IFRR]), and assessed whether the former were predictive of the latter. Analyses utilized Spearman correlation coefficient. We found that the URS, which is based on objective and criterion based parameters, was a better predictor of subsequent performance than the FAR, which is a modification of the URS based on subsequent determinations of the resident selection committee. USMLE score was a reliable predictor of ABSITE scores only. However, when we compared our worst residence performances with the performances of the other residents in this evaluation, the data did not produce convincing evidence that poor resident performances could be reliably predicted by any of the recruitment ranking parameters. Finally, stratifying candidates based on their rank range did not effectively define a ranking cut-off beyond which resident performance would drop off. Based on these findings, we recommend surgery programs may be better served by utilizing a more structured resident ranking process and that subsequent adjustments to the rank list generated by this process should be undertaken with caution. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Performance-based brake testers : round robin study

DOT National Transportation Integrated Search

2000-11-01

In the early 1990s, the Federal Motor Carrier Safety Administration initiated research to evaluate various types of performance-based brake testing technologies for application to commercial vehicle inspections. The purpose of the research was to det...

An Evaluation of the Performance Diagnostic Checklist-Human Services to Assess an Employee Performance Problem in a Center-Based Autism Treatment Facility

ERIC Educational Resources Information Center

Ditzian, Kyle; Wilder, David A.; King, Allison; Tanz, Jeanine

2015-01-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to assess the environmental variables that contribute to poor employee performance in human services settings. We administered the PDC-HS to 3 supervisors to assess the variables that contributed to poor performance by 4 staff members when securing…

An experimental study on CHVE's performance evaluation.

PubMed

Paiva, Paulo V F; Machado, Liliane S; Oliveira, Jauvane C

2012-01-01

Virtual reality-based training simulators, with collaborative capabilities, are known to improve the way users interact with one another while learning or improving skills on a given medical procedure. Performance evaluation of Collaborative Haptic Virtual Environments (CHVE) allows us to understand how such systems can work in the Internet, as well as the requirements for multisensorial and real-time data. This work discloses new performance evaluation results for the collaborative module of the CyberMed VR framework.

Evaluating Curriculum-Based Measurement from a Behavioral Assessment Perspective

ERIC Educational Resources Information Center

Ardoin, Scott P.; Roof, Claire M.; Klubnick, Cynthia; Carfolite, Jessica

2008-01-01

Curriculum-based measurement Reading (CBM-R) is an assessment procedure used to evaluate students' relative performance compared to peers and to evaluate their growth in reading. Within the response to intervention (RtI) model, CBM-R data are plotted in time series fashion as a means modeling individual students' response to varying levels of…

48 CFR 1552.219-74 - Small disadvantaged business participation evaluation factor.

Code of Federal Regulations, 2012 CFR

2012-10-01

... based on the demonstrated extent of participation of small disadvantaged business (SDB) concerns in the... evaluation, offerors will be evaluated based on: (1) The extent to which SDB concerns are specifically identified to participate in the performance of the contract; (2) The extent of the commitment to use SDB...

48 CFR 1552.219-74 - Small disadvantaged business participation evaluation factor.

Code of Federal Regulations, 2013 CFR

2013-10-01

... based on the demonstrated extent of participation of small disadvantaged business (SDB) concerns in the... evaluation, offerors will be evaluated based on: (1) The extent to which SDB concerns are specifically identified to participate in the performance of the contract; (2) The extent of the commitment to use SDB...

48 CFR 1552.219-74 - Small disadvantaged business participation evaluation factor.

Code of Federal Regulations, 2011 CFR

2011-10-01

... based on the demonstrated extent of participation of small disadvantaged business (SDB) concerns in the... evaluation, offerors will be evaluated based on: (1) The extent to which SDB concerns are specifically identified to participate in the performance of the contract; (2) The extent of the commitment to use SDB...

48 CFR 1552.219-74 - Small disadvantaged business participation evaluation factor.

Code of Federal Regulations, 2010 CFR

2010-10-01

... based on the demonstrated extent of participation of small disadvantaged business (SDB) concerns in the... evaluation, offerors will be evaluated based on: (1) The extent to which SDB concerns are specifically identified to participate in the performance of the contract; (2) The extent of the commitment to use SDB...

48 CFR 1552.219-74 - Small disadvantaged business participation evaluation factor.

Code of Federal Regulations, 2014 CFR

2014-10-01

... based on the demonstrated extent of participation of small disadvantaged business (SDB) concerns in the... evaluation, offerors will be evaluated based on: (1) The extent to which SDB concerns are specifically identified to participate in the performance of the contract; (2) The extent of the commitment to use SDB...

Evaluation of Road Performance Based on International Roughness Index and Falling Weight Deflectometer

NASA Astrophysics Data System (ADS)

Hasanuddin; Setyawan, A.; Yulianto, B.

2018-03-01

Assessment to the performance of road pavement is deemed necessary to improve the management quality of road maintenance and rehabilitation. This research to evaluate the road base on functional and structural and recommendations handling done. Assessing the pavement performance is conducted with functional and structural evaluation. Functional evaluation of pavement is based on the value of IRI (International Roughness Index) which among others is derived from reading NAASRA for analysis and recommended road handling. Meanwhile, structural evaluation of pavement is done by analyzing deflection value based on FWD (Falling Weight Deflectometer) data resulting in SN (Structural Number) value. The analysis will result in SN eff (Structural Number Effective) and SN f (Structural Number Future) value obtained from comparing SN eff to SN f value that leads to SCI (Structural Condition Index) value. SCI value implies the possible recommendation for handling pavement. The study done to Simpang Tuan-Batas Kota Jambi road segment was based on functional analysis. The study indicated that the road segment split into 12 segments in which segment 1, 3, 5, 7, 9, and 11 were of regular maintenance, segment 2, 4, 8, 10, 12 belonged to periodic maintenance, and segment 6 was of rehabilitation. The structural analysis resulted in 8 segments consisting of segment 1 and 2 recommended for regular maintenance, segment 3, 4, 5, and 7 for functional overlay, and 6 and 8 were of structural overlay.

Vibration-based monitoring for performance evaluation of flexible civil structures in Japan

PubMed Central

FUJINO, Yozo

2018-01-01

The vibration-based monitoring of flexible civil structures and performance evaluation from this monitoring are reviewed, with an emphasis on research and practice in Japan and the author’s experiences. Some new findings and unexpected vibrations from the monitoring of real bridges and buildings are reported to emphasize the importance of monitoring. Future developments and applications of vibration-based monitoring to civil infrastructure management are also described. Many examples are taken from the author’s past 30 years’ experience of research on bridge dynamics. PMID:29434082

Game-based versus storyboard-based evaluations of crew support prototypes for long duration missions

NASA Astrophysics Data System (ADS)

Smets, N. J. J. M.; Abbing, M. S.; Neerincx, M. A.; Lindenberg, J.; van Oostendorp, H.

2010-03-01

The Mission Execution Crew Assistant (MECA) is developing a distributed system of electronic partners (ePartners) to support astronauts performing nominal and off- nominal actions in long duration missions. The ePartners' support should adequately deal with the dynamics of the context, operations, team and personal conditions, which will change over time substantially. Such support—with the concerning context effects—should be thoroughly tested in all stages of the development process. A major question is how to address the context effects of in-space operations for evaluations of crew support prototypes. Via game-technology, the prototype can be tested with astronauts or their representatives, immersed in the envisioned, simulated context. We investigated if a game-based evaluation better addresses the context effects by producing a more elaborate, in-depth and realistic user experience than a "classical" storyboard-based evaluation. In the game-based evaluation, the participants showed higher arousal levels where expected, a more intense feeling of spatial presence, better situation awareness, and faster performance where needed. Such an evaluation can be used as an alternative or complement of field or micro-world tests when context dynamics cannot be simulated in these last tests cost-efficiently.

Performance assessment of geospatial simulation models of land-use change--a landscape metric-based approach.

PubMed

Sakieh, Yousef; Salmanmahiny, Abdolrassoul

2016-03-01

Performance evaluation is a critical step when developing land-use and cover change (LUCC) models. The present study proposes a spatially explicit model performance evaluation method, adopting a landscape metric-based approach. To quantify GEOMOD model performance, a set of composition- and configuration-based landscape metrics including number of patches, edge density, mean Euclidean nearest neighbor distance, largest patch index, class area, landscape shape index, and splitting index were employed. The model takes advantage of three decision rules including neighborhood effect, persistence of change direction, and urbanization suitability values. According to the results, while class area, largest patch index, and splitting indices demonstrated insignificant differences between spatial pattern of ground truth and simulated layers, there was a considerable inconsistency between simulation results and real dataset in terms of the remaining metrics. Specifically, simulation outputs were simplistic and the model tended to underestimate number of developed patches by producing a more compact landscape. Landscape-metric-based performance evaluation produces more detailed information (compared to conventional indices such as the Kappa index and overall accuracy) on the model's behavior in replicating spatial heterogeneity features of a landscape such as frequency, fragmentation, isolation, and density. Finally, as the main characteristic of the proposed method, landscape metrics employ the maximum potential of observed and simulated layers for a performance evaluation procedure, provide a basis for more robust interpretation of a calibration process, and also deepen modeler insight into the main strengths and pitfalls of a specific land-use change model when simulating a spatiotemporal phenomenon.

Efficient Comparison between Windows and Linux Platform Applicable in a Virtual Architectural Walkthrough Application

NASA Astrophysics Data System (ADS)

Thubaasini, P.; Rusnida, R.; Rohani, S. M.

This paper describes Linux, an open source platform used to develop and run a virtual architectural walkthrough application. It proposes some qualitative reflections and observations on the nature of Linux in the concept of Virtual Reality (VR) and on the most popular and important claims associated with the open source approach. The ultimate goal of this paper is to measure and evaluate the performance of Linux used to build the virtual architectural walkthrough and develop a proof of concept based on the result obtain through this project. Besides that, this study reveals the benefits of using Linux in the field of virtual reality and reflects a basic comparison and evaluation between Windows and Linux base operating system. Windows platform is use as a baseline to evaluate the performance of Linux. The performance of Linux is measured based on three main criteria which is frame rate, image quality and also mouse motion.

Effectiveness of human anatomy education for pharmacy students via the Internet.

PubMed

Limpach, Aimee L; Bazrafshan, Parham; Turner, Paul D; Monaghan, Michael S

2008-12-15

To evaluate the overall effectiveness of a human anatomy course taught to distance-based and campus-based pharmacy students. A retrospective analysis of students' grades and course evaluations from 2003 through 2006 was conducted. No significant differences in student performance by pathway were found for the 2003-2005 academic years (p > 0.05). However, distance-based students' percentage and letter grades were significantly higher in 2006 (p = 0.013 and p = 0.004 respectively). Comparison of course and instructor evaluations showed that students in the distance course held similar or more positive perceptions of the course than their campus peers. Similar performance by campus and distance students enrolled in a human anatomy suggests that a distance-based course can be used successfully to teach human anatomy to pharmacy students.

ASSESSMENT OF TWO PHYSICALLY BASED WATERSHED MODELS BASED ON THEIR PERFORMANCES OF SIMULATING SEDIMENT MOVEMENT OVER SMALL WATERSHEDS

EPA Science Inventory

Abstract: Two physically based and deterministic models, CASC2-D and KINEROS are evaluated and compared for their performances on modeling sediment movement on a small agricultural watershed over several events. Each model has different conceptualization of a watershed. CASC...

ASSESSMENT OF TWO PHYSICALLY-BASED WATERSHED MODELS BASED ON THEIR PERFORMANCES OF SIMULATING WATER AND SEDIMENT MOVEMENT

EPA Science Inventory

Two physically based watershed models, GSSHA and KINEROS-2 are evaluated and compared for their performances on modeling flow and sediment movement. Each model has a different watershed conceptualization. GSSHA divides the watershed into cells, and flow and sediments are routed t...

Is the evaluation of risk of bias in periodontology and implant dentistry comprehensive? A systematic review.

PubMed

Faggion, Clovis Mariano; Listl, Stefan; Alarcón, Marco Antonio

2015-05-01

The objective of this study was to assess how authors of systematic reviews (SRs) with meta-analyses published in periodontology and implant dentistry evaluate risk of bias (ROB) in primary studies included in these reviews. A literature search for SRs with meta-analyses was performed in PubMed and Cochrane library databases up to July 20th 2014. The reference lists of included articles were screened for further reviews. The standards of evaluating ROB in primary studies were evaluated by using a 14-item checklist based on the Cochrane approach for evaluating ROB. Standards in ROB evaluations in Cochrane and paper-based SRs were compared using the Fisher's exact test. All searches, data extraction and evaluations were performed independently and in duplicate. Seventy SRs were included (45 paper-based and 25 Cochrane SRs, respectively). The median percentage of items addressed was 58% (interquartile range 4-100%). Cochrane SRs more frequently included ROB assessments than paper-based reviews in terms of examiner blinding (p = 0.0026), selective outcome reporting (p = 0.0207) and other bias (p = 0.0241). The ROB evaluation in primary studies currently included in SRs with meta-analyses in periodontology and implant dentistry is not sufficiently comprehensive. Cochrane SRs have more comprehensive ROB evaluation than paper-based reviews. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Simulation-based team training improved the self-assessed ability of physicians, nurses and midwives to perform neonatal resuscitation.

PubMed

Malmström, B; Nohlert, E; Ewald, U; Widarsson, M

2017-08-01

The use of simulation-based team training in neonatal resuscitation has increased in Sweden during the last decade, but no formal evaluation of this training method has been performed. This study evaluated the effect of simulation-based team training on the self-assessed ability of personnel to perform neonatal resuscitation. We evaluated a full-day simulation-based team training course in neonatal resuscitation, by administering a questionnaire to 110 physicians, nurses and midwives before and after the training period. The questionnaire focused on four important domains: communication, leadership, confidence and technical skills. The study was carried out in Sweden from 2005 to 2007. The response rate was 84%. Improvements in the participants' self-assessed ability to perform neonatal resuscitation were seen in all four domains after training (p < 0.001). Professionally inexperienced personnel showed a significant improvement in the technical skills domain compared to experienced personnel (p = 0.001). No differences were seen between professions or time since training in any of the four domains. Personnel with less previous experience with neonatal resuscitation showed improved confidence (p = 0.007) and technical skills (p = 0.003). A full-day course on simulation-based team training with video-supported debriefing improved the participants' self-assessed ability to perform neonatal resuscitation. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

Language disturbance and functioning in first episode psychosis.

PubMed

Roche, Eric; Segurado, Ricardo; Renwick, Laoise; McClenaghan, Aisling; Sexton, Sarah; Frawley, Timothy; Chan, Carol K; Bonar, Maurice; Clarke, Mary

2016-01-30

Language disturbance has a central role in the presentation of psychotic disorders however its relationship with functioning requires further clarification, particularly in first episode psychosis (FEP). Both language disturbance and functioning can be evaluated with clinician-rated and performance-based measures. We aimed to investigate the concurrent association between clinician-rated and performance-based measures of language disturbance and functioning in FEP. We assessed 108 individuals presenting to an Early Intervention in Psychosis Service in Ireland. Formal thought disorder (FTD) dimensions and bizarre idiosyncratic thinking (BIT) were rated with structured assessment tools. Functioning was evaluated with a performance-based instrument, a clinician-rated measure and indicators of real-world functioning. The disorganisation dimension of FTD was significantly associated with clinician-rated measures of occupational and social functioning (Beta=-0.19, P<0.05 and Beta=-0.31, P<0.01, respectively). BIT was significantly associated with the performance-based measure of functioning (Beta=-0.22, P<0.05). Language disturbance was of less value in predicting real-world measures of functioning. Clinician-rated and performance-based assessments of language disturbance are complementary and each has differential associations with functioning. Communication disorders should be considered as a potential target for intervention in FEP, although further evaluation of the longitudinal relationship between language disturbance and functioning should be undertaken. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

SELECTION OF ENDOCRINOLOGY SUBSPECIALTY TRAINEES: WHICH APPLICANT CHARACTERISTICS ARE ASSOCIATED WITH PERFORMANCE DURING FELLOWSHIP TRAINING?

PubMed Central

Natt, Neena; Chang, Alice Y.; Berbari, Elie F.; Kennel, Kurt A.; Kearns, Ann E.

2016-01-01

Objective To determine which residency characteristics are associated with performance during endocrinology fellowship training as measured by competency-based faculty evaluation scores and faculty global ratings of trainee performance. Method We performed a retrospective review of interview applications from endocrinology fellows who graduated from a single academic institution between 2006 and 2013. Performance measures included competency-based faculty evaluation scores and faculty global ratings. The association between applicant characteristics and measures of performance during fellowship was examined by linear regression. Results The presence of a laudatory comparative statement in the residency program director’s letter of recommendation (LoR) or experience as a chief resident was significantly associated with competency-based faculty evaluation scores (β = 0.22, P = 0.001; and β = 0.24, P = 0.009, respectively) and faculty global ratings (β = 0.85, P = 0.006; and β = 0.96, P = 0.015, respectively). Conclusion The presence of a laudatory comparative statement in the residency program director’s LoR or experience as a chief resident were significantly associated with overall performance during subspecialty fellowship training. Future studies are needed in other cohorts to determine the broader implications of these findings in the application and selection process. PMID:26437219

Performance evaluation of nursing students following competency-based education.

PubMed

Fan, Jun-Yu; Wang, Yu Hsin; Chao, Li Fen; Jane, Sui-Whi; Hsu, Li-Ling

2015-01-01

Competency-based education is known to improve the match between educational performance and employment opportunities. This study examined the effects of competency-based education on the learning outcomes of undergraduate nursing students. The study used a quasi-experimental design. A convenience sample of 312 second-year undergraduate nursing students from northern and southern Taiwan participated in the study. The experimental group (n=163) received competency-based education and the control group received traditional instruction (n=149) in a medical-surgical nursing course. Outcome measures included students' scores on the Objective Structured Clinical Examination, Self-Evaluated Core Competencies Scale, Metacognitive Inventory for Nursing Students questionnaire, and academic performance. Students who received competency-based education had significantly higher academic performance in the medical-surgical nursing course and practicum than did the control group. Required core competencies and metacognitive abilities improved significantly in the competency-based education group as compared to the control group after adjusting for covariates. Competency-based education is worth implementing and may close the gap between education and the ever-changing work environment. Copyright © 2014 Elsevier Ltd. All rights reserved.

Teachers' Perceptions of Administrative Autonomy-Supportive versus Controlling Behaviors: Factors That Influence Teacher Intrinsic Motivation and Relationships with Administrators

ERIC Educational Resources Information Center

Scudella, Christine M.

2015-01-01

Federal policy around supervision and evaluation has prompted state action to develop new evaluation systems to increase student achievement. Systems, such as the Framework for Educator Effectiveness implemented in Wisconsin, are tied to teacher performance as well as student achievement. This type of performance-based evaluation system relies on…

Implementation and Evaluation of Multiple Adaptive Control Technologies for a Generic Transport Aircraft Simulation

NASA Technical Reports Server (NTRS)

Campbell, Stefan F.; Kaneshige, John T.; Nguyen, Nhan T.; Krishakumar, Kalmanje S.

2010-01-01

Presented here is the evaluation of multiple adaptive control technologies for a generic transport aircraft simulation. For this study, seven model reference adaptive control (MRAC) based technologies were considered. Each technology was integrated into an identical dynamic-inversion control architecture and tuned using a methodology based on metrics and specific design requirements. Simulation tests were then performed to evaluate each technology s sensitivity to time-delay, flight condition, model uncertainty, and artificially induced cross-coupling. The resulting robustness and performance characteristics were used to identify potential strengths, weaknesses, and integration challenges of the individual adaptive control technologies

How the Brain Converts Negative Evaluation into Performance Facilitation.

PubMed

Prévost, Charlotte; Lau, Hakwan; Mobbs, Dean

2018-02-01

Surpassing negative evaluation is a recurrent theme of success stories. Yet, there is little evidence supporting the counterintuitive idea that negative evaluation might not only motivate people, but also enhance performance. To address this question, we designed a task that required participants to decide whether taking up a risky challenge after receiving positive or negative evaluations from independent judges. Participants believed that these evaluations were based on their prior performance on a related task. Results showed that negative evaluation caused a facilitation in performance. Concurrent functional magnetic resonance imaging revealed that the motivating effect of negative evaluation was represented in the insula and striatum, while the performance boost was associated with functional positive connectivity between the insula and a set of brain regions involved in goal-directed behavior and the orienting of attention. These findings provide new insight into the neural representation of negative evaluation-induced facilitation. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

A core competency-based objective structured clinical examination (OSCE) can predict future resident performance.

PubMed

Wallenstein, Joshua; Heron, Sheryl; Santen, Sally; Shayne, Philip; Ander, Douglas

2010-10-01

This study evaluated the ability of an objective structured clinical examination (OSCE) administered in the first month of residency to predict future resident performance in the Accreditation Council for Graduate Medical Education (ACGME) core competencies. Eighteen Postgraduate Year 1 (PGY-1) residents completed a five-station OSCE in the first month of postgraduate training. Performance was graded in each of the ACGME core competencies. At the end of 18 months of training, faculty evaluations of resident performance in the emergency department (ED) were used to calculate a cumulative clinical evaluation score for each core competency. The correlations between OSCE scores and clinical evaluation scores at 18 months were assessed on an overall level and in each core competency. There was a statistically significant correlation between overall OSCE scores and overall clinical evaluation scores (R = 0.48, p < 0.05) and in the individual competencies of patient care (R = 0.49, p < 0.05), medical knowledge (R = 0.59, p < 0.05), and practice-based learning (R = 0.49, p < 0.05). No correlation was noted in the systems-based practice, interpersonal and communication skills, or professionalism competencies. An early-residency OSCE has the ability to predict future postgraduate performance on a global level and in specific core competencies. Used appropriately, such information can be a valuable tool for program directors in monitoring residents' progress and providing more tailored guidance. © 2010 by the Society for Academic Emergency Medicine.

PET and MRI image fusion based on combination of 2-D Hilbert transform and IHS method.

PubMed

Haddadpour, Mozhdeh; Daneshvar, Sabalan; Seyedarabi, Hadi

2017-08-01

The process of medical image fusion is combining two or more medical images such as Magnetic Resonance Image (MRI) and Positron Emission Tomography (PET) and mapping them to a single image as fused image. So purpose of our study is assisting physicians to diagnose and treat the diseases in the least of the time. We used Magnetic Resonance Image (MRI) and Positron Emission Tomography (PET) as input images, so fused them based on combination of two dimensional Hilbert transform (2-D HT) and Intensity Hue Saturation (IHS) method. Evaluation metrics that we apply are Discrepancy (D k ) as an assessing spectral features and Average Gradient (AG k ) as an evaluating spatial features and also Overall Performance (O.P) to verify properly of the proposed method. In this paper we used three common evaluation metrics like Average Gradient (AG k ) and the lowest Discrepancy (D k ) and Overall Performance (O.P) to evaluate the performance of our method. Simulated and numerical results represent the desired performance of proposed method. Since that the main purpose of medical image fusion is preserving both spatial and spectral features of input images, so based on numerical results of evaluation metrics such as Average Gradient (AG k ), Discrepancy (D k ) and Overall Performance (O.P) and also desired simulated results, it can be concluded that our proposed method can preserve both spatial and spectral features of input images. Copyright © 2017 Chang Gung University. Published by Elsevier B.V. All rights reserved.

Investigating the Influences of Core Self-Evaluations, Job Autonomy, and Intrinsic Motivation on In-Role Job Performance

ERIC Educational Resources Information Center

Joo, Baek-Kyoo; Jeung, Chang-Wook; Yoon, Hea Jun

2010-01-01

This study investigates the effects of core self-evaluations, job autonomy, and intrinsic motivation on employees' perceptions of their in-role job performance, based on a cross-sectional survey of 283 employees in a Fortune Global 100 company in Korea. The results suggest that employees perceived higher in-role job performance when they had…

Incentives, Selection, and Teacher Performance: Evidence from IMPACT

ERIC Educational Resources Information Center

Dee, Thomas S.; Wyckoff, James

2015-01-01

Teachers in the United States are compensated largely on the basis of fixed schedules that reward experience and credentials. However, there is a growing interest in whether performance-based incentives based on rigorous teacher evaluations can improve teacher retention and performance. The evidence available to date has been mixed at best. This…

Towards a Uniform Metrological Assessment of Grating-Based Optical Fiber Sensors: From Refractometers to Biosensors

PubMed Central

Chiavaioli, Francesco; Gouveia, Carlos A. J.; Jorge, Pedro A. S.; Baldini, Francesco

2017-01-01

A metrological assessment of grating-based optical fiber sensors is proposed with the aim of providing an objective evaluation of the performance of this sensor category. Attention was focused on the most common parameters, used to describe the performance of both optical refractometers and biosensors, which encompassed sensitivity, with a distinction between volume or bulk sensitivity and surface sensitivity, resolution, response time, limit of detection, specificity (or selectivity), reusability (or regenerability) and some other parameters of generic interest, such as measurement uncertainty, accuracy, precision, stability, drift, repeatability and reproducibility. Clearly, the concepts discussed here can also be applied to any resonance-based sensor, thus providing the basis for an easier and direct performance comparison of a great number of sensors published in the literature up to now. In addition, common mistakes present in the literature made for the evaluation of sensor performance are highlighted, and lastly a uniform performance assessment is discussed and provided. Finally, some design strategies will be proposed to develop a grating-based optical fiber sensing scheme with improved performance. PMID:28635665

Comparison of pre-processing methods for multiplex bead-based immunoassays.

PubMed

Rausch, Tanja K; Schillert, Arne; Ziegler, Andreas; Lüking, Angelika; Zucht, Hans-Dieter; Schulz-Knappe, Peter

2016-08-11

High throughput protein expression studies can be performed using bead-based protein immunoassays, such as the Luminex® xMAP® technology. Technical variability is inherent to these experiments and may lead to systematic bias and reduced power. To reduce technical variability, data pre-processing is performed. However, no recommendations exist for the pre-processing of Luminex® xMAP® data. We compared 37 different data pre-processing combinations of transformation and normalization methods in 42 samples on 384 analytes obtained from a multiplex immunoassay based on the Luminex® xMAP® technology. We evaluated the performance of each pre-processing approach with 6 different performance criteria. Three performance criteria were plots. All plots were evaluated by 15 independent and blinded readers. Four different combinations of transformation and normalization methods performed well as pre-processing procedure for this bead-based protein immunoassay. The following combinations of transformation and normalization were suitable for pre-processing Luminex® xMAP® data in this study: weighted Box-Cox followed by quantile or robust spline normalization (rsn), asinh transformation followed by loess normalization and Box-Cox followed by rsn.

Towards a Uniform Metrological Assessment of Grating-Based Optical Fiber Sensors: From Refractometers to Biosensors.

PubMed

Chiavaioli, Francesco; Gouveia, Carlos A J; Jorge, Pedro A S; Baldini, Francesco

2017-06-21

A metrological assessment of grating-based optical fiber sensors is proposed with the aim of providing an objective evaluation of the performance of this sensor category. Attention was focused on the most common parameters, used to describe the performance of both optical refractometers and biosensors, which encompassed sensitivity, with a distinction between volume or bulk sensitivity and surface sensitivity, resolution, response time, limit of detection, specificity (or selectivity), reusability (or regenerability) and some other parameters of generic interest, such as measurement uncertainty, accuracy, precision, stability, drift, repeatability and reproducibility. Clearly, the concepts discussed here can also be applied to any resonance-based sensor, thus providing the basis for an easier and direct performance comparison of a great number of sensors published in the literature up to now. In addition, common mistakes present in the literature made for the evaluation of sensor performance are highlighted, and lastly a uniform performance assessment is discussed and provided. Finally, some design strategies will be proposed to develop a grating-based optical fiber sensing scheme with improved performance.

Evaluation of CNN as anthropomorphic model observer

NASA Astrophysics Data System (ADS)

Massanes, Francesc; Brankov, Jovan G.

2017-03-01

Model observers (MO) are widely used in medical imaging to act as surrogates of human observers in task-based image quality evaluation, frequently towards optimization of reconstruction algorithms. In this paper, we explore the use of convolutional neural networks (CNN) to be used as MO. We will compare CNN MO to alternative MO currently being proposed and used such as the relevance vector machine based MO and channelized Hotelling observer (CHO). As the success of the CNN, and other deep learning approaches, is rooted in large data sets availability, which is rarely the case in medical imaging systems task-performance evaluation, we will evaluate CNN performance on both large and small training data sets.

Style-independent document labeling: design and performance evaluation

NASA Astrophysics Data System (ADS)

Mao, Song; Kim, Jong Woo; Thoma, George R.

2003-12-01

The Medical Article Records System or MARS has been developed at the U.S. National Library of Medicine (NLM) for automated data entry of bibliographical information from medical journals into MEDLINE, the premier bibliographic citation database at NLM. Currently, a rule-based algorithm (called ZoneCzar) is used for labeling important bibliographical fields (title, author, affiliation, and abstract) on medical journal article page images. While rules have been created for medical journals with regular layout types, new rules have to be manually created for any input journals with arbitrary or new layout types. Therefore, it is of interest to label any journal articles independent of their layout styles. In this paper, we first describe a system (called ZoneMatch) for automated generation of crucial geometric and non-geometric features of important bibliographical fields based on string-matching and clustering techniques. The rule based algorithm is then modified to use these features to perform style-independent labeling. We then describe a performance evaluation method for quantitatively evaluating our algorithm and characterizing its error distributions. Experimental results show that the labeling performance of the rule-based algorithm is significantly improved when the generated features are used.

Minimum detectable gas concentration performance evaluation method for gas leak infrared imaging detection systems.

PubMed

Zhang, Xu; Jin, Weiqi; Li, Jiakun; Wang, Xia; Li, Shuo

2017-04-01

Thermal imaging technology is an effective means of detecting hazardous gas leaks. Much attention has been paid to evaluation of the performance of gas leak infrared imaging detection systems due to several potential applications. The minimum resolvable temperature difference (MRTD) and the minimum detectable temperature difference (MDTD) are commonly used as the main indicators of thermal imaging system performance. This paper establishes a minimum detectable gas concentration (MDGC) performance evaluation model based on the definition and derivation of MDTD. We proposed the direct calculation and equivalent calculation method of MDGC based on the MDTD measurement system. We build an experimental MDGC measurement system, which indicates the MDGC model can describe the detection performance of a thermal imaging system to typical gases. The direct calculation, equivalent calculation, and direct measurement results are consistent. The MDGC and the minimum resolvable gas concentration (MRGC) model can effectively describe the performance of "detection" and "spatial detail resolution" of thermal imaging systems to gas leak, respectively, and constitute the main performance indicators of gas leak detection systems.

Building an Evaluation Framework for a Competency-Based Graduate Program at the University Of Southern Mississippi

ERIC Educational Resources Information Center

Gaudet, Cyndi H.; Annulis, Heather M.; Kmiec, John J., Jr.

2008-01-01

This article describes an ongoing project to build a comprehensive evaluation framework for the competency-based Master of Science in Workforce Training and Development (MSWTD) program at The University of Southern Mississippi (USM). First, it discusses some trends and issues in evaluating the performance of higher education programs in the United…

Evaluating School-Based Tobacco Control Programs and Policies: An Opportunity Gained and Many Opportunities Lost

ERIC Educational Resources Information Center

Leatherdale, Scott T.

2009-01-01

In the domain of school-based tobacco control, there is a large gap between the research being performed and the type of research needed to inform school-based prevention activities. The tobacco module of the school health action planning and evaluation system is a data collection and feedback system designed to support school-based tobacco…

Operator performance evaluation using multi criteria decision making methods

NASA Astrophysics Data System (ADS)

Rani, Ruzanita Mat; Ismail, Wan Rosmanira; Razali, Siti Fatihah

2014-06-01

Operator performance evaluation is a very important operation in labor-intensive manufacturing industry because the company's productivity depends on the performance of its operators. The aims of operator performance evaluation are to give feedback to operators on their performance, to increase company's productivity and to identify strengths and weaknesses of each operator. In this paper, six multi criteria decision making methods; Analytical Hierarchy Process (AHP), fuzzy AHP (FAHP), ELECTRE, PROMETHEE II, Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) and VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) are used to evaluate the operators' performance and to rank the operators. The performance evaluation is based on six main criteria; competency, experience and skill, teamwork and time punctuality, personal characteristics, capability and outcome. The study was conducted at one of the SME food manufacturing companies in Selangor. From the study, it is found that AHP and FAHP yielded the "outcome" criteria as the most important criteria. The results of operator performance evaluation showed that the same operator is ranked the first using all six methods.

Experimental heat and mass transfer of the separated and coupled rotating desiccant wheel and heat wheel

DOE Office of Scientific and Technical Information (OSTI.GOV)

Enteria, Napoleon; Yoshino, Hiroshi; Mochida, Akashi

The experimental evaluation of the separated and coupled rotating desiccant wheel and heat wheel is reported. The study aims to investigate the performance of the desiccant wheel and of the heat wheel both when operated separately and jointly. The performance evaluation of the desiccant wheel is based on its moisture removal capacity (MRC), moisture removal regeneration (MRR), and moisture mass balance (MMB). In addition, the study used the total energy balance (TEB), sensible coefficient of performance (COP{sub Sensible}), latent coefficient of performance (COP{sub Latent}) and, total coefficient of performance (COP{sub Total}). The performance of the heat wheel is based onmore » its effectiveness. The COP{sub Sensible}, COP{sub Latent} and, COP{sub Total} are used in the performance evaluation of the coupled desiccant wheel and heat wheel. The general results of the study show that the MRC, MRR and MMB coupled with the TEB, COP{sub Latent}, COP{sub Sensible} and COP{sub Total} predict adequately the performance of the desiccant wheel. In addition, the coupled operation of the desiccant wheel and heat wheel, contributed to the reduction of the external thermal energy requirement for the regeneration of the desiccant wheel. This study can be applied in other researches seeking evaluation of the desiccant wheel, heat wheel, and their combined operation. Moreover, the data presented here are significant for the desiccant wheel benchmarking and for evaluation of the desiccant wheel models. (author)« less

Neural-genetic synthesis for state-space controllers based on linear quadratic regulator design for eigenstructure assignment.

PubMed

da Fonseca Neto, João Viana; Abreu, Ivanildo Silva; da Silva, Fábio Nogueira

2010-04-01

Toward the synthesis of state-space controllers, a neural-genetic model based on the linear quadratic regulator design for the eigenstructure assignment of multivariable dynamic systems is presented. The neural-genetic model represents a fusion of a genetic algorithm and a recurrent neural network (RNN) to perform the selection of the weighting matrices and the algebraic Riccati equation solution, respectively. A fourth-order electric circuit model is used to evaluate the convergence of the computational intelligence paradigms and the control design method performance. The genetic search convergence evaluation is performed in terms of the fitness function statistics and the RNN convergence, which is evaluated by landscapes of the energy and norm, as a function of the parameter deviations. The control problem solution is evaluated in the time and frequency domains by the impulse response, singular values, and modal analysis.

Experimental Simulation-Based Performance Evaluation of an SMS-Based Emergency Geolocation Notification System

PubMed Central

Osebor, Isibor

2017-01-01

In an emergency, a prompt response can save the lives of victims. This statement generates an imperative issue in emergency medical services (EMS). Designing a system that brings simplicity in locating emergency scenes is a step towards improving response time. This paper therefore implemented and evaluated the performance of an SMS-based emergency geolocation notification system with emphasis on its SMS delivery time and the system's geolocation and dispatch time. Using the RAS metrics recommended by IEEE for evaluation, the designed system was found to be efficient and effective as its reliability stood within 62.7% to 70.0% while its availability stood at 99% with a downtime of 3.65 days/year. PMID:29065643

A comparison of spectral decorrelation techniques and performance evaluation metrics for a wavelet-based, multispectral data compression algorithm

NASA Technical Reports Server (NTRS)

Matic, Roy M.; Mosley, Judith I.

1994-01-01

Future space-based, remote sensing systems will have data transmission requirements that exceed available downlinks necessitating the use of lossy compression techniques for multispectral data. In this paper, we describe several algorithms for lossy compression of multispectral data which combine spectral decorrelation techniques with an adaptive, wavelet-based, image compression algorithm to exploit both spectral and spatial correlation. We compare the performance of several different spectral decorrelation techniques including wavelet transformation in the spectral dimension. The performance of each technique is evaluated at compression ratios ranging from 4:1 to 16:1. Performance measures used are visual examination, conventional distortion measures, and multispectral classification results. We also introduce a family of distortion metrics that are designed to quantify and predict the effect of compression artifacts on multi spectral classification of the reconstructed data.

Adaptive strategies of remote systems operators exposed to perturbed camera-viewing conditions

NASA Technical Reports Server (NTRS)

Stuart, Mark A.; Manahan, Meera K.; Bierschwale, John M.; Sampaio, Carlos E.; Legendre, A. J.

1991-01-01

This report describes a preliminary investigation of the use of perturbed visual feedback during the performance of simulated space-based remote manipulation tasks. The primary objective of this NASA evaluation was to determine to what extent operators exhibit adaptive strategies which allow them to perform these specific types of remote manipulation tasks more efficiently while exposed to perturbed visual feedback. A secondary objective of this evaluation was to establish a set of preliminary guidelines for enhancing remote manipulation performance and reducing the adverse effects. These objectives were accomplished by studying the remote manipulator performance of test subjects exposed to various perturbed camera-viewing conditions while performing a simulated space-based remote manipulation task. Statistical analysis of performance and subjective data revealed that remote manipulation performance was adversely affected by the use of perturbed visual feedback and performance tended to improve with successive trials in most perturbed viewing conditions.

Asynchronous threat awareness by observer trials using crowd simulation

NASA Astrophysics Data System (ADS)

Dunau, Patrick; Huber, Samuel; Stein, Karin U.; Wellig, Peter

2016-10-01

The last few years showed that a high risk of asynchronous threats is given in every day life. Especially in large crowds a high probability of asynchronous attacks is evident. High observational abilities to detect threats are desirable. Consequently highly trained security and observation personal is needed. This paper evaluates the effectiveness of a training methodology to enhance performance of observation personnel engaging in a specific target identification task. For this purpose a crowd simulation video is utilized. The study first provides a measurement of the base performance before the training sessions. Furthermore a training procedure will be performed. Base performance will then be compared to the after training performance in order to look for a training effect. A thorough evaluation of both the training sessions as well as the overall performance will be done in this paper. A specific hypotheses based metric is used. Results will be discussed in order to provide guidelines for the design of training for observational tasks.

Performance Demonstration of Mcmb-LiNiCoO2 Cells Containing Electrolytes Designed for Wide Operating Temperature Range

NASA Technical Reports Server (NTRS)

Smart, M. C.; Ratnakumar, B. V.; Whicanack, L. D.; Smith, K. A.; Santee, S.; Puglia, F. J.; Gitzendanner, R.

2009-01-01

With the intent of improving the performance of Li-ion cells over a wide operating temperature range, we have investigated the use of co-solvents to improve the properties of electrolyte formulations. In the current study, we have focused upon evaluating promising electrolytes which have been incorporated into large capacity (7 Ah) prototype Li-ion cells, fabricated by Yardney Technical Products, Inc. The electrolytes selected for performance evaluation include the use of a number of esters as co-solvents, including methyl propionate (MP), ethyl propionate (EP), ethyl butyrate (EB), propyl butyrate (PB), and 2,2,2-trifluoroethyl butyrate (TFEB). The performance of the prototype cells containing the ester-based electrolytes was compared with an extensive data base generated on cells containing previously developed all carbonate-based electrolytes. A number of performance tests were performed, including determining (i) the discharge rate capacity over a wide range of temperatures, (ii) the charge characteristics, (iii) the cycle life characteristics under various conditions, and (iv) the impedance characteristics.

Performance evaluation of two black nickel and two black chrome solar collectors

NASA Technical Reports Server (NTRS)

Losey, R.

1977-01-01

The test program was based on the evaluation of four unique solar collectors described below: (1) black nickel collector surface with a desiccant drying bed, (2) black nickel collector surface without a desiccant drying bed, (3) black chrome collector surface with a dessicant drying bed, and (4) black chrome collector surface without a desiccant drying bed. The test program included three distinct phases: Initial performance evaluation, natural environmental aging, and post-aging performance evaluation. Results of Phase III testing conclusively indicated a higher normalized efficiency for Black Chrome surfaces when compared to Black Nickel.

Evaluation of Emerging Technologies for Traffic Crash Reporting

DOT National Transportation Integrated Search

1998-02-01

An evaluation was performed of the effect of emerging technologies on traffic accident reporting. The technologies evaluated were standard laptop and pen-based portable computers, Global Positioning Systems (GPS), Geographic Information Systems (GIS)...

Validation of tungsten cross sections in the neutron energy region up to 100 keV

NASA Astrophysics Data System (ADS)

Pigni, Marco T.; Žerovnik, Gašper; Leal, Luiz. C.; Trkov, Andrej

2017-09-01

Following a series of recent cross section evaluations on tungsten isotopes performed at Oak Ridge National Laboratory (ORNL), this paper presents the validation work carried out to test the performance of the evaluated cross sections based on lead-slowing-down (LSD) benchmarks conducted in Grenoble. ORNL completed the resonance parameter evaluation of four tungsten isotopes - 182,183,184,186W - in August 2014 and submitted it as an ENDF-compatible file to be part of the next release of the ENDF/B-VIII.0 nuclear data library. The evaluations were performed with support from the US Nuclear Criticality Safety Program in an effort to provide improved tungsten cross section and covariance data for criticality safety sensitivity analyses. The validation analysis based on the LSD benchmarks showed an improved agreement with the experimental response when the ORNL tungsten evaluations were included in the ENDF/B-VII.1 library. Comparison with the results obtained with the JEFF-3.2 nuclear data library are also discussed.

Evolution of the Marine Officer Fitness Report: A Multivariate Analysis

DTIC Science & Technology

This thesis explores the evaluation behavior of United States Marine Corps (USMC) Reporting Seniors (RSs) from 2010 to 2017. Using fitness report...RSs evaluate the performance of subordinate active component unrestricted officer MROs over time. I estimate logistic regression models of the...lowest. However, these correlations indicating the effects of race matching on FITREP evaluations narrow in significance when performance-based factors

An open source multivariate framework for n-tissue segmentation with evaluation on public data.

PubMed

Avants, Brian B; Tustison, Nicholas J; Wu, Jue; Cook, Philip A; Gee, James C

2011-12-01

We introduce Atropos, an ITK-based multivariate n-class open source segmentation algorithm distributed with ANTs ( http://www.picsl.upenn.edu/ANTs). The Bayesian formulation of the segmentation problem is solved using the Expectation Maximization (EM) algorithm with the modeling of the class intensities based on either parametric or non-parametric finite mixtures. Atropos is capable of incorporating spatial prior probability maps (sparse), prior label maps and/or Markov Random Field (MRF) modeling. Atropos has also been efficiently implemented to handle large quantities of possible labelings (in the experimental section, we use up to 69 classes) with a minimal memory footprint. This work describes the technical and implementation aspects of Atropos and evaluates its performance on two different ground-truth datasets. First, we use the BrainWeb dataset from Montreal Neurological Institute to evaluate three-tissue segmentation performance via (1) K-means segmentation without use of template data; (2) MRF segmentation with initialization by prior probability maps derived from a group template; (3) Prior-based segmentation with use of spatial prior probability maps derived from a group template. We also evaluate Atropos performance by using spatial priors to drive a 69-class EM segmentation problem derived from the Hammers atlas from University College London. These evaluation studies, combined with illustrative examples that exercise Atropos options, demonstrate both performance and wide applicability of this new platform-independent open source segmentation tool.

An Open Source Multivariate Framework for n-Tissue Segmentation with Evaluation on Public Data

PubMed Central

Tustison, Nicholas J.; Wu, Jue; Cook, Philip A.; Gee, James C.

2012-01-01

We introduce Atropos, an ITK-based multivariate n-class open source segmentation algorithm distributed with ANTs (http://www.picsl.upenn.edu/ANTs). The Bayesian formulation of the segmentation problem is solved using the Expectation Maximization (EM) algorithm with the modeling of the class intensities based on either parametric or non-parametric finite mixtures. Atropos is capable of incorporating spatial prior probability maps (sparse), prior label maps and/or Markov Random Field (MRF) modeling. Atropos has also been efficiently implemented to handle large quantities of possible labelings (in the experimental section, we use up to 69 classes) with a minimal memory footprint. This work describes the technical and implementation aspects of Atropos and evaluates its performance on two different ground-truth datasets. First, we use the BrainWeb dataset from Montreal Neurological Institute to evaluate three-tissue segmentation performance via (1) K-means segmentation without use of template data; (2) MRF segmentation with initialization by prior probability maps derived from a group template; (3) Prior-based segmentation with use of spatial prior probability maps derived from a group template. We also evaluate Atropos performance by using spatial priors to drive a 69-class EM segmentation problem derived from the Hammers atlas from University College London. These evaluation studies, combined with illustrative examples that exercise Atropos options, demonstrate both performance and wide applicability of this new platform-independent open source segmentation tool. PMID:21373993

Scoring annual earthquake predictions in China

NASA Astrophysics Data System (ADS)

Zhuang, Jiancang; Jiang, Changsheng

2012-02-01

The Annual Consultation Meeting on Earthquake Tendency in China is held by the China Earthquake Administration (CEA) in order to provide one-year earthquake predictions over most China. In these predictions, regions of concern are denoted together with the corresponding magnitude range of the largest earthquake expected during the next year. Evaluating the performance of these earthquake predictions is rather difficult, especially for regions that are of no concern, because they are made on arbitrary regions with flexible magnitude ranges. In the present study, the gambling score is used to evaluate the performance of these earthquake predictions. Based on a reference model, this scoring method rewards successful predictions and penalizes failures according to the risk (probability of being failure) that the predictors have taken. Using the Poisson model, which is spatially inhomogeneous and temporally stationary, with the Gutenberg-Richter law for earthquake magnitudes as the reference model, we evaluate the CEA predictions based on 1) a partial score for evaluating whether issuing the alarmed regions is based on information that differs from the reference model (knowledge of average seismicity level) and 2) a complete score that evaluates whether the overall performance of the prediction is better than the reference model. The predictions made by the Annual Consultation Meetings on Earthquake Tendency from 1990 to 2003 are found to include significant precursory information, but the overall performance is close to that of the reference model.

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2010 CFR

2010-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... the reading ability of students in a program over time to a similar group of students not... example, a performance measure for a literacy program may include the percentage of students receiving...

A method to evaluate performance reliability of individual subjects in laboratory research applied to work settings.

DOT National Transportation Integrated Search

1978-10-01

This report presents a method that may be used to evaluate the reliability of performance of individual subjects, particularly in applied laboratory research. The method is based on analysis of variance of a tasks-by-subjects data matrix, with all sc...

MnROAD cells 16-23 (phase II) : forensic investigation into recycled unbound base and asphalt surface materials.

DOT National Transportation Integrated Search

2017-06-01

This report presents the findings from an eight-year performance evaluation of eight cells (Cells 16-23) built at the Minnesota Road Research Facility (MnROAD) in 2008. The constructed cells were used for two performance evaluation studies of: 1) unb...

The "Anatomy" of a Performance-Enhancing Drug Test in Sports

ERIC Educational Resources Information Center

Werner, T. C.

2012-01-01

The components of a performance-enhancing drug (PED) test in sports include sample selection, collection, establishing sample integrity, sample pretreatment, analyte detection, data evaluation, reporting results, and action taken based on the result. Undergraduate curricula generally focus on the detection and evaluation steps of an analytical…

The Effect of Training Data Set Composition on the Performance of a Neural Image Caption Generator

DTIC Science & Technology

2017-09-01

objects was compared using the Metric for Evaluation of Translation with Explicit Ordering (METEOR) and Consensus-Based Image Description Evaluation...using automated scoring systems. Many such systems exist, including Bilingual Evaluation Understudy (BLEU), Consensus-Based Image Description Evaluation...shown to be essential to automated scoring, which correlates highly with human precision.5 CIDEr uses a system of consensus among the captions and

An examination of the relationships between physicians' clinical and hospital-utilization performance.

PubMed Central

Saywell, R M; Bean, J A; Ludke, R L; Redman, R W; McHugh, G J

1981-01-01

To examine the relationships between measures of attending physician teams' clinical and utilization performance, inpatient hospital audits were conducted in 22 Maryland and western Pennsylvania nonfederal short-term hospitals. A total of 6,980 medical records were abstracted from eight diagnostic categories using the Payne and JCAH PEP medical audit procedures. The results indicate weak statistical associations between the two medical care evaluation audits; between clinical performance and utilization performance, as measured by appropriateness of admissions and length of stay; and between three utilization measures. Based on these findings, it does not appear valid to use performance in one area to evaluate performance in the other in order to measure or evaluate and ultimately improve physicians; clinical or utilization performance. PMID:6946048

A report documenting the completion of the Los Alamos National Laboratory portion of the ASC level II milestone ""Visualization on the supercomputing platform

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ahrens, James P; Patchett, John M; Lo, Li - Ta

2011-01-24

This report provides documentation for the completion of the Los Alamos portion of the ASC Level II 'Visualization on the Supercomputing Platform' milestone. This ASC Level II milestone is a joint milestone between Sandia National Laboratory and Los Alamos National Laboratory. The milestone text is shown in Figure 1 with the Los Alamos portions highlighted in boldfaced text. Visualization and analysis of petascale data is limited by several factors which must be addressed as ACES delivers the Cielo platform. Two primary difficulties are: (1) Performance of interactive rendering, which is the most computationally intensive portion of the visualization process. Formore » terascale platforms, commodity clusters with graphics processors (GPUs) have been used for interactive rendering. For petascale platforms, visualization and rendering may be able to run efficiently on the supercomputer platform itself. (2) I/O bandwidth, which limits how much information can be written to disk. If we simply analyze the sparse information that is saved to disk we miss the opportunity to analyze the rich information produced every timestep by the simulation. For the first issue, we are pursuing in-situ analysis, in which simulations are coupled directly with analysis libraries at runtime. This milestone will evaluate the visualization and rendering performance of current and next generation supercomputers in contrast to GPU-based visualization clusters, and evaluate the perfromance of common analysis libraries coupled with the simulation that analyze and write data to disk during a running simulation. This milestone will explore, evaluate and advance the maturity level of these technologies and their applicability to problems of interest to the ASC program. In conclusion, we improved CPU-based rendering performance by a a factor of 2-10 times on our tests. In addition, we evaluated CPU and CPU-based rendering performance. We encourage production visualization experts to consider using CPU-based rendering solutions when it is appropriate. For example, on remote supercomputers CPU-based rendering can offer a means of viewing data without having to offload the data or geometry onto a CPU-based visualization system. In terms of comparative performance of the CPU and CPU we believe that further optimizations of the performance of both CPU or CPU-based rendering are possible. The simulation community is currently confronting this reality as they work to port their simulations to different hardware architectures. What is interesting about CPU rendering of massive datasets is that for part two decades CPU performance has significantly outperformed CPU-based systems. Based on our advancements, evaluations and explorations we believe that CPU-based rendering has returned as one viable option for the visualization of massive datasets.« less

A root cause analysis project in a medication safety course.

PubMed

Schafer, Jason J

2012-08-10

To develop, implement, and evaluate team-based root cause analysis projects as part of a required medication safety course for second-year pharmacy students. Lectures, in-class activities, and out-of-class reading assignments were used to develop students' medication safety skills and introduce them to the culture of medication safety. Students applied these skills within teams by evaluating cases of medication errors using root cause analyses. Teams also developed error prevention strategies and formally presented their findings. Student performance was assessed using a medication errors evaluation rubric. Of the 211 students who completed the course, the majority performed well on root cause analysis assignments and rated them favorably on course evaluations. Medication error evaluation and prevention was successfully introduced in a medication safety course using team-based root cause analysis projects.

Standardized evaluation of algorithms for computer-aided diagnosis of dementia based on structural MRI: the CADDementia challenge.

PubMed

Bron, Esther E; Smits, Marion; van der Flier, Wiesje M; Vrenken, Hugo; Barkhof, Frederik; Scheltens, Philip; Papma, Janne M; Steketee, Rebecca M E; Méndez Orellana, Carolina; Meijboom, Rozanna; Pinto, Madalena; Meireles, Joana R; Garrett, Carolina; Bastos-Leite, António J; Abdulkadir, Ahmed; Ronneberger, Olaf; Amoroso, Nicola; Bellotti, Roberto; Cárdenas-Peña, David; Álvarez-Meza, Andrés M; Dolph, Chester V; Iftekharuddin, Khan M; Eskildsen, Simon F; Coupé, Pierrick; Fonov, Vladimir S; Franke, Katja; Gaser, Christian; Ledig, Christian; Guerrero, Ricardo; Tong, Tong; Gray, Katherine R; Moradi, Elaheh; Tohka, Jussi; Routier, Alexandre; Durrleman, Stanley; Sarica, Alessia; Di Fatta, Giuseppe; Sensi, Francesco; Chincarini, Andrea; Smith, Garry M; Stoyanov, Zhivko V; Sørensen, Lauge; Nielsen, Mads; Tangaro, Sabina; Inglese, Paolo; Wachinger, Christian; Reuter, Martin; van Swieten, John C; Niessen, Wiro J; Klein, Stefan

2015-05-01

Algorithms for computer-aided diagnosis of dementia based on structural MRI have demonstrated high performance in the literature, but are difficult to compare as different data sets and methodology were used for evaluation. In addition, it is unclear how the algorithms would perform on previously unseen data, and thus, how they would perform in clinical practice when there is no real opportunity to adapt the algorithm to the data at hand. To address these comparability, generalizability and clinical applicability issues, we organized a grand challenge that aimed to objectively compare algorithms based on a clinically representative multi-center data set. Using clinical practice as the starting point, the goal was to reproduce the clinical diagnosis. Therefore, we evaluated algorithms for multi-class classification of three diagnostic groups: patients with probable Alzheimer's disease, patients with mild cognitive impairment and healthy controls. The diagnosis based on clinical criteria was used as reference standard, as it was the best available reference despite its known limitations. For evaluation, a previously unseen test set was used consisting of 354 T1-weighted MRI scans with the diagnoses blinded. Fifteen research teams participated with a total of 29 algorithms. The algorithms were trained on a small training set (n=30) and optionally on data from other sources (e.g., the Alzheimer's Disease Neuroimaging Initiative, the Australian Imaging Biomarkers and Lifestyle flagship study of aging). The best performing algorithm yielded an accuracy of 63.0% and an area under the receiver-operating-characteristic curve (AUC) of 78.8%. In general, the best performances were achieved using feature extraction based on voxel-based morphometry or a combination of features that included volume, cortical thickness, shape and intensity. The challenge is open for new submissions via the web-based framework: http://caddementia.grand-challenge.org. Copyright © 2015 Elsevier Inc. All rights reserved.

Evaluation of Low Power Hall Thruster Propulsion

NASA Technical Reports Server (NTRS)

Manzella, David; Oleson, Steve; Sankovic, John; Haag, Tom; Semenkin, Alexander; Kim, Vladimir

1996-01-01

Hall thruster systems based on the SPT-50 and the TAL D-38 were evaluated and mission studies were performed. The 0.3 kilowatt SPT-50 operated with a specific impulse of 1160 seconds and an efficiency of 0.32. The 0.8 kilowatt D-38 provided a specific impulse above 1700 seconds at an efficiency of 0.5. The D-38 system was shown to offer a 56 kilogram propulsion system mass savings over a 101 kilogram hydrazine monopropellant system designed to perform North-South station keeping maneuvers on board a 430 kilogram geostationary satellite. The SPIT-50 system offered a greater than 50% propulsion system mass reduction in comparison to the chemical system on board a 200 kilogram low Earth orbit spacecraft performing two orbit raises and drag makeup over two years. The performance characteristics of the SPF-50 were experimentally evaluated at a number of operating conditions. The ion current density distribution of this engine was measured. The performance and system mass benefits of advanced systems based on both engines were considered.

DeltaSA tool for source apportionment benchmarking, description and sensitivity analysis

NASA Astrophysics Data System (ADS)

Pernigotti, D.; Belis, C. A.

2018-05-01

DeltaSA is an R-package and a Java on-line tool developed at the EC-Joint Research Centre to assist and benchmark source apportionment applications. Its key functionalities support two critical tasks in this kind of studies: the assignment of a factor to a source in factor analytical models (source identification) and the model performance evaluation. The source identification is based on the similarity between a given factor and source chemical profiles from public databases. The model performance evaluation is based on statistical indicators used to compare model output with reference values generated in intercomparison exercises. The references values are calculated as the ensemble average of the results reported by participants that have passed a set of testing criteria based on chemical profiles and time series similarity. In this study, a sensitivity analysis of the model performance criteria is accomplished using the results of a synthetic dataset where "a priori" references are available. The consensus modulated standard deviation punc gives the best choice for the model performance evaluation when a conservative approach is adopted.

MSFC Skylab thermal and environmental control system mission evaluation

NASA Technical Reports Server (NTRS)

Hopson, G. D.; Littles, J. W.; Patterson, W. C.

1974-01-01

An evaluation of the performance of the Skylab thermal and environmental control system is presented. Actual performance is compared to design and functional requirements and anomalies and discrepancies and their resolution are discussed. The thermal and environmental control systems performed their intended role. Based on the experience gained in design, development and flight, recommendations are provided which may be beneficial to future system designs.

Performance evaluation of infrared imaging system in field test

NASA Astrophysics Data System (ADS)

Wang, Chensheng; Guo, Xiaodong; Ren, Tingting; Zhang, Zhi-jie

2014-11-01

Infrared imaging system has been applied widely in both military and civilian fields. Since the infrared imager has various types and different parameters, for system manufacturers and customers, there is great demand for evaluating the performance of IR imaging systems with a standard tool or platform. Since the first generation IR imager was developed, the standard method to assess the performance has been the MRTD or related improved methods which are not perfect adaptable for current linear scanning imager or 2D staring imager based on FPA detector. For this problem, this paper describes an evaluation method based on the triangular orientation discrimination metric which is considered as the effective and emerging method to evaluate the synthesis performance of EO system. To realize the evaluation in field test, an experiment instrument is developed. And considering the importance of operational environment, the field test is carried in practical atmospheric environment. The test imagers include panoramic imaging system and staring imaging systems with different optics and detectors parameters (both cooled and uncooled). After showing the instrument and experiment setup, the experiment results are shown. The target range performance is analyzed and discussed. In data analysis part, the article gives the range prediction values obtained from TOD method, MRTD method and practical experiment, and shows the analysis and results discussion. The experimental results prove the effectiveness of this evaluation tool, and it can be taken as a platform to give the uniform performance prediction reference.

Hall Thruster Technology for NASA Science Missions

NASA Technical Reports Server (NTRS)

Manzella, David; Oh, David; Aadland, Randall

2005-01-01

The performance of a prototype Hall thruster designed for Discovery-class NASA science mission applications was evaluated at input powers ranging from 0.2 to 2.9 kilowatts. These data were used to construct a throttle profile for a projected Hall thruster system based on this prototype thruster. The suitability of such a Hall thruster system to perform robotic exploration missions was evaluated through the analysis of a near Earth asteroid sample return mission. This analysis demonstrated that a propulsion system based on the prototype Hall thruster offers mission benefits compared to a propulsion system based on an existing ion thruster.

Evaluation of a PfHRP2 and a pLDH-based Rapid Diagnostic Test for the Diagnosis of Severe Malaria in 2 Populations of African Children

PubMed Central

Hendriksen, Ilse C. E.; Mtove, George; Pedro, Alínia José; Gomes, Ermelinda; Silamut, Kamolrat; Lee, Sue J.; Mwambuli, Abraham; Gesase, Samwel; Reyburn, Hugh; Day, Nicholas P. J.; White, Nicholas J.; von Seidlein, Lorenz

2011-01-01

Background. Rapid diagnostic tests (RDTs) now play an important role in the diagnosis of falciparum malaria in many countries where the disease is endemic. Although these tests have been extensively evaluated in uncomplicated falciparum malaria, reliable data on their performance for diagnosing potentially lethal severe malaria is lacking. Methods. We compared a Plasmodium falciparum histidine-rich-protein2 (PfHRP2)–based RDT and a Plasmodium lactate dehydrogenase (pLDH)–based RDT with routine microscopy of a peripheral blood slide and expert microscopy as a reference standard for the diagnosis of severe malaria in 1898 children who presented with severe febrile illness at 2 centers in Mozambique and Tanzania. Results. The overall sensitivity, specificity, positive predictive value, and negative predictive values of the PfHRP2-based test were 94.0%, 70.9%, 85.4%, and 86.8%, respectively, and for the pLDH-based test, the values were 88.0%, 88.3%, 93.2%, and 80.3%, respectively. At parasite counts <1000 parasites/μL (n = 173), sensitivity of the pLDH-based test was low (45.7%), compared with that of the PfHRP2-based test (69.9%). Both RDTs performed better than did the routine slide reading in a clinical laboratory as assessed in 1 of the centers. Conclusion. The evaluated PfHRP2-based RDT is an acceptable alternative to routine microscopy for diagnosing severe malaria in African children and performed better than did the evaluated pLDH-based RDT. PMID:21467015

Designing and Evaluating an Interactive Multimedia Web-Based Simulation for Developing Nurses’ Competencies in Acute Nursing Care: Randomized Controlled Trial

PubMed Central

Wong, Lai Fun; Chan, Sally Wai-Chi; Ho, Jasmine Tze Yin; Mordiffi, Siti Zubaidah; Ang, Sophia Bee Leng; Goh, Poh Sun; Ang, Emily Neo Kim

2015-01-01

Background Web-based learning is becoming an increasingly important instructional tool in nursing education. Multimedia advancements offer the potential for creating authentic nursing activities for developing nursing competency in clinical practice. Objective This study aims to describe the design, development, and evaluation of an interactive multimedia Web-based simulation for developing nurses’ competencies in acute nursing care. Methods Authentic nursing activities were developed in a Web-based simulation using a variety of instructional strategies including animation video, multimedia instructional material, virtual patients, and online quizzes. A randomized controlled study was conducted on 67 registered nurses who were recruited from the general ward units of an acute care tertiary hospital. Following a baseline evaluation of all participants’ clinical performance in a simulated clinical setting, the experimental group received 3 hours of Web-based simulation and completed a survey to evaluate their perceptions of the program. All participants were re-tested for their clinical performances using a validated tool. Results The clinical performance posttest scores of the experimental group improved significantly (P<.001) from the pretest scores after the Web-based simulation. In addition, compared to the control group, the experimental group had significantly higher clinical performance posttest scores (P<.001) after controlling the pretest scores. The participants from the experimental group were satisfied with their learning experience and gave positive ratings for the quality of the Web-based simulation. Themes emerging from the comments about the most valuable aspects of the Web-based simulation include relevance to practice, instructional strategies, and fostering problem solving. Conclusions Engaging in authentic nursing activities using interactive multimedia Web-based simulation can enhance nurses’ competencies in acute care. Web-based simulations provide a promising educational tool in institutions where large groups of nurses need to be trained in acute nursing care and accessibility to repetitive training is essential for achieving long-term retention of clinical competency. PMID:25583029

Designing and evaluating an interactive multimedia Web-based simulation for developing nurses' competencies in acute nursing care: randomized controlled trial.

PubMed

Liaw, Sok Ying; Wong, Lai Fun; Chan, Sally Wai-Chi; Ho, Jasmine Tze Yin; Mordiffi, Siti Zubaidah; Ang, Sophia Bee Leng; Goh, Poh Sun; Ang, Emily Neo Kim

2015-01-12

Web-based learning is becoming an increasingly important instructional tool in nursing education. Multimedia advancements offer the potential for creating authentic nursing activities for developing nursing competency in clinical practice. This study aims to describe the design, development, and evaluation of an interactive multimedia Web-based simulation for developing nurses' competencies in acute nursing care. Authentic nursing activities were developed in a Web-based simulation using a variety of instructional strategies including animation video, multimedia instructional material, virtual patients, and online quizzes. A randomized controlled study was conducted on 67 registered nurses who were recruited from the general ward units of an acute care tertiary hospital. Following a baseline evaluation of all participants' clinical performance in a simulated clinical setting, the experimental group received 3 hours of Web-based simulation and completed a survey to evaluate their perceptions of the program. All participants were re-tested for their clinical performances using a validated tool. The clinical performance posttest scores of the experimental group improved significantly (P<.001) from the pretest scores after the Web-based simulation. In addition, compared to the control group, the experimental group had significantly higher clinical performance posttest scores (P<.001) after controlling the pretest scores. The participants from the experimental group were satisfied with their learning experience and gave positive ratings for the quality of the Web-based simulation. Themes emerging from the comments about the most valuable aspects of the Web-based simulation include relevance to practice, instructional strategies, and fostering problem solving. Engaging in authentic nursing activities using interactive multimedia Web-based simulation can enhance nurses' competencies in acute care. Web-based simulations provide a promising educational tool in institutions where large groups of nurses need to be trained in acute nursing care and accessibility to repetitive training is essential for achieving long-term retention of clinical competency.

Incentives, Selection, and Teacher Performance: Evidence from IMPACT. NBER Working Paper No. 19529

ERIC Educational Resources Information Center

Dee, Thomas; Wyckoff, James

2013-01-01

Teachers in the United States are compensated largely on the basis of fixed schedules that reward experience and credentials. However, there is a growing interest in whether performance-based incentives based on rigorous teacher evaluations can improve teacher retention and performance. The evidence available to date has been mixed at best. This…

Findings from the School-Based Theatrical Performance "Walk in Our Shoes." Research Report

ERIC Educational Resources Information Center

Wong, Eunice C.; Cerully, Jennifer L.; Collings, Rebecca L.; Roth, Elizabeth

2014-01-01

The study presented in this report evaluates the effects of a school-based theatrical performance "Walk In Our Shoes" on a group of predominantly Latino youth in Santa Barbara County, California. The performance follows the lives of four (fictional) high school students and introduces their various experiences with both mental health…

Motor Skill Assessment of Children: Is There an Association between Performance-Based, Child-Report, and Parent-Report Measures of Children's Motor Skills?

ERIC Educational Resources Information Center

Kennedy, Johanna; Brown, Ted; Chien, Chi-Wen

2012-01-01

Client-centered practice requires therapists to actively seek the perspectives of children and families. Several assessment tools are available to facilitate this process. However, when evaluating motor skill performance, therapists typically concentrate on performance-based assessment. To improve understanding of the information provided by the…

Performance-Based Contracting in Residential Care and Treatment: Driving Policy and Practice Change through Public-Private Partnership in Illinois

ERIC Educational Resources Information Center

Kearney, Kathleen A.; McEwen, Erwin; Bloom-Ellis, Brice; Jordan, Neil

2010-01-01

The National Quality Improvement Center on the Privatization of Child Welfare Services selected Illinois as a demonstration site in 2007 to evaluate performance-based contracting in residential treatment services. This article discusses the first two years of project implementation including developing residential treatment performance indicators,…

Influence of socioeconomic status on trauma center performance evaluations in a Canadian trauma system.

PubMed

Moore, Lynne; Turgeon, Alexis F; Sirois, Marie-Josée; Murat, Valérie; Lavoie, André

2011-09-01

Trauma center performance evaluations generally include adjustment for injury severity, age, and comorbidity. However, disparities across trauma centers may be due to other differences in source populations that are not accounted for, such as socioeconomic status (SES). We aimed to evaluate whether SES influences trauma center performance evaluations in an inclusive trauma system with universal access to health care. The study was based on data collected between 1999 and 2006 in a Canadian trauma system. Patient SES was quantified using an ecologic index of social and material deprivation. Performance evaluations were based on mortality adjusted using the Trauma Risk Adjustment Model. Agreement between performance results with and without additional adjustment for SES was evaluated with correlation coefficients. The study sample comprised a total of 71,784 patients from 48 trauma centers, including 3,828 deaths within 30 days (4.5%) and 5,549 deaths within 6 months (7.7%). The proportion of patients in the highest quintile of social and material deprivation varied from 3% to 43% and from 11% to 90% across hospitals, respectively. The correlation between performance results with or without adjustment for SES was almost perfect (r = 0.997; 95% CI 0.995-0.998) and the same hospital outliers were identified. We observed an important variation in SES across trauma centers but no change in risk-adjusted mortality estimates when SES was added to adjustment models. Results suggest that after adjustment for injury severity, age, comorbidity, and transfer status, disparities in SES across trauma center source populations do not influence trauma center performance evaluations in a system offering universal health coverage. Copyright © 2011 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Evaluating building performance in healthcare facilities: an organizational perspective.

PubMed

Steinke, Claudia; Webster, Lynn; Fontaine, Marie

2010-01-01

Using the environment as a strategic tool is one of the most cost-effective and enduring approaches for improving public health; however, it is one that requires multiple perspectives. The purpose of this article is to highlight an innovative methodology that has been developed for conducting comprehensive performance evaluations in public sector health facilities in Canada. The building performance evaluation methodology described in this paper is a government initiative. The project team developed a comprehensive building evaluation process for all new capital health projects that would respond to the aforementioned need for stakeholders to be more accountable and to better integrate the larger organizational strategy of facilities. The Balanced Scorecard, which is a multiparadigmatic, performance-based business framework, serves as the underlying theoretical framework for this initiative. It was applied in the development of the conceptual model entitled the Building Performance Evaluation Scorecard, which provides the following benefits: (1) It illustrates a process to link facilities more effectively to the overall mission and goals of an organization; (2) It is both a measurement and a management system that has the ability to link regional facilities to measures of success and larger business goals; (3) It provides a standardized methodology that ensures consistency in assessing building performance; and (4) It is more comprehensive than traditional building evaluations. The methodology presented in this paper is both a measurement and management system that integrates the principles of evidence-based design with the practices of pre- and post-occupancy evaluation. It promotes accountability and continues throughout the life cycle of a project. The advantage of applying this framework is that it engages health organizations in clarifying a vision and strategy for their facilities and helps translate those strategies into action and measurable performance outcomes.

UNIX-based operating systems robustness evaluation

NASA Technical Reports Server (NTRS)

Chang, Yu-Ming

1996-01-01

Robust operating systems are required for reliable computing. Techniques for robustness evaluation of operating systems not only enhance the understanding of the reliability of computer systems, but also provide valuable feed- back to system designers. This thesis presents results from robustness evaluation experiments on five UNIX-based operating systems, which include Digital Equipment's OSF/l, Hewlett Packard's HP-UX, Sun Microsystems' Solaris and SunOS, and Silicon Graphics' IRIX. Three sets of experiments were performed. The methodology for evaluation tested (1) the exception handling mechanism, (2) system resource management, and (3) system capacity under high workload stress. An exception generator was used to evaluate the exception handling mechanism of the operating systems. Results included exit status of the exception generator and the system state. Resource management techniques used by individual operating systems were tested using programs designed to usurp system resources such as physical memory and process slots. Finally, the workload stress testing evaluated the effect of the workload on system performance by running a synthetic workload and recording the response time of local and remote user requests. Moderate to severe performance degradations were observed on the systems under stress.

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the 'Black Box' of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda.

PubMed

Renmans, Dimitri; Holvoet, Nathalie; Criel, Bart

2017-09-03

Increased attention on "complexity" in health systems evaluation has resulted in many different methodological responses. Theory-driven evaluations and systems thinking are two such responses that aim for better understanding of the mechanisms underlying given outcomes. Here, we studied the implementation of a performance-based financing intervention by the Belgian Technical Cooperation in Western Uganda to illustrate a methodological strategy of combining these two approaches. We utilized a systems dynamics tool called causal loop diagramming (CLD) to generate hypotheses feeding into a theory-driven evaluation. Semi-structured interviews were conducted with 30 health workers from two districts (Kasese and Kyenjojo) and with 16 key informants. After CLD, we identified three relevant hypotheses: "success to the successful", "growth and underinvestment", and "supervision conundrum". The first hypothesis leads to increasing improvements in performance, as better performance leads to more incentives, which in turn leads to better performance. The latter two hypotheses point to potential bottlenecks. Thus, the proposed methodological strategy was a useful tool for identifying hypotheses that can inform a theory-driven evaluation. The hypotheses are represented in a comprehensible way while highlighting the underlying assumptions, and are more easily falsifiable than hypotheses identified without using CLD.

Embedded measures of performance validity using verbal fluency tests in a clinical sample.

PubMed

Sugarman, Michael A; Axelrod, Bradley N

2015-01-01

The objective of this study was to determine to what extent verbal fluency measures can be used as performance validity indicators during neuropsychological evaluation. Participants were clinically referred for neuropsychological evaluation in an urban-based Veteran's Affairs hospital. Participants were placed into 2 groups based on their objectively evaluated effort on performance validity tests (PVTs). Individuals who exhibited credible performance (n = 431) failed 0 PVTs, and those with poor effort (n = 192) failed 2 or more PVTs. All participants completed the Controlled Oral Word Association Test (COWAT) and Animals verbal fluency measures. We evaluated how well verbal fluency scores could discriminate between the 2 groups. Raw scores and T scores for Animals discriminated between the credible performance and poor-effort groups with 90% specificity and greater than 40% sensitivity. COWAT scores had lower sensitivity for detecting poor effort. A combination of FAS and Animals scores into logistic regression models yielded acceptable group classification, with 90% specificity and greater than 44% sensitivity. Verbal fluency measures can yield adequate detection of poor effort during neuropsychological evaluation. We provide suggested cut points and logistic regression models for predicting the probability of poor effort in our clinical setting and offer suggested cutoff scores to optimize sensitivity and specificity.

Performance evaluation of Chrysopogon zizanoides under urban conditions of Kuwait.

PubMed

Suleiman, Majda Khalil; Bhat, Narayana Ramachandra; Jacob, Sheena; Al-Burais, Meali

2018-02-01

Plant physiological and morphological attributes should be critically evaluated for selecting any species for landscaping projects. The selection of a species should be based on the evaluation of its adaptability, noninvasiveness, growth potential, and performance under the prevailing local arid conditions for their aesthetic looks, soil stabilization, and afforestation values. Chrysopogon zizanoides (Vetiver), is suitable for Kuwait because it can withstand fluctuating temperatures ranging from -14 to 55 °C with unique physical and physiological characteristics. Despite the successful growth performance of Vetiver in landscaping projects mostly in several tropical countries, it has not been utilized and evaluated in the Arabian Gulf region. The objective of the current study was to evaluate the performance of selected ten cultivars of Vetiver (ODV-1, 8, 9, 13, 17, 21, 23, Silent Valley, Urlikal, and Pannimedu) in the deficient soil and environmental conditions of Kuwait in urban landscape at minimal maintenance. It is suggested that based on visual greenery effect and overall growth performance cultivars, Pannimedu, Silent Valley, ODV-13, ODV-8 and ODV-9 can be considered for landscaping projects in Kuwait. To obtain the superior crown volume (which considers height and canopy) cultivar Pannimedu is suggested and to get a bushy growth (considering the number of tillers) cultivar ODV-13 and ODV-8 is found to be suitable.

A comprehensive performance evaluation on the prediction results of existing cooperative transcription factors identification algorithms.

PubMed

Lai, Fu-Jou; Chang, Hong-Tsun; Huang, Yueh-Min; Wu, Wei-Sheng

2014-01-01

Eukaryotic transcriptional regulation is known to be highly connected through the networks of cooperative transcription factors (TFs). Measuring the cooperativity of TFs is helpful for understanding the biological relevance of these TFs in regulating genes. The recent advances in computational techniques led to various predictions of cooperative TF pairs in yeast. As each algorithm integrated different data resources and was developed based on different rationales, it possessed its own merit and claimed outperforming others. However, the claim was prone to subjectivity because each algorithm compared with only a few other algorithms and only used a small set of performance indices for comparison. This motivated us to propose a series of indices to objectively evaluate the prediction performance of existing algorithms. And based on the proposed performance indices, we conducted a comprehensive performance evaluation. We collected 14 sets of predicted cooperative TF pairs (PCTFPs) in yeast from 14 existing algorithms in the literature. Using the eight performance indices we adopted/proposed, the cooperativity of each PCTFP was measured and a ranking score according to the mean cooperativity of the set was given to each set of PCTFPs under evaluation for each performance index. It was seen that the ranking scores of a set of PCTFPs vary with different performance indices, implying that an algorithm used in predicting cooperative TF pairs is of strength somewhere but may be of weakness elsewhere. We finally made a comprehensive ranking for these 14 sets. The results showed that Wang J's study obtained the best performance evaluation on the prediction of cooperative TF pairs in yeast. In this study, we adopted/proposed eight performance indices to make a comprehensive performance evaluation on the prediction results of 14 existing cooperative TFs identification algorithms. Most importantly, these proposed indices can be easily applied to measure the performance of new algorithms developed in the future, thus expedite progress in this research field.

Impact of workplace based assessment on doctors' education and performance: a systematic review.

PubMed

Miller, Alice; Archer, Julian

2010-09-24

To investigate the literature for evidence that workplace based assessment affects doctors' education and performance. Systematic review. The primary data sources were the databases Journals@Ovid, Medline, Embase, CINAHL, PsycINFO, and ERIC. Evidence based reviews (Bandolier, Cochrane Library, DARE, HTA Database, and NHS EED) were accessed and searched via the Health Information Resources website. Reference lists of relevant studies and bibliographies of review articles were also searched. Review methods Studies of any design that attempted to evaluate either the educational impact of workplace based assessment, or the effect of workplace based assessment on doctors' performance, were included. Studies were excluded if the sampled population was non-medical or the study was performed with medical students. Review articles, commentaries, and letters were also excluded. The final exclusion criterion was the use of simulated patients or models rather than real life clinical encounters. Sixteen studies were included. Fifteen of these were non-comparative descriptive or observational studies; the other was a randomised controlled trial. Study quality was mixed. Eight studies examined multisource feedback with mixed results; most doctors felt that multisource feedback had educational value, although the evidence for practice change was conflicting. Some junior doctors and surgeons displayed little willingness to change in response to multisource feedback, whereas family physicians might be more prepared to initiate change. Performance changes were more likely to occur when feedback was credible and accurate or when coaching was provided to help subjects identify their strengths and weaknesses. Four studies examined the mini-clinical evaluation exercise, one looked at direct observation of procedural skills, and three were concerned with multiple assessment methods: all these studies reported positive results for the educational impact of workplace based assessment tools. However, there was no objective evidence of improved performance with these tools. Considering the emphasis placed on workplace based assessment as a method of formative performance assessment, there are few published articles exploring its impact on doctors' education and performance. This review shows that multisource feedback can lead to performance improvement, although individual factors, the context of the feedback, and the presence of facilitation have a profound effect on the response. There is no evidence that alternative workplace based assessment tools (mini-clinical evaluation exercise, direct observation of procedural skills, and case based discussion) lead to improvement in performance, although subjective reports on their educational impact are positive.

Social status determines how we monitor and evaluate our performance

PubMed Central

Kostermans, Evelien; Milivojevic, Branka; De Cremer, David

2012-01-01

Since people with low status are more likely to experience social evaluative threat and are therefore more inclined to monitor for these threats and inhibit approach behaviour, we expected that low-status subjects would be more engaged in evaluating their own performance, compared with high-status subjects. We created a highly salient social hierarchy based on the performance of a simple time estimation task. Subjects could achieve high, middle or low status while performing this task simultaneously with other two players who were either higher or lower in status. Subjects received feedback on their own performance, as well as on the performance of the other two players simultaneously. Electroencephalography (EEG) was recorded from all three participants. The results showed that medial frontal negativity (an event-related potential reflecting performance evaluation) was significantly enhanced for low-status subjects. Implications for status-related differences in goal-directed behaviour are discussed. PMID:21421733

Performance assessments of Android-powered military applications operating on tactical handheld devices

NASA Astrophysics Data System (ADS)

Weiss, Brian A.; Fronczek, Lisa; Morse, Emile; Kootbally, Zeid; Schlenoff, Craig

2013-05-01

Transformative Apps (TransApps) is a Defense Advanced Research Projects Agency (DARPA) funded program whose goal is to develop a range of militarily-relevant software applications ("apps") to enhance the operational-effectiveness of military personnel on (and off) the battlefield. TransApps is also developing a military apps marketplace to facilitate rapid development and dissemination of applications to address user needs by connecting engaged communities of endusers with development groups. The National Institute of Standards and Technology's (NIST) role in the TransApps program is to design and implement evaluation procedures to assess the performance of: 1) the various software applications, 2) software-hardware interactions, and 3) the supporting online application marketplace. Specifically, NIST is responsible for evaluating 50+ tactically-relevant applications operating on numerous Android™-powered platforms. NIST efforts include functional regression testing and quantitative performance testing. This paper discusses the evaluation methodologies employed to assess the performance of three key program elements: 1) handheld-based applications and their integration with various hardware platforms, 2) client-based applications and 3) network technologies operating on both the handheld and client systems along with their integration into the application marketplace. Handheld-based applications are assessed using a combination of utility and usability-based checklists and quantitative performance tests. Client-based applications are assessed to replicate current overseas disconnected (i.e. no network connectivity between handhelds) operations and to assess connected operations envisioned for later use. Finally, networked applications are assessed on handhelds to establish baselines of performance for when connectivity will be common usage.

A Reflection on Aging: A Portfolio of Change in Attitudes toward Geriatric Patients during a Clerkship Rotation

ERIC Educational Resources Information Center

Del Duca, Danny; Duque, Gustavo

2006-01-01

The process of students' evaluation in medical schools has changed from a tutor-led evaluation system based on students' performance to a student-based evaluation that involves self-reflection and their level of change in skills and attitudes. At the McGill University Division of Geriatric Medicine, we developed an innovative system of evaluation…

Development of GUI Type On-Line Condition Monitoring Program for a Turboprop Engine Using Labview

NASA Astrophysics Data System (ADS)

Kong, Changduk; Kim, Keonwoo

2011-12-01

Recently, an aero gas turbine health monitoring system has been developed for precaution and maintenance action against faults or performance degradations of the advanced propulsion system which occurs in severe environments such as high altitude, foreign object damage particles, hot and heavy rain and snowy atmospheric conditions. However to establish this health monitoring system, the online condition monitoring program is firstly required, and the program must monitor the engine performance trend through comparison between measured engine performance data and base performance results calculated by base engine performance model. This work aims to develop a GUI type on-line condition monitoring program for the PT6A-67 turboprop engine of a high altitude and long endurance operation UAV using LabVIEW. The base engine performance of the on-line condition monitoring program is simulated using component maps inversely generated from the limited performance deck data provided by engine manufacturer. The base engine performance simulation program is evaluated because analysis results by this program agree well with the performance deck data. The proposed on-line condition program can monitor the real engine performance as well as the trend through precise comparison between clean engine performance results calculated by the base performance simulation program and measured engine performance signals. In the development phase of this monitoring system, a signal generation module is proposed to evaluate the proposed online monitoring system. For user friendly purpose, all monitoring program are coded by LabVIEW, and monitoring examples are demonstrated using the proposed GUI type on-condition monitoring program.

Summary of performance data for technologies to control gaseous, odor, and particulate emissions from livestock operations: Air management practices assessment tool (AMPAT)

PubMed Central

Maurer, Devin L.; Koziel, Jacek A.; Harmon, Jay D.; Hoff, Steven J.; Rieck-Hinz, Angela M.; Andersen, Daniel S.

2016-01-01

The livestock and poultry production industry, regulatory agencies, and researchers lack a current, science-based guide and data base for evaluation of air quality mitigation technologies. Data collected from science-based review of mitigation technologies using practical, stakeholders-oriented evaluation criteria to identify knowledge gaps/needs and focuses for future research efforts on technologies and areas with the greatest impact potential is presented in the Literature Database tab on the air management practices tool (AMPAT). The AMPAT is web-based (available at www.agronext.iastate.edu/ampat) and provides an objective overview of mitigation practices best suited to address odor, gaseous, and particulate matter (PM) emissions at livestock operations. The data was compiled into Excel spreadsheets from a literature review of 265 papers was performed to (1) evaluate mitigation technologies performance for emissions of odor, volatile organic compounds (VOCs), ammonia (NH3), hydrogen sulfide (H2S), particulate matter (PM), and greenhouse gases (GHGs) and to (2) inform future research needs. PMID:27158660

Watch what happens: using a web-based multimedia platform to enhance intraoperative learning and development of clinical reasoning.

PubMed

Fingeret, Abbey L; Martinez, Rebecca H; Hsieh, Christine; Downey, Peter; Nowygrod, Roman

2016-02-01

We aim to determine whether observed operations or internet-based video review predict improved performance in the surgery clerkship. A retrospective review of students' usage of surgical videos, observed operations, evaluations, and examination scores were used to construct an exploratory principal component analysis. Multivariate regression was used to determine factors predictive of clerkship performance. Case log data for 231 students revealed a median of 25 observed cases. Students accessed the web-based video platform a median of 15 times. Principal component analysis yielded 4 factors contributing 74% of the variability with a Kaiser-Meyer-Olkin coefficient of .83. Multivariate regression predicted shelf score (P < .0001), internal clinical skills examination score (P < .0001), subjective evaluations (P < .001), and video website utilization (P < .001) but not observed cases to be significantly associated with overall performance. Utilization of a web-based operative video platform during a surgical clerkship is an independently associated with improved clinical reasoning, fund of knowledge, and overall evaluation. Thus, this modality can serve as a useful adjunct to live observation. Copyright © 2016 Elsevier Inc. All rights reserved.

Collaborative en-route and slot allocation algorithm based on fuzzy comprehensive evaluation

NASA Astrophysics Data System (ADS)

Yang, Shangwen; Guo, Baohua; Xiao, Xuefei; Gao, Haichao

2018-01-01

To allocate the en-routes and slots to the flights with collaborative decision making, a collaborative en-route and slot allocation algorithm based on fuzzy comprehensive evaluation was proposed. Evaluation indexes include flight delay costs, delay time and the number of turning points. Analytic hierarchy process is applied to determining index weights. Remark set for current two flights not yet obtained the en-route and slot in flight schedule is established. Then, fuzzy comprehensive evaluation is performed, and the en-route and slot for the current two flights are determined. Continue selecting the flight not yet obtained an en-route and a slot in flight schedule. Perform fuzzy comprehensive evaluation until all flights have obtained the en-routes and slots. MatlabR2007b was applied to numerical test based on the simulated data of a civil en-route. Test results show that, compared with the traditional strategy of first come first service, the algorithm gains better effect. The effectiveness of the algorithm was verified.

The Effects of Preexercise Caffeinated Coffee Ingestion on Endurance Performance: An Evidence-Based Review.

PubMed

Higgins, Simon; Straight, Chad R; Lewis, Richard D

2016-06-01

Endurance athletes commonly ingest caffeine as a means to enhance training intensity and competitive performance. A widely-used source of caffeine is coffee, however conflicting evidence exists regarding the efficacy of coffee in improving endurance performance. In this context, the aims of this evidence-based review were threefold: 1) to evaluate the effects of preexercise coffee on endurance performance, 2) to evaluate the effects of coffee on perceived exertion during endurance performance, and 3) to translate the research into usable information for athletes to make an informed decision regarding the intake of caffeine via coffee as a potential ergogenic aid. Searches of three major databases were performed using terms caffeine and coffee, or coffee-caffeine, and endurance, or aerobic. Included studies (n = 9) evaluated the effects of caffeinated coffee on human subjects, provided the caffeine dose administered, administered caffeine ≥ 45 min before testing, and included a measure of endurance performance (e.g., time trial). Significant improvements in endurance performance were observed in five of nine studies, which were on average 24.2% over controls for time to exhaustion trials, and 3.1% for time to completion trials. Three of six studies found that coffee reduced perceived exertion during performance measures significantly more than control conditions (p < .05). Based on the reviewed studies there is moderate evidence supporting the use of coffee as an ergogenic aid to improve performance in endurance cycling and running. Coffee providing 3-8.1 mg/kg (1.36-3.68 mg/lb) of caffeine may be used as a safe alternative to anhydrous caffeine to improve endurance performance.

Performance Evaluation in Network-Based Parallel Computing

NASA Technical Reports Server (NTRS)

Dezhgosha, Kamyar

1996-01-01

Network-based parallel computing is emerging as a cost-effective alternative for solving many problems which require use of supercomputers or massively parallel computers. The primary objective of this project has been to conduct experimental research on performance evaluation for clustered parallel computing. First, a testbed was established by augmenting our existing SUNSPARCs' network with PVM (Parallel Virtual Machine) which is a software system for linking clusters of machines. Second, a set of three basic applications were selected. The applications consist of a parallel search, a parallel sort, a parallel matrix multiplication. These application programs were implemented in C programming language under PVM. Third, we conducted performance evaluation under various configurations and problem sizes. Alternative parallel computing models and workload allocations for application programs were explored. The performance metric was limited to elapsed time or response time which in the context of parallel computing can be expressed in terms of speedup. The results reveal that the overhead of communication latency between processes in many cases is the restricting factor to performance. That is, coarse-grain parallelism which requires less frequent communication between processes will result in higher performance in network-based computing. Finally, we are in the final stages of installing an Asynchronous Transfer Mode (ATM) switch and four ATM interfaces (each 155 Mbps) which will allow us to extend our study to newer applications, performance metrics, and configurations.

Spectral contents readout of birefringent sensor

NASA Technical Reports Server (NTRS)

Redner, Alex S.

1989-01-01

The technical objective of this research program was to develop a birefringent sensor, capable of measuring strain/stress up to 2000 F and a readout system based on Spectral Contents analysis. As a result of the research work, a data acquisition system was developed, capable of measuring strain birefringence in a sensor at 2000 F, with multi-point static and dynamic capabilities. The system uses a dedicated spectral analyzer for evaluation of stress-birefringence and a PC-based readout. Several sensor methods were evaluated. Fused silica was found most satisfactory. In the final evaluation, measurements were performed up to 2000 F and the system performance exceeded expectations.

Performance Evaluation of the International Space Station Flow Boiling and Condensation Experiment (FBCE) Test Facility

NASA Technical Reports Server (NTRS)

Hasan, Mohammad; Balasubramaniam, R.; Nahra, Henry; Mackey, Jeff; Hall, Nancy; Frankenfield, Bruce; Harpster, George; May, Rochelle; Mudawar, Issam; Kharangate, Chirag R.;

Assessment of Anatomical Knowledge and Core Trauma Competency Vascular Skills.

PubMed

Granite, Guinevere; Pugh, Kristy; Chen, Hegang; Longinaker, Nyaradzo; Garofalo, Evan; Shackelford, Stacy; Shalin, Valerie; Puche, Adam; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin

2018-03-01

Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training, and 12-18 mo later. We hypothesize that residents will better judge their own skill after ASSET than before when compared with evaluator ratings. Forty PGY2-7 surgical residents performed four procedures: axillary artery (AA), brachial artery (BA), femoral artery exposure and control (FA), and lower extremity fasciotomy (FAS) at the three evaluations. Using 5-point Likert scales, surgeons self-assessed their confidence in anatomical understanding and procedure performance after each procedure and evaluators rated each surgeon accordingly. For all the three evaluations, residents consistently rated their anatomical understanding (p < 0.04) and surgical performance (p < 0.03) higher than evaluators for both FA and FAS. Residents rated their anatomical understanding and surgical performance higher (p < 0.005) than evaluators for BA after training and up to 18 mo later. Only for third AA evaluation were there no rating differences. Residents overrate their anatomical understanding and performance abilities for BA, FA, and FAS even after performing the procedures and being debriefed three times in 18 mo.

A Compact Methodology to Understand, Evaluate, and Predict the Performance of Automatic Target Recognition

PubMed Central

Li, Yanpeng; Li, Xiang; Wang, Hongqiang; Chen, Yiping; Zhuang, Zhaowen; Cheng, Yongqiang; Deng, Bin; Wang, Liandong; Zeng, Yonghu; Gao, Lei

2014-01-01

This paper offers a compacted mechanism to carry out the performance evaluation work for an automatic target recognition (ATR) system: (a) a standard description of the ATR system's output is suggested, a quantity to indicate the operating condition is presented based on the principle of feature extraction in pattern recognition, and a series of indexes to assess the output in different aspects are developed with the application of statistics; (b) performance of the ATR system is interpreted by a quality factor based on knowledge of engineering mathematics; (c) through a novel utility called “context-probability” estimation proposed based on probability, performance prediction for an ATR system is realized. The simulation result shows that the performance of an ATR system can be accounted for and forecasted by the above-mentioned measures. Compared to existing technologies, the novel method can offer more objective performance conclusions for an ATR system. These conclusions may be helpful in knowing the practical capability of the tested ATR system. At the same time, the generalization performance of the proposed method is good. PMID:24967605

Thermal and frictional performance evaluation of nano lubricant with multi wall carbon nano tubes (MWCNTs) as nano-additive

NASA Astrophysics Data System (ADS)

Lijesh K., P.; Kumar, Deepak; Muzakkir S., M.; Hirani, Harish

2018-05-01

A Fluid Film Bearings (FFBs) operating in hydrodynamic boundary regime can provide moderate load carrying capacity, negligible wear and friction. However in extreme operating conditions i.e. at high load and low speed, asperities of journal and bearing surfaces come in contact with each other resulting in high wear and friction. During the contact of the asperities, the temperature of the lubricant increases due to frictional heating, resulting in reduction of the viscosity of lubricant. Variation of lubricant viscosity results in low load carrying capacity of the FFB and therefore resulting in detoriation of FFB performance. In the present work it is hypothesized that, by adding multi-functional Multi Wall Carbon Nano-Tubes (MWCNT) (having high thermal conductivity and anti-friction properties) as nano-additive in the base mineral oil, the aforementioned problems can be overcome. To validate the proposed hypothesis, five different samples of lubricant is considered: Sample 1: Base oil, Sample 2: Base oil +0.05% MWCNT, Sample 3: Base oil +0.05% MWCNT +0.5%surfactant, Sample 4: Base oil +0.1% MWCNT +0.5% surfactant, and Sample 5: Base oil +0.15% MWCNT +0.5%surfactant. To evaluate the performance of the developed lubricants, experiments were performed on the reduced scale conformal block on disc test setup. The experimental condition and dimension of the block and disc were decide for the Sommerfeld number equal to 0.0025, which indicates mixed lubrication regime. The performance of lubricant is evaluated by measuring the frictional force and temperature rise of the lubricant during the experiment.

Performance-Based Assessment Resource Guide.

ERIC Educational Resources Information Center

Gilbert, Judith C.; Burger, Patricia

This resource guide reviews a variety of performance-based student assessment strategies, and provides examples of, and references for, the strategies. Strategies include anecdotal records, interviews, peer report and group evaluations, and portfolios. Materials in the guide include: (1) a resource guide update form for teachers; (2) department…

PERFORMANCE EVALUATION OF A CARBON-BASED REACTIVE BARRIER FOR NITRATE REMEDIATION

EPA Science Inventory

Nitrate (NO3-) is a common ground water contaminant related to agricultural activity, waste water disposal, leachate from landfills, septic systems, and industrial processes. This study reports on the performance of a carbon-based permeable reactive barrier (PRB) that was constr...

Evaluation of Methods for Decladding LWR Fuel for a Pyroprocessing-Based Reprocessing Plant

DTIC Science & Technology

1992-10-01

oAD-A275 326 ORN.rFM-1121o04 OAK RIDGE NATIONAL LABORATORY Evaluation of Methods for Decladding _LWR Fuel for a Pyroprocessing -Based Reprocessing...Dist. Category UC-526 EVALUATION OF METHODS FOR DECLADDING LWR FUEL FOR A PYROPROCESSING -BASED REPROCESSING PLANT W. D. Bond J. C. Mailen G. E...decladding technologies has been performed to identify candidate decladding processes suitable for LWR fuel and compatible with downstream pyroprocesses

A Web-Based Peer-Assessment Approach to Improving Junior High School Students' Performance, Self-Efficacy and Motivation in Performing Arts Courses

ERIC Educational Resources Information Center

Hsia, Lu-Ho; Huang, Iwen; Hwang, Gwo-Jen

2016-01-01

In this paper, a web-based peer-assessment approach is proposed for conducting performing arts activities. A peer-assessment system was implemented and applied to a junior high school performing arts course to evaluate the effectiveness of the proposed approach. A total of 163 junior high students were assigned to an experimental group and a…

Fire Performance Evaluation of Solid Aqueous Film-Forming Foam (AFFF).

DTIC Science & Technology

1986-05-01

Aqueous Film - Forming Foam ( AFFF ) Concentrates as Firefighting Agents, USAF Report ESL-TR-81-18, Tyndall Air Force Base, Florida...Evaluation of Solid Aqueous Film - Forming Foam ( AFFF ) JOSEPH L. SCHEFFEY HUGHES ASSOCIATES, INC. , EDWIN J. JABLONSKI 2730 UNIVERSITY BLVD. W. JOSEPH T...performance evaluation of the solid agent is the 28-square-foot fire test described in ’L F-24385C, Military Specification for Aqueous Film - Forming

Can traits predict individual growth performance? A test in a hyperdiverse tropical forest.

PubMed

Poorter, Lourens; Castilho, Carolina V; Schietti, Juliana; Oliveira, Rafael S; Costa, Flávia R C

2018-07-01

The functional trait approach has, as a central tenet, that plant traits are functional and shape individual performance, but this has rarely been tested in the field. Here, we tested the individual-based trait approach in a hyperdiverse Amazonian tropical rainforest and evaluated intraspecific variation in trait values, plant strategies at the individual level, and whether traits are functional and predict individual performance. We evaluated > 1300 tree saplings belonging to > 383 species, measured 25 traits related to growth and defense, and evaluated the effects of environmental conditions, plant size, and traits on stem growth. A total of 44% of the trait variation was observed within species, indicating a strong potential for acclimation. Individuals showed two strategy spectra, related to tissue toughness and organ size vs leaf display. In this nutrient- and light-limited forest, traits measured at the individual level were surprisingly poor predictors of individual growth performance because of convergence of traits and growth rates. Functional trait approaches based on individuals or species are conceptually fundamentally different: the species-based approach focuses on the potential and the individual-based approach on the realized traits and growth rates. Counterintuitively, the individual approach leads to a poor prediction of individual performance, although it provides a more realistic view on community dynamics. © 2018 The Authors. New Phytologist © 2018 New Phytologist Trust.

A multiobjective decision support/numerical modeling approach for design and evaluation of shallow landfill burial systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ascough, II, James Clifford

1992-05-01

The capability to objectively evaluate design performance of shallow landfill burial (SLB) systems is of great interest to diverse scientific disciplines, including hydrologists, engineers, environmental scientists, and SLB regulators. The goal of this work was to develop and validate a procedure for the nonsubjective evaluation of SLB designs under actual or simulated environmental conditions. A multiobjective decision module (MDM) based on scoring functions (Wymore, 1988) was implemented to evaluate SLB design performance. Input values to the MDM are provided by hydrologic models. The MDM assigns a total score to each SLB design alternative, thereby allowing for rapid and repeatable designmore » performance evaluation. The MDM was validated for a wide range of SLB designs under different climatic conditions. Rigorous assessment of SLB performance also requires incorporation of hydrologic probabilistic analysis and hydrologic risk into the overall design. This was accomplished through the development of a frequency analysis module. The frequency analysis module allows SLB design event magnitudes to be calculated based on the hydrologic return period. The multiobjective decision and freqeuncy anslysis modules were integrated in a decision support system (DSS) framework, SLEUTH (Shallow Landfill Evaluation Using Transport and Hydrology). SLEUTH is a Microsoft Windows {trademark} application, and is written in the Knowledge Pro Windows (Knowledge Garden, Inc., 1991) development language.« less

Investigation of Formative Assessment of Learning (INFORMAL): The Performance Indicator Tool (PIT)

ERIC Educational Resources Information Center

Dutton, Philip J.; Bickerstaff, Helen E.; Rymer, Janice M.; Webb, Mary E.; Ballinger-Mills, Deborah; Greenough, Anne; Reynolds, Patricia A.

2017-01-01

This pilot study evaluated the student user experience of a performance indicator tool (PIT) for formative assessment of a cohort of fourth year medical undergraduates undertaking a 12 week rotation. Scoping and elaboration for the standalone web-based tool was based on the existing paper-based formative assessment system for which training and…

Laboratory and field based evaluation of chromatography related performance of the Monitor for Aerosols and Gases in Ambient Air (MARGA)

EPA Science Inventory

The Monitor for AeRosols and GAses in ambient air (MARGA) is an on-line ion-chromatography-based instrument designed for speciation of the inorganic gas and aerosol ammonium-nitrate-sulfate system. Previous work to characterize the performance of the MARGA has been primarily base...

Developing Clinical Competency in Crisis Event Management: An Integrated Simulation Problem-Based Learning Activity

ERIC Educational Resources Information Center

Liaw, S. Y.; Chen, F. G.; Klainin, P.; Brammer, J.; O'Brien, A.; Samarasekera, D. D.

2010-01-01

This study aimed to evaluate the integration of a simulation based learning activity on nursing students' clinical crisis management performance in a problem-based learning (PBL) curriculum. It was hypothesized that the clinical performance of first year nursing students who participated in a simulated learning activity during the PBL session…

Deterministic and fuzzy-based methods to evaluate community resilience

NASA Astrophysics Data System (ADS)

Kammouh, Omar; Noori, Ali Zamani; Taurino, Veronica; Mahin, Stephen A.; Cimellaro, Gian Paolo

2018-04-01

Community resilience is becoming a growing concern for authorities and decision makers. This paper introduces two indicator-based methods to evaluate the resilience of communities based on the PEOPLES framework. PEOPLES is a multi-layered framework that defines community resilience using seven dimensions. Each of the dimensions is described through a set of resilience indicators collected from literature and they are linked to a measure allowing the analytical computation of the indicator's performance. The first method proposed in this paper requires data on previous disasters as an input and returns as output a performance function for each indicator and a performance function for the whole community. The second method exploits a knowledge-based fuzzy modeling for its implementation. This method allows a quantitative evaluation of the PEOPLES indicators using descriptive knowledge rather than deterministic data including the uncertainty involved in the analysis. The output of the fuzzy-based method is a resilience index for each indicator as well as a resilience index for the community. The paper also introduces an open source online tool in which the first method is implemented. A case study illustrating the application of the first method and the usage of the tool is also provided in the paper.

Diagnostic performance and useful findings of ultrasound re-evaluation for patients with equivocal CT features of acute appendicitis.

PubMed

Kim, Mi Sung; Kwon, Heon-Ju; Kang, Kyung A; Do, In-Gu; Park, Hee-Jin; Kim, Eun Young; Hong, Hyun Pyo; Choi, Yoon Jung; Kim, Young Hwan

2018-02-01

To evaluate the diagnostic performance of ultrasound and to determine which ultrasound findings are useful to differentiate appendicitis from non-appendicitis in patients who underwent ultrasound re-evaluation owing to equivocal CT features of acute appendicitis. 62 patients who underwent CT examinations for suspected appendicitis followed by ultrasound re-evaluation owing to equivocal CT findings were included. Equivocal CT findings were considered based on the presence of only one or two findings among the CT criteria, and ultrasound re-evaluation was done based on a predefined structured report form. The diagnostic performance of ultrasound and independent variables to discriminate appendicitis from non-appendicitis were assessed. There were 27 patients in the appendicitis group. The overall diagnostic performance of ultrasound re-evaluation was sensitivity of 96.3%, specificity of 91.2% and accuracy of 91.9%. In terms of the performance of individual ultrasound findings, probe-induced tenderness showed the highest accuracy (86.7%) with sensitivity of 74% and specificity of 97%, followed by non-compressibility (accuracy 71.7%, sensitivity 85.2% and specificity 60.6%). The independent ultrasound findings for discriminating appendicitis were non-compressibility (p = 0.002) and increased flow on the appendiceal wall (p = 0.001). Ultrasound re-evaluation can be used to improve diagnostic accuracy in cases with equivocal CT features for diagnosing appendicitis. The presence of non-compressibility and increased vascular flow on the appendix wall are useful ultrasound findings to discriminate appendicitis from non-appendicitis. Advances in knowledge: Ultrasound re-evaluation is useful to discriminate appendicitis from non-appendicitis when CT features are inconclusive.

Performance of a carbon nanotube field emission electron gun

NASA Astrophysics Data System (ADS)

Getty, Stephanie A.; King, Todd T.; Bis, Rachael A.; Jones, Hollis H.; Herrero, Federico; Lynch, Bernard A.; Roman, Patrick; Mahaffy, Paul

2007-04-01

A cold cathode field emission electron gun (e-gun) based on a patterned carbon nanotube (CNT) film has been fabricated for use in a miniaturized reflectron time-of-flight mass spectrometer (RTOF MS), with future applications in other charged particle spectrometers, and performance of the CNT e-gun has been evaluated. A thermionic electron gun has also been fabricated and evaluated in parallel and its performance is used as a benchmark in the evaluation of our CNT e-gun. Implications for future improvements and integration into the RTOF MS are discussed.

Proceedings of the Conference on the Design of Experiments in Army Research, Development, and Testing (33rd)

DTIC Science & Technology

1988-05-01

Evaluation Directorate (ARMTE) was tasked to conduct a "side- by-side" comparison of EMPS vs . DATMs and to conduct a human factors evaluation of the EMPS...performance ("side-by-side") comparison of EMPS vs . DATMs and to conduct a human factors evaluation. The performance evaluation was based on the speed... independent targets over time. To acquire data for this research, the BRL conducted a statistically designed exper- iment, the Firepower Control Experiment

Web-Based vs. Paper-Based Homework to Evaluate Students' Performance in Introductory Physics Courses and Students' Perceptions: Two Years Experience

ERIC Educational Resources Information Center

Demirci, Neset

2010-01-01

The main aim of this study was to assess and compare undergraduate students' homework performance using a web-based testing system with paper-based, hand-graded one in introductory physics courses. Students' perceptions about each method were then investigated. Every semester during the two-year period, one of the two identical sections of…

Evaluation of Oral Performance in Outsourced Call Centres: An Exploratory Case Study

ERIC Educational Resources Information Center

Friginal, Eric

2013-01-01

This case study discusses the development and use of an oral performance assessment instrument intended to evaluate Filipino agents' customer service transactions with callers from the United States (US). The design and applications of the instrument were based on a longitudinal, qualitative observation of language training and customer service…

Laboratory and field based evaluations of chromatography related performance of the Monitor for AeRosols and GAses in ambient Air (MARGA)

EPA Science Inventory

The semi-continuous Monitor for AeRosols and Gases in Ambient air (MARGA) was evaluated using laboratory and field data with a focus on chromatography. The performance and accuracy assessment revealed various errors and uncertainties resulting from mis-identification and mis-int...

Laboratory and field based evaluation of chromatography related performance of the Monitor for AeRosols and Gases in ambient Air (MARGA)

EPA Science Inventory

The semi-continuous Monitor for AeRosols and Gases in Ambient air (MARGA) was evaluated using laboratory and field data with a focus on chromatography. The performance and accuracy assessment revealed various errors and uncertainties resulting from mis-identification and mis-int...

An Evaluation of the IntelliMetric[SM] Essay Scoring System

ERIC Educational Resources Information Center

Rudner, Lawrence M.; Garcia, Veronica; Welch, Catherine

2006-01-01

This report provides a two-part evaluation of the IntelliMetric[SM] automated essay scoring system based on its performance scoring essays from the Analytic Writing Assessment of the Graduate Management Admission Test[TM] (GMAT[TM]). The IntelliMetric system performance is first compared to that of individual human raters, a Bayesian system…

The Impact of Performance Ratings on Job Satisfaction for Public School Teachers

ERIC Educational Resources Information Center

Koedel, Cory; Li, Jiaxi; Springer, Matthew G.; Tan, Li

2017-01-01

Spurred by the federal Race to the Top competition, the state of Tennessee implemented a comprehensive statewide educator evaluation system in 2011. The new system is designed to increase the rigor of evaluations and better differentiate teachers based on performance. The use of more differentiated ratings represents a significant shift in…

45 CFR 2516.810 - What types of evaluations are grantees and subgrantees required to perform?

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 4 2011-10-01 2011-10-01 false What types of evaluations are grantees and subgrantees required to perform? 2516.810 Section 2516.810 Public Welfare Regulations Relating to Public Welfare (Continued) CORPORATION FOR NATIONAL AND COMMUNITY SERVICE SCHOOL-BASED SERVICE-LEARNING PROGRAMS...

Monte Carlo dose calculation using a cell processor based PlayStation 3 system

NASA Astrophysics Data System (ADS)

Chow, James C. L.; Lam, Phil; Jaffray, David A.

2012-02-01

This study investigates the performance of the EGSnrc computer code coupled with a Cell-based hardware in Monte Carlo simulation of radiation dose in radiotherapy. Performance evaluations of two processor-intensive functions namely, HOWNEAR and RANMAR_GET in the EGSnrc code were carried out basing on the 20-80 rule (Pareto principle). The execution speeds of the two functions were measured by the profiler gprof specifying the number of executions and total time spent on the functions. A testing architecture designed for Cell processor was implemented in the evaluation using a PlayStation3 (PS3) system. The evaluation results show that the algorithms examined are readily parallelizable on the Cell platform, provided that an architectural change of the EGSnrc was made. However, as the EGSnrc performance was limited by the PowerPC Processing Element in the PS3, PC coupled with graphics processing units or GPCPU may provide a more viable avenue for acceleration.

Application of Support Vector Machine to Forex Monitoring

NASA Astrophysics Data System (ADS)

Kamruzzaman, Joarder; Sarker, Ruhul A.

Previous studies have demonstrated superior performance of artificial neural network (ANN) based forex forecasting models over traditional regression models. This paper applies support vector machines to build a forecasting model from the historical data using six simple technical indicators and presents a comparison with an ANN based model trained by scaled conjugate gradient (SCG) learning algorithm. The models are evaluated and compared on the basis of five commonly used performance metrics that measure closeness of prediction as well as correctness in directional change. Forecasting results of six different currencies against Australian dollar reveal superior performance of SVM model using simple linear kernel over ANN-SCG model in terms of all the evaluation metrics. The effect of SVM parameter selection on prediction performance is also investigated and analyzed.

Empirical performance of interpolation techniques in risk-neutral density (RND) estimation

NASA Astrophysics Data System (ADS)

Bahaludin, H.; Abdullah, M. H.

2017-03-01

The objective of this study is to evaluate the empirical performance of interpolation techniques in risk-neutral density (RND) estimation. Firstly, the empirical performance is evaluated by using statistical analysis based on the implied mean and the implied variance of RND. Secondly, the interpolation performance is measured based on pricing error. We propose using the leave-one-out cross-validation (LOOCV) pricing error for interpolation selection purposes. The statistical analyses indicate that there are statistical differences between the interpolation techniques:second-order polynomial, fourth-order polynomial and smoothing spline. The results of LOOCV pricing error shows that interpolation by using fourth-order polynomial provides the best fitting to option prices in which it has the lowest value error.

New integrated information system for pusan national university hospital.

PubMed

Kim, Hyung Hoi; Cho, Kyung-Won; Kim, Hye Sook; Kim, Ju-Sim; Kim, Jung Hyun; Han, Sang Pil; Park, Chun Bok; Kim, Seok; Chae, Young Moon

2011-03-01

This study presents the information system for Pusan National University Hospital (PNUH), evaluates its performance qualitatively, and conducts economic analysis. Information system for PNUH was designed by component-based development and developed by internet technologies. Order Communication System, Electronic Medical Record, and Clinical Decision Support System were newly developed. The performance of the hospital information system was qualitatively evaluated based on the performance reference model in order to identify problem areas for the old system. The Information Economics approach was used to analyze the economic feasibility of hospital information system in order to account for the intangible benefits. Average performance scores were 3.16 for input layer, 3.35 for process layer, and 3.57 for business layer. In addition, the cumulative benefit to cost ratio was 0.50 in 2011, 1.73 in 2012, 1.76 in 2013, 1.71 in 2014, and 1.71 in 2015. The B/C ratios steadily increase as value items are added. While overall performance scores were reasonably high, doctors were less satisfied with the system, perhaps due to the weak clinical function in the systems. The information economics analysis demonstrated the economic profitability of the information systems if all intangible benefits were included. The second qualitative evaluation survey and economic analysis were proposed to evaluate the changes in performance of the new system.

Efficiency of HIV/AIDS Health Centers and Effect of Community-Based Health Insurance and Performance-Based Financing on HIV/AIDS Service Delivery in Rwanda

PubMed Central

Zeng, Wu; Rwiyereka, Angelique K.; Amico, Peter R.; Ávila-Figueroa, Carlos; Shepard, Donald S.

2014-01-01

This study evaluates the efficiency of rural health centers in Rwanda in delivering the three key human immunodeficiency virus/acquired immunodeficiency syndrome services: antiretroviral treatment, prevention of mother-to-child transmission, and voluntary counseling and testing using data envelopment analysis, and assesses the impact of community-based health insurance (CBHI) and performance-based financing on improving the delivery of the three services. Results show that health centers average efficiency of 78%, and despite the observed variation, the performance increased by 15.6% from 2006 through 2007. When the services are examined separately, each 1% growth of CBHI use was associated with 3.7% more prevention of mother-to-child transmission and 2.5% more voluntary counseling and testing services. Although more health centers would have been needed to evaluate performance-based financing, we found that high use of CBHI in Rwanda was an important contributor to improving human immunodeficiency virus/acquired immunodeficiency syndrome services in rural health centers in Rwanda. PMID:24515939

Efficiency of HIV/AIDS health centers and effect of community-based health insurance and performance-based financing on HIV/AIDS service delivery in Rwanda.

PubMed

Zeng, Wu; Rwiyereka, Angelique K; Amico, Peter R; Avila-Figueroa, Carlos; Shepard, Donald S

2014-04-01

This study evaluates the efficiency of rural health centers in Rwanda in delivering the three key human immunodeficiency virus/acquired immunodeficiency syndrome services: antiretroviral treatment, prevention of mother-to-child transmission, and voluntary counseling and testing using data envelopment analysis, and assesses the impact of community-based health insurance (CBHI) and performance-based financing on improving the delivery of the three services. Results show that health centers average efficiency of 78%, and despite the observed variation, the performance increased by 15.6% from 2006 through 2007. When the services are examined separately, each 1% growth of CBHI use was associated with 3.7% more prevention of mother-to-child transmission and 2.5% more voluntary counseling and testing services. Although more health centers would have been needed to evaluate performance-based financing, we found that high use of CBHI in Rwanda was an important contributor to improving human immunodeficiency virus/acquired immunodeficiency syndrome services in rural health centers in Rwanda.

Using Team-Based Learning to Teach Grade 7 Biology: Student Satisfaction and Improved Performance

ERIC Educational Resources Information Center

Jarjoura, Christiane; Tayeh, Paula Abou; Zgheib, Nathalie K.

2015-01-01

Team-based learning (TBL) is an innovative form of collaborative learning. The purpose of this study was to evaluate TBL's effect on the performance and satisfaction of grade 7 students in biology in a private school in Lebanon, as well as teachers' willingness to implement this new methodology. An exploratory study was performed whereby two…

Performance, physiological, and oculometer evaluation of VTOL landing displays

NASA Technical Reports Server (NTRS)

North, R. A.; Stackhouse, S. P.; Graffunder, K.

1979-01-01

A methodological approach to measuring workload was investigated for evaluation of new concepts in VTOL aircraft displays. Physiological, visual response, and conventional flight performance measures were recorded for landing approaches performed in the NASA Visual Motion Simulator (VMS). Three displays (two computer graphic and a conventional flight director), three crosswind amplitudes, and two motion base conditions (fixed vs. moving base) were tested in a factorial design. Multivariate discriminant functions were formed from flight performance and/or visual response variables. The flight performance variable discriminant showed maximum differentation between crosswind conditions. The visual response measure discriminant maximized differences between fixed vs. motion base conditions and experimental displays. Physiological variables were used to attempt to predict the discriminant function values for each subject/condition trial. The weights of the physiological variables in these equations showed agreement with previous studies. High muscle tension, light but irregular breathing patterns, and higher heart rate with low amplitude all produced higher scores on this scale and thus represent higher workload levels.

Incorporating Team-Based Learning Into a Physician Assistant Clinical Pharmacology Course.

PubMed

Nguyen, Timothy; Wong, Elaine; Pham, Antony

2016-03-01

To obtain student perceptions of team-based learning and compare the effectiveness of team-based learning and traditional lecture formats in a clinical pharmacology course for physician assistant (PA) students. Clinical pharmacology is a course offered to PA students in their first year of training at LIU Brooklyn, Brooklyn, NY. In spring 2014, half of the course was offered in a traditional lecture format and the remaining half was offered in a team-based learning format. The team-based learning format had 3 components: (1) prereading assignments, (2) individual readiness assessment tests, and (3) team readiness assessment tests. So that student perceptions of the integration of team-based learning activities into the course could be evaluated, presurveys and postsurveys were administered. The effectiveness of team-based learning was evaluated by comparing overall student performance with student performance in the preceding year. Thirty-three students were enrolled in the course and completed the presurveys and postsurveys. The survey results are presented in Table 1. Comparison of student performance on examinations with performance from the previous year showed similar outcomes. Incorporating a team-based learning pedagogical approach in the PA pharmacology course yielded similar examination results to those of traditional lecture formats. Presurvey and postsurvey questionnaires yielded various student perceptions of team-based learning.

Fabrication, Characterization, and Evaluation of Bionanocomposites Based on Natural Polymers and Antibiotics for Wound Healing Applications.

PubMed

Rădulescu, Marius; Holban, Alina Maria; Mogoantă, Laurențiu; Bălşeanu, Tudor-Adrian; Mogoșanu, George Dan; Savu, Diana; Popescu, Roxana Cristina; Fufă, Oana; Grumezescu, Alexandru Mihai; Bezirtzoglou, Eugenia; Lazar, Veronica; Chifiriuc, Mariana Carmen

2016-06-10

The aim of our research activity was to obtain a biocompatible nanostructured composite based on naturally derived biopolymers (chitin and sodium alginate) loaded with commercial antibiotics (either Cefuroxime or Cefepime) with dual functions, namely promoting wound healing and assuring the local delivery of the loaded antibiotic. Compositional, structural, and morphological evaluations were performed by using the thermogravimetric analysis (TGA), scanning electron microscopy (SEM), and fourier transform infrared spectroscopy (FTIR) analytical techniques. In order to quantitatively and qualitatively evaluate the biocompatibility of the obtained composites, we performed the tetrazolium-salt (MTT) and agar diffusion in vitro assays on the L929 cell line. The evaluation of antimicrobial potential was evaluated by the viable cell count assay on strains belonging to two clinically relevant bacterial species (i.e., Escherichia coli and Staphylococcus aureus).

Demystifying Results-Based Performance Measurement.

ERIC Educational Resources Information Center

Jorjani, Hamid

Many evaluators are convinced that Results-based Performance Measurement (RBPM) is an effective tool to improve service delivery and cost effectiveness in both public and private sectors. Successful RBPM requires self-directed and cross-functional work teams and the supporting infrastructure to make it work. There are many misconceptions and…

The Arizona Performance-Based Teacher Certification Program.

ERIC Educational Resources Information Center

Kelley, Michael F.

In response to public pressures and a legislative mandate, the State of Arizona began to systematically evaluate prospective teachers while concomitantly requiring a restructuring of the Arizona teacher preparation programs at the college and university level as part of a program entitled the Arizona Performance-Based Teacher Certification…

Measuring Provider Performance for Physicians Participating in the Merit-Based Incentive Payment System.

PubMed

Squitieri, Lee; Chung, Kevin C

2017-07-01

In 2017, the Centers for Medicare and Medicaid Services began requiring all eligible providers to participate in the Quality Payment Program or face financial reimbursement penalty. The Quality Payment Program outlines two paths for provider participation: the Merit-Based Incentive Payment System and Advanced Alternative Payment Models. For the first performance period beginning in January of 2017, the Centers for Medicare and Medicaid Services estimates that approximately 83 to 90 percent of eligible providers will not qualify for participation in an Advanced Alternative Payment Model and therefore must participate in the Merit-Based Incentive Payment System program. The Merit-Based Incentive Payment System path replaces existing quality-reporting programs and adds several new measures to evaluate providers using four categories of data: (1) quality, (2) cost/resource use, (3) improvement activities, and (4) advancing care information. These categories will be combined to calculate a weighted composite score for each provider or provider group. Composite Merit-Based Incentive Payment System scores based on 2017 performance data will be used to adjust reimbursed payment in 2019. In this article, the authors provide relevant background for understanding value-based provider performance measurement. The authors also discuss Merit-Based Incentive Payment System reporting requirements and scoring methodology to provide plastic surgeons with the necessary information to critically evaluate their own practice capabilities in the context of current performance metrics under the Quality Payment Program.

Effectiveness evaluation of objective and subjective weighting methods for aquifer vulnerability assessment in urban context

NASA Astrophysics Data System (ADS)

Sahoo, Madhumita; Sahoo, Satiprasad; Dhar, Anirban; Pradhan, Biswajeet

2016-10-01

Groundwater vulnerability assessment has been an accepted practice to identify the zones with relatively increased potential for groundwater contamination. DRASTIC is the most popular secondary information-based vulnerability assessment approach. Original DRASTIC approach considers relative importance of features/sub-features based on subjective weighting/rating values. However variability of features at a smaller scale is not reflected in this subjective vulnerability assessment process. In contrast to the subjective approach, the objective weighting-based methods provide flexibility in weight assignment depending on the variation of the local system. However experts' opinion is not directly considered in the objective weighting-based methods. Thus effectiveness of both subjective and objective weighting-based approaches needs to be evaluated. In the present study, three methods - Entropy information method (E-DRASTIC), Fuzzy pattern recognition method (F-DRASTIC) and Single parameter sensitivity analysis (SA-DRASTIC), were used to modify the weights of the original DRASTIC features to include local variability. Moreover, a grey incidence analysis was used to evaluate the relative performance of subjective (DRASTIC and SA-DRASTIC) and objective (E-DRASTIC and F-DRASTIC) weighting-based methods. The performance of the developed methodology was tested in an urban area of Kanpur City, India. Relative performance of the subjective and objective methods varies with the choice of water quality parameters. This methodology can be applied without/with suitable modification. These evaluations establish the potential applicability of the methodology for general vulnerability assessment in urban context.

The Application of FIA-based Data to Wildlife Habitat Modeling: A Comparative Study

Treesearch

Thomas C., Jr. Edwards; Gretchen G. Moisen; Tracey S. Frescino; Randall J. Schultz

2005-01-01

We evaluated the capability of two types of models, one based on spatially explicit variables derived from FIA data and one using so-called traditional habitat evaluation methods, for predicting the presence of cavity-nesting bird habitat in Fishlake National Forest, Utah. Both models performed equally well, in measures of predictive accuracy, with the FIA-based model...

Expert Advisor (EA) Evaluation System Using Web-based ELECTRE Method in Foreign Exchange (Forex) Market

NASA Astrophysics Data System (ADS)

Satibi; Widodo, Catur Edi; Farikhin

2018-02-01

This research aims to optimize forex trading profit automatically using EA but its still keep considering accuracy and drawdown levels. The evaluation system will classify EA performance based on trading market sessions (Sydney, Tokyo, London and New York) to determine the right EA to be used in certain market sessions. This evaluation system is a web-based ELECTRE methods that interact in real-time with EA through web service and are able to present real-time charts performance dashboard using web socket protocol communications. Web applications are programmed using NodeJs. In the testing period, all EAs had been simulated 24 hours in all market sessions for three months, the best EA is valued by its profit, accuracy and drawdown criteria that calculated using web-based ELECTRE method. The ideas of this research are to compare the best EA on testing period with collaboration performances of each best classified EA by market sessions. This research uses three months historical data of EUR/USD as testing period and other 3 months as validation period. As a result, performance of collaboration four best EA classified by market sessions can increase profits percentage consistently in testing and validation periods and keep securing accuracy and drawdown levels.

School-based sleep education program improves sleep and academic performance of school-age children.

PubMed

Gruber, Reut; Somerville, Gail; Bergmame, Lana; Fontil, Laura; Paquin, Soukaina

2016-05-01

The objective of this study was to develop and evaluate the effectiveness of a school-based sleep education program aimed at improving the sleep and academic performance of school-age children. Using a community-based participatory research approach, we created a school-based sleep education program, "Sleep for Success"™ (SFS), composed of four distinct modules that addressed the children, their family and community, the school staff, and decision makers within the school setting. Implementation was carried out in three elementary schools. Seventy-one students participated in the evaluation of the program. The effectiveness of the SFS program was evaluated using non-randomized controlled before-and-after study groups (intervention and control) assessed over two time points (pre- and post-program implementation). Before (baseline) and after implementation, sleep and academic performance were measured using actigraphy and report card marks, respectively. In the intervention group, true sleep was extended by 18.2 min per night, sleep efficiency improved by 2.3%, and sleep latency was shortened by 2.3 min, and report card grades in mathematics and English improved significantly. No changes were noted in the control group. Participation in the sleep education program was associated with significant improvements in children's sleep and academic performance. Copyright © 2016 Elsevier B.V. All rights reserved.

Genetic conditions of joint Nordic genetic evaluations of lifetime competition performance in warmblood sport horses.

PubMed

Viklund, Å; Furre, S; Eriksson, S; Vangen, O; Philipsson, J

2015-08-01

Breeding programmes for warmblood sport horses are similar in the Nordic countries Sweden, Denmark, Finland and Norway, and stallions of same origin are used. The aim was to investigate whether a joint Nordic genetic evaluation based on lifetime competition performance is feasible and beneficial for breeding competitive sport horses in the Nordic countries. Results for almost 45,000 horses in show jumping and 30,000 horses in dressage were available. The larger populations in Sweden and Denmark contributed with 85% of the results. Heritabilities and genetic correlations between performances in the different countries were estimated, and comparisons of accuracies of estimated breeding values (EBVs) and number of stallions with EBVs based on national or joint data were studied. The heritabilities ranged between 0.25 and 0.42 for show jumping and between 0.14 and 0.55 for dressage. The genetic correlations between competition performances in the Nordic countries were estimated to 0.63-1.00. EBVs based on joint data increased accuracies for EBVs for stallions by 38-81% and increased the number of available stallions with EBVs by 40-288%, compared to EBVs based on national data only. A joint Nordic genetic evaluation for sport horses is recommended. © 2015 Blackwell Verlag GmbH.

Evaluation of the base/subgrade soil under repeated loading : phase II, in-box and ALF cyclic plate load tests.

DOT National Transportation Integrated Search

2012-03-01

This research study aims at evaluating the performance of base and subgrade soil in flexible pavements under repeated loading test conditions. For this purpose, an indoor cyclic plate load testing equipment was developed and used to conduct a series ...

Evaluation of Complex Human Performance: The Promise of Computer-Based Simulation

ERIC Educational Resources Information Center

Newsom, Robert S.; And Others

1978-01-01

For the training and placement of professional workers, multiple-choice instruments are the norm for wide-scale measurement and evaluation efforts. These instruments contain fundamental problems. Computer-based management simulations may provide solutions to these problems, appear scoreable and reliable, offer increased validity, and are better…

Initial Usability and Feasibility Evaluation of a Personal Health Record-Based Self-Management System for Older Adults.

PubMed

Sheehan, Barbara; Lucero, Robert J

2015-01-01

Electronic personal health record-based (ePHR-based) self-management systems can improve patient engagement and have an impact on health outcomes. In order to realize the benefits of these systems, there is a need to develop and evaluate heath information technology from the same theoretical underpinnings. Using an innovative usability approach based in human-centered distributed information design (HCDID), we tested an ePHR-based falls-prevention self-management system-Self-Assessment via a Personal Health Record (i.e., SAPHeR)-designed using HCDID principles in a laboratory. And we later evaluated SAPHeR's use by community-dwelling older adults at home. The innovative approach used in this study supported the analysis of four components: tasks, users, representations, and functions. Tasks were easily learned and features such as text-associated images facilitated task completion. Task performance times were slow, however user satisfaction was high. Nearly seven out of every ten features desired by design participants were evaluated in our usability testing of the SAPHeR system. The in vivo evaluation suggests that older adults could improve their confidence in performing indoor and outdoor activities after using the SAPHeR system. We have applied an innovative consumer-usability evaluation. Our approach addresses the limitations of other usability testing methods that do not utilize consistent theoretically based methods for designing and testing technology. We have successfully demonstrated the utility of testing consumer technology use across multiple components (i.e., task, user, representational, functional) to evaluate the usefulness, usability, and satisfaction of an ePHR-based self-management system.

Evaluating Internal Model Strength and Performance of Myoelectric Prosthesis Control Strategies.

PubMed

Shehata, Ahmed W; Scheme, Erik J; Sensinger, Jonathon W

2018-05-01

On-going developments in myoelectric prosthesis control have provided prosthesis users with an assortment of control strategies that vary in reliability and performance. Many studies have focused on improving performance by providing feedback to the user but have overlooked the effect of this feedback on internal model development, which is key to improve long-term performance. In this paper, the strength of internal models developed for two commonly used myoelectric control strategies: raw control with raw feedback (using a regression-based approach) and filtered control with filtered feedback (using a classifier-based approach), were evaluated using two psychometric measures: trial-by-trial adaptation and just-noticeable difference. The performance of both strategies was also evaluated using Schmidt's style target acquisition task. Results obtained from 24 able-bodied subjects showed that although filtered control with filtered feedback had better short-term performance in path efficiency ( ), raw control with raw feedback resulted in stronger internal model development ( ), which may lead to better long-term performance. Despite inherent noise in the control signals of the regression controller, these findings suggest that rich feedback associated with regression control may be used to improve human understanding of the myoelectric control system.

Evaluation of Quantitative Performance of Sequential Immobilized Metal Affinity Chromatographic Enrichment for Phosphopeptides

PubMed Central

Sun, Zeyu; Hamilton, Karyn L.; Reardon, Kenneth F.

2014-01-01

We evaluated a sequential elution protocol from immobilized metal affinity chromatography (SIMAC) employing gallium-based immobilized metal affinity chromatography (IMAC) in conjunction with titanium-dioxide-based metal oxide affinity chromatography (MOAC). The quantitative performance of this SIMAC enrichment approach, assessed in terms of repeatability, dynamic range, and linearity, was evaluated using a mixture composed of tryptic peptides from caseins, bovine serum albumin, and phosphopeptide standards. While our data demonstrate the overall consistent performance of the SIMAC approach under various loading conditions, the results also revealed that the method had limited repeatability and linearity for most phosphopeptides tested, and different phosphopeptides were found to have different linear ranges. These data suggest that, unless additional strategies are used, SIMAC should be regarded as a semi-quantitative method when used in large-scale phosphoproteomics studies in complex backgrounds. PMID:24096195

2010 Perinatal GBS Prevention Guideline and Resource Utilization

PubMed Central

Mukhopadhyay, Sagori; Dukhovny, Dmitry; Mao, Wenyang; Eichenwald, Eric C.

2014-01-01

OBJECTIVES: To quantify differences in early-onset sepsis (EOS) evaluations, evaluation-associated resource utilization, and EOS cases detected, when comparing time periods before and after the implementation of an EOS algorithm based on the Centers for Disease Control and Prevention (CDC) 2010 guidelines for prevention of perinatal Group B Streptococcus (GBS) disease. METHODS: Retrospective cohort study of infants born at ≥36 weeks’ gestation from 2009 to 2012 in a single tertiary care center. One 12-month period during which EOS evaluations were based on the CDC 2002 guideline was compared with a second 12-month period during which EOS evaluations were based on the CDC 2010 guideline. A cost minimization analysis was performed to determine the EOS evaluation-associated costs and resources during each time period. RESULTS: During the study periods, among well-appearing infants ≥36 weeks’ gestation, EOS evaluations for inadequate GBS prophylaxis decreased from 32/1000 to <1/1000 live births; EOS evaluation-associated costs decreased by $6994 per 1000 live births; and EOS evaluation-associated work hours decreased by 29 per 1000 live births. We found no increase in EOS evaluations for other indications, total NICU admissions, frequency of infants evaluated for symptoms before hospital discharge, or incidence of EOS during the 2 study periods. CONCLUSIONS: Implementation of an EOS algorithm based on CDC 2010 GBS guidelines resulted in a 25% decrease in EOS evaluations performed among well-appearing infants ≥36 weeks’ gestation, attributable to decreased evaluation of infants born in the setting of inadequate indicated GBS prophylaxis. This resulted in significant changes in EOS evaluation-associated resource expenditures. PMID:24446442

Experimental Evaluation of High Performance Integrated Heat Pump

DOE Office of Scientific and Technical Information (OSTI.GOV)

Miller, William A; Berry, Robert; Durfee, Neal

2016-01-01

Integrated heat pump (IHP) technology provides significant potential for energy savings and comfort improvement for residential buildings. In this study, we evaluate the performance of a high performance IHP that provides space heating, cooling, and water heating services. Experiments were conducted according to the ASHRAE Standard 206-2013 where 24 test conditions were identified in order to evaluate the IHP performance indices based on the airside performance. Empirical curve fits of the unit s compressor maps are used in conjunction with saturated condensing and evaporating refrigerant conditions to deduce the refrigerant mass flowrate, which, in turn was used to evaluate themore » refrigerant side performance as a check on the airside performance. Heat pump (compressor, fans, and controls) and water pump power were measured separately per requirements of Standard 206. The system was charged per the system manufacturer s specifications. System test results are presented for each operating mode. The overall IHP performance metrics are determined from the test results per the Standard 206 calculation procedures.« less

Design and implementation of a controlled clinical trial to evaluate the effectiveness and efficiency of routine opt-out rapid human immunodeficiency virus screening in the emergency department.

PubMed

Haukoos, Jason S; Hopkins, Emily; Byyny, Richard L; Conroy, Amy A; Silverman, Morgan; Eisert, Sheri; Thrun, Mark; Wilson, Michael; Boyett, Brian; Heffelfinger, James D

2009-08-01

In 2006, the Centers for Disease Control and Prevention (CDC) released revised recommendations for performing human immunodeficiency virus (HIV) testing in health care settings, including implementing routine rapid HIV screening, the use of an integrated opt-out consent, and limited prevention counseling. Emergency departments (EDs) have been a primary focus of these efforts. These revised CDC recommendations were primarily based on feasibility studies and have not been evaluated through the application of rigorous research methods. This article describes the design and implementation of a large prospective controlled clinical trial to evaluate the CDC's recommendations in an ED setting. From April 15, 2007, through April 15, 2009, a prospective quasi-experimental equivalent time-samples clinical trial was performed to compare the clinical effectiveness and efficiency of routine (nontargeted) opt-out rapid HIV screening (intervention) to physician-directed diagnostic rapid HIV testing (control) in a high-volume urban ED. In addition, three nested observational studies were performed to evaluate the cost-effectiveness and patient and staff acceptance of the two rapid HIV testing methods. This article describes the rationale, methodologies, and study design features of this program evaluation clinical trial. It also provides details regarding the integration of the principal clinical trial and its nested observational studies. Such ED-based trials are rare, but serve to provide valid comparisons between testing approaches. Investigators should consider similar methodology when performing future ED-based health services research.

Performance Evaluation of Public Non-Profit Hospitals Using a BP Artificial Neural Network: The Case of Hubei Province in China

PubMed Central

Li, Chunhui; Yu, Chuanhua

2013-01-01

To provide a reference for evaluating public non-profit hospitals in the new environment of medical reform, we established a performance evaluation system for public non-profit hospitals. The new “input-output” performance model for public non-profit hospitals is based on four primary indexes (input, process, output and effect) that include 11 sub-indexes and 41 items. The indicator weights were determined using the analytic hierarchy process (AHP) and entropy weight method. The BP neural network was applied to evaluate the performance of 14 level-3 public non-profit hospitals located in Hubei Province. The most stable BP neural network was produced by comparing different numbers of neurons in the hidden layer and using the “Leave-one-out” Cross Validation method. The performance evaluation system we established for public non-profit hospitals could reflect the basic goal of the new medical health system reform in China. Compared with PLSR, the result indicated that the BP neural network could be used effectively for evaluating the performance public non-profit hospitals. PMID:23955238

A lightweight neighbor-info-based routing protocol for no-base-station taxi-call system.

PubMed

Zhu, Xudong; Wang, Jinhang; Chen, Yunchao

2014-01-01

Since the quick topology change and short connection duration, the VANET has had unstable routing and wireless signal quality. This paper proposes a kind of lightweight routing protocol-LNIB for call system without base station, which is applicable to the urban taxis. LNIB maintains and predicts neighbor information dynamically, thus finding the reliable path between the source and the target. This paper describes the protocol in detail and evaluates the performance of this protocol by simulating under different nodes density and speed. The result of evaluation shows that the performance of LNIB is better than AODV which is a classic protocol in taxi-call scene.

Evaluating stakeholder management performance using a stakeholder report card: the next step in theory and practice.

PubMed

Malvey, Donna; Fottler, Myron D; Slovensky, Donna J

2002-01-01

In the highly competitive health care environment, the survival of an organization may depend on how well powerful stakeholders are managed. Yet, the existing strategic stakeholder management process does not include evaluation of stakeholder management performance. To address this critical gap, this paper proposes a systematic method for evaluation using a stakeholder report card. An example of a physician report card based on this methodology is presented.

Evaluative stimulus (in)congruency impacts performance in an unrelated task: evidence for a resource-based account of evaluative priming.

PubMed

Gast, Anne; Werner, Benedikt; Heitmann, Christina; Spruyt, Adriaan; Rothermund, Klaus

2014-01-01

In two experiments, we assessed evaluative priming effects in a task that was unrelated to the congruent or incongruent stimulus pairs. In each trial, participants saw two valent (positive or negative) pictures that formed evaluatively congruent or incongruent stimulus pairs and a letter that was superimposed on the second picture. Different from typical evaluative priming studies, participants were not required to respond to the second of the valent stimuli, but asked to categorize the letter that was superimposed on the second picture. We assessed the impact of the evaluative (in)congruency of the two pictures on the performance in responding to the letter. In addition, we manipulated attention to the evaluative dimension by asking participants in one experimental group to respond to the valence of the pictures on a subset of trials (evaluative task condition). In both experiments, we found evaluative priming effects in letter categorization responses: Participants categorized the letter faster (and sometimes more correctly) in trials with congruent picture-pairs. These effects were present only in the evaluative task condition. These findings can be explained with different resource-based accounts of evaluative priming and the additional assumption that attention to valence is necessary for evaluative congruency to affect processing resources. According to resource-based accounts valence-incongruent trials require more cognitive resources than valence-congruent trials (e.g., Hermans, Van den Broeck, & Eelen, 1998).

Use of Latent Class Analysis to define groups based on validity, cognition, and emotional functioning.

PubMed

Morin, Ruth T; Axelrod, Bradley N

Latent Class Analysis (LCA) was used to classify a heterogeneous sample of neuropsychology data. In particular, we used measures of performance validity, symptom validity, cognition, and emotional functioning to assess and describe latent groups of functioning in these areas. A data-set of 680 neuropsychological evaluation protocols was analyzed using a LCA. Data were collected from evaluations performed for clinical purposes at an urban medical center. A four-class model emerged as the best fitting model of latent classes. The resulting classes were distinct based on measures of performance validity and symptom validity. Class A performed poorly on both performance and symptom validity measures. Class B had intact performance validity and heightened symptom reporting. The remaining two Classes performed adequately on both performance and symptom validity measures, differing only in cognitive and emotional functioning. In general, performance invalidity was associated with worse cognitive performance, while symptom invalidity was associated with elevated emotional distress. LCA appears useful in identifying groups within a heterogeneous sample with distinct performance patterns. Further, the orthogonal nature of performance and symptom validities is supported.

Performance of a computer-based assessment of cognitive function measures in two cohorts of seniors

USDA-ARS?s Scientific Manuscript database

Computer-administered assessment of cognitive function is being increasingly incorporated in clinical trials, however its performance in these settings has not been systematically evaluated. The Seniors Health and Activity Research Program (SHARP) pilot trial (N=73) developed a computer-based tool f...

Impact performance of two bamboo-based laminated composites

Treesearch

Huanrong Liu; Zehui Jiang; Zhengjun Sun; Yan Yan; Zhiyong Cai; Xiubiao Zhang

2017-01-01

The present work aims to determine the impact performance of two bamboo-based laminated composites [bamboo/poplar laminated composite (BPLC) and bamboo/ glass fiber laminated composite (BGFLC)] using lowvelocity impact tests by a drop tower. In addition, fracture characteristics were evaluated using computed tomography (CT). Results showed that BPLC presented better...

An XML-Based Protocol for Distributed Event Services

NASA Technical Reports Server (NTRS)

Smith, Warren; Gunter, Dan; Quesnel, Darcy; Biegel, Bryan (Technical Monitor)

2001-01-01

A recent trend in distributed computing is the construction of high-performance distributed systems called computational grids. One difficulty we have encountered is that there is no standard format for the representation of performance information and no standard protocol for transmitting this information. This limits the types of performance analysis that can be undertaken in complex distributed systems. To address this problem, we present an XML-based protocol for transmitting performance events in distributed systems and evaluate the performance of this protocol.

Evaluation of generic types of drilling fluid using a risk-based analytic hierarchy process.

PubMed

Sadiq, Rehan; Husain, Tahir; Veitch, Brian; Bose, Neil

2003-12-01

The composition of drilling muds is based on a mixture of clays and additives in a base fluid. There are three generic categories of base fluid--water, oil, and synthetic. Water-based fluids (WBFs) are relatively environmentally benign, but drilling performance is better with oil-based fluids (OBFs). The oil and gas industry developed synthetic-based fluids (SBFs), such as vegetable esters, olefins, ethers, and others, which provide drilling performance comparable to OBFs, but with lower environmental and occupational health effects. The primary objective of this paper is to present a methodology to guide decision-making in the selection and evaluation of three generic types of drilling fluids using a risk-based analytic hierarchy process (AHP). In this paper a comparison of drilling fluids is made considering various activities involved in the life cycle of drilling fluids. This paper evaluates OBFs, WBFs, and SBFs based on four major impacts--operations, resources, economics, and liabilities. Four major activities--drilling, discharging offshore, loading and transporting, and disposing onshore--cause the operational impacts. Each activity involves risks related to occupational injuries (safety), general public health, environmental impact, and energy use. A multicriteria analysis strategy was used for the selection and evaluation of drilling fluids using a risk-based AHP. A four-level hierarchical structure is developed to determine the final relative scores, and the SBFs are found to be the best option.

A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries.

PubMed

Jiang, Min; Chen, Yukun; Liu, Mei; Rosenbloom, S Trent; Mani, Subramani; Denny, Joshua C; Xu, Hua

2011-01-01

The authors' goal was to develop and evaluate machine-learning-based approaches to extracting clinical entities-including medical problems, tests, and treatments, as well as their asserted status-from hospital discharge summaries written using natural language. This project was part of the 2010 Center of Informatics for Integrating Biology and the Bedside/Veterans Affairs (VA) natural-language-processing challenge. The authors implemented a machine-learning-based named entity recognition system for clinical text and systematically evaluated the contributions of different types of features and ML algorithms, using a training corpus of 349 annotated notes. Based on the results from training data, the authors developed a novel hybrid clinical entity extraction system, which integrated heuristic rule-based modules with the ML-base named entity recognition module. The authors applied the hybrid system to the concept extraction and assertion classification tasks in the challenge and evaluated its performance using a test data set with 477 annotated notes. Standard measures including precision, recall, and F-measure were calculated using the evaluation script provided by the Center of Informatics for Integrating Biology and the Bedside/VA challenge organizers. The overall performance for all three types of clinical entities and all six types of assertions across 477 annotated notes were considered as the primary metric in the challenge. Systematic evaluation on the training set showed that Conditional Random Fields outperformed Support Vector Machines, and semantic information from existing natural-language-processing systems largely improved performance, although contributions from different types of features varied. The authors' hybrid entity extraction system achieved a maximum overall F-score of 0.8391 for concept extraction (ranked second) and 0.9313 for assertion classification (ranked fourth, but not statistically different than the first three systems) on the test data set in the challenge.

The Sodium Exposure Test Cell to determine operating parameters for AMTEC electrochemical cells

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ryan, M.A.; Williams, R.M.; Lara, L.

1998-07-01

The Sodium Exposure Test Cell (SETC) is a non-power producing cell which has been developed to evaluate and test components of the electrochemical cell in an Alkali Metal Thermal to Electric Converter. Performance and time dependence of performance of the electrode and the electrolyte in AMTEC cells can be tested in an SETC, and performance parameters which correlate with those taken from AMTEC operation can be calculated from data taken in an SETC. The components of the AMTEC electrochemical cell which are evaluated in an SETC are the electrode, {beta}{double{underscore}prime}-alumina solid electrolyte (BASE), the current collection network, and the containment.more » The components are held in low pressure sodium vapor at a temperature which reflects their operating conditions in an AMTEC device, and operating parameters determined. Electrodes and BASE are evaluated by measuring current-voltage (IV) characteristics and using Electrochemical Impedance Spectroscopy (EIS). Using these techniques, electrode performance parameters such as the exchange current (B), the morphology factor (G), and contact resistance between electrode and current collection network can be determined. The ionic conductivity (s) of BASE can also be determined. IV curves and EIS measurements are made at intervals over periods of several hundreds of hours in order to evaluate degradation of AMTEC electrochemical cell components. Electrode and BASE are analyzed after an SETC experiment using Scanning Electron Microscopy, Electron Dispersive Spectroscopy, and X-Ray Diffraction. These techniques allow evaluation of interaction of materials and changes in the composition and structure of materials. The purpose of these experiments is determination of the changes of operating parameters as a function of time in order to predict the operating lifetime of AMTEC cells.« less

Training evaluation final report

NASA Technical Reports Server (NTRS)

Sepulveda, Jose A.

1992-01-01

In the area of management training, 'evaluation' refers both to the specific evaluation instrument used to determine whether a training effort was considered effective, and to the procedures followed to evaluate specific training requests. This report recommends to evaluate new training requests in the same way new procurement or new projects are evaluated. This includes examining training requests from the perspective of KSC goals and objectives, and determining expected ROI of proposed training program (does training result in improved productivity, through savings of time, improved outputs, and/or personnel reduction?). To determine whether a specific training course is effective, a statement of what constitutes 'good performance' is required. The user (NOT the Training Branch) must define what is 'required level of performance'. This 'model' will be the basis for the design and development of an objective, performance-based, training evaluation instrument.

Evaluation of anti-sticking layers performances for 200mm wafer scale Smart NILTM process through surface and defectivity characterizations

NASA Astrophysics Data System (ADS)

Delachat, F.; Phillipe, J.-C.; Larrey, V.; Fournel, F.; Bos, S.; Teyssèdre, H.; Chevalier, Xavier; Nicolet, Célia; Navarro, Christophe; Cayrefourcq, Ian

2018-03-01

In this work, an evaluation of various ASL processes for 200 mm wafer scale in the HERCULES® NIL equipment platform available at the CEA-Leti through the INSPIRE program is reported. The surface and adherence energies were correlated to the AFM and defectivity results in order to select the most promising ASL process for high resolution etch mask applications. The ASL performances of the selected process were evaluated by multiple working stamp fabrication using unpatterned and patterned masters though defectivity monitoring on optical based-inspection tools. Optical and SEM defect reviews were systematically performed. Multiple working stamps fabrication without degradation of the master defectivity was witnessed. This evaluation enabled to benchmark several ASL solutions based on the grafted technology develop by ARKEMA in order to reduce and optimize the soft stamp defectivity prior to its replication and therefore considerably reduce the final imprint defectivity for the Smart NIL process.

Performance study of a data flow architecture

NASA Technical Reports Server (NTRS)

Adams, George

1985-01-01

Teams of scientists studied data flow concepts, static data flow machine architecture, and the VAL language. Each team mapped its application onto the machine and coded it in VAL. The principal findings of the study were: (1) Five of the seven applications used the full power of the target machine. The galactic simulation and multigrid fluid flow teams found that a significantly smaller version of the machine (16 processing elements) would suffice. (2) A number of machine design parameters including processing element (PE) function unit numbers, array memory size and bandwidth, and routing network capability were found to be crucial for optimal machine performance. (3) The study participants readily acquired VAL programming skills. (4) Participants learned that application-based performance evaluation is a sound method of evaluating new computer architectures, even those that are not fully specified. During the course of the study, participants developed models for using computers to solve numerical problems and for evaluating new architectures. These models form the bases for future evaluation studies.

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; van Ooijen, Peter M A

2016-01-01

To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study. All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client. The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total. Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Performance evaluation of nonhomogeneous hospitals: the case of Hong Kong hospitals.

PubMed

Li, Yongjun; Lei, Xiyang; Morton, Alec

2018-02-14

Throughout the world, hospitals are under increasing pressure to become more efficient. Efficiency analysis tools can play a role in giving policymakers insight into which units are less efficient and why. Many researchers have studied efficiencies of hospitals using data envelopment analysis (DEA) as an efficiency analysis tool. However, in the existing literature on DEA-based performance evaluation, a standard assumption of the constant returns to scale (CRS) or the variable returns to scale (VRS) DEA models is that decision-making units (DMUs) use a similar mix of inputs to produce a similar set of outputs. In fact, hospitals with different primary goals supply different services and provide different outputs. That is, hospitals are nonhomogeneous and the standard assumption of the DEA model is not applicable to the performance evaluation of nonhomogeneous hospitals. This paper considers the nonhomogeneity among hospitals in the performance evaluation and takes hospitals in Hong Kong as a case study. An extension of Cook et al. (2013) [1] based on the VRS assumption is developed to evaluated nonhomogeneous hospitals' efficiencies since inputs of hospitals vary greatly. Following the philosophy of Cook et al. (2013) [1], hospitals are divided into homogeneous groups and the product process of each hospital is divided into subunits. The performance of hospitals is measured on the basis of subunits. The proposed approach can be applied to measure the performance of other nonhomogeneous entities that exhibit variable return to scale.

Federal Motor Carrier Safety Administration’s Advanced System Testing Utilizing a Data Acquisition System on the Highways (FAST DASH) Safety Technology Evaluation Project #2: Driver Monitoring Final Report.

DOT National Transportation Integrated Search

2016-12-01

An independent evaluation of a non-video-based onboard monitoring system (OBMS) was conducted. The objective was to determine if the OBMS system performed reliably, improved driving safety and performance, and improved fuel efficiency in a commercial...

Development and Performance Evaluation of Optical Sensors for High Temperature Engine Applications

NASA Technical Reports Server (NTRS)

Adamovsky, G.; Varga, D.; Floyd, B.

2011-01-01

This paper discusses fiber optic sensors designed and constructed to withstand extreme temperatures of aircraft engine. The paper describes development and performance evaluation of fiber optic Bragg grating based sensors. It also describes the design and presents test results of packaged sensors subjected to temperatures up to 1000 C for prolonged periods of time.

Evaluation of the Teacher Incentive Fund: Implementation and Impacts of Pay-for-Performance after Two Years

ERIC Educational Resources Information Center

Chiang, Hanley; Wellington, Alison; Hallgren, Kristin; Speroni, Cecilia; Herrmann, Mariesa; Glazerman, Steven; Constantine, Jill

2016-01-01

Recent efforts to attract and retain effective educators and to improve teaching practices have focused on reforming evaluation and compensation systems for teachers and principals. In 2006, Congress established the Teacher Incentive Fund (TIF), which provides grants to support performance-based compensation systems for teachers and principals in…

Evaluation of formulated feed for juvenile lake sturgeon (Acipenser fulvescens) based on growth performance and nutrient retention

USDA-ARS?s Scientific Manuscript database

This study evaluated the potential of giving formulated feed to juvenile lake sturgeon (Acipenser fulvescens) and determined the optimal feeding rate of a soft-moist feed on the growth performance and whole-body composition of this fish. Six feeding rates (% body weight per day: % BW/d) of a soft-mo...

Computer-Assisted Performance Evaluation for Navy Anti-Air Warfare Training: Concepts, Methods, and Constraints.

ERIC Educational Resources Information Center

Chesler, David J.

An improved general methodological approach for the development of computer-assisted evaluation of trainee performance in the computer-based simulation environment is formulated in this report. The report focuses on the Tactical Advanced Combat Direction and Electronic Warfare system (TACDEW) at the Fleet Anti-Air Warfare Training Center at San…

Federal Motor Carrier Safety Administration’s advanced system testing utilizing a data acquisition system on the highways (FAST DASH) safety technology evaluation project #2 : driver monitoring, final report.

DOT National Transportation Integrated Search

2016-11-01

An independent evaluation of a non-video-based onboard monitoring system (OBMS) was conducted. The objective was to determine if the OBMS system performed reliably, improved driving safety and performance, and improved fuel efficiency in a commercial...

Evaluation of the Teacher Incentive Fund: Implementation and Early Impacts of Pay-for-Performance after One Year

ERIC Educational Resources Information Center

Max, Jeffrey; Constantine, Jill; Wellington, Alison; Hallgren, Kristin; Glazerman, Steven; Chiang, Hanley; Speroni, Cecilia

2015-01-01

Recent efforts to attract and retain effective educators and to improve teaching practices have focused on reforming evaluation and compensation systems for teachers and principals. In 2006, Congress established the Teacher Incentive Fund (TIF), which provides grants to support performance-based compensation systems for teachers and principals in…

Impacts of Performance Pay under the Teacher Incentive Fund: Study Design Report

ERIC Educational Resources Information Center

Glazerman, Steven; Chiang, Hanley; Wellington, Alison; Constantine, Jill; Player, Dan

2011-01-01

The body of research on the design, implementation, and effects of performance-based compensation systems has influenced the design and evaluation of the 2010 Teacher Incentive Fund (TIF) grants. In the sections presented here, the authors describe the key components of 2010 TIF grants and the conceptual framework for the evaluation. The remainder…

Enforcement of entailment constraints in distributed service-based business processes.

PubMed

Hummer, Waldemar; Gaubatz, Patrick; Strembeck, Mark; Zdun, Uwe; Dustdar, Schahram

2013-11-01

A distributed business process is executed in a distributed computing environment. The service-oriented architecture (SOA) paradigm is a popular option for the integration of software services and execution of distributed business processes. Entailment constraints, such as mutual exclusion and binding constraints, are important means to control process execution. Mutually exclusive tasks result from the division of powerful rights and responsibilities to prevent fraud and abuse. In contrast, binding constraints define that a subject who performed one task must also perform the corresponding bound task(s). We aim to provide a model-driven approach for the specification and enforcement of task-based entailment constraints in distributed service-based business processes. Based on a generic metamodel, we define a domain-specific language (DSL) that maps the different modeling-level artifacts to the implementation-level. The DSL integrates elements from role-based access control (RBAC) with the tasks that are performed in a business process. Process definitions are annotated using the DSL, and our software platform uses automated model transformations to produce executable WS-BPEL specifications which enforce the entailment constraints. We evaluate the impact of constraint enforcement on runtime performance for five selected service-based processes from existing literature. Our evaluation demonstrates that the approach correctly enforces task-based entailment constraints at runtime. The performance experiments illustrate that the runtime enforcement operates with an overhead that scales well up to the order of several ten thousand logged invocations. Using our DSL annotations, the user-defined process definition remains declarative and clean of security enforcement code. Our approach decouples the concerns of (non-technical) domain experts from technical details of entailment constraint enforcement. The developed framework integrates seamlessly with WS-BPEL and the Web services technology stack. Our prototype implementation shows the feasibility of the approach, and the evaluation points to future work and further performance optimizations.

Benchmark data sets for structure-based computational target prediction.

PubMed

Schomburg, Karen T; Rarey, Matthias

2014-08-25

Structure-based computational target prediction methods identify potential targets for a bioactive compound. Methods based on protein-ligand docking so far face many challenges, where the greatest probably is the ranking of true targets in a large data set of protein structures. Currently, no standard data sets for evaluation exist, rendering comparison and demonstration of improvements of methods cumbersome. Therefore, we propose two data sets and evaluation strategies for a meaningful evaluation of new target prediction methods, i.e., a small data set consisting of three target classes for detailed proof-of-concept and selectivity studies and a large data set consisting of 7992 protein structures and 72 drug-like ligands allowing statistical evaluation with performance metrics on a drug-like chemical space. Both data sets are built from openly available resources, and any information needed to perform the described experiments is reported. We describe the composition of the data sets, the setup of screening experiments, and the evaluation strategy. Performance metrics capable to measure the early recognition of enrichments like AUC, BEDROC, and NSLR are proposed. We apply a sequence-based target prediction method to the large data set to analyze its content of nontrivial evaluation cases. The proposed data sets are used for method evaluation of our new inverse screening method iRAISE. The small data set reveals the method's capability and limitations to selectively distinguish between rather similar protein structures. The large data set simulates real target identification scenarios. iRAISE achieves in 55% excellent or good enrichment a median AUC of 0.67 and RMSDs below 2.0 Å for 74% and was able to predict the first true target in 59 out of 72 cases in the top 2% of the protein data set of about 8000 structures.

Performance analysis of multiple Indoor Positioning Systems in a healthcare environment.

PubMed

Van Haute, Tom; De Poorter, Eli; Crombez, Pieter; Lemic, Filip; Handziski, Vlado; Wirström, Niklas; Wolisz, Adam; Voigt, Thiemo; Moerman, Ingrid

2016-02-03

The combination of an aging population and nursing staff shortages implies the need for more advanced systems in the healthcare industry. Many key enablers for the optimization of healthcare systems require provisioning of location awareness for patients (e.g. with dementia), nurses, doctors, assets, etc. Therefore, many Indoor Positioning Systems (IPSs) will be indispensable in healthcare systems. However, although many IPSs have been proposed in literature, most of these have been evaluated in non-representative environments such as office buildings rather than in a hospital. To remedy this, the paper evaluates the performance of existing IPSs in an operational modern healthcare environment: the "Sint-Jozefs kliniek Izegem" hospital in Belgium. The evaluation (data-collecting and data-processing) is executed using a standardized methodology and evaluates the point accuracy, room accuracy and latency of multiple IPSs. To evaluate the solutions, the position of a stationary device was requested at 73 evaluation locations. By using the same evaluation locations for all IPSs the performance of all systems could objectively be compared. Several trends can be identified such as the fact that Wi-Fi based fingerprinting solutions have the best accuracy result (point accuracy of 1.21 m and room accuracy of 98%) however it requires calibration before use and needs 5.43 s to estimate the location. On the other hand, proximity based solutions (based on sensor nodes) are significantly cheaper to install, do not require calibration and still obtain acceptable room accuracy results. As a conclusion of this paper, Wi-Fi based solutions have the most potential for an indoor positioning service in case when accuracy is the most important metric. Applying the fingerprinting approach with an anchor installed in every two rooms is the preferred solution for a hospital environment.

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the ‘Black Box’ of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda

PubMed Central

Holvoet, Nathalie; Criel, Bart

2017-01-01

Increased attention on “complexity” in health systems evaluation has resulted in many different methodological responses. Theory-driven evaluations and systems thinking are two such responses that aim for better understanding of the mechanisms underlying given outcomes. Here, we studied the implementation of a performance-based financing intervention by the Belgian Technical Cooperation in Western Uganda to illustrate a methodological strategy of combining these two approaches. We utilized a systems dynamics tool called causal loop diagramming (CLD) to generate hypotheses feeding into a theory-driven evaluation. Semi-structured interviews were conducted with 30 health workers from two districts (Kasese and Kyenjojo) and with 16 key informants. After CLD, we identified three relevant hypotheses: “success to the successful”, “growth and underinvestment”, and “supervision conundrum”. The first hypothesis leads to increasing improvements in performance, as better performance leads to more incentives, which in turn leads to better performance. The latter two hypotheses point to potential bottlenecks. Thus, the proposed methodological strategy was a useful tool for identifying hypotheses that can inform a theory-driven evaluation. The hypotheses are represented in a comprehensible way while highlighting the underlying assumptions, and are more easily falsifiable than hypotheses identified without using CLD. PMID:28869518

Evaluating Pavement Design Features: Five Year Performance Evaluation of FA 401 and FA 409

DOT National Transportation Integrated Search

1993-02-01

In the summer of 1986, the Illinois Department of Transportation began the construction of four demonstration projects which focused on evaluating proposed mechanistically-based asphalt concrete (AC) and Portland cement concrete (PCC) pavement design...

Accelerated testing for studying pavement design and performance (FY 2001) : evaluation of the performance of permeable and semi-permeable unbound granular bases under Portland Cement Concrete Pavement (PCCP) slabs and alternate load transfer devices for

DOT National Transportation Integrated Search

2003-11-01

The objectives of this research are to determine the effect of unbound drainable base types on the performance of PCCP and the efficiency of fiber-reinforced polymer (FRP) dowels, compared to epoxy coated steel dowels, when retrofitted to re-establis...

Performance evaluation of existing building structure with pushover analysis

NASA Astrophysics Data System (ADS)

Handana, MAP; Karolina, R.; Steven

2018-02-01

In the management of the infrastructure of the building, during the period of buildings common building damage as a result of several reasons, earthquakes are common. The building is planned to work for a certain service life. But during the certain service life, the building vulnerable to damage due to various things. Any damage to cultivate can be detected as early as possible, because the damage could spread, triggering and exacerbating the latest. The newest concept to earthquake engineering is Performance Based Earthquake Engineering (PBEE). PBEE divided into two, namely Performance Based Seismic Design (PBSD) and Performance Based Seismic Evaluation (PBSE). Evaluation on PBSE one of which is the analysis of nonlinear pushover. Pushover analysis is a static analysis of nonlinear where the influence of the earthquake plan on building structure is considered as burdens static catch at the center of mass of each floor, which it was increased gradually until the loading causing the melting (plastic hinge) first within the building structure, then the load increases further changes the shapes of post-elastic large it reached the condition of elastic. Then followed melting (plastic hinge) in the location of the other structured.

Students’ Attitudes, Academic Performance and Preferences for Content Delivery in a Very Large Self-Care Course Redesign

PubMed Central

Mistry, Amee; Schnee, David; Tataronis, Gary; Taglieri, Catherine; Zaiken, Kathy; Patel, Dhiren; Nigro, Stefanie; Jacobson, Susan; Goldman, Jennifer

2016-01-01

Objective. To evaluate students’ performance/attitudes toward a flipped team-based learning (TBL) format in a “very large” self-care course based on student content delivery preference. Design. Third-year students enrolled in the course were surveyed regarding elements of redesign and homework completion. Additionally, their performance and incoming grade point average were evaluated. Assessment. A survey was completed by 286 of 305 students. Nineteen percent of respondents preferred traditional content delivery, whereas 30% preferred flipped TBL, 48% preferred a mixed format, and 3% had no preference. The grades achieved in the course were: A (49%), B (48%), C (3%) and D (0%). The majority completed “all” or “most” of the homework, appreciated attributes of course redesign, felt home preparation and in-class activities engaged them, and reported improved communication/evaluation skills. Content delivery preference significantly affected attitudes. Conclusion. Students positively received a flipped team-based learning classroom format, especially those who preferred flipped TBL or mixed content delivery. A minority with preference for traditional teaching style did not enjoy the new format; however, their academic performance did not differ significantly from those who did. PMID:27293234

Experimental performance evaluation of software defined networking (SDN) based data communication networks for large scale flexi-grid optical networks.

PubMed

Zhao, Yongli; He, Ruiying; Chen, Haoran; Zhang, Jie; Ji, Yuefeng; Zheng, Haomian; Lin, Yi; Wang, Xinbo

2014-04-21

Software defined networking (SDN) has become the focus in the current information and communication technology area because of its flexibility and programmability. It has been introduced into various network scenarios, such as datacenter networks, carrier networks, and wireless networks. Optical transport network is also regarded as an important application scenario for SDN, which is adopted as the enabling technology of data communication networks (DCN) instead of general multi-protocol label switching (GMPLS). However, the practical performance of SDN based DCN for large scale optical networks, which is very important for the technology selection in the future optical network deployment, has not been evaluated up to now. In this paper we have built a large scale flexi-grid optical network testbed with 1000 virtual optical transport nodes to evaluate the performance of SDN based DCN, including network scalability, DCN bandwidth limitation, and restoration time. A series of network performance parameters including blocking probability, bandwidth utilization, average lightpath provisioning time, and failure restoration time have been demonstrated under various network environments, such as with different traffic loads and different DCN bandwidths. The demonstration in this work can be taken as a proof for the future network deployment.

Immunity-based detection, identification, and evaluation of aircraft sub-system failures

NASA Astrophysics Data System (ADS)

Moncayo, Hever Y.

This thesis describes the design, development, and flight-simulation testing of an integrated Artificial Immune System (AIS) for detection, identification, and evaluation of a wide variety of sensor, actuator, propulsion, and structural failures/damages including the prediction of the achievable states and other limitations on performance and handling qualities. The AIS scheme achieves high detection rate and low number of false alarms for all the failure categories considered. Data collected using a motion-based flight simulator are used to define the self for an extended sub-region of the flight envelope. The NASA IFCS F-15 research aircraft model is used and represents a supersonic fighter which include model following adaptive control laws based on non-linear dynamic inversion and artificial neural network augmentation. The flight simulation tests are designed to analyze and demonstrate the performance of the immunity-based aircraft failure detection, identification and evaluation (FDIE) scheme. A general robustness analysis is also presented by determining the achievable limits for a desired performance in the presence of atmospheric perturbations. For the purpose of this work, the integrated AIS scheme is implemented based on three main components. The first component performs the detection when one of the considered failures is present in the system. The second component consists in the identification of the failure category and the classification according to the failed element. During the third phase a general evaluation of the failure is performed with the estimation of the magnitude/severity of the failure and the prediction of its effect on reducing the flight envelope of the aircraft system. Solutions and alternatives to specific design issues of the AIS scheme, such as data clustering and empty space optimization, data fusion and duplication removal, definition of features, dimensionality reduction, and selection of cluster/detector shape are also analyzed in this thesis. They showed to have an important effect on detection performance and are a critical aspect when designing the configuration of the AIS. The results presented in this thesis show that the AIS paradigm addresses directly the complexity and multi-dimensionality associated with a damaged aircraft dynamic response and provides the tools necessary for a comprehensive/integrated solution to the FDIE problem. Excellent detection, identification, and evaluation performance has been recorded for all types of failures considered. The implementation of the proposed AIS-based scheme can potentially have a significant impact on the safety of aircraft operation. The output information obtained from the scheme will be useful to increase pilot situational awareness and determine automated compensation.

Guidelines for Evaluation in California Community Colleges.

ERIC Educational Resources Information Center

Los Angeles Pierce Coll., Woodland Hills, CA.

This report was prepared in part as a response to a State of California legislative mandate calling for evaluation in community colleges. The preparation of evaluative guidelines was the primary goal and that effort was based on four action steps: (1) ascertaining faculty and administrative attitudes locally towards evaluation; (2) performing a…

A Database Evaluation Based on Information Needs of Academic Social Scientists.

ERIC Educational Resources Information Center

Buterbaugh, Nancy Toth

This study evaluates two databases, "Historical Abstracts" and REESWeb, to determine their effectiveness in supporting academic social science research. While many performance evaluations gather quantitative data from isolated query and response transactions, this study is a qualitative evaluation of the databases in the context of…

Broadening the Educational Evaluation Lens with Communicative Evaluation

ERIC Educational Resources Information Center

Brooks-LaRaviere, Margaret; Ryan, Katherine; Miron, Luis; Samuels, Maurice

2009-01-01

Outcomes-based accountability in the form of test scores and performance indicators are a primary lever for improving student achievement in the current educational landscape. The article presents communicative evaluation as a complementary evaluation approach that may be used along with the primary methods of school accountability to provide a…

Teacher Evaluation Policy and Conflicting Theories of Motivation

ERIC Educational Resources Information Center

Firestone, William A.

2014-01-01

Current interest in teacher evaluation focuses disproportionately on measurement issues and performance-based pay without an overarching theory of how evaluation works. To develop such a theory, I contrast two motivation theories often used to guide thinking about teacher evaluation. External motivation theory relies on economics and extrinsic…

Gum-compliant uncertainty propagations for Pu and U concentration measurements using the 1st-prototype XOS/LANL hiRX instrument; an SRNL H-Canyon Test Bed performance evaluation project

DOE Office of Scientific and Technical Information (OSTI.GOV)

Holland, Michael K.; O'Rourke, Patrick E.

An SRNL H-Canyon Test Bed performance evaluation project was completed jointly by SRNL and LANL on a prototype monochromatic energy dispersive x-ray fluorescence instrument, the hiRX. A series of uncertainty propagations were generated based upon plutonium and uranium measurements performed using the alpha-prototype hiRX instrument. Data reduction and uncertainty modeling provided in this report were performed by the SRNL authors. Observations and lessons learned from this evaluation were also used to predict the expected uncertainties that should be achievable at multiple plutonium and uranium concentration levels provided instrument hardware and software upgrades being recommended by LANL and SRNL are performed.

Detecting epileptic seizure with different feature extracting strategies using robust machine learning classification techniques by applying advance parameter optimization approach.

PubMed

Hussain, Lal

2018-06-01

Epilepsy is a neurological disorder produced due to abnormal excitability of neurons in the brain. The research reveals that brain activity is monitored through electroencephalogram (EEG) of patients suffered from seizure to detect the epileptic seizure. The performance of EEG detection based epilepsy require feature extracting strategies. In this research, we have extracted varying features extracting strategies based on time and frequency domain characteristics, nonlinear, wavelet based entropy and few statistical features. A deeper study was undertaken using novel machine learning classifiers by considering multiple factors. The support vector machine kernels are evaluated based on multiclass kernel and box constraint level. Likewise, for K-nearest neighbors (KNN), we computed the different distance metrics, Neighbor weights and Neighbors. Similarly, the decision trees we tuned the paramours based on maximum splits and split criteria and ensemble classifiers are evaluated based on different ensemble methods and learning rate. For training/testing tenfold Cross validation was employed and performance was evaluated in form of TPR, NPR, PPV, accuracy and AUC. In this research, a deeper analysis approach was performed using diverse features extracting strategies using robust machine learning classifiers with more advanced optimal options. Support Vector Machine linear kernel and KNN with City block distance metric give the overall highest accuracy of 99.5% which was higher than using the default parameters for these classifiers. Moreover, highest separation (AUC = 0.9991, 0.9990) were obtained at different kernel scales using SVM. Additionally, the K-nearest neighbors with inverse squared distance weight give higher performance at different Neighbors. Moreover, to distinguish the postictal heart rate oscillations from epileptic ictal subjects, and highest performance of 100% was obtained using different machine learning classifiers.

A classification system for characterization of physical and non-physical work factors.

PubMed

Genaidy, A; Karwowski, W; Succop, P; Kwon, Y G; Alhemoud, A; Goyal, D

2000-01-01

A comprehensive evaluation of work-related performance factors is a prerequisite to developing integrated and long-term solutions to workplace performance improvement. This paper describes a work-factor classification system that categorizes the entire domain of workplace factors impacting performance. A questionnaire-based instrument was developed to implement this classification system in industry. Fifty jobs were evaluated in 4 different service and manufacturing companies using the proposed questionnaire-based instrument. The reliability coefficients obtained from the analyzed jobs were considered good (0.589 to 0.862). In general, the physical work factors resulted in higher reliability coefficients (0.847 to 0.862) than non-physical work factors (0.589 to 0.768).

Simulator evaluation of manually flown curved instrument approaches. M.S. Thesis

NASA Technical Reports Server (NTRS)

Sager, D.

1973-01-01

Pilot performance in flying horizontally curved instrument approaches was analyzed by having nine test subjects fly curved approaches in a fixed-base simulator. Approaches were flown without an autopilot and without a flight director. Evaluations were based on deviation measurements made at a number of points along the curved approach path and on subject questionnaires. Results indicate that pilots can fly curved approaches, though less accurately than straight-in approaches; that a moderate wind does not effect curve flying performance; and that there is no performance difference between 60 deg. and 90 deg. turns. A tradeoff of curve path parameters and a paper analysis of wind compensation were also made.

An efficient impedance method for induced field evaluation based on a stabilized Bi-conjugate gradient algorithm.

PubMed

Wang, Hua; Liu, Feng; Xia, Ling; Crozier, Stuart

2008-11-21

This paper presents a stabilized Bi-conjugate gradient algorithm (BiCGstab) that can significantly improve the performance of the impedance method, which has been widely applied to model low-frequency field induction phenomena in voxel phantoms. The improved impedance method offers remarkable computational advantages in terms of convergence performance and memory consumption over the conventional, successive over-relaxation (SOR)-based algorithm. The scheme has been validated against other numerical/analytical solutions on a lossy, multilayered sphere phantom excited by an ideal coil loop. To demonstrate the computational performance and application capability of the developed algorithm, the induced fields inside a human phantom due to a low-frequency hyperthermia device is evaluated. The simulation results show the numerical accuracy and superior performance of the method.

Evaluation of solar thermal power plants using economic and performance simulations

NASA Technical Reports Server (NTRS)

El-Gabawali, N.

1980-01-01

An energy cost analysis is presented for central receiver power plants with thermal storage and point focusing power plants with electrical storage. The present approach is based on optimizing the size of the plant to give the minimum energy cost (in mills/kWe hr) of an annual plant energy production. The optimization is done by considering the trade-off between the collector field size and the storage capacity for a given engine size. The energy cost is determined by the plant cost and performance. The performance is estimated by simulating the behavior of the plant under typical weather conditions. Plant capital and operational costs are estimated based on the size and performance of different components. This methodology is translated into computer programs for automatic and consistent evaluation.

Workload Characterization of CFD Applications Using Partial Differential Equation Solvers

NASA Technical Reports Server (NTRS)

Waheed, Abdul; Yan, Jerry; Saini, Subhash (Technical Monitor)

1998-01-01

Workload characterization is used for modeling and evaluating of computing systems at different levels of detail. We present workload characterization for a class of Computational Fluid Dynamics (CFD) applications that solve Partial Differential Equations (PDEs). This workload characterization focuses on three high performance computing platforms: SGI Origin2000, EBM SP-2, a cluster of Intel Pentium Pro bases PCs. We execute extensive measurement-based experiments on these platforms to gather statistics of system resource usage, which results in workload characterization. Our workload characterization approach yields a coarse-grain resource utilization behavior that is being applied for performance modeling and evaluation of distributed high performance metacomputing systems. In addition, this study enhances our understanding of interactions between PDE solver workloads and high performance computing platforms and is useful for tuning these applications.

Estimation for aerial detection effectiveness with cooperation efficiency factors of early-warning aircraft in early-warning detection SoS under BSC framework

NASA Astrophysics Data System (ADS)

Zhu, Feng; Hu, Xiaofeng; He, Xiaoyuan; Guo, Rui; Li, Kaiming; Yang, Lu

2017-11-01

In the military field, the performance evaluation of early-warning aircraft deployment or construction is always an important problem needing to be explored. As an effective approach of enterprise management and performance evaluation, Balanced Score Card (BSC) attracts more and more attentions and is studied more and more widely all over the world. It can also bring feasible ideas and technical approaches for studying the issue of the performance evaluation of the deployment or construction of early-warning aircraft which is the important component in early-warning detection system of systems (SoS). Therefore, the deep explored researches are carried out based on the previously research works. On the basis of the characteristics of space exploration and aerial detection effectiveness of early-warning detection SoS and the cardinal principle of BSC are analyzed simply, and the performance evaluation framework of the deployment or construction of early-warning aircraft is given, under this framework, aimed at the evaluation issue of aerial detection effectiveness of early-warning detection SoS with the cooperation efficiency factors of the early-warning aircraft and other land based radars, the evaluation indexes are further designed and the relative evaluation model is further established, especially the evaluation radar chart being also drawn to obtain the evaluation results from a direct sight angle. Finally, some practical computer simulations are launched to prove the validity and feasibility of the research thinking and technologic approaches which are proposed in the paper.

Develop a new testing and evaluation protocol to assess flexbase performance using strength of soil binder.

DOT National Transportation Integrated Search

2008-01-01

This research involved a detailed laboratory study of a new test method for evaluating road base materials based on : the strength of the soil binder. In this test method, small test specimens (5.0in length and 0.75in square cross : section) of binde...

Interactive Graphics Simulator: Design, Development, and Effectiveness/Cost Evaluation. Final Report.

ERIC Educational Resources Information Center

Pieper, William J.; And Others

This study was initiated to design, develop, implement, and evaluate a videodisc-based simulator system, the Interactive Graphics Simulator (IGS) for 6883 Converter Flight Control Test Station training at Lowry Air Force Base, Colorado. The simulator provided a means for performing task analysis online, developing simulations from the task…

Marking Strategies in Metacognition-Evaluated Computer-Based Testing

ERIC Educational Resources Information Center

Chen, Li-Ju; Ho, Rong-Guey; Yen, Yung-Chin

2010-01-01

This study aimed to explore the effects of marking and metacognition-evaluated feedback (MEF) in computer-based testing (CBT) on student performance and review behavior. Marking is a strategy, in which students place a question mark next to a test item to indicate an uncertain answer. The MEF provided students with feedback on test results…

On Information Retrieval (IR) Systems: Revisiting Their Development, Evaluation Methodologies, and Assumptions (SIGs LAN, ED).

ERIC Educational Resources Information Center

Stirling, Keith

2000-01-01

Describes a session on information retrieval systems that planned to discuss relevance measures with Web-based information retrieval; retrieval system performance and evaluation; probabilistic independence of index terms; vector-based models; metalanguages and digital objects; how users assess the reliability, timeliness and bias of information;…

Evaluation of a sugar based edible adhesive utilizing a tensile strength tester

USDA-ARS?s Scientific Manuscript database

A new method to evaluate adhesives has been developed and utilized to formulate a recently patented adhesive based on sugar and citric acid. Factors affecting adhesive performance were uncovered, such as reduced strength due to improper heating time, and an optimal curing temperature of 60oC was ac...

Performance of human fecal anaerobe-associated PCR-based assays in a multi-laboratory method evaluation study

EPA Science Inventory

A number of PCR-based methods for detecting human fecal material in environmental waters have been developed over the past decade, but these methods have rarely received independent comparative testing. Here, we evaluated ten of these methods (BacH, BacHum-UCD, B. thetaiotaomic...

Development and Evaluation of Computerized Problem-based Learning Cases Emphasizing Basic Sciences Concepts.

ERIC Educational Resources Information Center

Abate, Marie A.; Meyer-Stout, Paula J.; Stamatakis, Mary K.; Gannett, Peter M.; Dunsworth, Teresa S.; Nardi, Anne H.

2000-01-01

Describes development and evaluation of eight computerized problem-based learning (PBL) cases in medicinal chemistry and pharmaceutics concepts. Case versions either incorporated concept maps emphasizing key ideas or did not. Student performance on quizzes did not differ between the different case versions and was similar to that of students who…

Evaluating Automatic Speech Recognition-Based Language Learning Systems: A Case Study

ERIC Educational Resources Information Center

van Doremalen, Joost; Boves, Lou; Colpaert, Jozef; Cucchiarini, Catia; Strik, Helmer

2016-01-01

The purpose of this research was to evaluate a prototype of an automatic speech recognition (ASR)-based language learning system that provides feedback on different aspects of speaking performance (pronunciation, morphology and syntax) to students of Dutch as a second language. We carried out usability reviews, expert reviews and user tests to…

Evaluation of the user experience of "astronaut training device": an immersive, vr-based, motion-training system

NASA Astrophysics Data System (ADS)

Yue, Kang; Wang, Danli; Yang, Xinpan; Hu, Haichen; Liu, Yuqing; Zhu, Xiuqing

2016-10-01

To date, as the different application fields, most VR-based training systems have been different. Therefore, we should take the characteristics of application field into consideration and adopt different evaluation methods when evaluate the user experience of these training systems. In this paper, we propose a method to evaluate the user experience of virtual astronauts training system. Also, we design an experiment based on the proposed method. The proposed method takes learning performance as one of the evaluation dimensions, also combines with other evaluation dimensions such as: presence, immersion, pleasure, satisfaction and fatigue to evaluation user experience of the System. We collect subjective and objective data, the subjective data are mainly from questionnaire designed based on the evaluation dimensions and user interview conducted before and after the experiment. While the objective data are consisted of Electrocardiogram (ECG), reaction time, numbers of reaction error and the video data recorded during the experiment. For the analysis of data, we calculate the integrated score of each evaluation dimension by using factor analysis. In order to improve the credibility of the assessment, we use the ECG signal and reaction test data before and after experiment to validate the changes of fatigue during the experiment, and the typical behavioral features extracted from the experiment video to explain the result of subjective questionnaire. Experimental results show that the System has a better user experience and learning performance, but slight visual fatigue exists after experiment.

Multimedia-based training on Internet platforms improves surgical performance: a randomized controlled trial.

PubMed

Pape-Koehler, Carolina; Immenroth, Marc; Sauerland, Stefan; Lefering, Rolf; Lindlohr, Cornelia; Toaspern, Jens; Heiss, Markus

2013-05-01

Surgical procedures are complex motion sequences that require a high level of preparation, training, and concentration. In recent years, Internet platforms providing surgical content have been established. Used as a surgical training method, the effect of multimedia-based training on practical surgical skills has not yet been evaluated. This study aimed to evaluate the effect of multimedia-based training on surgical performance. A 2 × 2 factorial, randomized controlled trial with a pre- and posttest design was used to test the effect of multimedia-based training in addition to or without practical training on 70 participants in four groups defined by the intervention used: multimedia-based training, practical training, and combination training (multimedia-based training + practical training) or no training (control group). The pre- and posttest consisted of a laparoscopic cholecystectomy in a Pelvi-Trainer and was video recorded, encoded, and saved on DVDs. These were evaluated by blinded raters using a modified objective structured assessment of technical skills (OSATS). The main evaluation criterion was the difference in OSATS score between the pre- and posttest (ΔOSATS) results in terms of a task-specific checklist (procedural steps scored as correct or incorrect). The groups were homogeneous in terms of demographic parameters, surgical experience, and pretest OSATS scores. The ΔOSATS results were highest in the multimedia-based training group (4.7 ± 3.3; p < 0.001). The practical training group achieved 2.5 ± 4.3 (p = 0.028), whereas the combination training group achieved 4.6 ± 3.5 (p < 0.001), and the control group achieved 0.8 ± 2.9 (p = 0.294). Multimedia-based training improved surgical performance significantly and thus could be considered a reasonable tool for inclusion in surgical curricula.

Evaluation about the performance of E-government based on interval-valued intuitionistic fuzzy set.

PubMed

Zhang, Shuai; Yu, Dejian; Wang, Yan; Zhang, Wenyu

2014-01-01

The evaluation is an important approach to promote the development of the E-Government. Since the rapid development of E-Government in the world, the E-Government performance evaluation has become a hot issue in the academia. In this paper, we develop a new evaluation method for the development of the E-Government based on the interval-valued intuitionistic fuzzy set which is a powerful technique in expressing the uncertainty of the real situation. First, we extend the geometric Heronian mean (GHM) operator to interval-valued intuitionistic fuzzy environment and proposed the interval-valued intuitionistic fuzzy GHM (IIFGHM) operator. Then, we investigate the relationships between the IIFGHM operator and some existing ones, such as generalized interval-valued intuitionistic fuzzy HM (GIIFHM) and interval-valued intuitionistic fuzzy weighted Bonferoni mean operator. Furthermore, we validate the effectiveness of the proposed method using a real case about the E-Government evaluation in Hangzhou City, China.

Kernel-based least squares policy iteration for reinforcement learning.

PubMed

Xu, Xin; Hu, Dewen; Lu, Xicheng

2007-07-01

In this paper, we present a kernel-based least squares policy iteration (KLSPI) algorithm for reinforcement learning (RL) in large or continuous state spaces, which can be used to realize adaptive feedback control of uncertain dynamic systems. By using KLSPI, near-optimal control policies can be obtained without much a priori knowledge on dynamic models of control plants. In KLSPI, Mercer kernels are used in the policy evaluation of a policy iteration process, where a new kernel-based least squares temporal-difference algorithm called KLSTD-Q is proposed for efficient policy evaluation. To keep the sparsity and improve the generalization ability of KLSTD-Q solutions, a kernel sparsification procedure based on approximate linear dependency (ALD) is performed. Compared to the previous works on approximate RL methods, KLSPI makes two progresses to eliminate the main difficulties of existing results. One is the better convergence and (near) optimality guarantee by using the KLSTD-Q algorithm for policy evaluation with high precision. The other is the automatic feature selection using the ALD-based kernel sparsification. Therefore, the KLSPI algorithm provides a general RL method with generalization performance and convergence guarantee for large-scale Markov decision problems (MDPs). Experimental results on a typical RL task for a stochastic chain problem demonstrate that KLSPI can consistently achieve better learning efficiency and policy quality than the previous least squares policy iteration (LSPI) algorithm. Furthermore, the KLSPI method was also evaluated on two nonlinear feedback control problems, including a ship heading control problem and the swing up control of a double-link underactuated pendulum called acrobot. Simulation results illustrate that the proposed method can optimize controller performance using little a priori information of uncertain dynamic systems. It is also demonstrated that KLSPI can be applied to online learning control by incorporating an initial controller to ensure online performance.

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017. Published by Elsevier B.V.

Fresh-cow handling practices and methods for identification of health disorders on 45 dairy farms in California.

PubMed

Espadamala, A; Pallarés, P; Lago, A; Silva-Del-Río, N

2016-11-01

The aim of the present study was to describe fresh-cow handling practices and techniques used during fresh cow evaluations to identify postpartum health disorders on 45 dairy farms in California ranging from 450 to 9,500 cows. Fresh cow practices were surveyed regarding (a) grouping and housing, (b) scheduling and work organization, (c) screening for health disorders, and (d) physical examination methods. Information was collected based on cow-side observations and responses from fresh cow evaluators. Cows were housed in the fresh cow pen for 3 to 14 (20%), 15 to 30 (49%), or >31 (31%) d in milk. Fresh cow evaluations were performed daily (78%), 6 times a week (11%), 2 to 5 times a week (9%), or were not routinely performed (2%). There was significant correlation between the duration of fresh cow evaluations and the number of cows housed in the fresh pen. Across all farms, the duration of evaluations ranged from 5 to 240 min, with an average of 16 s spent per cow. During fresh cow checks, evaluators always looked for abnormal vaginal discharge, retained fetal membranes, and down cows. Dairies evaluated appetite based on rumen fill (11%), reduction of feed in the feed bunk (20%), rumination sensors (2%), or a combination of these (29%). Milk yield was evaluated based on udder fill at fresh cow checks (40%), milk flow during milking (11%), milk yield records collected by milk meters (2%), or a combination of udder fill and milk meters (5%). Depressed attitude was evaluated on 64% of the dairies. Health-monitoring exams for early detection of metritis were implemented on 42% of the dairies based on rectal examination (13%), rectal temperature (22%), or both (7%). Dairies implementing health-monitoring exams took longer to perform fresh cow evaluations. Physical examination methods such as rectal examination, auscultation, rectal temperature evaluation, and cow-side ketosis tests were used on 76, 67, 38, and 9% of dairies, respectively. Across dairies, we found large variation in signs of health disorders screened and how those signs were evaluated. Fresh cows were primarily evaluated based on nonspecific and subjective observations during screening. Future research efforts should focus on developing and validating scoring systems to more objectively identify health disorders in postpartum cows. Copyright © 2016 American Dairy Science Association. Published by Elsevier Inc. All rights reserved.

Evaluation of a stereoscopic camera-based three-dimensional viewing workstation for ophthalmic surgery.

PubMed

Bhadri, Prashant R; Rowley, Adrian P; Khurana, Rahul N; Deboer, Charles M; Kerns, Ralph M; Chong, Lawrence P; Humayun, Mark S

2007-05-01

To evaluate the effectiveness of a prototype stereoscopic camera-based viewing system (Digital Microsurgical Workstation, three-dimensional (3D) Vision Systems, Irvine, California, USA) for anterior and posterior segment ophthalmic surgery. Institutional-based prospective study. Anterior and posterior segment surgeons performed designated standardized tasks on porcine eyes after training on prosthetic plastic eyes. Both anterior and posterior segment surgeons were able to complete tasks requiring minimal or moderate stereoscopic viewing. The results indicate that the system provides improved ergonomics. Improvements in key viewing performance areas would further enhance the value over a conventional operating microscope. The performance of the prototype system is not at par with the planned commercial system. With continued development of this technology, the three- dimensional system may be a novel viewing system in ophthalmic surgery with improved ergonomics with respect to traditional microscopic viewing.

POCO-MOEA: Using Evolutionary Algorithms to Solve the Controller Placement Problem

DTIC Science & Technology

2016-03-24

to gather data on POCO-MOEA performance to a series of iv model networks. The algorithm’s behavior is then evaluated and compared to ex- haustive... evaluation of a third heuristic based on a Multi 3 Objective Evolutionary Algorithm (MOEA). This heuristic is modeled after one of the most well known MOEAs...researchers to extend into more realistic evaluations of the performance characteristics of SDN controllers, such as the use of simulators or live

Experimental evaluations of wearable ECG monitor.

PubMed

Ha, Kiryong; Kim, Youngsung; Jung, Junyoung; Lee, Jeunwoo

2008-01-01

Healthcare industry is changing with ubiquitous computing environment and wearable ECG measurement is one of the most popular approaches in this healthcare industry. Reliability and performance of healthcare device is fundamental issue for widespread adoptions, and interdisciplinary perspectives of wearable ECG monitor make this more difficult. In this paper, we propose evaluation criteria considering characteristic of both ECG measurement and ubiquitous computing. With our wearable ECG monitors, various levels of experimental analysis are performed based on evaluation strategy.

MSFC Skylab Apollo Telescope Mount experiment systems mission evaluation

NASA Technical Reports Server (NTRS)

White, A. F., Jr.

1974-01-01

A detailed evaluation is presented of the Skylab Apollo Telescope Mount experiments performance throughout the eight and one-half month Skylab Mission. Descriptions and the objectives of each instrument are included. The anomalies experienced, the causes, and corrective actions taken are discussed. Conclusions, based on evaluation of the performance of each instrument, are presented. Examples of the scientific data obtained, as well as a discussion of the quality and quantity of the data, are presented.

Ascertaining educational outcomes after assessment in children with learning disorders.

PubMed

Waber, Deborah P; Boiselle, Ellen C; Girard, Jonathan M; Amaral, Joseph L; Forbes, Peter W

2017-01-01

To survey educational outcomes after an interdisciplinary, neuropsychologically based team assessment for learning disorders. Parents of 137 children who underwent a comprehensive interdisciplinary neuropsychologically based assessment for learning problems completed an online survey one to four years later. Questions pertained broadly to school outcomes: positive or negative school responses, changes in special education services, and parental perceptions about the helpfulness of those services. These outcomes were examined in relation to demographic characteristics and parent satisfaction with the evaluation. We also obtained recent performance on state-based academic testing for descriptive purposes. Parents reported that schools generally responded positively (78%), and 70% reported that their children had access to more or different special education services after the evaluation. Parents nearly uniformly (98%) viewed these services as helpful. Positive changes in education services were related to income (lower income received more services, p < .05) and parent satisfaction with the evaluation (p < .05). The intensity of special education services was strongly related to performance on state-based testing (p < .0001-p < .01). School response is a relatively objective and meaningful metric of educational outcome after neuropsychologically based evaluation for children with learning problems.

Validation of voxel-based morphometry (VBM) based on MRI

NASA Astrophysics Data System (ADS)

Yang, Xueyu; Chen, Kewei; Guo, Xiaojuan; Yao, Li

2007-03-01

Voxel-based morphometry (VBM) is an automated and objective image analysis technique for detecting differences in regional concentration or volume of brain tissue composition based on structural magnetic resonance (MR) images. VBM has been used widely to evaluate brain morphometric differences between different populations, but there isn't an evaluation system for its validation until now. In this study, a quantitative and objective evaluation system was established in order to assess VBM performance. We recruited twenty normal volunteers (10 males and 10 females, age range 20-26 years, mean age 22.6 years). Firstly, several focal lesions (hippocampus, frontal lobe, anterior cingulate, back of hippocampus, back of anterior cingulate) were simulated in selected brain regions using real MRI data. Secondly, optimized VBM was performed to detect structural differences between groups. Thirdly, one-way ANOVA and post-hoc test were used to assess the accuracy and sensitivity of VBM analysis. The results revealed that VBM was a good detective tool in majority of brain regions, even in controversial brain region such as hippocampus in VBM study. Generally speaking, much more severity of focal lesion was, better VBM performance was. However size of focal lesion had little effects on VBM analysis.

Performance evaluation of an automatic MGRF-based lung segmentation approach

NASA Astrophysics Data System (ADS)

Soliman, Ahmed; Khalifa, Fahmi; Alansary, Amir; Gimel'farb, Georgy; El-Baz, Ayman

2013-10-01

The segmentation of the lung tissues in chest Computed Tomography (CT) images is an important step for developing any Computer-Aided Diagnostic (CAD) system for lung cancer and other pulmonary diseases. In this paper, we introduce a new framework for validating the accuracy of our developed Joint Markov-Gibbs based lung segmentation approach using 3D realistic synthetic phantoms. These phantoms are created using a 3D Generalized Gauss-Markov Random Field (GGMRF) model of voxel intensities with pairwise interaction to model the 3D appearance of the lung tissues. Then, the appearance of the generated 3D phantoms is simulated based on iterative minimization of an energy function that is based on the learned 3D-GGMRF image model. These 3D realistic phantoms can be used to evaluate the performance of any lung segmentation approach. The performance of our segmentation approach is evaluated using three metrics, namely, the Dice Similarity Coefficient (DSC), the modified Hausdorff distance, and the Average Volume Difference (AVD) between our segmentation and the ground truth. Our approach achieves mean values of 0.994±0.003, 8.844±2.495 mm, and 0.784±0.912 mm3, for the DSC, Hausdorff distance, and the AVD, respectively.

Automated Storm Tracking and the Lightning Jump Algorithm Using GOES-R Geostationary Lightning Mapper (GLM) Proxy Data.

PubMed

Schultz, Elise V; Schultz, Christopher J; Carey, Lawrence D; Cecil, Daniel J; Bateman, Monte

2016-01-01

This study develops a fully automated lightning jump system encompassing objective storm tracking, Geostationary Lightning Mapper proxy data, and the lightning jump algorithm (LJA), which are important elements in the transition of the LJA concept from a research to an operational based algorithm. Storm cluster tracking is based on a product created from the combination of a radar parameter (vertically integrated liquid, VIL), and lightning information (flash rate density). Evaluations showed that the spatial scale of tracked features or storm clusters had a large impact on the lightning jump system performance, where increasing spatial scale size resulted in decreased dynamic range of the system's performance. This framework will also serve as a means to refine the LJA itself to enhance its operational applicability. Parameters within the system are isolated and the system's performance is evaluated with adjustments to parameter sensitivity. The system's performance is evaluated using the probability of detection (POD) and false alarm ratio (FAR) statistics. Of the algorithm parameters tested, sigma-level (metric of lightning jump strength) and flash rate threshold influenced the system's performance the most. Finally, verification methodologies are investigated. It is discovered that minor changes in verification methodology can dramatically impact the evaluation of the lightning jump system.

Automated Storm Tracking and the Lightning Jump Algorithm Using GOES-R Geostationary Lightning Mapper (GLM) Proxy Data

NASA Technical Reports Server (NTRS)

Schultz, Elise; Schultz, Christopher Joseph; Carey, Lawrence D.; Cecil, Daniel J.; Bateman, Monte

2016-01-01

This study develops a fully automated lightning jump system encompassing objective storm tracking, Geostationary Lightning Mapper proxy data, and the lightning jump algorithm (LJA), which are important elements in the transition of the LJA concept from a research to an operational based algorithm. Storm cluster tracking is based on a product created from the combination of a radar parameter (vertically integrated liquid, VIL), and lightning information (flash rate density). Evaluations showed that the spatial scale of tracked features or storm clusters had a large impact on the lightning jump system performance, where increasing spatial scale size resulted in decreased dynamic range of the system's performance. This framework will also serve as a means to refine the LJA itself to enhance its operational applicability. Parameters within the system are isolated and the system's performance is evaluated with adjustments to parameter sensitivity. The system's performance is evaluated using the probability of detection (POD) and false alarm ratio (FAR) statistics. Of the algorithm parameters tested, sigma-level (metric of lightning jump strength) and flash rate threshold influenced the system's performance the most. Finally, verification methodologies are investigated. It is discovered that minor changes in verification methodology can dramatically impact the evaluation of the lightning jump system.

Automated Storm Tracking and the Lightning Jump Algorithm Using GOES-R Geostationary Lightning Mapper (GLM) Proxy Data

PubMed Central

SCHULTZ, ELISE V.; SCHULTZ, CHRISTOPHER J.; CAREY, LAWRENCE D.; CECIL, DANIEL J.; BATEMAN, MONTE

2017-01-01

This study develops a fully automated lightning jump system encompassing objective storm tracking, Geostationary Lightning Mapper proxy data, and the lightning jump algorithm (LJA), which are important elements in the transition of the LJA concept from a research to an operational based algorithm. Storm cluster tracking is based on a product created from the combination of a radar parameter (vertically integrated liquid, VIL), and lightning information (flash rate density). Evaluations showed that the spatial scale of tracked features or storm clusters had a large impact on the lightning jump system performance, where increasing spatial scale size resulted in decreased dynamic range of the system’s performance. This framework will also serve as a means to refine the LJA itself to enhance its operational applicability. Parameters within the system are isolated and the system’s performance is evaluated with adjustments to parameter sensitivity. The system’s performance is evaluated using the probability of detection (POD) and false alarm ratio (FAR) statistics. Of the algorithm parameters tested, sigma-level (metric of lightning jump strength) and flash rate threshold influenced the system’s performance the most. Finally, verification methodologies are investigated. It is discovered that minor changes in verification methodology can dramatically impact the evaluation of the lightning jump system. PMID:29303164

Performance and economics of advanced energy conversion systems for coal and coal-derived fuels

NASA Technical Reports Server (NTRS)

Corman, J. C.; Fox, G. R.

1978-01-01

The desire to establish an efficient Energy Conversion System to utilize the fossil fuel of the future - coal - has produced many candidate systems. A comparative technical/economic evaluation was performed on the seven most attractive advanced energy conversion systems. The evaluation maintains a cycle-to-cycle consistency in both performance and economic projections. The technical information base can be employed to make program decisions regarding the most attractive concept. A reference steam power plant was analyzed to the same detail and, under the same ground rules, was used as a comparison base. The power plants were all designed to utilize coal or coal-derived fuels and were targeted to meet an environmental standard. The systems evaluated were two advanced steam systems, a potassium topping cycle, a closed cycle helium system, two open cycle gas turbine combined cycles, and an open cycle MHD system.

Evaluation and Testing of Commercially-Available Carbon Nanotubes as Negative Electrodes for Lithium Ion Cells

NASA Technical Reports Server (NTRS)

Britton, Doris L.

2007-01-01

Rechargeable lithium ion (Li-ion) battery technology offers significant performance advantages over the nickel-based technologies used for energy storage for the majority of NASA's missions. Specifically Li-ion technology offers a threefold to fourfold increase in gravimetric and volumetric energy densities and produces voltages in excess of three times the value of typical nickel-based battery systems. As part of the Advanced Battery Technology program at NASA Glenn Research Center (GRC), a program on the evaluation of anodes for Li-ion cells and batteries was conducted. This study focused on the feasibility of using carbon nanotubes as anodes in Li-Ion cells. Candidate materials from multiple sources were evaluated. Their performance was compared to a standard anode comprised of mesocarbon microbeads. In all cases, the standard MCMB electrode exhibited superior performance. The details and results of the study are presented.

Evaluation of the Quality of Occupational Health and Safety Management Systems Based on Key Performance Indicators in Certified Organizations.

PubMed

Mohammadfam, Iraj; Kamalinia, Mojtaba; Momeni, Mansour; Golmohammadi, Rostam; Hamidi, Yadollah; Soltanian, Alireza

2017-06-01

Occupational Health and Safety Management Systems are becoming more widespread in organizations. Consequently, their effectiveness has become a core topic for researchers. This paper evaluates the performance of the Occupational Health and Safety Assessment Series 18001 specification in certified companies in Iran. The evaluation is based on a comparison of specific criteria and indictors related to occupational health and safety management practices in three certified and three noncertified companies. Findings indicate that the performance of certified companies with respect to occupational health and safety management practices is significantly better than that of noncertified companies. Occupational Health and Safety Assessment Series 18001-certified companies have a better level of occupational health and safety; this supports the argument that Occupational Health and Safety Management Systems play an important strategic role in health and safety in the workplace.

Proposed Performance Measures and Strategies for Implementation of the Fatigue Risk Management Guidelines for Emergency Medical Services

DOT National Transportation Integrated Search

2018-01-11

Background: Performance measures are a key component of implementation, dissemination, and evaluation of evidence-based guidelines (EBGs). We developed performance measures for Emergency Medical Services (EMS) stakeholders to enable the implementatio...

ANN based Performance Evaluation of BDI for Condition Monitoring of Induction Motor Bearings

NASA Astrophysics Data System (ADS)

Patel, Raj Kumar; Giri, V. K.

2017-06-01

One of the critical parts in rotating machines is bearings and most of the failure arises from the defective bearings. Bearing failure leads to failure of a machine and the unpredicted productivity loss in the performance. Therefore, bearing fault detection and prognosis is an integral part of the preventive maintenance procedures. In this paper vibration signal for four conditions of a deep groove ball bearing; normal (N), inner race defect (IRD), ball defect (BD) and outer race defect (ORD) were acquired from a customized bearing test rig, under four different conditions and three different fault sizes. Two approaches have been opted for statistical feature extraction from the vibration signal. In the first approach, raw signal is used for statistical feature extraction and in the second approach statistical features extracted are based on bearing damage index (BDI). The proposed BDI technique uses wavelet packet node energy coefficients analysis method. Both the features are used as inputs to an ANN classifier to evaluate its performance. A comparison of ANN performance is made based on raw vibration data and data chosen by using BDI. The ANN performance has been found to be fairly higher when BDI based signals were used as inputs to the classifier.

Evaluating the accuracy of the Wechsler Memory Scale-Fourth Edition (WMS-IV) logical memory embedded validity index for detecting invalid test performance.

PubMed

Soble, Jason R; Bain, Kathleen M; Bailey, K Chase; Kirton, Joshua W; Marceaux, Janice C; Critchfield, Edan A; McCoy, Karin J M; O'Rourke, Justin J F

2018-01-08

Embedded performance validity tests (PVTs) allow for continuous assessment of invalid performance throughout neuropsychological test batteries. This study evaluated the utility of the Wechsler Memory Scale-Fourth Edition (WMS-IV) Logical Memory (LM) Recognition score as an embedded PVT using the Advanced Clinical Solutions (ACS) for WAIS-IV/WMS-IV Effort System. This mixed clinical sample was comprised of 97 total participants, 71 of whom were classified as valid and 26 as invalid based on three well-validated, freestanding criterion PVTs. Overall, the LM embedded PVT demonstrated poor concordance with the criterion PVTs and unacceptable psychometric properties using ACS validity base rates (42% sensitivity/79% specificity). Moreover, 15-39% of participants obtained an invalid ACS base rate despite having a normatively-intact age-corrected LM Recognition total score. Receiving operating characteristic curve analysis revealed a Recognition total score cutoff of < 61% correct improved specificity (92%) while sensitivity remained weak (31%). Thus, results indicated the LM Recognition embedded PVT is not appropriate for use from an evidence-based perspective, and that clinicians may be faced with reconciling how a normatively intact cognitive performance on the Recognition subtest could simultaneously reflect invalid performance validity.

Medical Students' Satisfaction and Academic Performance with Problem-Based Learning in Practice-Based Exercises for Epidemiology and Health Demographics

ERIC Educational Resources Information Center

Jiménez-Mejías, E.; Amezcua-Prieto, C.; Martínez-Ruiz, V.; Olvera-Porcel, M. C.; Jiménez-Moleón, J. J.; Lardelli Claret, P.

2015-01-01

The aim of this study was to evaluate the effect of problem-based learning (PBL) on university students' satisfaction with and academic performance in a course on epidemiology and social and demographic health. The participants in this interventional study were 529 students (272 in the intervention group and 257 in the control group) enrolled in a…

Discovering the Unknown: Improving Detection of Novel Species and Genera from Short Reads

DOE PAGES

Rosen, Gail L.; Polikar, Robi; Caseiro, Diamantino A.; ...

2011-01-01

High-throughput sequencing technologies enable metagenome profiling, simultaneous sequencing of multiple microbial species present within an environmental sample. Since metagenomic data includes sequence fragments (“reads”) from organisms that are absent from any database, new algorithms must be developed for the identification and annotation of novel sequence fragments. Homology-based techniques have been modified to detect novel species and genera, but, composition-based methods, have not been adapted. We develop a detection technique that can discriminate between “known” and “unknown” taxa, which can be used with composition-based methods, as well as a hybrid method. Unlike previous studies, we rigorously evaluate all algorithms for theirmore » ability to detect novel taxa. First, we show that the integration of a detector with a composition-based method performs significantly better than homology-based methods for the detection of novel species and genera, with best performance at finer taxonomic resolutions. Most importantly, we evaluate all the algorithms by introducing an “unknown” class and show that the modified version of PhymmBL has similar or better overall classification performance than the other modified algorithms, especially for the species-level and ultrashort reads. Finally, we evaluate theperformance of several algorithms on a real acid mine drainage dataset.« less

Performance evaluation of multi-stratum resources optimization with network functions virtualization for cloud-based radio over optical fiber networks.

PubMed

Yang, Hui; He, Yongqi; Zhang, Jie; Ji, Yuefeng; Bai, Wei; Lee, Young

2016-04-18

Cloud radio access network (C-RAN) has become a promising scenario to accommodate high-performance services with ubiquitous user coverage and real-time cloud computing using cloud BBUs. In our previous work, we implemented cross stratum optimization of optical network and application stratums resources that allows to accommodate the services in optical networks. In view of this, this study extends to consider the multiple dimensional resources optimization of radio, optical and BBU processing in 5G age. We propose a novel multi-stratum resources optimization (MSRO) architecture with network functions virtualization for cloud-based radio over optical fiber networks (C-RoFN) using software defined control. A global evaluation scheme (GES) for MSRO in C-RoFN is introduced based on the proposed architecture. The MSRO can enhance the responsiveness to dynamic end-to-end user demands and globally optimize radio frequency, optical and BBU resources effectively to maximize radio coverage. The efficiency and feasibility of the proposed architecture are experimentally demonstrated on OpenFlow-based enhanced SDN testbed. The performance of GES under heavy traffic load scenario is also quantitatively evaluated based on MSRO architecture in terms of resource occupation rate and path provisioning latency, compared with other provisioning scheme.

Performability evaluation of the SIFT computer

NASA Technical Reports Server (NTRS)

Meyer, J. F.; Furchtgott, D. G.; Wu, L. T.

1979-01-01

Performability modeling and evaluation techniques are applied to the SIFT computer as it might operate in the computational evironment of an air transport mission. User-visible performance of the total system (SIFT plus its environment) is modeled as a random variable taking values in a set of levels of accomplishment. These levels are defined in terms of four attributes of total system behavior: safety, no change in mission profile, no operational penalties, and no economic process whose states describe the internal structure of SIFT as well as relavant conditions of the environment. Base model state trajectories are related to accomplishment levels via a capability function which is formulated in terms of a 3-level model hierarchy. Performability evaluation algorithms are then applied to determine the performability of the total system for various choices of computer and environment parameter values. Numerical results of those evaluations are presented and, in conclusion, some implications of this effort are discussed.

The Discrepancy Evaluation Model: A Systematic Approach for the Evaluation of Career Planning and Placement Programs.

ERIC Educational Resources Information Center

Buttram, Joan L.; Covert, Robert W.

The Discrepancy Evaluation Model (DEM), developed in 1966 by Malcolm Provus, provides information for program assessment and program improvement. Under the DEM, evaluation is defined as the comparison of an actual performance to a desired standard. The DEM embodies five stages of evaluation based upon a program's natural development: program…

Optimal Contractor Selection in Construction Industry: The Fuzzy Way

NASA Astrophysics Data System (ADS)

Krishna Rao, M. V.; Kumar, V. S. S.; Rathish Kumar, P.

2018-02-01

A purely price-based approach to contractor selection has been identified as the root cause for many serious project delivery problems. Therefore, the capability of the contractor to execute the project should be evaluated using a multiple set of selection criteria including reputation, past performance, performance potential, financial soundness and other project specific criteria. An industry-wide questionnaire survey was conducted with the objective of identifying the important criteria for adoption in the selection process. In this work, a fuzzy set based model was developed for contractor prequalification/evaluation, by using effective criteria obtained from the percept of construction professionals, taking subjective judgments of decision makers also into consideration. A case study consisting of four alternatives (contractors in the present case) solicited from a public works department of Pondicherry in India, is used to illustrate the effectiveness of the proposed approach. The final selection of contractor is made based on the integrated score or Overall Evaluation Score of the decision alternative in prequalification as well as bid evaluation stages.

An Adaptive Reputation-Based Algorithm for Grid Virtual Organization Formation

NASA Astrophysics Data System (ADS)

Cui, Yongrui; Li, Mingchu; Ren, Yizhi; Sakurai, Kouichi

A novel adaptive reputation-based virtual organization formation is proposed. It restrains the bad performers effectively based on the consideration of the global experience of the evaluator and evaluates the direct trust relation between two grid nodes accurately by consulting the previous trust value rationally. It also consults and improves the reputation evaluation process in PathTrust model by taking account of the inter-organizational trust relationship and combines it with direct and recommended trust in a weighted way, which makes the algorithm more robust against collusion attacks. Additionally, the proposed algorithm considers the perspective of the VO creator and takes required VO services as one of the most important fine-grained evaluation criterion, which makes the algorithm more suitable for constructing VOs in grid environments that include autonomous organizations. Simulation results show that our algorithm restrains the bad performers and resists against fake transaction attacks and badmouth attacks effectively. It provides a clear advantage in the design of a VO infrastructure.

A Spreadsheet-Based Visualized Mindtool for Improving Students' Learning Performance in Identifying Relationships between Numerical Variables

ERIC Educational Resources Information Center

Lai, Chiu-Lin; Hwang, Gwo-Jen

2015-01-01

In this study, a spreadsheet-based visualized Mindtool was developed for improving students' learning performance when finding relationships between numerical variables by engaging them in reasoning and decision-making activities. To evaluate the effectiveness of the proposed approach, an experiment was conducted on the "phenomena of climate…

The Performance-Based Research Fund, Gender and a Cultural Cringe

ERIC Educational Resources Information Center

Curtis, Bruce

2016-01-01

This article explores ways the Performance-based Research Fund (PBRF) produces gendered results and expresses a cultural cringe. It is argued that the research evaluation is fixated with being "world-class" at the expense of academic practice that focuses on New Zealand. In this context, disadvantage faced by female academics under the…

Development of Entry-Level Competence Tests: A Strategy for Evaluation of Vocational Education Training Systems

ERIC Educational Resources Information Center

Schutte, Marc; Spottl, Georg

2011-01-01

Developing countries such as Malaysia and Oman have recently established occupational standards based on core work processes (functional clusters of work objects, activities and performance requirements), to which competencies (performance determinants) can be linked. While the development of work-process-based occupational standards is supposed…

SU-F-T-552: A One-Year Evaluation of the QABeamChecker+ for Use with the CyberKnife System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gersh, J; Spectrum Medical Physics, LLC, Greenville, SC

Purpose: By attaching an adapter plate with fiducial markers to the QA BeamChecker+ (Standard Imaging, Inc., Middleton, WI), the output of the CyberKnife can be accurately, efficiently, and consistently evaluated. The adapter plate, known as the Cutting Board, allows for automated alignment of the QABC+ using the CK’s stereoscopic kV image-based treatment localization system (TLS). Described herein is an evaluation of the system following a year of clinical utilization. Methods: Based on a CT scan of the QABC+ and CB, a treatment plan is generated which delivers a beam to each of the 5 plane-parallel ionization chambers. Following absolute calibrationmore » of the CK, the QA plan is delivered, and baseline measurements are acquired (and automatically corrected for temperature and pressure). This test was performed at the beginning of each treatment day for a year. A calibration evaluation (using a water-equivalent slab and short thimble chamber) is performed every four weeks, or whenever the QABC+ detects a deviation of more than 1.0%. Results: During baseline evaluation, repeat measurements (n=10) were performed, with an average output of 0.25% with an SD of 0.11%. As a test of the reposition of the QABC+ and CB, ten additional measurements were performed where between each acquisition, the entire system was removed and re-positioned using the TLS. The average output deviation was 0.30% with a SD of 0.13%. During the course of the year, 187 QABC+ measurements and 13 slab-based measurements were performed. The output measurements of the QABC+ correlated well with slab-based measurements (R2=0.909). Conclusion: By using the QABC+ and CB, daily output was evaluated accurately, efficiently, and consistently. From setup to break-down (including analysis), this test required 5 minutes instead of approximately 15 using traditional techniques (collimator-mounted ionization chambers). Additionally, by automatically saving resultant output deviation to a database, trend analysis was simplified. Spectrum Medical Physics, LLC of Greenville, SC has a consulting contract with Standard Imaging of Middleton, WI.« less

Replacing fossil based plastic performance products by bio-based plastic products-Technical feasibility.

PubMed

van den Oever, Martien; Molenveld, Karin

2017-07-25

Larger scale market introduction of new bio-based products requires a clear advantage regarding sustainability, as well as an adequate techno-economic positioning relative to fossil based products. In a previous paper [Broeren et al., 2016], LCA results per kg and per functionality equivalent of bio-based plastics were presented, together with economic considerations. The present paper discusses the mechanical and thermal properties of a range of commercially available bio-based plastics based on polylactic acid (PLA), cellulose esters, starch and polyamides, and the feasibility of replacing fossil-based counterparts based on performance. The evaluation is approached from an end user perspective. First, potentially suitable bio-based plastics are selected based on manufacturers' specifications in technical data sheets, then a first experimental evaluation is performed on injection moulded ISO specimens, and finally a further selection of plastics is tested on large 50×70cm panels. This technical feasibility study indicates that so far bio-based plastics do not completely match the properties of high performance materials like flame retardant V-0 PC/ABS blends used in electronic devices. The performance gap is being decreased by the development of stereocomplex PLA and hybrid PLA blends with polycarbonate, which offer clearly improved properties with respect to maximum usage temperature and toughness. In addition, several materials meet the V-0 flammability requirements needed in specific durable applications. On the other hand, improving these properties so far has negative consequences for the bio-based content. This study also shows that replacement of bulk polymers like PS is feasible using PLA compounds with a bio-based content as high as 85%. Copyright © 2016 Elsevier B.V. All rights reserved.

Performance Evaluation Model for Application Layer Firewalls.

PubMed

Xuan, Shichang; Yang, Wu; Dong, Hui; Zhang, Jiangchuan

2016-01-01

Application layer firewalls protect the trusted area network against information security risks. However, firewall performance may affect user experience. Therefore, performance analysis plays a significant role in the evaluation of application layer firewalls. This paper presents an analytic model of the application layer firewall, based on a system analysis to evaluate the capability of the firewall. In order to enable users to improve the performance of the application layer firewall with limited resources, resource allocation was evaluated to obtain the optimal resource allocation scheme in terms of throughput, delay, and packet loss rate. The proposed model employs the Erlangian queuing model to analyze the performance parameters of the system with regard to the three layers (network, transport, and application layers). Then, the analysis results of all the layers are combined to obtain the overall system performance indicators. A discrete event simulation method was used to evaluate the proposed model. Finally, limited service desk resources were allocated to obtain the values of the performance indicators under different resource allocation scenarios in order to determine the optimal allocation scheme. Under limited resource allocation, this scheme enables users to maximize the performance of the application layer firewall.

The artificial membrane insert system as predictive tool for formulation performance evaluation.

PubMed

Berben, Philippe; Brouwers, Joachim; Augustijns, Patrick

2018-02-15

In view of the increasing interest of pharmaceutical companies for cell- and tissue-free models to implement permeation into formulation testing, this study explored the capability of an artificial membrane insert system (AMI-system) as predictive tool to evaluate the performance of absorption-enabling formulations. Firstly, to explore the usefulness of the AMI-system in supersaturation assessment, permeation was monitored after induction of different degrees of loviride supersaturation. Secondly, to explore the usefulness of the AMI-system in formulation evaluation, a two-stage dissolution test was performed prior to permeation assessment. Different case examples were selected based on the availability of in vivo (intraluminal and systemic) data: (i) a suspension of posaconazole (Noxafil ® ), (ii) a cyclodextrin-based formulation of itraconazole (Sporanox ® ), and (iii) a micronized (Lipanthyl ® ) and nanosized (Lipanthylnano ® ) formulation of fenofibrate. The obtained results demonstrate that the AMI-system is able to capture the impact of loviride supersaturation on permeation. Furthermore, the AMI-system correctly predicted the effects of (i) formulation pH on posaconazole absorption, (ii) dilution on cyclodextrin-based itraconazole absorption, and (iii) food intake on fenofibrate absorption. Based on the applied in vivo/in vitro approach, the AMI-system combined with simple dissolution testing appears to be a time- and cost-effective tool for the early-stage evaluation of absorption-enabling formulations. Copyright © 2017 Elsevier B.V. All rights reserved.

Walsh-Hadamard transform kernel-based feature vector for shot boundary detection.

PubMed

Lakshmi, Priya G G; Domnic, S

2014-12-01

Video shot boundary detection (SBD) is the first step of video analysis, summarization, indexing, and retrieval. In SBD process, videos are segmented into basic units called shots. In this paper, a new SBD method is proposed using color, edge, texture, and motion strength as vector of features (feature vector). Features are extracted by projecting the frames on selected basis vectors of Walsh-Hadamard transform (WHT) kernel and WHT matrix. After extracting the features, based on the significance of the features, weights are calculated. The weighted features are combined to form a single continuity signal, used as input for Procedure Based shot transition Identification process (PBI). Using the procedure, shot transitions are classified into abrupt and gradual transitions. Experimental results are examined using large-scale test sets provided by the TRECVID 2007, which has evaluated hard cut and gradual transition detection. To evaluate the robustness of the proposed method, the system evaluation is performed. The proposed method yields F1-Score of 97.4% for cut, 78% for gradual, and 96.1% for overall transitions. We have also evaluated the proposed feature vector with support vector machine classifier. The results show that WHT-based features can perform well than the other existing methods. In addition to this, few more video sequences are taken from the Openvideo project and the performance of the proposed method is compared with the recent existing SBD method.

Technology-Enhanced Physics Programme for Community-Based Science Learning: Innovative Design and Programme Evaluation in a Theme Park

NASA Astrophysics Data System (ADS)

Tho, Siew Wei; Chan, Ka Wing; Yeung, Yau Yuen

2015-10-01

In this study, a new physics education programme is specifically developed for a famous theme park in Hong Kong to provide community-based science learning to her visitors, involving her three newly constructed rides. We make innovative use of digital technologies in this programme and incorporate a rigorous evaluation of the learning effectiveness of the programme. A total of around 200 students from nine local secondary schools participated in both the physics programme and its subsequent evaluation which consists of a combination of research and assessment tools, including pre- and post-multiple-choice tests, a questionnaire survey and an interview as specifically developed for this programme, or adopted from some well-accepted research instruments. Based on the evaluation of students' academic performance, there are two educationally significant findings on enhancing the students' physics learning: (a) traditionally large gender differences in physics performance and interest of learning are mostly eliminated; and (b) a less-exciting ride called the aviator (instead of the most exciting roller-coaster ride) can induce the largest learning effect (or gain in academic performance) amongst teenagers. Besides, findings from the questionnaire survey and interviews of participants are reported to reveal their views, perceptions, positive and negative comments or feedback on this programme which could provide valuable insights for future development of other similar community-based programmes.

Extending the Distributed Lag Model framework to handle chemical mixtures.

PubMed

Bello, Ghalib A; Arora, Manish; Austin, Christine; Horton, Megan K; Wright, Robert O; Gennings, Chris

2017-07-01

Distributed Lag Models (DLMs) are used in environmental health studies to analyze the time-delayed effect of an exposure on an outcome of interest. Given the increasing need for analytical tools for evaluation of the effects of exposure to multi-pollutant mixtures, this study attempts to extend the classical DLM framework to accommodate and evaluate multiple longitudinally observed exposures. We introduce 2 techniques for quantifying the time-varying mixture effect of multiple exposures on an outcome of interest. Lagged WQS, the first technique, is based on Weighted Quantile Sum (WQS) regression, a penalized regression method that estimates mixture effects using a weighted index. We also introduce Tree-based DLMs, a nonparametric alternative for assessment of lagged mixture effects. This technique is based on the Random Forest (RF) algorithm, a nonparametric, tree-based estimation technique that has shown excellent performance in a wide variety of domains. In a simulation study, we tested the feasibility of these techniques and evaluated their performance in comparison to standard methodology. Both methods exhibited relatively robust performance, accurately capturing pre-defined non-linear functional relationships in different simulation settings. Further, we applied these techniques to data on perinatal exposure to environmental metal toxicants, with the goal of evaluating the effects of exposure on neurodevelopment. Our methods identified critical neurodevelopmental windows showing significant sensitivity to metal mixtures. Copyright © 2017 Elsevier Inc. All rights reserved.

Performance Evaluation and Compensation for Public School Principals: Results from a National Survey

ERIC Educational Resources Information Center

Kimball, Steven M.; Heneman, Herbert G., III; Milanowski, Anthony

2007-01-01

This article reports on a national survey designed to learn how medium and large school districts are using standards-based leadership evaluation and related human resource management practices, such as pay for performance. Surveys were sent to all school districts in the United States with student populations 10,000 and over (total n=867).…

Storying Teacher Education Policy: Critical Counternarratives of Curricular, Pedagogical, and Activist Responses to State-Mandated Teacher Performance Assessments

ERIC Educational Resources Information Center

Henning, Nick; Dover, Alison; Dotson, Erica K.; Agarwal-Rangath, Ruchi

2018-01-01

The rise of high-stakes, standardized, teacher performance assessments (TPAs) is central to the industry being created out of the regulation, policing, and evaluation of university-based teacher education In addition to reinforcing a narrow and counter-critical framework, TPAs can shift responsibility for the evaluation of teacher candidates from…

Monitoring the Impact of Testing and Evaluation Innovations Project: State Activity and Interest Concerning Performance-Based Assessment.

ERIC Educational Resources Information Center

Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.

Information was gathered about current state interest, activity, and concerns related to performance assessment for students. The Center for Research on Evaluation, Standards, and Student Testing of the University of California (Los Angeles) conducted telephone interviews with directors of testing in each of the 50 states in the spring of 1990.…

Evaluation of the Teacher Incentive Fund: Implementation and Impacts of Pay-for-Performance after Two Years. Executive Summary. NCEE 2015-4021

ERIC Educational Resources Information Center

Chiang, Hanley; Wellington, Alison; Hallgren, Kristin; Speroni, Cecilia; Herrmann, Mariesa; Glazerman, Steven; Constantine, Jill

2015-01-01

Recent efforts to attract and retain effective educators and to improve teaching practices have focused on reforming evaluation and compensation systems for teachers and principals. In 2006, Congress established the Teacher Incentive Fund (TIF), which provides grants to support performance-based compensation systems for teachers and principals in…

A Prototype Public Speaking Skills Assessment: An Evaluation of Human-Scoring Quality. Research Report. ETS RR-15-36

ERIC Educational Resources Information Center

Joe, Jilliam; Kitchen, Christopher; Chen, Lei; Feng, Gary

2015-01-01

The purpose of this paper is to summarize the evaluation of human-scoring quality for an assessment of public speaking skills. Videotaped performances given by 17 speakers on 4 tasks were scored by expert and nonexpert raters who had extensive experience scoring performance-based and constructed-response assessments. The Public Speaking Competence…

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Agent-based modeling as a tool for program design and evaluation.

PubMed

Lawlor, Jennifer A; McGirr, Sara

2017-12-01

Recently, systems thinking and systems science approaches have gained popularity in the field of evaluation; however, there has been relatively little exploration of how evaluators could use quantitative tools to assist in the implementation of systems approaches therein. The purpose of this paper is to explore potential uses of one such quantitative tool, agent-based modeling, in evaluation practice. To this end, we define agent-based modeling and offer potential uses for it in typical evaluation activities, including: engaging stakeholders, selecting an intervention, modeling program theory, setting performance targets, and interpreting evaluation results. We provide demonstrative examples from published agent-based modeling efforts both inside and outside the field of evaluation for each of the evaluative activities discussed. We further describe potential pitfalls of this tool and offer cautions for evaluators who may chose to implement it in their practice. Finally, the article concludes with a discussion of the future of agent-based modeling in evaluation practice and a call for more formal exploration of this tool as well as other approaches to simulation modeling in the field. Copyright © 2017 Elsevier Ltd. All rights reserved.

SMOS and AMSR-2 soil moisture evaluation using representative monitoring sites in southern Australia

NASA Astrophysics Data System (ADS)

Walker, J. P.; Mei Sun, M. S.; Rudiger, C.; Parinussa, R.; Koike, T.; Kerr, Y. H.

2016-12-01

The performance of soil moisture products from AMSR-2 and SMOS were evaluated against representative surface soil moisture stations within the Yanco study area in the Murrumbidgee Catchment, in southeast Australia. AMSR-2 Level 3 (L3) soil moisture products retrieved from two sets of brightness temperatures using the Japanese Aerospace exploration Agency (JAXA) and the Land Parameter Retrieval Model (LPRM) algorithms were included. For the LPRM algorithm, two different parameterization methods were applied. In the case of SMOS, two versions of the SMOS L3 soil moisture product were assessed. Results based on using "random" and representative stations to evaluate the products were contrasted. The latest versions of the JAXA (JX2) and LPRM (LP3) products were found to perform better than the earlier versions (JX1, LP1 and LP2). Moreover, soil moisture retrieval based on the latter version of brightness temperature and parameterization scheme improved when C-band observations were used, as opposed to the X-band data. Yet, X-band retrievals were found to perform better than C-band. Inter-comparing AMSR-2 X-band products from different acquisition times showed a better performance for 1:30 pm overpasses whereas SMOS 6:00 am retrievals were found to perform the best. The mean average error (MAE) goal accuracy of the AMSR-2 mission (MAE < 0.08 m3/m3) was met by both versions of the JAXA products, the LPRM X-band products retrieved from the reprocessed version of brightness temperatures, and both versions of SMOS products. Nevertheless, none of the products achieved the SMOS target accuracy of 0.04 m3/m3. Finally, the product performance depended on the statistics used in their evaluation; based on temporal and absolute accuracy JX2 is recommended, whereas LP3 X-band 1:30 pm and SMOS2 6:00 am are recommended based on temporal accuracy alone.

Optical burst switching for the next generation Optical Internet

NASA Astrophysics Data System (ADS)

Yoo, Myungsik

2000-11-01

In recent years, Internet Protocol (IP) over Wavelength Division Multiplexing (WDM) networks for the next generation Internet (or the so-called Optical Internet) have received enormous attention. There are two main drivers for an Optical Internet. One is the explosion of Internet traffic, which seems to keep growing exponentially. The other driver is the rapid advance in the WDM optical networking technology. In this study, key issues in the optical (WDM) layer will be investigated. As a novel switching paradigm for Optical Internet, Optical Burst Switching (OBS) is discussed. By leveraging the attractive properties of optical communications and at the same time, taking into account its limitations, OBS can combine the best of optical circuit-switching and packet/cell switching. The general concept of JET-based OBS protocol is described, including offset time and delayed reservation. In the next generation Optical Internet, one must address how to support Quality of Service (QoS) at the WDM layer since current IP provides only best effort services. The offset-time- based QoS scheme is proposed as a way of supporting QoS at the WDM layer. Unlike existing QoS schemes, offset- time-based QoS scheme does not mandate the use of buffer to differentiate services. For the bufferless WDM switch, the performance of offset- time-based QoS scheme is evaluated in term of blocking probability. In addition, the extra offset time required for class isolation is quantified and the theoretical bounds on blocking probability are analyzed. The offset-time-based scheme is applied to WDM switch with limited fiber delay line (FDL) buffer. We evaluate the effect of having a FDL buffer on the QoS performance of the offset-time-based scheme in terms of the loss probability and queuing delay of bursts. Finally, in order to dimension the network resources in Optical Internet backbone networks, the performance of the offset-time-based QoS scheme is evaluated for the multi-hop case. In particular, we consider very high performance Backbone Network Service (vBNS) backbone network. Various policies such as drop, retransmission, deflection routing and buffering are considered for performance evaluation. The performance results obtained under these policies are compared to decide the most efficient policy for the WDM backbone network.

Comparing Methods for UAV-Based Autonomous Surveillance

NASA Technical Reports Server (NTRS)

Freed, Michael; Harris, Robert; Shafto, Michael

2004-01-01

We describe an approach to evaluating algorithmic and human performance in directing UAV-based surveillance. Its key elements are a decision-theoretic framework for measuring the utility of a surveillance schedule and an evaluation testbed consisting of 243 scenarios covering a well-defined space of possible missions. We apply this approach to two example UAV-based surveillance methods, a TSP-based algorithm and a human-directed approach, then compare them to identify general strengths, and weaknesses of each method.

Performance Evaluation of Remote Memory Access (RMA) Programming on Shared Memory Parallel Computers

NASA Technical Reports Server (NTRS)

Jin, Hao-Qiang; Jost, Gabriele; Biegel, Bryan A. (Technical Monitor)

2002-01-01

The purpose of this study is to evaluate the feasibility of remote memory access (RMA) programming on shared memory parallel computers. We discuss different RMA based implementations of selected CFD application benchmark kernels and compare them to corresponding message passing based codes. For the message-passing implementation we use MPI point-to-point and global communication routines. For the RMA based approach we consider two different libraries supporting this programming model. One is a shared memory parallelization library (SMPlib) developed at NASA Ames, the other is the MPI-2 extensions to the MPI Standard. We give timing comparisons for the different implementation strategies and discuss the performance.

Evaluation of the performance of existing non-laboratory based cardiovascular risk assessment algorithms

PubMed Central

2013-01-01

Background The high burden and rising incidence of cardiovascular disease (CVD) in resource constrained countries necessitates implementation of robust and pragmatic primary and secondary prevention strategies. Many current CVD management guidelines recommend absolute cardiovascular (CV) risk assessment as a clinically sound guide to preventive and treatment strategies. Development of non-laboratory based cardiovascular risk assessment algorithms enable absolute risk assessment in resource constrained countries. The objective of this review is to evaluate the performance of existing non-laboratory based CV risk assessment algorithms using the benchmarks for clinically useful CV risk assessment algorithms outlined by Cooney and colleagues. Methods A literature search to identify non-laboratory based risk prediction algorithms was performed in MEDLINE, CINAHL, Ovid Premier Nursing Journals Plus, and PubMed databases. The identified algorithms were evaluated using the benchmarks for clinically useful cardiovascular risk assessment algorithms outlined by Cooney and colleagues. Results Five non-laboratory based CV risk assessment algorithms were identified. The Gaziano and Framingham algorithms met the criteria for appropriateness of statistical methods used to derive the algorithms and endpoints. The Swedish Consultation, Framingham and Gaziano algorithms demonstrated good discrimination in derivation datasets. Only the Gaziano algorithm was externally validated where it had optimal discrimination. The Gaziano and WHO algorithms had chart formats which made them simple and user friendly for clinical application. Conclusion Both the Gaziano and Framingham non-laboratory based algorithms met most of the criteria outlined by Cooney and colleagues. External validation of the algorithms in diverse samples is needed to ascertain their performance and applicability to different populations and to enhance clinicians’ confidence in them. PMID:24373202

Validity evidence for the Simulated Colonoscopy Objective Performance Evaluation scoring system.

PubMed

Trinca, Kristen D; Cox, Tiffany C; Pearl, Jonathan P; Ritter, E Matthew

2014-02-01

Low-cost, objective systems to assess and train endoscopy skills are needed. The aim of this study was to evaluate the ability of Simulated Colonoscopy Objective Performance Evaluation to assess the skills required to perform endoscopy. Thirty-eight subjects were included in this study, all of whom performed 4 tasks. The scoring system measured performance by calculating precision and efficiency. Data analysis assessed the relationship between colonoscopy experience and performance on each task and the overall score. Endoscopic trainees' Simulated Colonoscopy Objective Performance Evaluation scores correlated significantly with total colonoscopy experience (r = .61, P = .003) and experience in the past 12 months (r = .63, P = .002). Significant differences were seen among practicing endoscopists, nonendoscopic surgeons, and trainees (P < .0001). When the 4 tasks were analyzed, each showed significant correlation with colonoscopy experience (scope manipulation, r = .44, P = .044; tool targeting, r = .45, P = .04; loop management, r = .47, P = .032; mucosal inspection, r = .65, P = .001) and significant differences in performance between the endoscopist groups, except for mucosal inspection (scope manipulation, P < .0001; tool targeting, P = .002; loop management, P = .0008; mucosal inspection, P = .27). Simulated Colonoscopy Objective Performance Evaluation objectively assesses the technical skills required to perform endoscopy and shows promise as a platform for proficiency-based skills training. Published by Elsevier Inc.

Toward Meaningful Evaluation of Medical Trainees: The Influence of Participants' Perceptions of the Process

ERIC Educational Resources Information Center

Watling, Christopher J.; Lingard, Lorelei

2012-01-01

An essential goal of evaluation is to foster learning. Across the medical education spectrum, evaluation of clinical performance is dominated by subjective feedback to learners based on observation by expert supervisors. Research in non-medical settings has suggested that participants' perceptions of evaluation processes exert considerable…

An EGR performance evaluation and decision-making approach based on grey theory and grey entropy analysis

PubMed Central

2018-01-01

Exhaust gas recirculation (EGR) is one of the main methods of reducing NOX emissions and has been widely used in marine diesel engines. This paper proposes an optimized comprehensive assessment method based on multi-objective grey situation decision theory, grey relation theory and grey entropy analysis to evaluate the performance and optimize rate determination of EGR, which currently lack clear theoretical guidance. First, multi-objective grey situation decision theory is used to establish the initial decision-making model according to the main EGR parameters. The optimal compromise between diesel engine combustion and emission performance is transformed into a decision-making target weight problem. After establishing the initial model and considering the characteristics of EGR under different conditions, an optimized target weight algorithm based on grey relation theory and grey entropy analysis is applied to generate the comprehensive evaluation and decision-making model. Finally, the proposed method is successfully applied to a TBD234V12 turbocharged diesel engine, and the results clearly illustrate the feasibility of the proposed method for providing theoretical support and a reference for further EGR optimization. PMID:29377956

Current concepts in simulation-based trauma education.

PubMed

Cherry, Robert A; Ali, Jameel

2008-11-01

The use of simulation-based technology in trauma education has focused on providing a safe and effective alternative to the more traditional methods that are used to teach technical skills and critical concepts in trauma resuscitation. Trauma team training using simulation-based technology is also being used to develop skills in leadership, team-information sharing, communication, and decision-making. The integration of simulators into medical student curriculum, residency training, and continuing medical education has been strongly recommended by the American College of Surgeons as an innovative means of enhancing patient safety, reducing medical errors, and performing a systematic evaluation of various competencies. Advanced human patient simulators are increasingly being used in trauma as an evaluation tool to assess clinical performance and to teach and reinforce essential knowledge, skills, and abilities. A number of specialty simulators in trauma and critical care have also been designed to meet these educational objectives. Ongoing educational research is still needed to validate long-term retention of knowledge and skills, provide reliable methods to evaluate teaching effectiveness and performance, and to demonstrate improvement in patient safety and overall quality of care.

An EGR performance evaluation and decision-making approach based on grey theory and grey entropy analysis.

PubMed

Zu, Xianghuan; Yang, Chuanlei; Wang, Hechun; Wang, Yinyan

2018-01-01

Exhaust gas recirculation (EGR) is one of the main methods of reducing NOX emissions and has been widely used in marine diesel engines. This paper proposes an optimized comprehensive assessment method based on multi-objective grey situation decision theory, grey relation theory and grey entropy analysis to evaluate the performance and optimize rate determination of EGR, which currently lack clear theoretical guidance. First, multi-objective grey situation decision theory is used to establish the initial decision-making model according to the main EGR parameters. The optimal compromise between diesel engine combustion and emission performance is transformed into a decision-making target weight problem. After establishing the initial model and considering the characteristics of EGR under different conditions, an optimized target weight algorithm based on grey relation theory and grey entropy analysis is applied to generate the comprehensive evaluation and decision-making model. Finally, the proposed method is successfully applied to a TBD234V12 turbocharged diesel engine, and the results clearly illustrate the feasibility of the proposed method for providing theoretical support and a reference for further EGR optimization.

Quality based prequalification of contractors

DOT National Transportation Integrated Search

2001-08-01

This report summarizes the efforts to provide the Kentucky Transportation Cabinet with a system for evaluating the quality of the performance of contractors on highway construction projects and using that evaluation in the Cabinet's annual prequalifi...

Case-based fracture image retrieval.

PubMed

Zhou, Xin; Stern, Richard; Müller, Henning

2012-05-01

Case-based fracture image retrieval can assist surgeons in decisions regarding new cases by supplying visually similar past cases. This tool may guide fracture fixation and management through comparison of long-term outcomes in similar cases. A fracture image database collected over 10 years at the orthopedic service of the University Hospitals of Geneva was used. This database contains 2,690 fracture cases associated with 43 classes (based on the AO/OTA classification). A case-based retrieval engine was developed and evaluated using retrieval precision as a performance metric. Only cases in the same class as the query case are considered as relevant. The scale-invariant feature transform (SIFT) is used for image analysis. Performance evaluation was computed in terms of mean average precision (MAP) and early precision (P10, P30). Retrieval results produced with the GNU image finding tool (GIFT) were used as a baseline. Two sampling strategies were evaluated. One used a dense 40 × 40 pixel grid sampling, and the second one used the standard SIFT features. Based on dense pixel grid sampling, three unsupervised feature selection strategies were introduced to further improve retrieval performance. With dense pixel grid sampling, the image is divided into 1,600 (40 × 40) square blocks. The goal is to emphasize the salient regions (blocks) and ignore irrelevant regions. Regions are considered as important when a high variance of the visual features is found. The first strategy is to calculate the variance of all descriptors on the global database. The second strategy is to calculate the variance of all descriptors for each case. A third strategy is to perform a thumbnail image clustering in a first step and then to calculate the variance for each cluster. Finally, a fusion between a SIFT-based system and GIFT is performed. A first comparison on the selection of sampling strategies using SIFT features shows that dense sampling using a pixel grid (MAP = 0.18) outperformed the SIFT detector-based sampling approach (MAP = 0.10). In a second step, three unsupervised feature selection strategies were evaluated. A grid parameter search is applied to optimize parameters for feature selection and clustering. Results show that using half of the regions (700 or 800) obtains the best performance for all three strategies. Increasing the number of clusters in clustering can also improve the retrieval performance. The SIFT descriptor variance in each case gave the best indication of saliency for the regions (MAP = 0.23), better than the other two strategies (MAP = 0.20 and 0.21). Combining GIFT (MAP = 0.23) and the best SIFT strategy (MAP = 0.23) produced significantly better results (MAP = 0.27) than each system alone. A case-based fracture retrieval engine was developed and is available for online demonstration. SIFT is used to extract local features, and three feature selection strategies were introduced and evaluated. A baseline using the GIFT system was used to evaluate the salient point-based approaches. Without supervised learning, SIFT-based systems with optimized parameters slightly outperformed the GIFT system. A fusion of the two approaches shows that the information contained in the two approaches is complementary. Supervised learning on the feature space is foreseen as the next step of this study.

Evaluation of Deep Learning Based Stereo Matching Methods: from Ground to Aerial Images

NASA Astrophysics Data System (ADS)

Liu, J.; Ji, S.; Zhang, C.; Qin, Z.

2018-05-01

Dense stereo matching has been extensively studied in photogrammetry and computer vision. In this paper we evaluate the application of deep learning based stereo methods, which were raised from 2016 and rapidly spread, on aerial stereos other than ground images that are commonly used in computer vision community. Two popular methods are evaluated. One learns matching cost with a convolutional neural network (known as MC-CNN); the other produces a disparity map in an end-to-end manner by utilizing both geometry and context (known as GC-net). First, we evaluate the performance of the deep learning based methods for aerial stereo images by a direct model reuse. The models pre-trained on KITTI 2012, KITTI 2015 and Driving datasets separately, are directly applied to three aerial datasets. We also give the results of direct training on target aerial datasets. Second, the deep learning based methods are compared to the classic stereo matching method, Semi-Global Matching(SGM), and a photogrammetric software, SURE, on the same aerial datasets. Third, transfer learning strategy is introduced to aerial image matching based on the assumption of a few target samples available for model fine tuning. It experimentally proved that the conventional methods and the deep learning based methods performed similarly, and the latter had greater potential to be explored.

Nonstructural urban stormwater quality measures: building a knowledge base to improve their use.

PubMed

Taylor, André C; Fletcher, Tim D

2007-05-01

This article summarizes a research project that investigated the use, performance, cost, and evaluation of nonstructural measures to improve urban stormwater quality. A survey of urban stormwater managers from Australia, New Zealand, and the United States revealed a widespread trend of increasing use of nonstructural measures among leading stormwater management agencies, with at least 76% of 41 types of nonstructural measures being found to be increasing in use. Data gathered from the survey, an international literature review, and a multicriteria analysis highlighted four nonstructural measures of greatest potential value: mandatory town planning controls that promote the adoption of low-impact development principles and techniques; development of strategic urban stormwater management plans for a city, shire, or catchment; stormwater management measures and programs for construction/building sites; and stormwater management activities related to municipal maintenance operations such as maintenance of the stormwater drainage network and manual litter collections. Knowledge gained on the use and performance of nonstructural measures from the survey, literature review, and three trial evaluation projects was used to develop tailored monitoring and evaluation guidelines for these types of measure. These guidelines incorporate a new evaluation framework based on seven alternative styles of evaluation that range from simply monitoring whether a nonstructural measure has been fully implemented to monitoring its impact on waterway health. This research helps to build the stormwater management industry's knowledge base concerning nonstructural measures and provides a practical tool to address common impediments associated with monitoring and evaluating the performance and cost of these measures.

Utilization of highly robust and selective crosslinked polymeric ionic liquid-based sorbent coatings in direct-immersion solid-phase microextraction and high-performance liquid chromatography for determining polar organic pollutants in waters.

PubMed

Pacheco-Fernández, Idaira; Najafi, Ali; Pino, Verónica; Anderson, Jared L; Ayala, Juan H; Afonso, Ana M

2016-09-01

Several crosslinked polymeric ionic liquid (PIL)-based sorbent coatings of different nature were prepared by UV polymerization onto nitinol wires. They were evaluated in a direct-immersion solid-phase microextraction (DI-SPME) method in combination with high-performance liquid chromatography (HPLC) and diode array detection (DAD). The studied PIL coatings contained either vinyl alkyl or vinylbenzyl imidazolium-based (ViCnIm- or ViBCnIm-) IL monomers with different anions, as well as different dicationic IL crosslinkers. The analytical performance of these PIL-based SPME coatings was firstly evaluated for the extraction of a group of 10 different model analytes, including hydrocarbons and phenols, while exhaustively comparing the performance with commercial SPME fibers such as polydimethylsyloxane (PDMS), polyacrylate (PA) and polydimethylsiloxane/divinylbenzene (PDMS/DVB), and using all fibers under optimized conditions. Those fibers exhibiting a high selectivity for polar compounds were selected to carry out an analytical method for a group of 5 alkylphenols, including bisphenol-A (BPA) and nonylphenol (n-NP). Under optimum conditions, average relative recoveries of 108% and inter-day precision values (3 non-consecutive days) lower than 19% were obtained for a spiked level of 10µgL(-1). Correlations coefficients for the overall method ranged between 0.990 and 0.999, and limits of detection were down to 1µgL(-1). Tap water, river water, and bottled water were analyzed to evaluate matrix effects. Comparison with the PA fiber was also performed in terms of analytical performance. Partition coefficients (logKfs) of the alkylphenols to the SPME coating varied from 1.69 to 2.45 for the most efficient PIL-based fiber, and from 1.58 to 2.30 for the PA fiber. These results agree with those obtained by the normalized calibration slopes, pointing out the affinity of these PILs-based coatings. Copyright © 2016 Elsevier B.V. All rights reserved.

Evaluation of the Performance of Texas Pavements Made with Different Coarse Aggregates

DOT National Transportation Integrated Search

2000-10-01

This report summarizes 23 years of work undertaken in Texas to understand the reasons for significant performance differences found in pavements placed around the state. To a significant degree, pavement performance can be predicted based on the conc...

A modular method for evaluating the performance of picture archiving and communication systems.

PubMed

Sanders, W H; Kant, L A; Kudrimoti, A

1993-08-01

Modeling can be used to predict the performance of picture archiving and communication system (PACS) configurations under various load conditions at an early design stage. This is important because choices made early in the design of a system can have a significant impact on the performance of the resulting implementation. Because PACS consist of many types of components, it is important to do such evaluations in a modular manner, so that alternative configurations and designs can be easily investigated. Stochastic activity networks (SANs) and reduced base model construction methods can aid in doing this. SANs are a model type particularly suited to the evaluation of systems in which several activities may be in progress concurrently, and each activity may affect the others through the results of its completion. Together with SANs, reduced base model construction methods provide a means to build highly modular models, in which models of particular components can be easily reused. In this article, we investigate the use of SANs and reduced base model construction techniques in evaluating PACS. Construction and solution of the models is done using UltraSAN, a graphic-oriented software tool for model specification, analysis, and simulation. The method is illustrated via the evaluation of a realistically sized PACS for a typical United States hospital of 300 to 400 beds, and the derivation of system response times and component utilizations.

Toward the establishment of standardized in vitro tests for lipid-based formulations, part 4: proposing a new lipid formulation performance classification system.

PubMed

Williams, Hywel D; Sassene, Philip; Kleberg, Karen; Calderone, Marilyn; Igonin, Annabel; Jule, Eduardo; Vertommen, Jan; Blundell, Ross; Benameur, Hassan; Müllertz, Anette; Porter, Christopher J H; Pouton, Colin W

2014-08-01

The Lipid Formulation Classification System Consortium looks to develop standardized in vitro tests and to generate much-needed performance criteria for lipid-based formulations (LBFs). This article highlights the value of performing a second, more stressful digestion test to identify LBFs near a performance threshold and to facilitate lead formulation selection in instances where several LBF prototypes perform adequately under standard digestion conditions (but where further discrimination is necessary). Stressed digestion tests can be designed based on an understanding of the factors that affect LBF performance, including the degree of supersaturation generated on dispersion/digestion. Stresses evaluated included decreasing LBF concentration (↓LBF), increasing bile salt, and decreasing pH. Their capacity to stress LBFs was dependent on LBF composition and drug type: ↓LBF was a stressor to medium-chain glyceride-rich LBFs, but not more hydrophilic surfactant-rich LBFs, whereas decreasing pH stressed tolfenamic acid LBFs, but not fenofibrate LBFs. Lastly, a new Performance Classification System, that is, LBF composition independent, is proposed to promote standardized LBF comparisons, encourage robust LBF development, and facilitate dialogue with the regulatory authorities. This classification system is based on the concept that performance evaluations across three in vitro tests, designed to subject a LBF to progressively more challenging conditions, will enable effective LBF discrimination and performance grading. © 2014 Wiley Periodicals, Inc. and the American Pharmacists Association.

Quantitative assessments of municipal waste management systems: using different indicators to compare and rank programs in New York State.

PubMed

Greene, Krista L; Tonjes, David J

2014-04-01

The primary objective of waste management technologies and policies in the United States is to reduce the harmful environmental impacts of waste, particularly those relating to energy consumption and climate change. Performance indicators are frequently used to evaluate the environmental quality of municipal waste systems, as well as to compare and rank programs relative to each other in terms of environmental performance. However, there currently is no consensus on the best indicator for performing these environmental evaluations. The purpose of this study is to examine the common performance indicators used to assess the environmental benefits of municipal waste systems to determine if there is agreement between them regarding which system performs best environmentally. Focus is placed on how indicator selection influences comparisons between municipal waste management programs and subsequent system rankings. The waste systems of ten municipalities in the state of New York, USA, were evaluated using each common performance indicator and Spearman correlations were calculated to see if there was a significant association between system rank orderings. Analyses showed that rank orders of waste systems differ substantially when different indicators are used. Therefore, comparative system assessments based on indicators should be considered carefully, especially those intended to gauge environmental quality. Insight was also gained into specific factors which may lead to one system achieving higher rankings than another. However, despite the insufficiencies of indicators for comparative quality assessments, they do provide important information for waste managers and they can assist in evaluating internal programmatic performance and progress. To enhance these types of assessments, a framework for scoring indicators based on criteria that evaluate their utility and value for system evaluations was developed. This framework was used to construct an improved model for waste system performance assessments. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of Cache-based Superscalar and Cacheless Vector Architectures for Scientific Computations

NASA Technical Reports Server (NTRS)

Oliker, Leonid; Carter, Jonathan; Shalf, John; Skinner, David; Ethier, Stephane; Biswas, Rupak; Djomehri, Jahed; VanderWijngaart, Rob

2003-01-01

The growing gap between sustained and peak performance for scientific applications has become a well-known problem in high performance computing. The recent development of parallel vector systems offers the potential to bridge this gap for a significant number of computational science codes and deliver a substantial increase in computing capabilities. This paper examines the intranode performance of the NEC SX6 vector processor and the cache-based IBM Power3/4 superscalar architectures across a number of key scientific computing areas. First, we present the performance of a microbenchmark suite that examines a full spectrum of low-level machine characteristics. Next, we study the behavior of the NAS Parallel Benchmarks using some simple optimizations. Finally, we evaluate the perfor- mance of several numerical codes from key scientific computing domains. Overall results demonstrate that the SX6 achieves high performance on a large fraction of our application suite and in many cases significantly outperforms the RISC-based architectures. However, certain classes of applications are not easily amenable to vectorization and would likely require extensive reengineering of both algorithm and implementation to utilize the SX6 effectively.

Poem Generator: A Comparative Quantitative Evaluation of a Microworlds-Based Learning Approach for Teaching English

ERIC Educational Resources Information Center

Jenkins, Craig

2015-01-01

This paper is a comparative quantitative evaluation of an approach to teaching poetry in the subject domain of English that employs a "guided discovery" pedagogy using computer-based microworlds. It uses a quasi-experimental design in order to measure performance gains in computational thinking and poetic thinking following a…

Teaching Grocery Store Purchasing Skills to Students with Intellectual Disabilities Using a Computer-Based Instruction Program

ERIC Educational Resources Information Center

Hansen, David L.; Morgan, Robert L.

2008-01-01

This research evaluated effects of a multi-media computer-based instruction (CBI) program designed to teach grocery store purchasing skills to three high-school students with intellectual disabilities. A multiple baseline design across participants used measures of computer performance mastery and grocery store probes to evaluate the CBI. All…

A Survey of Immersive Technology For Maintenance Evaluations

DTIC Science & Technology

1998-04-01

image display system. Based on original work performed at the German National Computer Science and Mathematics Research Institute (GMD), and further...simulations, architectural walk- throughs, medical simulations, general research , entertainment applications and location based entertainment use...simulations. This study was conducted as part of a logistics research and development program Design Evaluation for Personnel, Training, and Human Factors

Developing and Evaluating Gamifying Learning System by Using Flow-Based Model

ERIC Educational Resources Information Center

Su, Chung-Ho; Hsaio, Kai-Chong

2015-01-01

Game-based learning is an effective learning method, whose performance depends on the quality of the educational game. Due to versatile game environments with complex backgrounds, evaluations are not easy to implement. Consequently, it is difficult for educators to determine to what degree a game may be qualified. This study proposes a novel,…

26 CFR 31.3306(c)(10)-2 - Services of student in employ of school, college, or university.

Code of Federal Regulations, 2014 CFR

2014-04-01

... is evaluated based on all the relevant facts and circumstances related to the educational aspect of the relationship. The service aspect of the relationship is evaluated based on all the relevant facts... relationship is not affected by the fact that the services performed by the employee may have an educational...

26 CFR 31.3306(c)(10)-2 - Services of student in employ of school, college, or university.

Code of Federal Regulations, 2012 CFR

2012-04-01

... is evaluated based on all the relevant facts and circumstances related to the educational aspect of the relationship. The service aspect of the relationship is evaluated based on all the relevant facts... relationship is not affected by the fact that the services performed by the employee may have an educational...

26 CFR 31.3306(c)(10)-2 - Services of student in employ of school, college, or university.

Code of Federal Regulations, 2010 CFR

2010-04-01

... is evaluated based on all the relevant facts and circumstances related to the educational aspect of the relationship. The service aspect of the relationship is evaluated based on all the relevant facts... relationship is not affected by the fact that the services performed by the employee may have an educational...

Responsive Evaluation as a Guide to Design and Implementation: Case Study of an E-Health Learning System

ERIC Educational Resources Information Center

Schaffer, Scott P.; Kim, Hannah

2012-01-01

Evaluation of the design and implementation of a web-based e-health application offers an opportunity to apply extensive research findings and evidence-based practices from the learning and performance literature. In this study, we examined how interactions between stakeholders influenced the design, implementation, and outcomes of an e-health…

Is Mathematical Representation of Problems an Evidence-Based Strategy for Students with Mathematics Difficulties?

ERIC Educational Resources Information Center

Jitendra, Asha K.; Nelson, Gena; Pulles, Sandra M.; Kiss, Allyson J.; Houseworth, James

2016-01-01

The purpose of the present review was to evaluate the quality of the research and evidence base for representation of problems as a strategy to enhance the mathematical performance of students with learning disabilities and those at risk for mathematics difficulties. The authors evaluated 25 experimental and quasiexperimental studies according to…

An Evaluation of Test Speededness in an Assessment for Third-Grade Gifted Students

ERIC Educational Resources Information Center

Hailey, Emily; Callahan, Carolyn M.; Azano, Amy; Moon, Tonya R.

2012-01-01

Reliability and validity are integral concepts in assessment design. Test speededness, the influence of time constraints on test taker performance, is often an overlooked threat to reliability and validity, especially in classroom-based testing. The purpose of this study is to evaluate the degree of test speededness of classroom-based assessments…

Importance-performance analysis: an application to Michigan's natural resources

Treesearch

Gloria Sanders; Erin White; Lori Pennington-Gray

2001-01-01

In the state of Michigan, the nature-based tourist is becoming an increasingly important target market for providers of natural resources. To meet the demands of this growing market segment, evaluation strategies for nature-based sites are needed to maintain and improve customer satisfaction and loyalty. Evaluation strategies that incorporate consumer input can help to...

Evaluation of natural language processing systems: Issues and approaches

DOE Office of Scientific and Technical Information (OSTI.GOV)

Guida, G.; Mauri, G.

This paper encompasses two main topics: a broad and general analysis of the issue of performance evaluation of NLP systems and a report on a specific approach developed by the authors and experimented on a sample test case. More precisely, it first presents a brief survey of the major works in the area of NLP systems evaluation. Then, after introducing the notion of the life cycle of an NLP system, it focuses on the concept of performance evaluation and analyzes the scope and the major problems of the investigation. The tools generally used within computer science to assess the qualitymore » of a software system are briefly reviewed, and their applicability to the task of evaluation of NLP systems is discussed. Particular attention is devoted to the concepts of efficiency, correctness, reliability, and adequacy, and how all of them basically fail in capturing the peculiar features of performance evaluation of an NLP system is discussed. Two main approaches to performance evaluation are later introduced; namely, black-box- and model-based, and their most important characteristics are presented. Finally, a specific model for performance evaluation proposed by the authors is illustrated, and the results of an experiment with a sample application are reported. The paper concludes with a discussion on research perspective, open problems, and importance of performance evaluation to industrial applications.« less

Evaluation of DuPont Qualicon Bax System PCR assay for yeast and mold.

PubMed

Wallace, F Morgan; Burns, Frank; Fleck, Lois; Andaloro, Bridget; Farnum, Andrew; Tice, George; Ruebl, Joanne

2010-01-01

Evaluations were conducted to test the performance of the BAX System PCR assay which was certified as Performance Tested Method 010902 for screening yeast and mold in yogurt, corn starch, and milk-based powdered infant formula. Method comparison studies performed on samples with low-level inoculates showed that the BAX System demonstrates a sensitivity equivalent to the U.S. Food and Drug Administration's Bacteriological Analytical Manual culture method, but with a significantly shorter time to obtain results. Tests to evaluate inclusivity and exclusivity returned no false-negative and no false-positive results on a diverse panel of isolates, and tests for lot-to-lot variability and tablet stability demonstrated consistent performance. Ruggedness studies determined that none of the factors examined affected the performance of the assay.

Weatherwise: evaluation of a cue-based training approach for the recognition of deteriorating weather conditions during flight.

PubMed

Wiggins, Mark; O'Hare, David

2003-01-01

Inappropriate and ineffective weather-related decision making continues to account for a significant proportion of general aviation fatalities in the United States and elsewhere. This study details the evaluation of a computer-based training system that was developed to provide visual pilots with the skills necessary to recognize and respond to the cues associated with deteriorating weather conditions during flight. A total of 66 pilots were assigned to one of two groups, and the evaluation process was undertaken at both a self-report and performance level. At the self-report level, the results suggested that pilots were more likely to use the cues following exposure to the training program. From a performance perspective, there is evidence to suggest that cue-based training can improve the timeliness of weather-related decision making during visual flight rules flight. Actual or potential applications of this research include the development of computer-based training systems for fault diagnosis in complex industrial environments.

An Auditory-Masking-Threshold-Based Noise Suppression Algorithm GMMSE-AMT[ERB] for Listeners with Sensorineural Hearing Loss

NASA Astrophysics Data System (ADS)

Natarajan, Ajay; Hansen, John H. L.; Arehart, Kathryn Hoberg; Rossi-Katz, Jessica

2005-12-01

This study describes a new noise suppression scheme for hearing aid applications based on the auditory masking threshold (AMT) in conjunction with a modified generalized minimum mean square error estimator (GMMSE) for individual subjects with hearing loss. The representation of cochlear frequency resolution is achieved in terms of auditory filter equivalent rectangular bandwidths (ERBs). Estimation of AMT and spreading functions for masking are implemented in two ways: with normal auditory thresholds and normal auditory filter bandwidths (GMMSE-AMT[ERB]-NH) and with elevated thresholds and broader auditory filters characteristic of cochlear hearing loss (GMMSE-AMT[ERB]-HI). Evaluation is performed using speech corpora with objective quality measures (segmental SNR, Itakura-Saito), along with formal listener evaluations of speech quality rating and intelligibility. While no measurable changes in intelligibility occurred, evaluations showed quality improvement with both algorithm implementations. However, the customized formulation based on individual hearing losses was similar in performance to the formulation based on the normal auditory system.

Louisiana experimental base project : interim report No. 1.

DOT National Transportation Integrated Search

1979-11-01

The Louisiana Experimental Base Project is a research study evaluating the design/performance characteristics of three types of base courses as incorporated into comparable flexible pavement systems on a full-scale test road. Fourteen different test ...

Neurologic examination and instrument-based measurements in the evaluation of ulnar neuropathy at the elbow.

PubMed

Omejec, Gregor; Podnar, Simon

2018-06-01

The aim of the study was to compare the utility of instrument-based assessment of peripheral nerve function with the neurologic examination in ulnar neuropathy at the elbow (UNE). We prospectively recruited consecutive patients with suspected UNE, performed a neurologic examination, and performed instrument-based measurements (muscle cross-sectional area by ultrasonography, muscle strength by dynamometry, and sensation using monofilaments). We found good correlations between clinical estimates and corresponding instrument-based measurements, with similar ability to diagnose UNE and predict UNE pathophysiology. Although instrument-based methods provide quantitative evaluation of peripheral nerve function, we did not find them to be more sensitive or specific in the diagnosis of UNE than the standard neurologic examination. Likewise, instrument-based methods were not better able to differentiate between groups of UNE patients with different pathophysiologies. Muscle Nerve 57: 951-957, 2018. © 2017 Wiley Periodicals, Inc.

Two Methods of Automatic Evaluation of Speech Signal Enhancement Recorded in the Open-Air MRI Environment

NASA Astrophysics Data System (ADS)

Přibil, Jiří; Přibilová, Anna; Frollo, Ivan

2017-12-01

The paper focuses on two methods of evaluation of successfulness of speech signal enhancement recorded in the open-air magnetic resonance imager during phonation for the 3D human vocal tract modeling. The first approach enables to obtain a comparison based on statistical analysis by ANOVA and hypothesis tests. The second method is based on classification by Gaussian mixture models (GMM). The performed experiments have confirmed that the proposed ANOVA and GMM classifiers for automatic evaluation of the speech quality are functional and produce fully comparable results with the standard evaluation based on the listening test method.

Classifier ensemble construction with rotation forest to improve medical diagnosis performance of machine learning algorithms.

PubMed

Ozcift, Akin; Gulten, Arif

2011-12-01

Improving accuracies of machine learning algorithms is vital in designing high performance computer-aided diagnosis (CADx) systems. Researches have shown that a base classifier performance might be enhanced by ensemble classification strategies. In this study, we construct rotation forest (RF) ensemble classifiers of 30 machine learning algorithms to evaluate their classification performances using Parkinson's, diabetes and heart diseases from literature. While making experiments, first the feature dimension of three datasets is reduced using correlation based feature selection (CFS) algorithm. Second, classification performances of 30 machine learning algorithms are calculated for three datasets. Third, 30 classifier ensembles are constructed based on RF algorithm to assess performances of respective classifiers with the same disease data. All the experiments are carried out with leave-one-out validation strategy and the performances of the 60 algorithms are evaluated using three metrics; classification accuracy (ACC), kappa error (KE) and area under the receiver operating characteristic (ROC) curve (AUC). Base classifiers succeeded 72.15%, 77.52% and 84.43% average accuracies for diabetes, heart and Parkinson's datasets, respectively. As for RF classifier ensembles, they produced average accuracies of 74.47%, 80.49% and 87.13% for respective diseases. RF, a newly proposed classifier ensemble algorithm, might be used to improve accuracy of miscellaneous machine learning algorithms to design advanced CADx systems. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Applicability evaluation of Deep Eutectic Solvents-Cellulase system for lignocellulose hydrolysis.

PubMed

Gunny, Ahmad Anas Nagoor; Arbain, Dachyar; Nashef, Enas Muen; Jamal, Parveen

2015-04-01

Deep Eutectic Solvents (DESs) have recently emerged as a new generation of ionic liquids for lignocellulose pretreatment. However, DESs contain salt components which tend to inactivate cellulase in the subsequent saccharification process. To alleviate this problem, it is necessary to evaluate the applicability of the DESs-Cellulase system. This was accomplished in the present study by first studying the stability of cellulase in the presence of selected DESs followed by applicability evaluation based on glucose production, energy consumption and kinetic performance. Results showed that the cellulase was able to retain more than 90% of its original activity in the presence of 10% (v/v) for glycerol based DES (GLY) and ethylene glycol based DES (EG). Furthermore, both DESs system exhibited higher glucose percentage enhancement and lower energy consumption as compared to diluted alkali system. Among the two DESs studied, EG showed comparatively better kinetic performance. Copyright © 2015 Elsevier Ltd. All rights reserved.

Comparison of Different Methods of Grading a Level Turn Task on a Flight Simulator

NASA Technical Reports Server (NTRS)

Heath, Bruce E.; Crier, tomyka

2003-01-01

With the advancements in the computing power of personal computers, pc-based flight simulators and trainers have opened new avenues in the training of airplane pilots. It may be desirable to have the flight simulator make a quantitative evaluation of the progress of a pilot's training thereby reducing the physical requirement of the flight instructor who must, in turn, watch every flight. In an experiment, University students conducted six different flights, each consisting of two level turns. The flights were three minutes in duration. By evaluating videotapes, two certified flight instructors provided separate letter grades for each turn. These level turns were also evaluated using two other computer based grading methods. One method determined automated grades based on prescribed tolerances in bank angle, airspeed and altitude. The other method used was deviations in altitude and bank angle for performance index and performance grades.

Insight into Evaluation Practice: A Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation-Focused Journals

ERIC Educational Resources Information Center

Christie, Christina A.; Fleischer, Dreolin Nesbitt

2010-01-01

To describe the recent practice of evaluation, specifically method and design choices, the authors performed a content analysis on 117 evaluation studies published in eight North American evaluation-focused journals for a 3-year period (2004-2006). The authors chose this time span because it follows the scientifically based research (SBR)…

A physiologically informed virtual reality based social communication system for individuals with autism.

PubMed

Lahiri, Uttama; Bekele, Esubalew; Dohrmann, Elizabeth; Warren, Zachary; Sarkar, Nilanjan

2015-04-01

Clinical applications of advanced technology may hold promise for addressing impairments associated with autism spectrum disorders (ASD). This project evaluated the application of a novel physiologically responsive virtual reality based technological system for conversation skills in a group of adolescents with ASD. The system altered components of conversation based on (1) performance alone or (2) the composite effect of performance and physiological metrics of predicted engagement (e.g., gaze pattern, pupil dilation, blink rate). Participants showed improved performance and looking pattern within the physiologically sensitive system as compared to the performance based system. This suggests that physiologically informed technologies may have the potential of being an effective tool in the hands of interventionists.

Modeling and evaluating the performance of Brillouin distributed optical fiber sensors.

PubMed

Soto, Marcelo A; Thévenaz, Luc

2013-12-16

A thorough analysis of the key factors impacting on the performance of Brillouin distributed optical fiber sensors is presented. An analytical expression is derived to estimate the error on the determination of the Brillouin peak gain frequency, based for the first time on real experimental conditions. This expression is experimentally validated, and describes how this frequency uncertainty depends on measurement parameters, such as Brillouin gain linewidth, frequency scanning step and signal-to-noise ratio. Based on the model leading to this expression and considering the limitations imposed by nonlinear effects and pump depletion, a figure-of-merit is proposed to fairly compare the performance of Brillouin distributed sensing systems. This figure-of-merit offers to the research community and to potential users the possibility to evaluate with an objective metric the real performance gain resulting from any proposed configuration.

Managing Performance Evaluation Uncertainties in Schools: When Teachers Become Struggling Performers

ERIC Educational Resources Information Center

Englund, Hans; Frostenson, Magnus

2017-01-01

Performative technologies are increasingly relied upon as a means of controlling the work of teachers. As noted in the literature, one possible outcome of this trend is the performer, a teacher identity that presupposes the internalization of, and adaptation to, a performative logic. Based on the findings from an empirical study of a Swedish upper…

A Milestone-Based Evaluation System-The Cure for Grade Inflation?

PubMed

Kuo, Lindsay E; Hoffman, Rebecca L; Morris, Jon B; Williams, Noel N; Malachesky, Mark; Huth, Laura E; Kelz, Rachel R

2015-01-01

Controversy exists over the optimal use of the Milestones in the process of resident evaluation and feedback. We sought to evaluate the performance of a Milestones-based feedback system in comparison to a traditional model. The traditional evaluation system (TES) consisted of a generic 16-item survey using a 5-point Likert scale ranging from 1 to 5, and a free-text comments section. The Milestones-based evaluation system (MBES) was launched in July 2014, ranging from 0 to 4. Individual milestones were mapped to rotations based on resident educational goals by postgraduate year (PGY). The MBES consisted of a survey with a maximum of 7 items, followed by a free-text comment section. Within each evaluation system, an overall composite score was calculated for each categorical general surgical resident. To scale the 2 systems for comparison, TES scores were adjusted downward by 1 point. Descriptive statistics were performed. Univariate analysis was performed with the Wilcoxon signed-rank test. A test for trend across PGY was used for the MBES only. In the traditional system, the median score was 3.66 (range: 3.2-4.0). There was no meaningful difference in the median score by PGY. In the new system, the median score was 2.69 (range: 1.5-3.7, p < 0.01). The median score differed across PGY and increased by PGY of training (p < 0.01). There was an increase in differences between median scores by PGY. On using the milestones to facilitate faculty evaluation of resident knowledge and skill, there was a trend in increasing score by PGY of training. In the MBES, scores could be used to better discriminate resident skill and knowledge levels and resulted in improved differentiation in scoring by PGY. The use of the milestones as a basis for evaluation enabled the program to provide more meaningful feedback to residents and represents an improvement in surgical education. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Evaluation of an S.D.I. System Based on "Nuclear Science Abstracts" and the Performance of Matching by Words in Titles Compared With Indexing Terms.

ERIC Educational Resources Information Center

Olive, G.; And Others

A selective dissemination of information service based on computer scanning of Nuclear Science Abstracts tapes has operated at the Atomic Energy Research Establishment, Harwell, England since October, 1968. The performance of the mechanized SDI service has been compared with that of the pre-existing current awareness service which is based on…

Systematic Evaluation of Professional Performance: Legally Supported Procedure and Process.

ERIC Educational Resources Information Center

Kerl, Stella Beatriz; Garcia, John L.; McCullough, C. Sue; Maxwell, Melissa Elaine

2002-01-01

Legal challenges to counseling students' dismissal that are based on interpersonal or clinical incompetence require sound systematic academic evaluation and adherence to procedural and substantive due process. Presents an examination of professional competency from counselor education and legal perspectives, an evaluation procedure and process,…

Information and complexity measures for hydrologic model evaluation

USDA-ARS?s Scientific Manuscript database

Hydrological models are commonly evaluated through the residual-based performance measures such as the root-mean square error or efficiency criteria. Such measures, however, do not evaluate the degree of similarity of patterns in simulated and measured time series. The objective of this study was to...

Performance and non-destructive evaluation methods of airborne radome and stealth structures

NASA Astrophysics Data System (ADS)

Panwar, Ravi; Ryul Lee, Jung

2018-06-01

In the past few years, great effort has been devoted to the fabrication of highly efficient, broadband radome and stealth (R&S) structures for distinct control, guidance, surveillance and communication applications for airborne platforms. The evaluation of non-planar aircraft R&S structures in terms of their electromagnetic performance and structural damage is still a very challenging task. In this article, distinct measurement techniques are discussed for the electromagnetic performance and non-destructive evaluation (NDE) of R&S structures. This paper deals with an overview of the transmission line method and free space measurement based microwave measurement techniques for the electromagnetic performance evaluation of R&S structures. In addition, various conventional as well as advanced methods, such as millimetre and terahertz wave based imaging techniques with great potential for NDE of load bearing R&S structures, are also discussed in detail. A glimpse of in situ NDE techniques with corresponding experimental setup for R&S structures is also presented. The basic concepts, measurement ranges and their instrumentation, measurement method of different R&S structures and some miscellaneous topics are discussed in detail. Some of the challenges and issues pertaining to the measurement of curved R&S structures are also presented. This study also lists various mathematical models and analytical techniques for the electromagnetic performance evaluation and NDE of R&S structures. The research directions described in this study may be of interest to the scientific community in the aerospace sectors.

Effort-based decision making as an objective paradigm for the assessment of motivational deficits in schizophrenia.

PubMed

Fervaha, Gagan; Duncan, Mark; Foussias, George; Agid, Ofer; Faulkner, Guy E; Remington, Gary

2015-10-01

Negative symptoms and motivational deficits are prevalent features of schizophrenia, and represent robust predictors of real-world functional outcomes. The standard for assessment of these symptoms is clinical interview and severity ratings on standardized rating scales. In the present study we examined the psychometric properties of a performance-based measure of motivational deficits in patients with schizophrenia. Ninety-seven patients with schizophrenia were included in this investigation. Patients' willingness to expend effort for reward (i.e., motivation) was evaluated using an effort-based decision making paradigm where participants chose over a series of trials whether to expend a greater amount of effort for a larger monetary reward versus less effort for a smaller reward. Effort performance was evaluated twice, separated by a two-week interval. Patients with schizophrenia opted to expend greater effort for trials with higher reward value and greater likelihood of reward receipt. Patients did not find the task overly difficult and reported being motivated to perform well, underscoring the tolerability of the task for patients. Test-retest consistency was good and there was only minimal change in scores over time. Effort performance was not related to sociodemographic or clinical variables (e.g., positive symptoms); however, deficit syndrome patients exerted effort for reward at a significantly lower rate than nondeficit patients. The effort-based decision making task used in the present study represents an objective paradigm that can be used to evaluate motivational impairments in patients with schizophrenia. Such performance-based measures of motivation may also serve as viable endpoints in clinical trials. Copyright © 2015 Elsevier B.V. All rights reserved.

On-the-field performance of quintuple-play long-reach OFDM-based WDM-PON optical access networks.

PubMed

Llorente, Roberto; Morant, Maria; Pellicer, Eloy; Herman, Milan; Nagy, Zsolt; Alves, Tiago; Cartaxo, Adolfo; Herrera, Javier; Correcher, Jose; Quinlan, Terence; Walker, Stuart; Rodrigues, Cláudio; Cluzeaud, Pierre; Schmidt, Axel; Piesiewicz, Radoslaw; Sambaraju, Rakesh

2014-03-24

In this paper the on-the-field performance of a WDM-PON optical access providing quintuple-play services using orthogonal frequency division multiplexing (OFDM) modulation is evaluated in a real fiber-to-the-home (FTTH) network deployed by Towercom operator in Bratislava (Slovakia). A bundle of quintuple-play services comprising full-standard OFDM-based signals (LTE, WiMAX, UWB and DVB-T) and an ad-hoc OFDM-GbE signal is transmitted in coexistence per single user. Both downstream and upstream transmission performances are evaluated in different on-the-field long-reach optical link distance configurations. Four wavelength multi-user transmission of quintuple-play OFDM services is demonstrated exceeding 60.8 km reach in standard single mode fiber.

Adjacent bin stability evaluating for feature description

NASA Astrophysics Data System (ADS)

Nie, Dongdong; Ma, Qinyong

2018-04-01

Recent study improves descriptor performance by accumulating stability votes for all scale pairs to compose the local descriptor. We argue that the stability of a bin depends on the differences across adjacent pairs more than the differences across all scale pairs, and a new local descriptor is composed based on the hypothesis. A series of SIFT descriptors are extracted from multiple scales firstly. Then the difference value of the bin across adjacent scales is calculated, and the stability value of a bin is calculated based on it and accumulated to compose the final descriptor. The performance of the proposed method is evaluated with two popular matching datasets, and compared with other state-of-the-art works. Experimental results show that the proposed method performs satisfactorily.

Evaluation of Raman spectroscopy in comparison to commonly performed dengue diagnostic tests

NASA Astrophysics Data System (ADS)

Khan, Saranjam; Ullah, Rahat; Khurram, Muhammad; Ali, Hina; Mahmood, Arshad; Khan, Ajmal; Ahmed, Mushtaq

2016-09-01

This study demonstrates the evaluation of Raman spectroscopy as a rapid diagnostic test in comparison to commonly performed tests for an accurate detection of dengue fever in human blood sera. Blood samples of 104 suspected dengue patients collected from Holy Family Hospital, Rawalpindi, Pakistan, have been used in this study. Out of 104 samples, 52 (50%) were positive based on immunoglobulin G (IgG), whereas 54 (52%) were positive based on immunoglobulin M (IgM) antibody tests. For the determination of the diagnostic capabilities of Raman spectroscopy, accuracy, sensitivity, specificity and false positive rate have been calculated in comparison to normally performed IgM and IgG captured enzyme-linked immunosorbent assay tests. Accuracy, precision, specificity, and sensitivity for Raman spectroscopy in comparison to IgM were found to be 66%, 70%, 72%, and 61%, whereas based on IgG they were 47%, 46%, 52%, and 43%, respectively.

Quality Measures for Dialysis: Time for a Balanced Scorecard

PubMed Central

2016-01-01

Recent federal legislation establishes a merit-based incentive payment system for physicians, with a scorecard for each professional. The Centers for Medicare and Medicaid Services evaluate quality of care with clinical performance measures and have used these metrics for public reporting and payment to dialysis facilities. Similar metrics may be used for the future merit-based incentive payment system. In nephrology, most clinical performance measures measure processes and intermediate outcomes of care. These metrics were developed from population studies of best practice and do not identify opportunities for individualizing care on the basis of patient characteristics and individual goals of treatment. The In-Center Hemodialysis (ICH) Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey examines patients' perception of care and has entered the arena to evaluate quality of care. A balanced scorecard of quality performance should include three elements: population-based best clinical practice, patient perceptions, and individually crafted patient goals of care. PMID:26316622

Wind Energy Conversion System Analysis Model (WECSAM) computer program documentation

NASA Astrophysics Data System (ADS)

Downey, W. T.; Hendrick, P. L.

1982-07-01

Described is a computer-based wind energy conversion system analysis model (WECSAM) developed to predict the technical and economic performance of wind energy conversion systems (WECS). The model is written in CDC FORTRAN V. The version described accesses a data base containing wind resource data, application loads, WECS performance characteristics, utility rates, state taxes, and state subsidies for a six state region (Minnesota, Michigan, Wisconsin, Illinois, Ohio, and Indiana). The model is designed for analysis at the county level. The computer model includes a technical performance module and an economic evaluation module. The modules can be run separately or together. The model can be run for any single user-selected county within the region or looped automatically through all counties within the region. In addition, the model has a restart capability that allows the user to modify any data-base value written to a scratch file prior to the technical or economic evaluation.

Evaluation of Troxler model 3411 nuclear gage.

DOT National Transportation Integrated Search

1978-01-01

The performance of the Troxler Electronics Laboratory Model 3411 nuclear gage was evaluated through laboratory tests on the Department's density and moisture standards and field tests on various soils, base courses, and bituminous concrete overlays t...

12 CFR 1808.500 - Evaluation of Qualified Issuer Applications.

Code of Federal Regulations, 2014 CFR

2014-01-01

... evaluation process will be based on established standard operating procedures, which may include interviews... Qualified Issuer over the life of the Bond to ensure it meets the performance standards over the life of the...

33 CFR 332.5 - Ecological performance standards.

Code of Federal Regulations, 2014 CFR

2014-07-01

... whether the project is achieving its objectives. Performance standards should relate to the objectives of the compensatory mitigation project, so that the project can be objectively evaluated to determine if... objective and verifiable. Ecological performance standards must be based on the best available science that...

33 CFR 332.5 - Ecological performance standards.

Code of Federal Regulations, 2012 CFR

2012-07-01

... whether the project is achieving its objectives. Performance standards should relate to the objectives of the compensatory mitigation project, so that the project can be objectively evaluated to determine if... objective and verifiable. Ecological performance standards must be based on the best available science that...

33 CFR 332.5 - Ecological performance standards.

Code of Federal Regulations, 2013 CFR

2013-07-01

... whether the project is achieving its objectives. Performance standards should relate to the objectives of the compensatory mitigation project, so that the project can be objectively evaluated to determine if... objective and verifiable. Ecological performance standards must be based on the best available science that...

Evaluation of the Performance of Texas Pavements Made with Different Coarse Aggregates: Project Summary Report

DOT National Transportation Integrated Search

1998-09-01

This report summarizes 23 years of work undertaken in Texas to understand the reasons for significant performance differences found in pavements placed around the state. To a significant degree, pavement performance can be predicted based on the conc...

33 CFR 332.5 - Ecological performance standards.

Code of Federal Regulations, 2011 CFR

2011-07-01

... whether the project is achieving its objectives. Performance standards should relate to the objectives of the compensatory mitigation project, so that the project can be objectively evaluated to determine if... objective and verifiable. Ecological performance standards must be based on the best available science that...

Vaccine adverse event text mining system for extracting features from vaccine safety reports.

PubMed

Botsis, Taxiarchis; Buttolph, Thomas; Nguyen, Michael D; Winiecki, Scott; Woo, Emily Jane; Ball, Robert

2012-01-01

To develop and evaluate a text mining system for extracting key clinical features from vaccine adverse event reporting system (VAERS) narratives to aid in the automated review of adverse event reports. Based upon clinical significance to VAERS reviewing physicians, we defined the primary (diagnosis and cause of death) and secondary features (eg, symptoms) for extraction. We built a novel vaccine adverse event text mining (VaeTM) system based on a semantic text mining strategy. The performance of VaeTM was evaluated using a total of 300 VAERS reports in three sequential evaluations of 100 reports each. Moreover, we evaluated the VaeTM contribution to case classification; an information retrieval-based approach was used for the identification of anaphylaxis cases in a set of reports and was compared with two other methods: a dedicated text classifier and an online tool. The performance metrics of VaeTM were text mining metrics: recall, precision and F-measure. We also conducted a qualitative difference analysis and calculated sensitivity and specificity for classification of anaphylaxis cases based on the above three approaches. VaeTM performed best in extracting diagnosis, second level diagnosis, drug, vaccine, and lot number features (lenient F-measure in the third evaluation: 0.897, 0.817, 0.858, 0.874, and 0.914, respectively). In terms of case classification, high sensitivity was achieved (83.1%); this was equal and better compared to the text classifier (83.1%) and the online tool (40.7%), respectively. Our VaeTM implementation of a semantic text mining strategy shows promise in providing accurate and efficient extraction of key features from VAERS narratives.

Handwriting features of children with developmental coordination disorder--results of triangular evaluation.

PubMed

Rosenblum, Sara; Margieh, Jumana Aassy; Engel-Yeger, Batya

2013-11-01

Developmental coordination disorders (DCD) is one of the most common disorders affecting school-aged children. The study aimed to characterize the handwriting performance of children with DCD who write in Arabic, based on triangular evaluation. Participants included 58 children aged 11-12 years, 29 diagnosed with DCD based on the DSM-IV criteria and the M-ABC, and 29 matched typically developed controls. Children were asked to copy a paragraph on a sheet of paper affixed to a digitizer supplying objective measures of the handwriting process. The handwriting proficiency screening questionnaire (HPSQ) was completed by their teachers while observing their performance and followed by evaluation of their final written product. Results indicated that compared to controls, children with DCD required significantly more on-paper and in-air time per stroke while copying. In addition, global legibility, unrecognizable letters and spatial arrangement measures of their written product were significantly inferior. Significant group differences were also found between the HPSQ subscales scores. Furthermore, 82.8% of all participants were correctly classified into groups based on one discriminate function which included two handwriting performance measures. These study results strongly propose application of triangular standardized evaluation to receive better insight of handwriting deficit features of individual children with DCD who write in Arabic. Copyright © 2013 Elsevier Ltd. All rights reserved.

Evaluation of a cardiopulmonary resuscitation curriculum in a low resource environment.

PubMed

Chang, Mary P; Lyon, Camila B; Janiszewski, David; Aksamit, Deborah; Kateh, Francis; Sampson, John

2015-11-07

To evaluate whether a 2-day International Liaison Committee on Resuscitation (ILCOR) Universal Algorithm-based curriculum taught in a tertiary care hospital in Liberia increases local health care provider knowledge and skill comfort level. A combined basic and advanced cardiopulmonary resuscitation (CPR) curriculum was developed for low-resource settings that included lectures and low-fidelity manikin-based simulations. In March 2014, the curriculum was taught to healthcare providers in a tertiary care hospital in Liberia. In a quality assurance review, participants were evaluated for knowledge and comfort levels with resuscitation before and after the workshop. They were also videotaped during simulation sessions and evaluated on standardized performance metrics. Fifty-two hospital staff completed both pre-and post-curriculum surveys. The median score was 45% pre-curriculum and 82% post-curriculum (p<0.00001). The median provider comfort level score was 4 of 5 pre-curriculum and 5 of 5 post-curriculum (p<0.00001). During simulations, 93.2% of participants performed the pulse check within 10 seconds, and 97.7% performed defibrillation within 180 seconds. Clinician knowledge of and comfort level with CPR increased significantly after participating in our curriculum. A CPR curriculum based on lectures and low-fidelity manikin simulations may be an effective way to teach resuscitation in this low-resource setting.

Training of Healthcare Personnel to Improve Performance of Community-Based Antenatal Care Program

ERIC Educational Resources Information Center

Ohnishi, Mayumi; Nakamura, Keiko; Takano, Takehito

2007-01-01

Background: The present study was performed to evaluate the effectiveness of a training course designed to improve the knowledge, skills, and attitudes of healthcare personnel to allow them to provide a comprehensive community-based antenatal care (ANC) program in rural Paraguay. Methods: Sixty-eight of 110 healthcare personnel in the Caazapa…

Faustmann and the forestry tradition of outcome-based performance measures

Treesearch

Peter J. Ince

1999-01-01

The concept of land expectation value developed by Martin Faustmann may serve as a paradigm for outcome-based performance measures in public forest management if the concept of forest equity value is broadened to include social and environmental benefits and costs, and sustainability. However, anticipation and accurate evaluation of all benefits and costs appears to...

The Influences of Physical Attractiveness and Sex-Based Biases on Midshipman Performance Evaluations at the United States Naval Academy

DTIC Science & Technology

2004-06-01

Meyer - 54 55 Olkin (KMO) and Bartlett’s test yielded a KMO measure of sampling adequacy of .683. Based on a rotated factor matrix, two factors were...factor analysis was performed on the first four questionnaire items (concern for success, effectiveness, friendliness, and sociability). A Kaiser

Socioeconomic Patterns and Educational Performance Based on Language-of-Instruction Models in the Basque Autonomous Community

ERIC Educational Resources Information Center

Elosua, Paula; Egaña, Maria

2017-01-01

One of the focuses of language revitalisation policies is to incorporate minority languages into education. Evaluation of new language-of-instruction models is usually based on the increase of minority language speakers. However, it is also important from an educational perspective to study the possible relationship between performance and…

Development of a Criterion-Referenced, Performance-Based Assessment of Reading Comprehension in a Whole Literacy Program.

ERIC Educational Resources Information Center

Tibbetts, Katherine A.; And Others

This paper describes the development of a criterion-referenced, performance-based measure of third grade reading comprehension. The primary purpose of the assessment is to contribute unique and valid information for use in the formative evaluation of a whole literacy program. A secondary purpose is to supplement other program efforts to…

Wavelet-Based Visible and Infrared Image Fusion: A Comparative Study

PubMed Central

Sappa, Angel D.; Carvajal, Juan A.; Aguilera, Cristhian A.; Oliveira, Miguel; Romero, Dennis; Vintimilla, Boris X.

2016-01-01

This paper evaluates different wavelet-based cross-spectral image fusion strategies adopted to merge visible and infrared images. The objective is to find the best setup independently of the evaluation metric used to measure the performance. Quantitative performance results are obtained with state of the art approaches together with adaptations proposed in the current work. The options evaluated in the current work result from the combination of different setups in the wavelet image decomposition stage together with different fusion strategies for the final merging stage that generates the resulting representation. Most of the approaches evaluate results according to the application for which they are intended for. Sometimes a human observer is selected to judge the quality of the obtained results. In the current work, quantitative values are considered in order to find correlations between setups and performance of obtained results; these correlations can be used to define a criteria for selecting the best fusion strategy for a given pair of cross-spectral images. The whole procedure is evaluated with a large set of correctly registered visible and infrared image pairs, including both Near InfraRed (NIR) and Long Wave InfraRed (LWIR). PMID:27294938

Northwestern University Flexible Subischial Vacuum Socket for persons with transfemoral amputation: Part 2 Description and Preliminary evaluation.

PubMed

Fatone, Stefania; Caldwell, Ryan

2017-06-01

Current transfemoral prosthetic sockets are problematic as they restrict function, lack comfort, and cause residual limb problems. Development of a subischial socket with lower proximal trim lines is an appealing way to address this problem and may contribute to improving quality of life of persons with transfemoral amputation. The purpose of this study was to illustrate the use of a new subischial socket in two subjects. Case series. Two unilateral transfemoral prosthesis users participated in preliminary socket evaluations comparing functional performance of the new subischial socket to ischial containment sockets. Testing included gait analysis, socket comfort score, and performance-based clinical outcome measures (Rapid-Sit-To-Stand, Four-Square-Step-Test, and Agility T-Test). For both subjects, comfort was better in the subischial socket, while gait and clinical outcomes were generally comparable between sockets. While these evaluations are promising regarding the ability to function in this new socket design, more definitive evaluation is needed. Clinical relevance Using gait analysis, socket comfort score and performance-based outcome measures, use of the Northwestern University Flexible Subischial Vaccum Socket was evaluated in two transfemoral prosthesis users. Socket comfort improved for both subjects with comparable function compared to ischial containment sockets.

Wavelet-Based Visible and Infrared Image Fusion: A Comparative Study.

PubMed

Sappa, Angel D; Carvajal, Juan A; Aguilera, Cristhian A; Oliveira, Miguel; Romero, Dennis; Vintimilla, Boris X

2016-06-10

This paper evaluates different wavelet-based cross-spectral image fusion strategies adopted to merge visible and infrared images. The objective is to find the best setup independently of the evaluation metric used to measure the performance. Quantitative performance results are obtained with state of the art approaches together with adaptations proposed in the current work. The options evaluated in the current work result from the combination of different setups in the wavelet image decomposition stage together with different fusion strategies for the final merging stage that generates the resulting representation. Most of the approaches evaluate results according to the application for which they are intended for. Sometimes a human observer is selected to judge the quality of the obtained results. In the current work, quantitative values are considered in order to find correlations between setups and performance of obtained results; these correlations can be used to define a criteria for selecting the best fusion strategy for a given pair of cross-spectral images. The whole procedure is evaluated with a large set of correctly registered visible and infrared image pairs, including both Near InfraRed (NIR) and Long Wave InfraRed (LWIR).

DSS range delay calibrations: Current performance level

NASA Technical Reports Server (NTRS)

Spradlin, G. L.

1976-01-01

A means for evaluating Deep Space Station (DSS) range delay calibration performance was developed. Inconsistencies frequently noted in these data are resolved. Development of the DSS range delay data base is described. The data base is presented with comments regarding apparent discontinuities. Data regarding the exciter frequency dependence of the delay values are presented. The improvement observed in the consistency of current DSS range delay calibration data over the performance previously observed is noted.

Dynamic online peer evaluations to improve group assignments in nursing e-learning environment.

PubMed

Adwan, Jehad

2016-06-01

The purpose of this research was to evaluate the use of online peer evaluation forms for online group activities in improving group project outcomes. The investigator developed and used a web-based Google Forms® self and peer evaluation form of 2 group assignments' rubric for junior and senior nursing students. The form covered elements of the assignments including: research activity, analysis of the literature, writing of report, participation in making of presentation, overall contribution to the project, and participation in the weekly group discussions. Items were rated from 1 (did not contribute) to 5 (outstanding contribution) in addition to NA when one activity did not apply. The self and peer evaluation process was conducted twice: once after group assignment 1 and once after group assignment 2. The group assignments final products were done in the form of VoiceThread online presentations that were shared with the rest of the class reflecting the groups' work on a health informatics topic of interest. Data collected as the students completed self and peer evaluations for group assignments 1 and 2. Also, optional comments regarding member performance were collected to add contextual information in addition to ratings. Students received credit for completing the peer evaluations and the grade for the particular assignment was affected by their performance based on peer evaluations of their contributions. Students' peer evaluations showed in a color-coded spreadsheet which enabled the course faculty to view real time results of students' ratings after each assignment. The faculty provided timely and tailored feedback to groups or individuals as needed, using positive feedback and commending high performance while urging struggling individual students and groups to improve lower ratings in specific areas. Comparing evaluations of both assignments, there were statistically significant improvements among all students. The mean scores of the entire sample were skewed toward the higher end of the scale, suggesting an overall high performance group. However, analysis of the lower performing individuals showed consistent and statistically significant improvements in all areas of the evaluation criteria. Anonymous peer evaluation activities and timely faculty feedback in e-Learning environment can be a useful tool to faculty to improve group performance over time by engaging the learners within their groups. Peer evaluations provided real time view of group mid-semester formative evaluations that allowed the faculty to provide timely and tailored feedback on student performance which allowed for better outcomes. Copyright © 2016 Elsevier Ltd. All rights reserved.

Information and problem report usage in system saftey engineering division

NASA Technical Reports Server (NTRS)

Morrissey, Stephen J.

1990-01-01

Five basic problems or question areas are examined. They are as follows: (1) Evaluate adequacy of current problem/performance data base; (2) Evaluate methods of performing trend analysis; (3) Methods and sources of data for probabilistic risk assessment; and (4) How is risk assessment documentation upgraded and/or updated. The fifth problem was to provide recommendations for each of the above four areas.

Exploring Instructional Coaches' Attitudes and Use of the DataCapture Mobile Application to Collect Video-Based Evidence in Teacher Evaluation

ERIC Educational Resources Information Center

Shewell, Justin Reed

2013-01-01

An integral part of teacher development are teacher observations. Many teachers are observed once or twice a year to evaluate their performance and hold them accountable for meeting standards. Instructional coaches, however, observe and work with teachers to help them reflect on their performance, with the goal of improving their practice.…

Evaluating the Impact of Performance Funding in Ohio and Tennessee

ERIC Educational Resources Information Center

Hillman, Nicholas W.; Hicklin Fryar, Alisa; Crespín-Trujillo, Valerie

2018-01-01

Today, 35 states use performance-based funding models tying appropriations directly to educational outcomes. Financial incentives should induce colleges to improve performance, but there are several well-documented reasons why this is unlikely to occur. We examine how two of the most robust performance funding states--Tennessee and Ohio--responded…

WWC Review of the Report "Incentives, Selection, and Teacher Performance: Evidence from IMPACT." What Works Clearinghouse Single Study Review

ERIC Educational Resources Information Center

What Works Clearinghouse, 2014

2014-01-01

The 2013 study, "Incentives, Selection, and Teacher Performance: Evidence from IMPACT" examined the effects of "IMPACT," a teacher evaluation system used in the District of Columbia Public Schools, on teacher retention and performance. "IMPACT" assigns each teacher a single performance score based on classroom…

Flat-Plate Solar-Collector Performance Evaluation with a Solar Simulator as a Basis for Collector Selection and Performance Prediction

NASA Technical Reports Server (NTRS)

Simon, F. F.

1975-01-01

The use of a solar simulator for performance determination permits collector testing under standard conditions of wind, ambient temperature, flow rate and sun. The performance results determined with the simulator have been found to be in good agreement with outdoor performance results. The measured thermal efficiency and evaluation of 23 collectors are reported which differ according to absorber material (copper, aluminum, steel), absorber coating (nonselective black paint, selective copper oxide, selective black nickel, selective black chrome), type of glazing material (glass, Tedlar, Lexan, antireflection glass), the use of honeycomb material and the use of vacuum to prevent thermal convection losses. The collectors were given performance rankings based on noon-hour solar conditions and all-day solar conditions. The determination with the simulator of an all-day collector performance was made possible by tests at different incident angles. The solar performance rankings were made based on whether the collector is to be used for pool heating, hot water, absorption air conditioning, heating, or for a solar Rankine machine.

Quantitative comparison of randomization designs in sequential clinical trials based on treatment balance and allocation randomness.

PubMed

Zhao, Wenle; Weng, Yanqiu; Wu, Qi; Palesch, Yuko

2012-01-01

To evaluate the performance of randomization designs under various parameter settings and trial sample sizes, and identify optimal designs with respect to both treatment imbalance and allocation randomness, we evaluate 260 design scenarios from 14 randomization designs under 15 sample sizes range from 10 to 300, using three measures for imbalance and three measures for randomness. The maximum absolute imbalance and the correct guess (CG) probability are selected to assess the trade-off performance of each randomization design. As measured by the maximum absolute imbalance and the CG probability, we found that performances of the 14 randomization designs are located in a closed region with the upper boundary (worst case) given by Efron's biased coin design (BCD) and the lower boundary (best case) from the Soares and Wu's big stick design (BSD). Designs close to the lower boundary provide a smaller imbalance and a higher randomness than designs close to the upper boundary. Our research suggested that optimization of randomization design is possible based on quantified evaluation of imbalance and randomness. Based on the maximum imbalance and CG probability, the BSD, Chen's biased coin design with imbalance tolerance method, and Chen's Ehrenfest urn design perform better than popularly used permuted block design, EBCD, and Wei's urn design. Copyright © 2011 John Wiley & Sons, Ltd.

Evaluation of exercise capacity after severe stroke using robotics-assisted treadmill exercise: a proof-of-concept study.

PubMed

Stoller, O; de Bruin, E D; Schindelholz, M; Schuster, C; de Bie, R A; Hunt, K J

2013-01-01

Robotics-assisted treadmill exercise (RATE) with focus on motor recovery has become popular in early post-stroke rehabilitation but low endurance for exercise is highly prevalent in these individuals. This study aimed to develop an exercise testing method using robotics-assisted treadmill exercise to evaluate aerobic capacity after severe stroke. Constant load testing (CLT) based on body weight support (BWS) control, and incremental exercise testing (IET) based on guidance force (GF) control were implemented during RATE. Analyses focussed on step change, step response kinetics, and peak performance parameters of oxygen uptake. Three subjects with severe motor impairment 16-23 days post-stroke were included. CLT yielded reasonable step change values in oxygen uptake, whereas response kinetics of oxygen uptake showed low goodness of fit. Peak performance parameters were not obtained during IET. Exercise testing in post-stroke individuals with severe motor impairments using a BWS control strategy for CLT is deemed feasible and safe. Our approach yielded reasonable results regarding cardiovascular performance parameters. IET based on GF control does not provoke peak cardiovascular performance due to uncoordinated walking patterns. GF control needs further development to optimally demand active participation during RATE. The findings warrant further research regarding the evaluation of exercise capacity after severe stroke.

Apollo experience report: Communications system flight evaluation and verification

NASA Technical Reports Server (NTRS)

Travis, D.; Royston, C. L., Jr.

1972-01-01

Flight tests of the synergetic operation of the spacecraft and earth based communications equipment were accomplished during Apollo missions AS-202 through Apollo 12. The primary goals of these tests were to verify that the communications system would adequately support lunar landing missions and to establish the inflight communications system performance characteristics. To attain these goals, a communications system flight verification and evaluation team was established. The concept of the team operations, the evolution of the evaluation processes, synopses of the team activities associated with each mission, and major conclusions and recommendations resulting from the performance evaluation are represented.

Bio-based renewable additives for anti-icing applications (phase one).

DOT National Transportation Integrated Search

2016-09-04

The performance and impacts of several bio-based anti-icers along with a traditional chloride-based anti-icer (salt brine) were evaluated. : A statistical design of experiments (uniform design) was employed for developing anti-icing liquids consistin...

Tuning HDF5 subfiling performance on parallel file systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Byna, Suren; Chaarawi, Mohamad; Koziol, Quincey

Subfiling is a technique used on parallel file systems to reduce locking and contention issues when multiple compute nodes interact with the same storage target node. Subfiling provides a compromise between the single shared file approach that instigates the lock contention problems on parallel file systems and having one file per process, which results in generating a massive and unmanageable number of files. In this paper, we evaluate and tune the performance of recently implemented subfiling feature in HDF5. In specific, we explain the implementation strategy of subfiling feature in HDF5, provide examples of using the feature, and evaluate andmore » tune parallel I/O performance of this feature with parallel file systems of the Cray XC40 system at NERSC (Cori) that include a burst buffer storage and a Lustre disk-based storage. We also evaluate I/O performance on the Cray XC30 system, Edison, at NERSC. Our results show performance benefits of 1.2X to 6X performance advantage with subfiling compared to writing a single shared HDF5 file. We present our exploration of configurations, such as the number of subfiles and the number of Lustre storage targets to storing files, as optimization parameters to obtain superior I/O performance. Based on this exploration, we discuss recommendations for achieving good I/O performance as well as limitations with using the subfiling feature.« less

Design and test of an automated version of the modified Jebsen test of hand function using Microsoft Kinect.

PubMed

Simonsen, Daniel; Nielsen, Ida F; Spaich, Erika G; Andersen, Ole K

2017-05-02

The present paper describes the design and evaluation of an automated version of the Modified Jebsen Test of Hand Function (MJT) based on the Microsoft Kinect sensor. The MJT was administered twice to 11 chronic stroke subjects with varying degrees of hand function deficits. The test times of the MJT were evaluated manually by a therapist using a stopwatch, and automatically using the Microsoft Kinect sensor. The ground truth times were assessed based on inspection of the video-recordings. The agreement between the methods was evaluated along with the test-retest performance. The results from Bland-Altman analysis showed better agreement between the ground truth times and the automatic MJT time evaluations compared to the agreement between the ground truth times and the times estimated by the therapist. The results from the test-retest performance showed that the subjects significantly improved their performance in several subtests of the MJT, indicating a practice effect. The results from the test showed that the Kinect can be used for automating the MJT.

A novel hybrid MCDM model for performance evaluation of research and technology organizations based on BSC approach.

PubMed

Varmazyar, Mohsen; Dehghanbaghi, Maryam; Afkhami, Mehdi

2016-10-01

Balanced Scorecard (BSC) is a strategic evaluation tool using both financial and non-financial indicators to determine the business performance of organizations or companies. In this paper, a new integrated approach based on the Balanced Scorecard (BSC) and multi-criteria decision making (MCDM) methods are proposed to evaluate the performance of research centers of research and technology organization (RTO) in Iran. Decision-Making Trial and Evaluation Laboratory (DEMATEL) are employed to reflect the interdependencies among BSC perspectives. Then, Analytic Network Process (ANP) is utilized to weight the indices influencing the considered problem. In the next step, we apply four MCDM methods including Additive Ratio Assessment (ARAS), Complex Proportional Assessment (COPRAS), Multi-Objective Optimization by Ratio Analysis (MOORA), and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) for ranking of alternatives. Finally, the utility interval technique is applied to combine the ranking results of MCDM methods. Weighted utility intervals are computed by constructing a correlation matrix between the ranking methods. A real case is presented to show the efficacy of the proposed approach. Copyright © 2016 Elsevier Ltd. All rights reserved.

A knowledge based search tool for performance measures in health care systems.

PubMed

Beyan, Oya D; Baykal, Nazife

2012-02-01

Performance measurement is vital for improving the health care systems. However, we are still far from having accepted performance measurement models. Researchers and developers are seeking comparable performance indicators. We developed an intelligent search tool to identify appropriate measures for specific requirements by matching diverse care settings. We reviewed the literature and analyzed 229 performance measurement studies published after 2000. These studies are evaluated with an original theoretical framework and stored in the database. A semantic network is designed for representing domain knowledge and supporting reasoning. We have applied knowledge based decision support techniques to cope with uncertainty problems. As a result we designed a tool which simplifies the performance indicator search process and provides most relevant indicators by employing knowledge based systems.

An enhanced performance through agent-based secure approach for mobile ad hoc networks

NASA Astrophysics Data System (ADS)

Bisen, Dhananjay; Sharma, Sanjeev

2018-01-01

This paper proposes an agent-based secure enhanced performance approach (AB-SEP) for mobile ad hoc network. In this approach, agent nodes are selected through optimal node reliability as a factor. This factor is calculated on the basis of node performance features such as degree difference, normalised distance value, energy level, mobility and optimal hello interval of node. After selection of agent nodes, a procedure of malicious behaviour detection is performed using fuzzy-based secure architecture (FBSA). To evaluate the performance of the proposed approach, comparative analysis is done with conventional schemes using performance parameters such as packet delivery ratio, throughput, total packet forwarding, network overhead, end-to-end delay and percentage of malicious detection.

Development of the performance confirmation program at YUCCA mountain, nevada

USGS Publications Warehouse

LeCain, G.D.; Barr, D.; Weaver, D.; Snell, R.; Goodin, S.W.; Hansen, F.D.

2006-01-01

The Yucca Mountain Performance Confirmation program consists of tests, monitoring activities, experiments, and analyses to evaluate the adequacy of assumptions, data, and analyses that form the basis of the conceptual and numerical models of flow and transport associated with a proposed radioactive waste repository at Yucca Mountain, Nevada. The Performance Confirmation program uses an eight-stage risk-informed, performance-based approach. Selection of the Performance Confirmation activities for inclusion in the Performance Confirmation program was done using a risk-informed performance-based decision analysis. The result of this analysis was a Performance Confirmation base portfolio that consists of 20 activities. The 20 Performance Confirmation activities include geologic, hydrologie, and construction/engineering testing. Some of the activities began during site characterization, and others will begin during construction, or post emplacement, and continue until repository closure.

Did you have an impact? A theory-based method for planning and evaluating knowledge-transfer and exchange activities in occupational health and safety.

PubMed

Kramer, Desré M; Wells, Richard P; Carlan, Nicolette; Aversa, Theresa; Bigelow, Philip P; Dixon, Shane M; McMillan, Keith

2013-01-01

Few evaluation tools are available to assess knowledge-transfer and exchange interventions. The objective of this paper is to develop and demonstrate a theory-based knowledge-transfer and exchange method of evaluation (KEME) that synthesizes 3 theoretical frameworks: the promoting action on research implementation of health services (PARiHS) model, the transtheoretical model of change, and a model of knowledge use. It proposes a new term, keme, to mean a unit of evidence-based transferable knowledge. The usefulness of the evaluation method is demonstrated with 4 occupational health and safety knowledge transfer and exchange (KTE) implementation case studies that are based upon the analysis of over 50 pre-existing interviews. The usefulness of the evaluation model has enabled us to better understand stakeholder feedback, frame our interpretation, and perform a more comprehensive evaluation of the knowledge use outcomes of our KTE efforts.

The Role of Performance Quality in Adolescents' Self-Evaluation and Rumination after a Speech: Is it Contingent on Social Anxiety Level?

PubMed

Blöte, Anke W; Miers, Anne C; Van den Bos, Esther; Westenberg, P Michiel

2018-05-17

Cognitive behavioural therapy (CBT) has relatively poor outcomes for youth with social anxiety, possibly because broad-based CBT is not tailored to their specific needs. Treatment of social anxiety in youth may need to pay more attention to negative social cognitions that are considered a key factor in social anxiety development and maintenance. The aim of the present study was to learn more about the role of performance quality in adolescents' cognitions about their social performance and, in particular, the moderating role social anxiety plays in the relationship between performance quality and self-cognitions. A community sample of 229 participants, aged 11 to 18 years, gave a speech and filled in questionnaires addressing social anxiety, depression, expected and self-evaluated performance, and post-event rumination. Independent observers rated the quality of the speech. The data were analysed using moderated mediation analysis. Performance quality mediated the link between expected and self-evaluated performance in adolescents with low and medium levels of social anxiety. For adolescents with high levels of social anxiety, only a direct link between expected and self-evaluated performance was found. Their self-evaluation was not related to the quality of their performance. Performance quality also mediated the link between expected performance and rumination, but social anxiety did not moderate this mediation effect. Results suggest that a good performance does not help socially anxious adolescents to replace their negative self-evaluations with more realistic ones. Specific cognitive intervention strategies should be tailored to the needs of socially anxious adolescents who perform well.

A comparison of performance of several artificial intelligence methods for forecasting monthly discharge time series

NASA Astrophysics Data System (ADS)

Wang, Wen-Chuan; Chau, Kwok-Wing; Cheng, Chun-Tian; Qiu, Lin

2009-08-01

SummaryDeveloping a hydrological forecasting model based on past records is crucial to effective hydropower reservoir management and scheduling. Traditionally, time series analysis and modeling is used for building mathematical models to generate hydrologic records in hydrology and water resources. Artificial intelligence (AI), as a branch of computer science, is capable of analyzing long-series and large-scale hydrological data. In recent years, it is one of front issues to apply AI technology to the hydrological forecasting modeling. In this paper, autoregressive moving-average (ARMA) models, artificial neural networks (ANNs) approaches, adaptive neural-based fuzzy inference system (ANFIS) techniques, genetic programming (GP) models and support vector machine (SVM) method are examined using the long-term observations of monthly river flow discharges. The four quantitative standard statistical performance evaluation measures, the coefficient of correlation ( R), Nash-Sutcliffe efficiency coefficient ( E), root mean squared error (RMSE), mean absolute percentage error (MAPE), are employed to evaluate the performances of various models developed. Two case study river sites are also provided to illustrate their respective performances. The results indicate that the best performance can be obtained by ANFIS, GP and SVM, in terms of different evaluation criteria during the training and validation phases.

Performance evaluation of restaurant food waste and biowaste to biogas pilot projects in China and implications for national policy.

PubMed

De Clercq, Djavan; Wen, Zongguo; Fan, Fei

2017-03-15

The objective of this research was to conduct a performance evaluation of three food waste/biowaste-to-biogas pilot projects across 7 scenarios in China based on multi-criteria decision analysis (MCDA) methodology. The projects ranked included a food waste-biogas project in Beijing, a food waste-biogas project in Suzhou and a co-digestion project producing biomethane in Hainan. The projects were ranked from best to worst based on technical, economic and environmental criteria under the MCDA framework. The results demonstrated that some projects are encountering operational problems. Based on these findings, six national policy recommendations were provided: (1) shift away from capital investment subsidies to performance-based subsidies; (2) re-design feed in tariffs; (3) promote bio-methane and project clustering; (4) improve collection efficiency by incentivizing FW producers to direct waste to biogas projects; (5) incentivize biogas projects to produce multiple outputs; (6) incentivize food waste-based projects to co-digest food waste with other substrates for higher gas output. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of Application Accuracy and Performance of a Hydraulically Operated Variable-Rate Aerial Application System

USDA-ARS?s Scientific Manuscript database

An aerial variable-rate application system consisting of a DGPS-based guidance system, automatic flow controller, and hydraulically controlled pump/valve was evaluated for response time to rapidly changing flow requirements and accuracy of application. Spray deposition position error was evaluated ...

Merit Pay and Faculty Evaluation.

ERIC Educational Resources Information Center

Hudgins, James L.

A program linking merit pay and faculty evaluation was initiated at Sumter Area Technical College (SATC) in Sumter, South Carolina, in 1978. The performance-based evaluation system focuses on three elements: the job description, which identifies professional responsibilities and how they relate to the college's mission; the individual action plan;…