48 CFR 236.201 - Evaluation of contractor performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

... CONTRACTS Special Aspects of Contracting for Construction 236.201 Evaluation of contractor performance. (a) Preparation of performance evaluation reports. Use DD Form 2626, Performance Evaluation (Construction... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Evaluation of contractor...

48 CFR 2936.604 - Performance evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor performance as required in FAR 36.604. Normally, the performance report must be prepared by the contracting...

48 CFR 2936.604 - Performance evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 7 2011-10-01 2011-10-01 false Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor performance as required in FAR 36.604. Normally, the performance report must be prepared by the contracting...

48 CFR 2936.604 - Performance evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 48 Federal Acquisition Regulations System 7 2014-10-01 2014-10-01 false Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor performance as required in FAR 36.604. Normally, the performance report must be prepared by the contracting...

48 CFR 2936.604 - Performance evaluation.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 48 Federal Acquisition Regulations System 7 2012-10-01 2012-10-01 false Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor performance as required in FAR 36.604. Normally, the performance report must be prepared by the contracting...

48 CFR 2936.604 - Performance evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 48 Federal Acquisition Regulations System 7 2013-10-01 2012-10-01 true Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor performance as required in FAR 36.604. Normally, the performance report must be prepared by the contracting...

Formative and Summative Evaluation: Related Issues in Performance Measurement.

ERIC Educational Resources Information Center

Wholey, Joseph S.

1996-01-01

Performance measurement can serve both formative and summative evaluation functions. Formative evaluation is typically more useful for government purposes whereas performance measurement is more useful than one-shot evaluations of either formative or summative nature. Evaluators should study performance measurement through case studies and…

48 CFR 3052.216-72 - Performance evaluation plan.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Performance evaluation... CONTRACT CLAUSES Text of Provisions and Clauses 3052.216-72 Performance evaluation plan. As prescribed in... Evaluation Plan (DEC 2003) (a) A Performance Evaluation Plan shall be unilaterally established by the...

76 FR 21851 - Defense Federal Acquisition Regulation Supplement; Construction and Architect-Engineer Services...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-04-19

... data on DD Form 2626, Performance Evaluation (Construction), and DD Form 2631, Performance Evaluation...(e) for the requirements for preparing past performance evaluations. The objective of this rule is to remove the requirement to use DD Forms 2626, Performance Evaluation (Construction), and 2631, Performance...

Effectiveness of the Marine Corps’ Junior Enlisted Performance Evaluation System: An Evaluation of Proficiency and Conduct Marks

DTIC Science & Technology

2017-03-01

THE MARINE CORPS’ JUNIOR ENLISTED PERFORMANCE EVALUATION SYSTEM: AN EVALUATION OF PROFICIENCY AND CONDUCT MARKS by Richard B. Larger Jr...CORPS’ JUNIOR ENLISTED PERFORMANCE EVALUATION SYSTEM: AN EVALUATION OF PROFICIENCY AND CONDUCT MARKS 5. FUNDING NUMBERS 6. AUTHOR(S) Richard B...in order to improve interpretability and minimize redundancies. 14. SUBJECT TERMS performance evaluation , proficiency marks, conduct marks

Model Performance Evaluation and Scenario Analysis (MPESA) Tutorial

EPA Science Inventory

This tool consists of two parts: model performance evaluation and scenario analysis (MPESA). The model performance evaluation consists of two components: model performance evaluation metrics and model diagnostics. These metrics provides modelers with statistical goodness-of-fit m...

The Context and Process for Performance Evaluations: Necessary Preconditions for the Use of Performance Evaluations as a Measure of Performance--A Critique of Perry

ERIC Educational Resources Information Center

McCarthy, Mary L.

2006-01-01

This article challenges Perry's research using performance evaluations to determine whether the educational background of child welfare workers is predictive of performance. Institutional theory, an understanding of street-level bureaucracies, and evaluations of field education performance measures are offered as necessary frameworks for Perry's…

48 CFR 36.604 - Performance evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 1 2011-10-01 2011-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL... Performance evaluation. See 42.1502(f) for the requirements for preparing past performance evaluations for...

48 CFR 36.604 - Performance evaluation.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 48 Federal Acquisition Regulations System 1 2012-10-01 2012-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL... Performance evaluation. See 42.1502(f) for the requirements for preparing past performance evaluations for...

48 CFR 36.604 - Performance evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL... Performance evaluation. See 42.1502(f) for the requirements for preparing past performance evaluations for...

48 CFR 36.604 - Performance evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 48 Federal Acquisition Regulations System 1 2014-10-01 2014-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL... Performance evaluation. See 42.1502(f) for the requirements for preparing past performance evaluations for...

48 CFR 1553.209-70 - EPA Form 1900-26, Contracting Officer's Evaluation of Contractor Performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

..., Contracting Officer's Evaluation of Contractor Performance. 1553.209-70 Section 1553.209-70 Federal... 1553.209-70 EPA Form 1900-26, Contracting Officer's Evaluation of Contractor Performance. As prescribed... evaluation of Contractor performance. ...

A performance evaluation model for the Stock Point Logistics Integrated Communication Environment (SPLICE)

NASA Astrophysics Data System (ADS)

Schmidt, J. B.

1985-09-01

This thesis investigates ways of improving the real-time performance of the Stockpoint Logistics Integrated Communication Environment (SPLICE). Performance evaluation through continuous monitoring activities and performance studies are the principle vehicles discussed. The method for implementing this performance evaluation process is the measurement of predefined performance indexes. Performance indexes for SPLICE are offered that would measure these areas. Existing SPLICE capability to carry out performance evaluation is explored, and recommendations are made to enhance that capability.

13 CFR 304.4 - Performance evaluations.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 13 Business Credit and Assistance 1 2011-01-01 2011-01-01 false Performance evaluations. 304.4... ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the management standards, financial accountability and program performance of each District Organization within three (3...

13 CFR 304.4 - Performance evaluations.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 13 Business Credit and Assistance 1 2014-01-01 2014-01-01 false Performance evaluations. 304.4... ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the management standards, financial accountability and program performance of each District Organization within three (3...

13 CFR 304.4 - Performance evaluations.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 13 Business Credit and Assistance 1 2013-01-01 2013-01-01 false Performance evaluations. 304.4... ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the management standards, financial accountability and program performance of each District Organization within three (3...

48 CFR 2936.201 - Evaluation of contractor performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Evaluation of contractor... Construction 2936.201 Evaluation of contractor performance. The HCA must establish procedures to evaluate construction contractor performance and prepare performance reports as required by FAR 36.201. ...

40 CFR Table 1 to Subpart Qqqqq of... - Applicability of General Provisions to Subpart QQQQQ

Code of Federal Regulations, 2010 CFR

2010-07-01

.... § 63.8(e) CMS Performance Evaluation No Subpart QQQQQ does not require CMS performance evaluations... QQQQQ does not require performance tests or CMS performance evaluations. § 63.9(e) Notification of... CMS No Subpart QQQQQ does not require CMS performance evaluations. § 63.10(a), (b), (d)(1), (d)(4)-(5...

Skylab program earth resources experiment package sensor performance evaluation, volume 1, (S190A)

NASA Technical Reports Server (NTRS)

Kenney, G. P.

1975-01-01

The results of S190A sensor performance evaluation are summarized based on data presented by all contributors to the sensor performance evaluation interim reports. Techniques used in sensor performance evaluation are discussed. Topics discussed include: performance degradation identified during the Skylab missions, S190A and EREP system anomalies that affected S190A performance, and the performance achieved, in terms of pertinent S190A parameters. Additional analyses include final performance analyses completed after submittal of the SL4 interim sensor performance evaluation reports, including completion of detailed analyses of basic performance parameters initiated during the interim report periods and consolidation analyses to reduce independent mission data (SL2, SL3, and SL4) to determine overall performance realized during all three Skylab missions.

48 CFR 2452.216-73 - Performance evaluation plan.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 6 2010-10-01 2010-10-01 true Performance evaluation plan... 2452.216-73 Performance evaluation plan. As prescribed in 2416.406(e)(3), insert the following clause in all award fee contracts: Performance Evaluation Plan (AUG 1987) (a) The Government shall...

An urban energy performance evaluation system and its computer implementation.

PubMed

Wang, Lei; Yuan, Guan; Long, Ruyin; Chen, Hong

2017-12-15

To improve the urban environment and effectively reflect and promote urban energy performance, an urban energy performance evaluation system was constructed, thereby strengthening urban environmental management capabilities. From the perspectives of internalization and externalization, a framework of evaluation indicators and key factors that determine urban energy performance and explore the reasons for differences in performance was proposed according to established theory and previous studies. Using the improved stochastic frontier analysis method, an urban energy performance evaluation and factor analysis model was built that brings performance evaluation and factor analysis into the same stage for study. According to data obtained for the Chinese provincial capitals from 2004 to 2013, the coefficients of the evaluation indicators and key factors were calculated by the urban energy performance evaluation and factor analysis model. These coefficients were then used to compile the program file. The urban energy performance evaluation system developed in this study was designed in three parts: a database, a distributed component server, and a human-machine interface. Its functions were designed as login, addition, edit, input, calculation, analysis, comparison, inquiry, and export. On the basis of these contents, an urban energy performance evaluation system was developed using Microsoft Visual Studio .NET 2015. The system can effectively reflect the status of and any changes in urban energy performance. Beijing was considered as an example to conduct an empirical study, which further verified the applicability and convenience of this evaluation system. Copyright © 2017 Elsevier Ltd. All rights reserved.

40 CFR 63.2994 - How do I verify the performance of monitoring equipment?

Code of Federal Regulations, 2010 CFR

2010-07-01

... monitoring equipment. (2) Conduct a performance evaluation of the continuous monitoring system (CMS...-specific performance evaluation plan, conduct of the performance evaluation, and reporting of performance... 40 Protection of Environment 12 2010-07-01 2010-07-01 true How do I verify the performance of...

24 CFR 570.491 - Performance and evaluation report.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 3 2010-04-01 2010-04-01 false Performance and evaluation report... Development Block Grant Program § 570.491 Performance and evaluation report. The annual performance and evaluation report shall be submitted in accordance with 24 CFR part 91. (Approved by the Office of Management...

Formal implementation of a performance evaluation model for the face recognition system.

PubMed

Shin, Yong-Nyuo; Kim, Jason; Lee, Yong-Jun; Shin, Woochang; Choi, Jin-Young

2008-01-01

Due to usability features, practical applications, and its lack of intrusiveness, face recognition technology, based on information, derived from individuals' facial features, has been attracting considerable attention recently. Reported recognition rates of commercialized face recognition systems cannot be admitted as official recognition rates, as they are based on assumptions that are beneficial to the specific system and face database. Therefore, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of any face recognition system. In this paper, we propose and formalize a performance evaluation model for the biometric recognition system, implementing an evaluation tool for face recognition systems based on the proposed model. Furthermore, we performed evaluations objectively by providing guidelines for the design and implementation of a performance evaluation system, formalizing the performance test process.

Building China's municipal healthcare performance evaluation system: a Tuscan perspective.

PubMed

Li, Hao; Barsanti, Sara; Bonini, Anna

2012-08-01

Regional healthcare performance evaluation systems can help optimize healthcare resources on regional basis and improve the performance of healthcare services provided. The Tuscany region in Italy is a good example of an institution which meets these requirements. China has yet to build such a system based on international experience. In this paper, based on comparative studies between Tuscany and China, we propose that the managing institutions in China's experimental cities can select and commission a third-party agency to, respectively, evaluate the performance of their affiliated hospitals and community health service centers. Following some features of the Tuscan experience, the Chinese municipal healthcare performance evaluation system can be built by focusing on the selection of an appropriate performance evaluation agency, the design of an adequate performance evaluation mechanism and the formulation of a complete set of laws, rules and regulations. When a performance evaluation system at city level is formed, the provincial government can extend the successful experience to other cities.

The Impact of Self-Evaluation Instruction on Student Self-Evaluation, Music Performance, and Self-Evaluation Accuracy

ERIC Educational Resources Information Center

Hewitt, Michael P.

2011-01-01

The author sought to determine whether self-evaluation instruction had an impact on student self-evaluation, music performance, and self-evaluation accuracy of music performance among middle school instrumentalists. Participants (N = 211) were students at a private middle school located in a metropolitan area of a mid-Atlantic state. Students in…

Apprentice Performance Evaluation.

ERIC Educational Resources Information Center

Gast, Clyde W.

The Granite City (Illinois) Steel apprentices are under a performance evaluation from entry to graduation. Federally approved, the program is guided by joint apprenticeship committees whose monthly meetings include performance evaluation from three information sources: journeymen, supervisors, and instructors. Journeymen's evaluations are made…

23 CFR 636.205 - Can past performance be used as an evaluation criteria?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 23 Highways 1 2010-04-01 2010-04-01 false Can past performance be used as an evaluation criteria... past performance be used as an evaluation criteria? (a) Yes, past performance information is one... used as an evaluation criteria in either phase-one or phase-two solicitations. If you elect to use past...

Reliability and performance evaluation of systems containing embedded rule-based expert systems

NASA Technical Reports Server (NTRS)

Beaton, Robert M.; Adams, Milton B.; Harrison, James V. A.

1989-01-01

A method for evaluating the reliability of real-time systems containing embedded rule-based expert systems is proposed and investigated. It is a three stage technique that addresses the impact of knowledge-base uncertainties on the performance of expert systems. In the first stage, a Markov reliability model of the system is developed which identifies the key performance parameters of the expert system. In the second stage, the evaluation method is used to determine the values of the expert system's key performance parameters. The performance parameters can be evaluated directly by using a probabilistic model of uncertainties in the knowledge-base or by using sensitivity analyses. In the third and final state, the performance parameters of the expert system are combined with performance parameters for other system components and subsystems to evaluate the reliability and performance of the complete system. The evaluation method is demonstrated in the context of a simple expert system used to supervise the performances of an FDI algorithm associated with an aircraft longitudinal flight-control system.

Mild test anxiety influences neurocognitive performance among African Americans and European Americans: identifying interfering and facilitating sources.

PubMed

Thames, April D; Panos, Stella E; Arentoft, Alyssa; Byrd, Desiree A; Hinkin, Charles H; Arbid, Natalie

2015-01-01

The current study examined ethnic/racial differences in test-related anxiety and its relationship to neurocognitive performance in a community sample of African American (n = 40) and European American (n = 36) adults. The authors hypothesized the following: (a) Test-anxiety related to negative performance evaluation would be associated with lower neurocognitive performance, whereas anxiety unrelated to negative evaluation would be associated with higher neurocognitive performance. (b) African American participants would report higher levels of anxiety about negative performance evaluation than European Americans. (c) European Americans would report higher levels of anxiety unrelated to negative performance evaluation. The first two hypotheses were supported: Ethnic/racial differences in test-taking anxiety emerged such that African Americans reported significantly higher levels of negative performance evaluation, which was associated with lower cognitive performance. The third hypothesis was not supported: African Americans and European Americans reported similar levels of test-anxiety unrelated to negative evaluation. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

The performance evaluation model of mining project founded on the weight optimization entropy value method

NASA Astrophysics Data System (ADS)

Mao, Chao; Chen, Shou

2017-01-01

According to the traditional entropy value method still have low evaluation accuracy when evaluating the performance of mining projects, a performance evaluation model of mineral project founded on improved entropy is proposed. First establish a new weight assignment model founded on compatible matrix analysis of analytic hierarchy process (AHP) and entropy value method, when the compatibility matrix analysis to achieve consistency requirements, if it has differences between subjective weights and objective weights, moderately adjust both proportions, then on this basis, the fuzzy evaluation matrix for performance evaluation. The simulation experiments show that, compared with traditional entropy and compatible matrix analysis method, the proposed performance evaluation model of mining project based on improved entropy value method has higher accuracy assessment.

A Study of the Associations between Conditions of Performance and Characteristics of Performers and New York State Solo Performance Ratings

ERIC Educational Resources Information Center

vonWurmb, Elizabeth C.

2013-01-01

This dissertation undertakes an analysis of 1,044 performance evaluations from New York State School Music Association (NYSSMA) Spring Festival solo adjudication ratings of student performers from a large suburban school district. It relies on results of evaluations of observed performances, and takes these evaluations as assessments of what the…

An hierarchical approach to performance evaluation of expert systems

NASA Technical Reports Server (NTRS)

Dominick, Wayne D. (Editor); Kavi, Srinu

1985-01-01

The number and size of expert systems is growing rapidly. Formal evaluation of these systems - which is not performed for many systems - increases the acceptability by the user community and hence their success. Hierarchical evaluation that had been conducted for computer systems is applied for expert system performance evaluation. Expert systems are also evaluated by treating them as software systems (or programs). This paper reports many of the basic concepts and ideas in the Performance Evaluation of Expert Systems Study being conducted at the University of Southwestern Louisiana.

Evaluating the Longevity and Hydraulic Performance of Permeable Reactive Barriers at Department of Defense Sites

DTIC Science & Technology

2001-10-01

Draft Final Report Evaluating the Longevity and Hydraulic Performance of Permeable Reactive Barriers at Department of Defense Sites Prepared for...AND SUBTITLE Evaluating the Longevity and Hydraulic Performance of Permeable Reactive Barriers at Department of Defense Sites 5a. CONTRACT NUMBER...34 4.3.2 Hydraulic Performance Evaluation .................................................................... 38 4.3.2.1 Water-Level

13 CFR 304.4 - Performance evaluations.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Performance evaluations. 304.4 Section 304.4 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION, DEPARTMENT OF COMMERCE ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the management...

48 CFR 1552.209-76 - Contractor performance evaluations.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 6 2010-10-01 2010-10-01 true Contractor performance... 1552.209-76 Contractor performance evaluations. As prescribed in section 1509.170-1, insert the following clause in all applicable solicitations and contracts. Contractor Performance Evaluations (OCT 2002...

48 CFR 8.406-7 - Contractor Performance Evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Contractor Performance... ACQUISITION PLANNING REQUIRED SOURCES OF SUPPLIES AND SERVICES Federal Supply Schedules 8.406-7 Contractor Performance Evaluation. Ordering activities must prepare an evaluation of contractor performance for each...

48 CFR 1536.201 - Evaluation of contracting performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

... performance. 1536.201 Section 1536.201 Federal Acquisition Regulations System ENVIRONMENTAL PROTECTION AGENCY... Contracting for Construction 1536.201 Evaluation of contracting performance. (a) The Contracting Officer will... will file the form in the contractor performance evaluation files which it maintains. (e) The Quality...

The ambiguities of performance-based governance reforms in Italy: Reviving the fortunes of evaluation and performance measurement.

PubMed

Marra, Mita

2018-08-01

Over the past two decades, Italy's administrative reforms have institutionalized evaluation to improve program effectiveness, staff productivity, and results-driven accountability against waste and corruption. Across ministries, regional governments, universities, schools and environmental protection agencies, seemingly unexpected consequences have emerged out of the implementation of performance measurement and evaluation regimes within public organizations. Formal compliance to legally binding evaluation procedures, judicially-sanctioned managerial accountability and lack of cross-agency coordination coupled with long-standing cultural separations among evaluators are some of the ambiguities associated with a performance-based governance system within Italian public administration. Building upon the 'new governane theory,' and qualitative fieldwork, I explore the political consequences of evaluation and performance measurement for possible improvements. From a normative perspective, greater integration between program evaluation and performance measurement can support organizational learning and democratic accountability both at the central and local level. Copyright © 2017 Elsevier Ltd. All rights reserved.

Study on evaluation index system of operational performance of municipal wastewater treatment plants in China

NASA Astrophysics Data System (ADS)

Xiaoxin, Zhang; Jin, Huang; Ling, Lin; Yan, Li

2018-05-01

According to the undeveloped evaluation method for the operational performance of the municipal wastewater treatment plants, this paper analyzes the policies related to sewage treatment industry based on the investigation of the municipal wastewater treatment plants. The applicable evaluation method for the operational performance was proposed from environmental protection performance, resources and energy consumption, technical and economic performance, production management and main equipment, providing a reliable basis for scientific evaluation of the operation as well as improving the operational performance of municipal wastewater treatment plant.

24 CFR 585.403 - Reporting requirements.

Code of Federal Regulations, 2010 CFR

2010-04-01

... Performance Evaluation Report noted in paragraph (b) of this section will constitute the final Quarterly Report. (b) Performance Evaluation Report. Each recipient of a Youthbuild grant must submit a Performance... substance of the Performance Evaluation Report shall be provided to recipients. (Approved by the Office of...

48 CFR 2452.216-72 - Determination of award fee earned.

Code of Federal Regulations, 2010 CFR

2010-10-01

... conclusion of each evaluation period specified in the Performance Evaluation Plan, the government shall evaluate the contractor's performance and determine the amount, if any, of award fee earned by the... Official's (FDO's) judgmental evaluation in accordance with the criteria set forth in the Performance...

A method to evaluate process performance by integrating time and resources

NASA Astrophysics Data System (ADS)

Wang, Yu; Wei, Qingjie; Jin, Shuang

2017-06-01

The purpose of process mining is to improve the existing process of the enterprise, so how to measure the performance of the process is particularly important. However, the current research on the performance evaluation method is still insufficient. The main methods of evaluation are mainly using time or resource. These basic statistics cannot evaluate process performance very well. In this paper, a method of evaluating the performance of the process based on time dimension and resource dimension is proposed. This method can be used to measure the utilization and redundancy of resources in the process. This paper will introduce the design principle and formula of the evaluation algorithm. Then, the design and the implementation of the evaluation method will be introduced. Finally, we will use the evaluating method to analyse the event log from a telephone maintenance process and propose an optimization plan.

Virginia Transit Performance Evaluation Package (VATPEP).

DOT National Transportation Integrated Search

1987-01-01

The Virginia Transit Performance Evaluation Package (VATPEP), a computer software package, is documented. This is the computerized version of the methodology used by the Virginia Department of Transportation to evaluate the performance of public tran...

Skylab program earth resouces experiment package. Volume 4: Sensor performance evaluation (S193 R/S). [radiometer/scatterometer

NASA Technical Reports Server (NTRS)

Kenney, G. P.

1975-01-01

The results of the sensor performance evaluation of the 13.9 GHz radiometer/scatterometer, which was part of the earth resources experiment package on Skylab. Findings are presented in the areas of housekeeping parameters, antenna gain and scanning performance, dynamic range, linearity, precision, resolution, stability, integration time, and transmitter output. Supplementary analyses covering performance anomalies, data stream peculiarities, aircraft sensor data comparisons, scatterometer saturation characteristics, and RF heating effects are reported. Results of the evaluation show that instrument performance was generally as expected, but capability degradations were observed to result from three major anomalies. Conclusions are drawn from the evaluation results, and recommendations for improving the effectiveness of a future program are offered. An addendum describes the special evaluation techniques developed and applied in the sensor performance evaluation tasks.

NREL Evaluates Advanced Solar Inverter Performance for Hawaiian Electric

Science.gov Websites

Companies | Energy Systems Integration Facility | NREL NREL Evaluates Advanced Solar Inverter Performance for Hawaiian Electric Companies NREL Evaluates Advanced Solar Inverter Performance for Hawaiian performance and impacts of today's advanced solar inverters, as well as proprietary feedback to the inverter

Conversations, Not Evaluations: An Alternative Model of Performance Management

ERIC Educational Resources Information Center

Lee, Christopher D.

2003-01-01

Traditional appraisal and evaluation systems focus almost exclusively on an employee's past performance. The desired result in each of these systems is better work performance. The very nature of most appraisals or evaluations, however, may inhibit performance unintentionally by focusing energy, attention and effort on past shortcomings rather…

Comparative analysis of techniques for evaluating the effectiveness of aircraft computing systems

NASA Technical Reports Server (NTRS)

Hitt, E. F.; Bridgman, M. S.; Robinson, A. C.

1981-01-01

Performability analysis is a technique developed for evaluating the effectiveness of fault-tolerant computing systems in multiphase missions. Performability was evaluated for its accuracy, practical usefulness, and relative cost. The evaluation was performed by applying performability and the fault tree method to a set of sample problems ranging from simple to moderately complex. The problems involved as many as five outcomes, two to five mission phases, permanent faults, and some functional dependencies. Transient faults and software errors were not considered. A different analyst was responsible for each technique. Significantly more time and effort were required to learn performability analysis than the fault tree method. Performability is inherently as accurate as fault tree analysis. For the sample problems, fault trees were more practical and less time consuming to apply, while performability required less ingenuity and was more checkable. Performability offers some advantages for evaluating very complex problems.

MFAHP: A novel method on the performance evaluation of the industrial wireless networked control system

NASA Astrophysics Data System (ADS)

Wu, Linqin; Xu, Sheng; Jiang, Dezhi

2015-12-01

Industrial wireless networked control system has been widely used, and how to evaluate the performance of the wireless network is of great significance. In this paper, considering the shortcoming of the existing performance evaluation methods, a comprehensive performance evaluation method of networks multi-indexes fuzzy analytic hierarchy process (MFAHP) combined with the fuzzy mathematics and the traditional analytic hierarchy process (AHP) is presented. The method can overcome that the performance evaluation is not comprehensive and subjective. Experiments show that the method can reflect the network performance of real condition. It has direct guiding role on protocol selection, network cabling, and node setting, and can meet the requirements of different occasions by modifying the underlying parameters.

Clinical Performance Evaluations of Third-Year Medical Students and Association With Student and Evaluator Gender.

PubMed

Riese, Alison; Rappaport, Leah; Alverson, Brian; Park, Sangshin; Rockney, Randal M

2017-06-01

Clinical performance evaluations are major components of medical school clerkship grades. But are they sufficiently objective? This study aimed to determine whether student and evaluator gender is associated with assessment of overall clinical performance. This was a retrospective analysis of 4,272 core clerkship clinical performance evaluations by 829 evaluators of 155 third-year students, within the Alpert Medical School grading database for the 2013-2014 academic year. Overall clinical performance, assessed on a three-point scale (meets expectations, above expectations, exceptional), was extracted from each evaluation, as well as evaluator gender, age, training level, department, student gender and age, and length of observation time. Hierarchical ordinal regression modeling was conducted to account for clustering of evaluations. Female students were more likely to receive a better grade than males (adjusted odds ratio [AOR] 1.30, 95% confidence interval [CI] 1.13-1.50), and female evaluators awarded lower grades than males (AOR 0.72, 95% CI 0.55-0.93), adjusting for department, observation time, and student and evaluator age. The interaction between student and evaluator gender was significant (P = .03), with female evaluators assigning higher grades to female students, while male evaluators' grading did not differ by student gender. Students who spent a short time with evaluators were also more likely to get a lower grade. A one-year examination of all third-year clerkship clinical performance evaluations at a single institution revealed that male and female evaluators rated male and female students differently, even when accounting for other measured variables.

Evaluating the performance of a fault detection and diagnostic system for vapor compression equipment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Breuker, M.S.; Braun, J.E.

This paper presents a detailed evaluation of the performance of a statistical, rule-based fault detection and diagnostic (FDD) technique presented by Rossi and Braun (1997). Steady-state and transient tests were performed on a simple rooftop air conditioner over a range of conditions and fault levels. The steady-state data without faults were used to train models that predict outputs for normal operation. The transient data with faults were used to evaluate FDD performance. The effect of a number of design variables on FDD sensitivity for different faults was evaluated and two prototype systems were specified for more complete evaluation. Good performancemore » was achieved in detecting and diagnosing five faults using only six temperatures (2 input and 4 output) and linear models. The performance improved by about a factor of two when ten measurements (three input and seven output) and higher order models were used. This approach for evaluating and optimizing the performance of the statistical, rule-based FDD technique could be used as a design and evaluation tool when applying this FDD method to other packaged air-conditioning systems. Furthermore, the approach could also be modified to evaluate the performance of other FDD methods.« less

The effects of non-evaluative feedback on drivers' self-evaluation and performance.

PubMed

Dogan, Ebru; Steg, Linda; Delhomme, Patricia; Rothengatter, Talib

2012-03-01

Drivers' tend to overestimate their competences, which may result in risk taking behavior. Providing drivers with feedback has been suggested as one of the solutions to overcome drivers' inaccurate self-evaluations. In practice, many tests and driving simulators provide drivers with non-evaluative feedback, which conveys information on the level of performance but not on what caused the performance. Is this type of feedback indeed effective in reducing self-enhancement biases? The current study aimed to investigate the effect of non-evaluative performance feedback on drivers' self-evaluations using a computerized hazard perception test. A between-subjects design was used with one group receiving feedback on performance in the hazard perception test while the other group not receiving any feedback. The results indicated that drivers had a robust self-enhancement bias in their self-evaluations regardless of the presence of performance feedback and that they systematically estimated their performance to be higher than they actually achieved in the test. Furthermore, they devalued the credibility of the test instead of adjusting their self-evaluations in order to cope with the negative feelings following the failure feedback. We discuss the theoretical and practical implications of these counterproductive effects of non-evaluative feedback. Copyright © 2011 Elsevier Ltd. All rights reserved.

Assessment of Anatomical Knowledge and Core Trauma Competency Vascular Skills.

PubMed

Granite, Guinevere; Pugh, Kristy; Chen, Hegang; Longinaker, Nyaradzo; Garofalo, Evan; Shackelford, Stacy; Shalin, Valerie; Puche, Adam; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin

2018-03-01

Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training, and 12-18 mo later. We hypothesize that residents will better judge their own skill after ASSET than before when compared with evaluator ratings. Forty PGY2-7 surgical residents performed four procedures: axillary artery (AA), brachial artery (BA), femoral artery exposure and control (FA), and lower extremity fasciotomy (FAS) at the three evaluations. Using 5-point Likert scales, surgeons self-assessed their confidence in anatomical understanding and procedure performance after each procedure and evaluators rated each surgeon accordingly. For all the three evaluations, residents consistently rated their anatomical understanding (p < 0.04) and surgical performance (p < 0.03) higher than evaluators for both FA and FAS. Residents rated their anatomical understanding and surgical performance higher (p < 0.005) than evaluators for BA after training and up to 18 mo later. Only for third AA evaluation were there no rating differences. Residents overrate their anatomical understanding and performance abilities for BA, FA, and FAS even after performing the procedures and being debriefed three times in 18 mo.

Conductor gestures influence evaluations of ensemble performance

PubMed Central

Morrison, Steven J.; Price, Harry E.; Smedley, Eric M.; Meals, Cory D.

2014-01-01

Previous research has found that listener evaluations of ensemble performances vary depending on the expressivity of the conductor’s gestures, even when performances are otherwise identical. It was the purpose of the present study to test whether this effect of visual information was evident in the evaluation of specific aspects of ensemble performance: articulation and dynamics. We constructed a set of 32 music performances that combined auditory and visual information and were designed to feature a high degree of contrast along one of two target characteristics: articulation and dynamics. We paired each of four music excerpts recorded by a chamber ensemble in both a high- and low-contrast condition with video of four conductors demonstrating high- and low-contrast gesture specifically appropriate to either articulation or dynamics. Using one of two equivalent test forms, college music majors and non-majors (N = 285) viewed sixteen 30 s performances and evaluated the quality of the ensemble’s articulation, dynamics, technique, and tempo along with overall expressivity. Results showed significantly higher evaluations for performances featuring high rather than low conducting expressivity regardless of the ensemble’s performance quality. Evaluations for both articulation and dynamics were strongly and positively correlated with evaluations of overall ensemble expressivity. PMID:25104944

U.S. Geological Survey Standard Reference Sample Project: Performance Evaluation of Analytical Laboratories

USGS Publications Warehouse

Long, H. Keith; Daddow, Richard L.; Farrar, Jerry W.

1998-01-01

Since 1962, the U.S. Geological Survey (USGS) has operated the Standard Reference Sample Project to evaluate the performance of USGS, cooperator, and contractor analytical laboratories that analyze chemical constituents of environmental samples. The laboratories are evaluated by using performance evaluation samples, called Standard Reference Samples (SRSs). SRSs are submitted to laboratories semi-annually for round-robin laboratory performance comparison purposes. Currently, approximately 100 laboratories are evaluated for their analytical performance on six SRSs for inorganic and nutrient constituents. As part of the SRS Project, a surplus of homogeneous, stable SRSs is maintained for purchase by USGS offices and participating laboratories for use in continuing quality-assurance and quality-control activities. Statistical evaluation of the laboratories results provides information to compare the analytical performance of the laboratories and to determine possible analytical deficiences and problems. SRS results also provide information on the bias and variability of different analytical methods used in the SRS analyses.

Evaluation methodologies for an advanced information processing system

NASA Technical Reports Server (NTRS)

Schabowsky, R. S., Jr.; Gai, E.; Walker, B. K.; Lala, J. H.; Motyka, P.

1984-01-01

The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.

24 CFR 968.330 - PHA performance and evaluation report.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 4 2010-04-01 2010-04-01 false PHA performance and evaluation... 250 or More Public Housing Units) § 968.330 PHA performance and evaluation report. For any FFY in which a PHA has received assistance under this subpart, the PHA shall submit a Performance and...

40 CFR 63.7342 - What records must I keep?

Code of Federal Regulations, 2010 CFR

2010-07-01

... malfunction. (3) Records of performance tests, performance evaluations, and opacity observations as required...) Monitoring data for COMS during a performance evaluation as required in § 63.6(h)(7)(i) and (ii). (3) Previous (that is, superceded) versions of the performance evaluation plan as required in § 63.8(d)(3). (4...

On the Performance Evaluation of 3D Reconstruction Techniques from a Sequence of Images

NASA Astrophysics Data System (ADS)

Eid, Ahmed; Farag, Aly

2005-12-01

The performance evaluation of 3D reconstruction techniques is not a simple problem to solve. This is not only due to the increased dimensionality of the problem but also due to the lack of standardized and widely accepted testing methodologies. This paper presents a unified framework for the performance evaluation of different 3D reconstruction techniques. This framework includes a general problem formalization, different measuring criteria, and a classification method as a first step in standardizing the evaluation process. Performance characterization of two standard 3D reconstruction techniques, stereo and space carving, is also presented. The evaluation is performed on the same data set using an image reprojection testing methodology to reduce the dimensionality of the evaluation domain. Also, different measuring strategies are presented and applied to the stereo and space carving techniques. These measuring strategies have shown consistent results in quantifying the performance of these techniques. Additional experiments are performed on the space carving technique to study the effect of the number of input images and the camera pose on its performance.

Operator performance evaluation using multi criteria decision making methods

NASA Astrophysics Data System (ADS)

Rani, Ruzanita Mat; Ismail, Wan Rosmanira; Razali, Siti Fatihah

2014-06-01

Operator performance evaluation is a very important operation in labor-intensive manufacturing industry because the company's productivity depends on the performance of its operators. The aims of operator performance evaluation are to give feedback to operators on their performance, to increase company's productivity and to identify strengths and weaknesses of each operator. In this paper, six multi criteria decision making methods; Analytical Hierarchy Process (AHP), fuzzy AHP (FAHP), ELECTRE, PROMETHEE II, Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) and VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) are used to evaluate the operators' performance and to rank the operators. The performance evaluation is based on six main criteria; competency, experience and skill, teamwork and time punctuality, personal characteristics, capability and outcome. The study was conducted at one of the SME food manufacturing companies in Selangor. From the study, it is found that AHP and FAHP yielded the "outcome" criteria as the most important criteria. The results of operator performance evaluation showed that the same operator is ranked the first using all six methods.

Evaluating Models of Human Performance: Safety-Critical Systems Applications

NASA Technical Reports Server (NTRS)

Feary, Michael S.

2012-01-01

This presentation is part of panel discussion on Evaluating Models of Human Performance. The purpose of this panel is to discuss the increasing use of models in the world today and specifically focus on how to describe and evaluate models of human performance. My presentation will focus on discussions of generating distributions of performance, and the evaluation of different strategies for humans performing tasks with mixed initiative (Human-Automation) systems. I will also discuss issues with how to provide Human Performance modeling data to support decisions on acceptability and tradeoffs in the design of safety critical systems. I will conclude with challenges for the future.

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Face-induced expectancies influence neural mechanisms of performance monitoring.

PubMed

Osinsky, Roman; Seeger, Jennifer; Mussel, Patrick; Hewig, Johannes

2016-04-01

In many daily situations, the consequences of our actions are predicted by cues that are often social in nature. For instance, seeing the face of an evaluator (e.g., a supervisor at work) may activate certain evaluative expectancies, depending on the history of prior encounters with that particular person. We investigated how such face-induced expectancies influence neurocognitive functions of performance monitoring. We recorded an electroencephalogram while participants completed a time-estimation task, during which they received performance feedback from a strict and a lenient evaluator. During each trial, participants first saw the evaluator's face before performing the task and, finally, receiving feedback. Therefore, faces could be used as predictive cues for the upcoming evaluation. We analyzed electrocortical signatures of performance monitoring at the stages of cue processing, task performance, and feedback reception. Our results indicate that, at the cue stage, seeing the strict evaluator's face results in an anticipatory preparation of fronto-medial monitoring mechanisms, as reflected by a sustained negative-going amplitude shift (i.e., the contingent negative variation). At the performance stage, face-induced expectancies of a strict evaluation rule led to increases of early performance monitoring signals (i.e., frontal-midline theta power). At the final stage of feedback reception, violations of outcome expectancies differentially affected the feedback-related negativity and frontal-midline theta power, pointing to a functional dissociation between these signatures. Altogether, our results indicate that evaluative expectancies induced by face-cues lead to adjustments of internal performance monitoring mechanisms at various stages of task processing.

Performance evaluation of extension education centers in universities based on the balanced scorecard.

PubMed

Wu, Hung-Yi; Lin, Yi-Kuei; Chang, Chi-Hsiang

2011-02-01

This study aims at developing a set of appropriate performance evaluation indices mainly based on balanced scorecard (BSC) for extension education centers in universities by utilizing multiple criteria decision making (MCDM). Through literature reviews and experts who have real practical experiences in extension education, adequate performance evaluation indices have been selected and then utilizing the decision making trial and evaluation laboratory (DEMATEL) and analytic network process (ANP), respectively, further establishes the causality between the four BSC perspectives as well as the relative weights between evaluation indices. According to this previous result, an empirical analysis of the performance evaluation of extension education centers of three universities at Taoyuan County in Taiwan is illustrated by applying VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR). From the analysis results, it indicates that "Learning and growth" is the significant influential factor and it would affect the other three perspectives. In addition, it is discovered that "Internal process" perspective as well as "Financial" perspective play important roles in the performance evaluation of extension education centers. The top three key performance indices are "After-sales service", "Turnover volume", and "Net income". The proposed evaluation model could be considered as a reference for extension education centers in universities to prioritize their improvements on the key performance indices after performing VIKOR analyses. 2010 Elsevier Ltd. All rights reserved.

Forging a Strategic and Comprehensive Approach to Evaluation within Public and Nonprofit Organizations: Integrating Measurement and Analytics within Evaluation

ERIC Educational Resources Information Center

Newcomer, Kathryn; Brass, Clinton T.

2016-01-01

The "performance movement" has been a subject of enthusiasm and frustration for evaluators. Performance measurement, data analytics, and program evaluation have been treated as different tasks, and those addressing them speak their own languages in their own circles. We suggest that situating performance measurement and data analytics…

25 CFR 1000.367 - Will the Department evaluate a Tribe's/Consortium's performance of non-trust related programs?

Code of Federal Regulations, 2010 CFR

2010-04-01

... Evaluations § 1000.367 Will the Department evaluate a Tribe's/Consortium's performance of non-trust related... 25 Indians 2 2010-04-01 2010-04-01 false Will the Department evaluate a Tribe's/Consortium's performance of non-trust related programs? 1000.367 Section 1000.367 Indians OFFICE OF THE ASSISTANT SECRETARY...

40 CFR Appendix A to Subpart Ll of... - Applicability of General Provisions

Code of Federal Regulations, 2010 CFR

2010-07-01

... not require CMS or CMS performance evaluation. 63.8(e) Performance evaluation for CMS No 63.9(b)(1)-(5... evaluations No Subpart LL does not require performance evaluation for CMS. 63.11(a)-(b) Control device... Appendix A to Subpart LL of Part 63 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED...

How the Brain Converts Negative Evaluation into Performance Facilitation.

PubMed

Prévost, Charlotte; Lau, Hakwan; Mobbs, Dean

2018-02-01

Surpassing negative evaluation is a recurrent theme of success stories. Yet, there is little evidence supporting the counterintuitive idea that negative evaluation might not only motivate people, but also enhance performance. To address this question, we designed a task that required participants to decide whether taking up a risky challenge after receiving positive or negative evaluations from independent judges. Participants believed that these evaluations were based on their prior performance on a related task. Results showed that negative evaluation caused a facilitation in performance. Concurrent functional magnetic resonance imaging revealed that the motivating effect of negative evaluation was represented in the insula and striatum, while the performance boost was associated with functional positive connectivity between the insula and a set of brain regions involved in goal-directed behavior and the orienting of attention. These findings provide new insight into the neural representation of negative evaluation-induced facilitation. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Performance Evaluation: A Deadly Disease?

ERIC Educational Resources Information Center

Aluri, Rao; Reichel, Mary

1994-01-01

W. Edwards Deming condemned performance evaluations as a deadly disease afflicting American management. He argued that performance evaluations nourish fear, encourage short-term thinking, stifle teamwork, and are no better than lotteries. This article examines library literature from Deming's perspective. Although that literature accepts…

Human performance evaluation in dual-axis critical task tracking

NASA Technical Reports Server (NTRS)

Ritchie, M. L.; Nataraj, N. S.

1975-01-01

A dual axis tracking using a multiloop critical task was set up to evaluate human performance. The effects of control stick variation and display formats are evaluated. A secondary loading was used to measure the degradation in tracking performance.

48 CFR 1509.170-7 - Release of ratings.

Code of Federal Regulations, 2010 CFR

2010-10-01

... ACQUISITION PLANNING CONTRACTOR QUALIFICATIONS Contractor Performance Evaluations 1509.170-7 Release of... contacting the EPA contracting officer responsible for the evaluation. (b) Contractors' performance ratings... contract is located. Requests for past performance evaluations during the period the information may be...

Performance Pay and Teacher Motivation: Separating Myth from Reality

ERIC Educational Resources Information Center

Hulleman, Chris S.; Barron, Kenneth E.

2010-01-01

This article draws on research from outside of education to evaluate some common myths about performance pay and to consider future directions for designing and evaluating performance pay systems in K-12 education. The five common myths surrounding performance pay include: (1) Performance pay systems improve performance; (2) Performance pay…

40 CFR 63.138 - Process wastewater provisions-performance standards for treatment processes managing Group 1...

Code of Federal Regulations, 2014 CFR

2014-07-01

... applicable. (4) Performance tests and design evaluations. If design steam stripper option (§ 63.138(d)) or..., neither a design evaluation nor a performance test is required. For any other non-biological treatment... or operator shall conduct either a design evaluation as specified in § 63.138(j), or a performance...

Self-Handicapping and Interpersonal Trade-Offs: The Effects of Claimed Self-Handicaps on Observers' Performance Evaluations and Feedback.

ERIC Educational Resources Information Center

Rhodewalt, Frederick; And Others

1995-01-01

Male subjects (n=130) evaluated performance of targets who, prior to and during the performance, offered no excuse, claimed intended low effort, claimed anxiety, or claimed drug impairment. Subjects evaluated objectively equivalent performances more negatively if they came from an excuse-making target than a no-excuse target. (JBJ)

Handbook for Improving Superintendent Performance Evaluation.

ERIC Educational Resources Information Center

Candoli, Carl; And Others

This handbook for superintendent performance evaluation contains information for boards of education as they institute or improve their evaluation system. The handbook answers questions involved in operationalizing, implementing, and evaluating a superintendent-evaluation system. The information was developed from research on superintendent…

An integrated evaluation for the performance of clinical engineering department.

PubMed

Yousry, Ahmed M; Ouda, Bassem K; Eldeib, Ayman M

2014-01-01

Performance benchmarking have become a very important component in all successful organizations nowadays that must be used by Clinical Engineering Department (CED) in hospitals. Many researchers identified essential mainstream performance indicators needed to improve the CED's performance. These studies revealed mainstream performance indicators that use the database of a CED to evaluate its performance. In this work, we believe that those indicators are insufficient for hospitals. Additional important indicators should be included to improve the evaluation accuracy. Therefore, we added new indicators: technical/maintenance indicators, economic indicators, intrinsic criticality indicators, basic hospital indicators, equipment acquisition, and safety indicators. Data is collected from 10 hospitals that cover different types of healthcare organizations. We developed a software tool that analyses collected data to provide a score for each CED under evaluation. Our results indicate that there is an average gap of 67% between the CEDs' performance and the ideal target. The reasons for the noncompliance are discussed in order to improve performance of CEDs under evaluation.

An Examination of Performance-Based Teacher Evaluation Systems in Five States. Summary. Issues & Answers. REL 2012-No. 129

ERIC Educational Resources Information Center

Shakman, Karen; Riordan, Julie; Sanchez, Maria Teresa; Cook, Kyle DeMeo; Fournier, Richard; Brett, Jessica

2012-01-01

This study reports on performance-based teacher evaluation systems in five states that have implemented such systems. It investigates two primary research questions: (1) What are the key characteristics of state-level performance-based teacher evaluation systems in the study states?; and (2) How do state teacher evaluation measures, the teaching…

An Application of the Impact Evaluation Process for Designing a Performance Measurement and Evaluation Framework in K-12 Environments

ERIC Educational Resources Information Center

Guerra-Lopez, Ingrid; Toker, Sacip

2012-01-01

This article illustrates the application of the Impact Evaluation Process for the design of a performance measurement and evaluation framework for an urban high school. One of the key aims of this framework is to enhance decision-making by providing timely feedback about the effectiveness of various performance improvement interventions. The…

NAS-Wide Fast-Time Simulation Study for Evaluating Performance of UAS Detect-and-Avoid Alerting and Guidance Systems

NASA Technical Reports Server (NTRS)

Lee, Seung Man; Park, Chunki; Cone, Andrew Clayton; Thipphavong, David P.; Santiago, Confesor

2016-01-01

This presentation contains the analysis results of NAS-wide fast-time simulations with UAS and VFR traffic for a single day for evaluating the performance of Detect-and-Avoid (DAA) alerting and guidance systems. This purpose of this study was to help refine and validate MOPS alerting and guidance requirements. In this study, we generated plots of all performance metrics that are specified by RTCA SC-228 Minimum Operational Performance Standards (MOPS): 1) to evaluate the sensitivity of alerting parameters on the performance metrics of each DAA alert type: Preventive, Corrective, and Warning alerts and 2) to evaluate the effect of sensor uncertainty on DAA alerting and guidance performance.

Biological Terrorism Preparedness: Evaluating the Performance of the Early Aberration Reporting System (EARS) Syndromic Surveillance Algorithms

DTIC Science & Technology

2007-06-01

PREPAREDNESS: EVALUATING THE PERFORMANCE OF THE EARLY ABERRATION REPORTING SYSTEM (EARS) SYNDROMIC SURVEILLANCE ALGORITHMS by David A...SUBTITLE Biological Terrorism Preparedness: Evaluating the Performance of the Early Aberration Reporting System (EARS) Syndromic Surveillance...Algorithms 6. AUTHOR(S) David Dunfee, Benjamin Hegler 5. FUNDING NUMBERS 7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) Naval Postgraduate School

The participatory design of a performance oriented monitoring and evaluation system in an international development environment.

PubMed

Guerra-López, Ingrid; Hicks, Karen

2015-02-01

This article illustrates the application of the impact monitoring and evaluation process for the design and development of a performance monitoring and evaluation framework in the context of human and institutional capacity development. This participative process facilitated stakeholder ownership in several areas including the design, development, and use of a new monitoring and evaluation system, as well their targeted results and accomplishments through the use of timely performance data gathered through ongoing monitoring and evaluation. The process produced a performance indicator map, a comprehensive monitoring and evaluation framework, and data collection templates to promote the development, implementation, and sustainability of the monitoring and evaluation system of a farmer's trade union in an African country. Copyright © 2014 Elsevier Ltd. All rights reserved.

Balanced scorecard-based performance evaluation of Chinese county hospitals in underdeveloped areas.

PubMed

Gao, Hongda; Chen, He; Feng, Jun; Qin, Xianjing; Wang, Xuan; Liang, Shenglin; Zhao, Jinmin; Feng, Qiming

2018-05-01

Objective Since the Guangxi government implemented public county hospital reform in 2009, there have been no studies of county hospitals in this underdeveloped area of China. This study aimed to establish an evaluation indicator system for Guangxi county hospitals and to generate recommendations for hospital development and policymaking. Methods A performance evaluation indicator system was developed based on balanced scorecard theory. Opinions were elicited from 25 experts from administrative units, universities and hospitals and the Delphi method was used to modify the performance indicators. The indicator system and the Topsis method were used to evaluate the performance of five county hospitals randomly selected from the same batch of 2015 Guangxi reform pilots. Results There were 4 first-level indicators, 9 second-level indicators and 36 third-level indicators in the final performance evaluation indicator system that showed good consistency, validity and reliability. The performance rank of the hospitals was B > E > A > C > D. Conclusions The performance evaluation indicator system established using the balanced scorecard is practical and scientific. Analysis of the results based on this indicator system identified several factors affecting hospital performance, such as resource utilisation efficiency, medical service price, personnel structure and doctor-patient relationships.

78 FR 41926 - Proposed Information Collection Request; Comment Request; Performance Evaluation Studies on...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-12

... ENVIRONMENTAL PROTECTION AGENCY [EPA-HQ-OECA-2013-0413; FRL--9832-8] Proposed Information Collection Request; Comment Request; Performance Evaluation Studies on Wastewater Laboratories (Renewal); EPA... request (ICR), ``Performance Evaluation Studies on Wastewater Laboratories'' (EPA ICR No. 0234.11, OMB...

48 CFR 36.201 - Evaluation of contractor performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Evaluation of contractor performance. 36.201 Section 36.201 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION... Contracting for Construction 36.201 Evaluation of contractor performance. See 42.1502(e) for the requirements...

40 CFR 60.185 - Monitoring of operations.

Code of Federal Regulations, 2010 CFR

2010-07-01

...) The continuous monitoring system performance evaluation required under § 60.13(c) shall be completed... monitoring system performance evaluation required under § 60.13(c), the reference method referred to under... be Method 6. For the performance evaluation, each concentration measurement shall be of one hour...

Metrics for Performance Evaluation of Patient Exercises during Physical Therapy.

PubMed

Vakanski, Aleksandar; Ferguson, Jake M; Lee, Stephen

2017-06-01

The article proposes a set of metrics for evaluation of patient performance in physical therapy exercises. Taxonomy is employed that classifies the metrics into quantitative and qualitative categories, based on the level of abstraction of the captured motion sequences. Further, the quantitative metrics are classified into model-less and model-based metrics, in reference to whether the evaluation employs the raw measurements of patient performed motions, or whether the evaluation is based on a mathematical model of the motions. The reviewed metrics include root-mean square distance, Kullback Leibler divergence, log-likelihood, heuristic consistency, Fugl-Meyer Assessment, and similar. The metrics are evaluated for a set of five human motions captured with a Kinect sensor. The metrics can potentially be integrated into a system that employs machine learning for modelling and assessment of the consistency of patient performance in home-based therapy setting. Automated performance evaluation can overcome the inherent subjectivity in human performed therapy assessment, and it can increase the adherence to prescribed therapy plans, and reduce healthcare costs.

Effect of the learning climate of residency programs on faculty's teaching performance as evaluated by residents.

PubMed

Lombarts, Kiki M J M H; Heineman, Maas Jan; Scherpbier, Albert J J A; Arah, Onyebuchi A

2014-01-01

To understand teaching performance of individual faculty, the climate in which residents' learning takes place, the learning climate, may be important. There is emerging evidence that specific climates do predict specific outcomes. Until now, the effect of learning climate on the performance of the individual faculty who actually do the teaching was unknown. THIS STUDY: (i) tested the hypothesis that a positive learning climate was associated with better teaching performance of individual faculty as evaluated by residents, and (ii) explored which dimensions of learning climate were associated with faculty's teaching performance. We conducted two cross-sectional questionnaire surveys amongst residents from 45 residency training programs and multiple specialties in 17 hospitals in the Netherlands. Residents evaluated the teaching performance of individual faculty using the robust System for Evaluating Teaching Qualities (SETQ) and evaluated the learning climate of residency programs using the Dutch Residency Educational Climate Test (D-RECT). The validated D-RECT questionnaire consisted of 11 subscales of learning climate. Main outcome measure was faculty's overall teaching (SETQ) score. We used multivariable adjusted linear mixed models to estimate the separate associations of overall learning climate and each of its subscales with faculty's teaching performance. In total 451 residents completed 3569 SETQ evaluations of 502 faculty. Residents also evaluated the learning climate of 45 residency programs in 17 hospitals in the Netherlands. Overall learning climate was positively associated with faculty's teaching performance (regression coefficient 0.54, 95% confidence interval: 0.37 to 0.71; P<0.001). Three out of 11 learning climate subscales were substantially associated with better teaching performance: 'coaching and assessment', 'work is adapted to residents' competence', and 'formal education'. Individual faculty's teaching performance evaluations are positively affected by better learning climate of residency programs.

WE-E-217A-02: Methodologies for Evaluation of Standalone CAD System Performance.

PubMed

Sahiner, B

2012-06-01

Standalone performance evaluation of a CAD system provides information about the abnormality detection or classification performance of the computerized system alone. Although the performance of the reader with CAD is the final step in CAD system assessment, standalone performance evaluation is an important component for several reasons: First, standalone evaluation informs the reader about the performance level of the CAD system and may have an impact on how the reader uses the system. Second, it provides essential information to the system designer for algorithm optimization during system development. Third, standalone evaluation can provide a detailed description of algorithm performance (e.g., on subgroups of the population) because a larger data set with more samples from different subgroups can be included in standalone studies compared to reader studies. Proper standalone evaluation of a CAD system involves a number of key components, some of which are shared with the assessment of reader performance with CAD. These include (1) selection of a test data set that allows performance assessment with little or no bias and acceptable uncertainty; (2) a reference standard that indicates disease status as well as the location and extent of disease; (3) a clearly defined method for labeling each CAD mark as a true-positive or false-positive; and (4) a properly selected set of metrics to summarize the accuracy of the computer marks and their corresponding scores. In this lecture, we will discuss various approaches for the key components of standalone CAD performance evaluation listed above, and present some of the recommendations and opinions from the AAPM CAD subcommittee on these issues. Learning Objectives 1. Identify basic components and metrics in the assessment of standalone CAD systems 2. Understand how each component may affect the assessed performance 3. Learn about AAPM CAD subcommittee's opinions and recommendations on factors and metrics related to the evaluation of standalone CAD system performance. © 2012 American Association of Physicists in Medicine.

Performance evaluation of TDT soil water content and watermark soil water potential sensors

USDA-ARS?s Scientific Manuscript database

This study evaluated the performance of digitized Time Domain Transmissometry (TDT) soil water content sensors (Acclima, Inc., Meridian, ID) and resistance-based soil water potential sensors (Watermark 200, Irrometer Company, Inc., Riverside, CA) in two soils. The evaluation was performed by compar...

Evaluating the Fraser Health Balanced Scorecard--a formative evaluation.

PubMed

Barnardo, Catherine; Jivanni, Amin

2009-01-01

Fraser Health (FH), a large, Canadian, integrated health care network, adopted the Balanced Scorecard (BSC) approach to monitor organizational performance in 2006. This paper reports on the results of a formative evaluation, conducted in April, 2008, to assess the usefulness of the BSC as a performance-reporting system and a performance management tool. Results indicated that the BSC has proven to be useful for reporting performance but is not currently used for performance management in a substantial way.

Performance analysis of static locking in replicated distributed database systems

NASA Technical Reports Server (NTRS)

Kuang, Yinghong; Mukkamala, Ravi

1991-01-01

Data replication and transaction deadlocks can severely affect the performance of distributed database systems. Many current evaluation techniques ignore these aspects, because it is difficult to evaluate through analysis and time consuming to evaluate through simulation. A technique is used that combines simulation and analysis to closely illustrate the impact of deadlock and evaluate performance of replicated distributed database with both shared and exclusive locks.

Program for the development of high temperature electrical materials and components

NASA Technical Reports Server (NTRS)

Neff, W. S.; Lowry, L. R.

1972-01-01

Evaluation of high temperature, space-vacuum performance of selected electrical materials and components, high temperature capacitor development, and evaluation, construction, and endurance testing of compression sealed pyrolytic boron nitride slot insulation are described. The first subject above covered the aging evaluation of electrical devices constructed from selected electrical materials. Individual materials performances were also evaluated and reported. The second subject included study of methods of improving electrical performance of pyrolytic boron nitride capacitors. The third portion was conducted to evaluate the thermal and electrical performance of pyrolytic boron nitride as stator slot liner material under varied temperature and compressive loading. Conclusions and recommendations are presented.

Advanced Video Analysis Needs for Human Performance Evaluation

NASA Technical Reports Server (NTRS)

Campbell, Paul D.

1994-01-01

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

The Role of Performance Quality in Adolescents' Self-Evaluation and Rumination after a Speech: Is it Contingent on Social Anxiety Level?

PubMed

Blöte, Anke W; Miers, Anne C; Van den Bos, Esther; Westenberg, P Michiel

2018-05-17

Cognitive behavioural therapy (CBT) has relatively poor outcomes for youth with social anxiety, possibly because broad-based CBT is not tailored to their specific needs. Treatment of social anxiety in youth may need to pay more attention to negative social cognitions that are considered a key factor in social anxiety development and maintenance. The aim of the present study was to learn more about the role of performance quality in adolescents' cognitions about their social performance and, in particular, the moderating role social anxiety plays in the relationship between performance quality and self-cognitions. A community sample of 229 participants, aged 11 to 18 years, gave a speech and filled in questionnaires addressing social anxiety, depression, expected and self-evaluated performance, and post-event rumination. Independent observers rated the quality of the speech. The data were analysed using moderated mediation analysis. Performance quality mediated the link between expected and self-evaluated performance in adolescents with low and medium levels of social anxiety. For adolescents with high levels of social anxiety, only a direct link between expected and self-evaluated performance was found. Their self-evaluation was not related to the quality of their performance. Performance quality also mediated the link between expected performance and rumination, but social anxiety did not moderate this mediation effect. Results suggest that a good performance does not help socially anxious adolescents to replace their negative self-evaluations with more realistic ones. Specific cognitive intervention strategies should be tailored to the needs of socially anxious adolescents who perform well.

Model performance evaluation (validation and calibration) in model-based studies of therapeutic interventions for cardiovascular diseases : a review and suggested reporting framework.

PubMed

Haji Ali Afzali, Hossein; Gray, Jodi; Karnon, Jonathan

2013-04-01

Decision analytic models play an increasingly important role in the economic evaluation of health technologies. Given uncertainties around the assumptions used to develop such models, several guidelines have been published to identify and assess 'best practice' in the model development process, including general modelling approach (e.g., time horizon), model structure, input data and model performance evaluation. This paper focuses on model performance evaluation. In the absence of a sufficient level of detail around model performance evaluation, concerns regarding the accuracy of model outputs, and hence the credibility of such models, are frequently raised. Following presentation of its components, a review of the application and reporting of model performance evaluation is presented. Taking cardiovascular disease as an illustrative example, the review investigates the use of face validity, internal validity, external validity, and cross model validity. As a part of the performance evaluation process, model calibration is also discussed and its use in applied studies investigated. The review found that the application and reporting of model performance evaluation across 81 studies of treatment for cardiovascular disease was variable. Cross-model validation was reported in 55 % of the reviewed studies, though the level of detail provided varied considerably. We found that very few studies documented other types of validity, and only 6 % of the reviewed articles reported a calibration process. Considering the above findings, we propose a comprehensive model performance evaluation framework (checklist), informed by a review of best-practice guidelines. This framework provides a basis for more accurate and consistent documentation of model performance evaluation. This will improve the peer review process and the comparability of modelling studies. Recognising the fundamental role of decision analytic models in informing public funding decisions, the proposed framework should usefully inform guidelines for preparing submissions to reimbursement bodies.

Use of social media in health promotion: purposes, key performance indicators, and evaluation metrics.

PubMed

Neiger, Brad L; Thackeray, Rosemary; Van Wagenen, Sarah A; Hanson, Carl L; West, Joshua H; Barnes, Michael D; Fagen, Michael C

2012-03-01

Despite the expanding use of social media, little has been published about its appropriate role in health promotion, and even less has been written about evaluation. The purpose of this article is threefold: (a) outline purposes for social media in health promotion, (b) identify potential key performance indicators associated with these purposes, and (c) propose evaluation metrics for social media related to the key performance indicators. Process evaluation is presented in this article as an overarching evaluation strategy for social media.

Who Should Evaluate Teachers' Performance at Schools?

ERIC Educational Resources Information Center

Tabancali, Erkan

2017-01-01

Correct determination of whether or not the objectives are achieved or of the level of achievement of the objectives is vital in educational organizations. In this context, one of the indicators of how teachers serve the organizational objectives is performance evaluation. In Turkish Educational System, the evaluation of the performance of…

A Modified Importance-Performance Framework for Evaluating Recreation-Based Experiential Learning Programs

ERIC Educational Resources Information Center

Pitas, Nicholas; Murray, Alison; Olsen, Max; Graefe, Alan

2017-01-01

This article describes a modified importance-performance framework for use in evaluation of recreation-based experiential learning programs. Importance-performance analysis (IPA) provides an effective and readily applicable means of evaluating many programs, but the near universal satisfaction associated with recreation inhibits the use of IPA in…

Models for evaluating the performability of degradable computing systems

NASA Technical Reports Server (NTRS)

Wu, L. T.

1982-01-01

Recent advances in multiprocessor technology established the need for unified methods to evaluate computing systems performance and reliability. In response to this modeling need, a general modeling framework that permits the modeling, analysis and evaluation of degradable computing systems is considered. Within this framework, several user oriented performance variables are identified and shown to be proper generalizations of the traditional notions of system performance and reliability. Furthermore, a time varying version of the model is developed to generalize the traditional fault tree reliability evaluation methods of phased missions.

48 CFR 1509.170-5 - Policy.

Code of Federal Regulations, 2010 CFR

2010-10-01

... CONTRACTOR QUALIFICATIONS Contractor Performance Evaluations 1509.170-5 Policy. (a) Contracting officers are responsible for the timely completion of contractors' performance evaluations. The National Institutes of Health Contractor Performance System shall be used to record individual contractor performance histories...

48 CFR 1509.170-5 - Policy.

Code of Federal Regulations, 2011 CFR

2011-10-01

... CONTRACTOR QUALIFICATIONS Contractor Performance Evaluations 1509.170-5 Policy. (a) Contracting officers are responsible for the timely completion of contractors' performance evaluations. The National Institutes of Health Contractor Performance System shall be used to record individual contractor performance histories...

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

21 CFR 900.23 - Evaluation.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Evaluation. 900.23 Section 900.23 Food and Drugs... STANDARDS ACT MAMMOGRAPHY States as Certifiers § 900.23 Evaluation. FDA shall evaluate annually the performance of each certification agency. The evaluation shall include the use of performance indicators that...

Performance analysis of static locking in replicated distributed database systems

NASA Technical Reports Server (NTRS)

Kuang, Yinghong; Mukkamala, Ravi

1991-01-01

Data replications and transaction deadlocks can severely affect the performance of distributed database systems. Many current evaluation techniques ignore these aspects, because it is difficult to evaluate through analysis and time consuming to evaluate through simulation. Here, a technique is discussed that combines simulation and analysis to closely illustrate the impact of deadlock and evaluate performance of replicated distributed databases with both shared and exclusive locks.

Evaluation of natural language processing systems: Issues and approaches

DOE Office of Scientific and Technical Information (OSTI.GOV)

Guida, G.; Mauri, G.

This paper encompasses two main topics: a broad and general analysis of the issue of performance evaluation of NLP systems and a report on a specific approach developed by the authors and experimented on a sample test case. More precisely, it first presents a brief survey of the major works in the area of NLP systems evaluation. Then, after introducing the notion of the life cycle of an NLP system, it focuses on the concept of performance evaluation and analyzes the scope and the major problems of the investigation. The tools generally used within computer science to assess the qualitymore » of a software system are briefly reviewed, and their applicability to the task of evaluation of NLP systems is discussed. Particular attention is devoted to the concepts of efficiency, correctness, reliability, and adequacy, and how all of them basically fail in capturing the peculiar features of performance evaluation of an NLP system is discussed. Two main approaches to performance evaluation are later introduced; namely, black-box- and model-based, and their most important characteristics are presented. Finally, a specific model for performance evaluation proposed by the authors is illustrated, and the results of an experiment with a sample application are reported. The paper concludes with a discussion on research perspective, open problems, and importance of performance evaluation to industrial applications.« less

Holistic rubric vs. analytic rubric for measuring clinical performance levels in medical students.

PubMed

Yune, So Jung; Lee, Sang Yeoup; Im, Sun Ju; Kam, Bee Sung; Baek, Sun Yong

2018-06-05

Task-specific checklists, holistic rubrics, and analytic rubrics are often used for performance assessments. We examined what factors evaluators consider important in holistic scoring of clinical performance assessment, and compared the usefulness of applying holistic and analytic rubrics respectively, and analytic rubrics in addition to task-specific checklists based on traditional standards. We compared the usefulness of a holistic rubric versus an analytic rubric in effectively measuring the clinical skill performances of 126 third-year medical students who participated in a clinical performance assessment conducted by Pusan National University School of Medicine. We conducted a questionnaire survey of 37 evaluators who used all three evaluation methods-holistic rubric, analytic rubric, and task-specific checklist-for each student. The relationship between the scores on the three evaluation methods was analyzed using Pearson's correlation. Inter-rater agreement was analyzed by Kappa index. The effect of holistic and analytic rubric scores on the task-specific checklist score was analyzed using multiple regression analysis. Evaluators perceived accuracy and proficiency to be major factors in objective structured clinical examinations evaluation, and history taking and physical examination to be major factors in clinical performance examinations evaluation. Holistic rubric scores were highly related to the scores of the task-specific checklist and analytic rubric. Relatively low agreement was found in clinical performance examinations compared to objective structured clinical examinations. Meanwhile, the holistic and analytic rubric scores explained 59.1% of the task-specific checklist score in objective structured clinical examinations and 51.6% in clinical performance examinations. The results show the usefulness of holistic and analytic rubrics in clinical performance assessment, which can be used in conjunction with task-specific checklists for more efficient evaluation.

Examining the effect of goal clarity on faculty performance

NASA Astrophysics Data System (ADS)

Waychal, Pradeep

2018-07-01

Performance of faculty members is the prime factor in the success of any academic organisation and certainly engineering academic organisation. The performance depends on various factors. This study tests our hypothesis, in the context of an Indian engineering college, that goal clarity is one such factor that significantly impacts faculty performance. Our experiment emphasised the importance of goal clarity by screening a relevant movie and by seeking professional goals from the faculty members. After a year, we evaluated the faculty performance using peer evaluation method and triangulated the data with course evaluation by students where faculty member's goal was to be a better teacher, to ensure the trustworthiness of peer evaluation. We found that the performance of faculty, who had goal clarity, was significantly better than the performance of those who did not have goal clarity.

Maritime Platform Sleep and Performance Study: Evaluating the SAFTE Model for Maritime Workplace Application

DTIC Science & Technology

2012-06-01

SLEEP AND PERFORMANCE STUDY: EVALUATING THE SAFTE MODEL FOR MARITIME WORKPLACE APPLICATION by Stephanie A. T. Brown June 2012 Thesis...REPORT DATE June 2012 3. REPORT TYPE AND DATES COVERED Master’s Thesis 4. TITLE AND SUBTITLE Maritime Platform Sleep and Performance Study...Evaluating the SAFTE Model for Maritime Workplace Application 5. FUNDING NUMBERS 6. AUTHOR(S) Stephanie A. T. Brown 7. PERFORMING ORGANIZATION

A mechanistic-empirical approach for evaluating the effect of diamond grinding and thin overlay on predicted pavement performance.

DOT National Transportation Integrated Search

2016-04-01

Advancements in pavement management practice require evaluating the performance of pavement preservation treatments using performance-related characteristics. However, state highway agencies face the challenge of developing performance-based relation...

Proposed evaluation framework for assessing operator performance with multisensor displays

NASA Technical Reports Server (NTRS)

Foyle, David C.

1992-01-01

Despite aggressive work on the development of sensor fusion algorithms and techniques, no formal evaluation procedures have been proposed. Based on existing integration models in the literature, an evaluation framework is developed to assess an operator's ability to use multisensor, or sensor fusion, displays. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The operator's performance with the sensor fusion display can be compared to the models' predictions based on the operator's performance when viewing the original sensor displays prior to fusion. This allows for the determination as to when a sensor fusion system leads to: 1) poorer performance than one of the original sensor displays (clearly an undesirable system in which the fused sensor system causes some distortion or interference); 2) better performance than with either single sensor system alone, but at a sub-optimal (compared to the model predictions) level; 3) optimal performance (compared to model predictions); or, 4) super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays. An experiment demonstrating the usefulness of the proposed evaluation framework is discussed.

Assessing Quality and Evaluating Performance in Higher Education: Worlds Apart or Complementary Views?

ERIC Educational Resources Information Center

Sarrico, Claudia S.; Rosa, Maria J.; Teixeira, Pedro N.; Cardoso, Margarida F.

2010-01-01

This paper reflects on quality assessment and performance evaluation in higher education, namely by analysing the insufficient link between those two aspects. We start by reviewing the current state of the art regarding different processes and mechanisms of quality assessment and performance evaluation and discuss some of the major issues…

Beginning and Intermediate Piano Students' Experiences Participating in Evaluative Performances

ERIC Educational Resources Information Center

Mitchell, Nancy

2017-01-01

Evaluative performances, such as conservatory examinations and competitions, frequently play a significant role in piano instruction in many parts of the world. Many students participate in these performances as a result of the perception that a program of instruction that is focused on standardized curriculum and evaluation practices will be of…

Report on the State of Development, Availability, Evaluation, and Future use of Test Kits for the Measurement of Lead in Paint

EPA Science Inventory

The purpose of this issue paper is to address the availability and performance characteristics of portable lead test kits especially suited for lead in paint, procedures for evaluating the performance of these test kits, and the availability of performance evaluation (PE) materia...

Evaluating the Implementation of Performance Improvement Training: The E[superscript 3] Process for Success

ERIC Educational Resources Information Center

Larbi-Apau, Josephine A.; Moseley, James L.

2008-01-01

This article provides a comprehensive approach to careful review and evaluation of the implementation of performance training intervention. It discusses the E[superscript 3] process for success, a basic framework for evaluating the implementation phase of a training program implemented as a broad-based performance improvement strategy. The intent…

U1108 performance model

NASA Technical Reports Server (NTRS)

Trachta, G.

1976-01-01

A model of Univac 1108 work flow has been developed to assist in performance evaluation studies and configuration planning. Workload profiles and system configurations are parameterized for ease of experimental modification. Outputs include capacity estimates and performance evaluation functions. The U1108 system is conceptualized as a service network; classical queueing theory is used to evaluate network dynamics.

Shared Features of High-Performing After-School Programs: A Follow-Up to the TASC Evaluation

ERIC Educational Resources Information Center

Birmingham, Jennifer; Pechman, Ellen M.; Russell, Christina A.; Mielke, Monica

2005-01-01

This study examined high-performing after-school projects funded by The After-School Corporation (TASC), to determine what characteristics, if any, these projects shared. Evaluators reanalyzed student performance data collected during the multi-year evaluation of the TASC initiative to identify projects where the after-school program was…

20 CFR 411.330 - How will SSA evaluate an EN's performance?

Code of Federal Regulations, 2014 CFR

2014-04-01

... 20 Employees' Benefits 2 2014-04-01 2014-04-01 false How will SSA evaluate an EN's performance? 411.330 Section 411.330 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.330 How will SSA evaluate an EN's performance? (a) We will...

20 CFR 411.330 - How will SSA evaluate an EN's performance?

Code of Federal Regulations, 2013 CFR

2013-04-01

... 20 Employees' Benefits 2 2013-04-01 2013-04-01 false How will SSA evaluate an EN's performance? 411.330 Section 411.330 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.330 How will SSA evaluate an EN's performance? (a) We will...

20 CFR 411.330 - How will SSA evaluate an EN's performance?

Code of Federal Regulations, 2012 CFR

2012-04-01

... 20 Employees' Benefits 2 2012-04-01 2012-04-01 false How will SSA evaluate an EN's performance? 411.330 Section 411.330 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.330 How will SSA evaluate an EN's performance? (a) We will...

20 CFR 411.330 - How will SSA evaluate an EN's performance?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 2 2010-04-01 2010-04-01 false How will SSA evaluate an EN's performance? 411.330 Section 411.330 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.330 How will SSA evaluate an EN's performance? (a) We will...

20 CFR 411.330 - How will SSA evaluate an EN's performance?

Code of Federal Regulations, 2011 CFR

2011-04-01

... 20 Employees' Benefits 2 2011-04-01 2011-04-01 false How will SSA evaluate an EN's performance? 411.330 Section 411.330 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.330 How will SSA evaluate an EN's performance? (a) We will...

48 CFR 1553.209-71 - EPA Form 1900-27, Project Officer's Evaluation of Contractor Performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

... Officer's Evaluation of Contractor Performance. 1553.209-71 Section 1553.209-71 Federal Acquisition Regulations System ENVIRONMENTAL PROTECTION AGENCY CLAUSES AND FORMS FORMS Prescription of Forms 1553.209-71 EPA Form 1900-27, Project Officer's Evaluation of Contractor Performance. As prescribed in 1509.170-4...

Performance Evaluation of Public Non-Profit Hospitals Using a BP Artificial Neural Network: The Case of Hubei Province in China

PubMed Central

Li, Chunhui; Yu, Chuanhua

2013-01-01

To provide a reference for evaluating public non-profit hospitals in the new environment of medical reform, we established a performance evaluation system for public non-profit hospitals. The new “input-output” performance model for public non-profit hospitals is based on four primary indexes (input, process, output and effect) that include 11 sub-indexes and 41 items. The indicator weights were determined using the analytic hierarchy process (AHP) and entropy weight method. The BP neural network was applied to evaluate the performance of 14 level-3 public non-profit hospitals located in Hubei Province. The most stable BP neural network was produced by comparing different numbers of neurons in the hidden layer and using the “Leave-one-out” Cross Validation method. The performance evaluation system we established for public non-profit hospitals could reflect the basic goal of the new medical health system reform in China. Compared with PLSR, the result indicated that the BP neural network could be used effectively for evaluating the performance public non-profit hospitals. PMID:23955238

Board self-evaluation: the Bayside Health experience.

PubMed

Duncan-Marr, Alison; Duckett, Stephen J

2005-08-01

Board evaluation is a critical component of good governance in any organisation. This paper describes the board self-evaluation process used by Bayside Health, a public health service in Melbourne. The question of how governing boards can assess their performance has received increasing attention over the past decade. In particular, the increasing demand for accountability to shareholders and regulators experienced by corporate sector Boards has resulted in greater scrutiny of board performance, with the market and the balance sheet providing some basis for assessment. Performance evaluation of governing boards in the public sector has been more challenging. Performance evaluation is complex in a sector that is not simply driven by the bottom line, where the stakeholders involve both government and the broader community, and where access to, and the quality and safety of the services provided, are often the major public criteria by which performance may be judged. While some practices from the corporate sector can be applied successfully in the public sector, this is not always the case, and public sector boards such as the Board of Directors of Bayside Health have been developing ways to evaluate and improve their performance.

Collecting and Using Staff Performance Information for School Improvement.

ERIC Educational Resources Information Center

Tucker, Null A.

Use of multiple data sources for evaluation of faculty performance by the DeKalb County (Georgia) School System is described. Focus is on two evaluations, the administrator evaluation and the counselor evaluation; the former has been employed longer than any other component of the evaluation system, while the latter is scheduled for its second…

Building an Evaluative Culture: The Key to Effective Evaluation and Results Management

ERIC Educational Resources Information Center

Mayne, John

2009-01-01

As many reviews of results-based performance systems have noted, a weak evaluative culture in an organization undermines attempts at building an effective evaluation and/or results management regime. This article sets out what constitutes a strong evaluative culture where information on performance results is deliberately sought in order to learn…

Course Evaluation in Sweden--When, How, What and Why

ERIC Educational Resources Information Center

Cronholm, Stefan

2010-01-01

This study is about course evaluation in Swedish higher education. Performing course evaluation is regulated in Swedish law. Despite this, only half of the courses are evaluated. The aim of this study is to understand why satisfactory course evaluations not are performed. Problems are identified from a student perspective and the paper provides…

Content Analysis of Evaluation Instruments Used for Student Evaluation of Classroom Teaching Performance in Higher Education.

ERIC Educational Resources Information Center

Tagomori, Harry T.; Bishop, Laurence A.

A major argument against evaluation of teacher performance by students pertains to the instruments being used. Colleges conduct instructional evaluation using instruments they devise, borrow, adopt, or adapt from other institutions. Whether these instruments are tested for content validity is unknown. This study determined how evaluation questions…

48 CFR 2919.812 - Contract administration.

Code of Federal Regulations, 2010 CFR

2010-10-01

... conduct periodic evaluations of the performance of an 8(a) contract at various stages of the contract period of performance. Any problems encountered during the performance evaluation, which cannot be...

Performance and life evaluation of advanced battery technologies for electric vehicle applications

NASA Astrophysics Data System (ADS)

Deluca, W. H.; Gillie, K. R.; Kulaga, J. E.; Smaga, J. A.; Tummillo, A. F.; Webster, C. E.

Advanced battery technology evaluations are performed under simulated electric vehicle (EV) operating conditions at the Argonne Analysis and Diagnostic Laboratory (ADL). The ADL provides a common basis for both performance characterization and life evaluation with unbiased application of tests and analyses. This paper summarizes the performance characterizations and life evaluations conducted in 1990 on nine single cells and fifteen 3- to 360-cell modules that encompass six technologies: (Na/S, Zn/Br, Ni/Fe, Ni/Cd, Ni-metal hydride, and lead-acid). These evaluations were performed for the Department of Energy and Electric Power Research Institute. The results provide battery users, developers, and program managers an interim measure of the progress being made in battery R and D programs, a comparison of battery technologies, and a source of basic data for modelling and continuing R and D.

Note on evaluating safety performance of road infrastructure to motivate safety competition.

PubMed

Han, Sangjin

2016-01-01

Road infrastructures are usually developed and maintained by governments or public sectors. There is no competitor in the market of their jurisdiction. This monopolic feature discourages road authorities from improving the level of safety with proactive motivation. This study suggests how to apply a principle of competition for roads, in particular by means of performance evaluation. It first discusses why road infrastructure has been slow in safety oriented development and management in respect of its business model. Then it suggests some practical ways of how to promote road safety between road authorities, particularly by evaluating safety performance of road infrastructure. These are summarized as decision of safety performance indicators, classification of spatial boundaries, data collection, evaluation, and reporting. Some consideration points are also discussed to make safety performance evaluation on road infrastructure lead to better road safety management.

48 CFR 1509.170-4 - Definitions.

Code of Federal Regulations, 2010 CFR

2010-10-01

... each performance category. Ratings are defined as follows: 0 = unsatisfactory, 1 = poor, 2 = fair, 3... PLANNING CONTRACTOR QUALIFICATIONS Contractor Performance Evaluations 1509.170-4 Definitions. (a) Contractor Performance Report is an evaluation of a contractor's performance for a specified period of time...

Validity evidence for the Simulated Colonoscopy Objective Performance Evaluation scoring system.

PubMed

Trinca, Kristen D; Cox, Tiffany C; Pearl, Jonathan P; Ritter, E Matthew

2014-02-01

Low-cost, objective systems to assess and train endoscopy skills are needed. The aim of this study was to evaluate the ability of Simulated Colonoscopy Objective Performance Evaluation to assess the skills required to perform endoscopy. Thirty-eight subjects were included in this study, all of whom performed 4 tasks. The scoring system measured performance by calculating precision and efficiency. Data analysis assessed the relationship between colonoscopy experience and performance on each task and the overall score. Endoscopic trainees' Simulated Colonoscopy Objective Performance Evaluation scores correlated significantly with total colonoscopy experience (r = .61, P = .003) and experience in the past 12 months (r = .63, P = .002). Significant differences were seen among practicing endoscopists, nonendoscopic surgeons, and trainees (P < .0001). When the 4 tasks were analyzed, each showed significant correlation with colonoscopy experience (scope manipulation, r = .44, P = .044; tool targeting, r = .45, P = .04; loop management, r = .47, P = .032; mucosal inspection, r = .65, P = .001) and significant differences in performance between the endoscopist groups, except for mucosal inspection (scope manipulation, P < .0001; tool targeting, P = .002; loop management, P = .0008; mucosal inspection, P = .27). Simulated Colonoscopy Objective Performance Evaluation objectively assesses the technical skills required to perform endoscopy and shows promise as a platform for proficiency-based skills training. Published by Elsevier Inc.

Performance and evaluation of real-time multicomputer control systems

NASA Technical Reports Server (NTRS)

Shin, K. G.

1983-01-01

New performance measures, detailed examples, modeling of error detection process, performance evaluation of rollback recovery methods, experiments on FTMP, and optimal size of an NMR cluster are discussed.

Performance evaluation of Louisiana superpave mixtures.

DOT National Transportation Integrated Search

2008-12-01

This report documents the performance of Louisiana Superpave mixtures through laboratory mechanistic tests, mixture : volumetric properties, gradation analysis, and early field performance. Thirty Superpave mixtures were evaluated in this : study. Fo...

Evaluating the Longevity and Hydraulic Performance of Permeable Reactive Barriers at Department of Defense Sites

DTIC Science & Technology

2002-04-24

F inal Repor t Evaluating the Longevity and Hydraulic Performance of Permeable Reactive Barriers at Department of Defense Sites P1·epared for... Hydraulic Performance of Permeable Reactive Barriers at Department of Defense Sites Prepared for Project Officer: Charles Reeter Naval Facilities...SUBTITLE 5a. CONTRACT NUMBER Evaluating the Longevity and Hydraulic Performance of Permeable Reactive N4 7408-95-D-0730/0087 Barriers at Department of

Social status determines how we monitor and evaluate our performance

PubMed Central

Kostermans, Evelien; Milivojevic, Branka; De Cremer, David

2012-01-01

Since people with low status are more likely to experience social evaluative threat and are therefore more inclined to monitor for these threats and inhibit approach behaviour, we expected that low-status subjects would be more engaged in evaluating their own performance, compared with high-status subjects. We created a highly salient social hierarchy based on the performance of a simple time estimation task. Subjects could achieve high, middle or low status while performing this task simultaneously with other two players who were either higher or lower in status. Subjects received feedback on their own performance, as well as on the performance of the other two players simultaneously. Electroencephalography (EEG) was recorded from all three participants. The results showed that medial frontal negativity (an event-related potential reflecting performance evaluation) was significantly enhanced for low-status subjects. Implications for status-related differences in goal-directed behaviour are discussed. PMID:21421733

40 CFR 35.115 - Evaluation of performance.

Code of Federal Regulations, 2010 CFR

2010-07-01

... requirements for progress reporting under 40 CFR 31.40(b). (b) Elements of the evaluation process. The.... The recipient may request review of the Regional Administrator's decision under the dispute processes... Evaluation of performance. (a) Joint evaluation process. The applicant and the Regional Administrator will...

Performance evaluation for pinhole collimators of small gamma camera by MTF and NNPS analysis: Monte Carlo simulation study

NASA Astrophysics Data System (ADS)

Jeon, Hosang; Kim, Hyunduk; Cha, Bo Kyung; Kim, Jong Yul; Cho, Gyuseong; Chung, Yong Hyun; Yun, Jong-Il

2009-06-01

Presently, the gamma camera system is widely used in various medical diagnostic, industrial and environmental fields. Hence, the quantitative and effective evaluation of its imaging performance is essential for design and quality assurance. The National Electrical Manufacturers Association (NEMA) standards for gamma camera evaluation are insufficient to perform sensitive evaluation. In this study, modulation transfer function (MTF) and normalized noise power spectrum (NNPS) will be suggested to evaluate the performance of small gamma camera with changeable pinhole collimators using Monte Carlo simulation. We simulated the system with a cylinder and a disk source, and seven different pinhole collimators from 1- to 4-mm-diameter pinhole with lead. The MTF and NNPS data were obtained from output images and were compared with full-width at half-maximum (FWHM), sensitivity and differential uniformity. In the result, we found that MTF and NNPS are effective and novel standards to evaluate imaging performance of gamma cameras instead of conventional NEMA standards.

Evaluating supplier quality performance using analytical hierarchy process

NASA Astrophysics Data System (ADS)

Kalimuthu Rajoo, Shanmugam Sundram; Kasim, Maznah Mat; Ahmad, Nazihah

2013-09-01

This paper elaborates the importance of evaluating supplier quality performance to an organization. Supplier quality performance evaluation reflects the actual performance of the supplier exhibited at customer's end. It is critical in enabling the organization to determine the area of improvement and thereafter works with supplier to close the gaps. Success of the customer partly depends on supplier's quality performance. Key criteria as quality, cost, delivery, technology support and customer service are categorized as main factors in contributing to supplier's quality performance. 18 suppliers' who were manufacturing automotive application parts evaluated in year 2010 using weight point system. There were few suppliers with common rating which led to common ranking observed by few suppliers'. Analytical Hierarchy Process (AHP), a user friendly decision making tool for complex and multi criteria problems was used to evaluate the supplier's quality performance challenging the weight point system that was used for 18 suppliers'. The consistency ratio was checked for criteria and sub-criteria. Final results of AHP obtained with no overlap ratings, therefore yielded a better decision making methodology as compared to weight point rating system.

A Component Analysis of the Impact of Evaluative and Objective Feedback on Performance

ERIC Educational Resources Information Center

Johnson, Douglas A.

2013-01-01

Despite the frequency with which performance feedback interventions are used in organizational behavior management, component analyses of such feedback are rare. It has been suggested that evaluation of performance and objective details about performance are two necessary components for performance feedback. The present study was designed to help…

Perceptions of the Principal Evaluation Process and Performance Criteria: A Qualitative Study of the Challenge of Principal Evaluation

ERIC Educational Resources Information Center

Faginski-Stark, Erica; Casavant, Christopher; Collins, William; McCandless, Jason; Tencza, Marilyn

2012-01-01

Recent federal and state mandates have tasked school systems to move beyond principal evaluation as a bureaucratic function and to re-imagine it as a critical component to improve principal performance and compel school renewal. This qualitative study investigated the district leaders' and principals' perceptions of the performance evaluation…

Teacher Evaluation in China: Latest Trends and Future Directions

ERIC Educational Resources Information Center

Liu, Shujie; Zhao, Decheng

2013-01-01

With the implementation of teacher performance pay in 2009 in China, teacher performance evaluation has become a heated topic. This research study follows up on two previous studies of teacher evaluation in China and continues the dialog by analyzing the latest trends in the context of teacher performance pay. There were two sources of information…

40 CFR 63.7842 - What records must I keep?

Code of Federal Regulations, 2010 CFR

2010-07-01

..., performance evaluations, and opacity observations as required in § 63.10(b)(2)(viii). (b) For each COMS, you... in § 63.10(b)(2)(vi) through (xi). (2) Monitoring data for a performance evaluation as required in § 63.6(h)(7)(i) and (ii). (3) Previous (that is, superceded) versions of the performance evaluation...

Diverging diamond interchange performance evaluation (I-44 and Route 13)

DOT National Transportation Integrated Search

2011-02-01

Performance evaluation was conducted on the first diverging diamond interchange (DDI) or double : crossover interchange (DCD) constructed in the United States. This evaluation assessed traffic operations, safety and : public perceptions t...

Performance Evaluation Model for Application Layer Firewalls.

PubMed

Xuan, Shichang; Yang, Wu; Dong, Hui; Zhang, Jiangchuan

2016-01-01

Application layer firewalls protect the trusted area network against information security risks. However, firewall performance may affect user experience. Therefore, performance analysis plays a significant role in the evaluation of application layer firewalls. This paper presents an analytic model of the application layer firewall, based on a system analysis to evaluate the capability of the firewall. In order to enable users to improve the performance of the application layer firewall with limited resources, resource allocation was evaluated to obtain the optimal resource allocation scheme in terms of throughput, delay, and packet loss rate. The proposed model employs the Erlangian queuing model to analyze the performance parameters of the system with regard to the three layers (network, transport, and application layers). Then, the analysis results of all the layers are combined to obtain the overall system performance indicators. A discrete event simulation method was used to evaluate the proposed model. Finally, limited service desk resources were allocated to obtain the values of the performance indicators under different resource allocation scenarios in order to determine the optimal allocation scheme. Under limited resource allocation, this scheme enables users to maximize the performance of the application layer firewall.

Planning for an Evaluation of Teaching Performance. Volume IV. Summaries of Instruments for Use in Evaluating Teacher Performance.

ERIC Educational Resources Information Center

Yuzdepski, I., Comp.; Elliott, L., Comp.

This document presents information, in the form of summary sheets, on 54 teacher evaluation instruments. Each summary contains pertinent information about the instrument regarding publishing company, author, criteria evaluated, subject of observation, category dimension, and coding units. The 19 criteria used in the evaluation tests, which were…

Practical Guide to Designing Comprehensive Principal Evaluation Systems: A Tool to Assist in the Development of Principal Evaluation Systems. Revised Edition

ERIC Educational Resources Information Center

Clifford, Matthew; Hansen, Ulcca Joshni; Wraight, Sara

2014-01-01

Across the country, states and districts are designing principal evaluation systems as a means of improving leadership, learning, and school performance. Principal evaluation systems hold potential for supporting leaders' learning and sense of accountability for instructional excellence and student performance. Principal evaluation also is an…

A Practical Guide to Designing Comprehensive Principal Evaluation Systems: A Tool to Assist in the Development of Principal Evaluation Systems

ERIC Educational Resources Information Center

Clifford, Matthew; Hansen, Ulcca Joshni; Wraight, Sara

2012-01-01

Across the country, states and districts are designing principal evaluation systems as a means of improving leadership, learning, and school performance. Principal evaluation systems hold potential for supporting leaders' learning and sense of accountability for instructional excellence and student performance. Principal evaluation is also an…

Model Performance Evaluation and Scenario Analysis (MPESA)

EPA Pesticide Factsheets

Model Performance Evaluation and Scenario Analysis (MPESA) assesses the performance with which models predict time series data. The tool was developed Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM)

Theory and Practice on Teacher Performance Evaluation

ERIC Educational Resources Information Center

Yonghong, Cai; Chongde, Lin

2006-01-01

Teacher performance evaluation plays a key role in educational personnel reform, so it has been an important yet difficult issue in educational reform. Previous evaluations on teachers failed to make strict distinction among the three dominant types of evaluation, namely, capability, achievement, and effectiveness. Moreover, teacher performance…

40 CFR 35.515 - Evaluation of performance.

Code of Federal Regulations, 2010 CFR

2010-07-01

....515 Evaluation of performance. (a) Joint evaluation process. The applicant and the Regional... work plan (see section 35.507(b)(2)(iv)). A description of the evaluation process and reporting... annually and must satisfy the requirements for progress reporting under 40 CFR 31.40(b). (b) Elements of...

Reducing the Effects of Gender Stereotypes on Performance Evaluations.

ERIC Educational Resources Information Center

Bauer, Cara C.; Baltes, Boris B.

2002-01-01

Examined whether a structured free recall intervention could decrease the influence of traditional gender stereotypes on the performance evaluations of women. College students provided performance ratings for vignettes describing the performance of male and female professors. Without the intervention, raters who had traditional stereotypes…

48 CFR 3036.201 - Evaluation of contractor performance.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Evaluation of contractor performance. 3036.201 Section 3036.201 Federal Acquisition Regulations System DEPARTMENT OF HOMELAND SECURITY... contractor performance. (a)(2) Performance reports shall be prepared and entered into the Contractor...

Experimental Evaluation of High Performance Integrated Heat Pump

DOE Office of Scientific and Technical Information (OSTI.GOV)

Miller, William A; Berry, Robert; Durfee, Neal

2016-01-01

Integrated heat pump (IHP) technology provides significant potential for energy savings and comfort improvement for residential buildings. In this study, we evaluate the performance of a high performance IHP that provides space heating, cooling, and water heating services. Experiments were conducted according to the ASHRAE Standard 206-2013 where 24 test conditions were identified in order to evaluate the IHP performance indices based on the airside performance. Empirical curve fits of the unit s compressor maps are used in conjunction with saturated condensing and evaporating refrigerant conditions to deduce the refrigerant mass flowrate, which, in turn was used to evaluate themore » refrigerant side performance as a check on the airside performance. Heat pump (compressor, fans, and controls) and water pump power were measured separately per requirements of Standard 206. The system was charged per the system manufacturer s specifications. System test results are presented for each operating mode. The overall IHP performance metrics are determined from the test results per the Standard 206 calculation procedures.« less

DECIDE: a software for computer-assisted evaluation of diagnostic test performance.

PubMed

Chiecchio, A; Bo, A; Manzone, P; Giglioli, F

1993-05-01

The evaluation of the performance of clinical tests is a complex problem involving different steps and many statistical tools, not always structured in an organic and rational system. This paper presents a software which provides an organic system of statistical tools helping evaluation of clinical test performance. The program allows (a) the building and the organization of a working database, (b) the selection of the minimal set of tests with the maximum information content, (c) the search of the model best fitting the distribution of the test values, (d) the selection of optimal diagnostic cut-off value of the test for every positive/negative situation, (e) the evaluation of performance of the combinations of correlated and uncorrelated tests. The uncertainty associated with all the variables involved is evaluated. The program works in a MS-DOS environment with EGA or higher performing graphic card.

Multi-criteria group decision making for evaluating the performance of e-waste recycling programs under uncertainty.

PubMed

Wibowo, Santoso; Deng, Hepu

2015-06-01

This paper presents a multi-criteria group decision making approach for effectively evaluating the performance of e-waste recycling programs under uncertainty in an organization. Intuitionistic fuzzy numbers are used for adequately representing the subjective and imprecise assessments of the decision makers in evaluating the relative importance of evaluation criteria and the performance of individual e-waste recycling programs with respect to individual criteria in a given situation. An interactive fuzzy multi-criteria decision making algorithm is developed for facilitating consensus building in a group decision making environment to ensure that all the interest of individual decision makers have been appropriately considered in evaluating alternative e-waste recycling programs with respect to their corporate sustainability performance. The developed algorithm is then incorporated into a multi-criteria decision support system for making the overall performance evaluation process effectively and simple to use. Such a multi-criteria decision making system adequately provides organizations with a proactive mechanism for incorporating the concept of corporate sustainability into their regular planning decisions and business practices. An example is presented for demonstrating the applicability of the proposed approach in evaluating the performance of e-waste recycling programs in organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Family incivility and job performance: a moderated mediation model of psychological distress and core self-evaluation.

PubMed

Lim, Sandy; Tai, Kenneth

2014-03-01

This study extends the stress literature by exploring the relationship between family incivility and job performance. We examine whether psychological distress mediates the link between family incivility and job performance. We also investigate how core self-evaluation might moderate this mediated relationship. Data from a 2-wave study indicate that psychological distress mediates the relationship between family incivility and job performance. In addition, core self-evaluation moderates the relationship between family incivility and psychological distress but not the relationship between psychological distress and job performance. The results hold while controlling for general job stress, family-to-work conflict, and work-to-family conflict. The findings suggest that family incivility is linked to poor performance at work, and psychological distress and core self-evaluation are key mechanisms in the relationship.

Objective Fidelity Evaluation in Multisensory Virtual Environments: Auditory Cue Fidelity in Flight Simulation

PubMed Central

Meyer, Georg F.; Wong, Li Ting; Timson, Emma; Perfect, Philip; White, Mark D.

2012-01-01

We argue that objective fidelity evaluation of virtual environments, such as flight simulation, should be human-performance-centred and task-specific rather than measure the match between simulation and physical reality. We show how principled experimental paradigms and behavioural models to quantify human performance in simulated environments that have emerged from research in multisensory perception provide a framework for the objective evaluation of the contribution of individual cues to human performance measures of fidelity. We present three examples in a flight simulation environment as a case study: Experiment 1: Detection and categorisation of auditory and kinematic motion cues; Experiment 2: Performance evaluation in a target-tracking task; Experiment 3: Transferrable learning of auditory motion cues. We show how the contribution of individual cues to human performance can be robustly evaluated for each task and that the contribution is highly task dependent. The same auditory cues that can be discriminated and are optimally integrated in experiment 1, do not contribute to target-tracking performance in an in-flight refuelling simulation without training, experiment 2. In experiment 3, however, we demonstrate that the auditory cue leads to significant, transferrable, performance improvements with training. We conclude that objective fidelity evaluation requires a task-specific analysis of the contribution of individual cues. PMID:22957068

Performance evaluation methodology for historical document image binarization.

PubMed

Ntirogiannis, Konstantinos; Gatos, Basilis; Pratikakis, Ioannis

2013-02-01

Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization evaluation methodology for historical handwritten/machine-printed document images. In the proposed evaluation scheme, the recall and precision evaluation measures are properly modified using a weighting scheme that diminishes any potential evaluation bias. Additional performance metrics of the proposed evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based evaluation measures demonstrate the validity of the proposed evaluation scheme.

Performance Evaluation of Nano-JASMINE

NASA Astrophysics Data System (ADS)

Hatsutori, Y.; Kobayashi, Y.; Gouda, N.; Yano, T.; Murooka, J.; Niwa, Y.; Yamada, Y.

We report the results of performance evaluation of the first Japanese astrometry satellite, Nano-JASMINE. It is a very small satellite and weighs only 35 kg. It aims to carry out astrometry measurement of nearby bright stars (z ≤ 7.5 mag) with an accuracy of 3 milli-arcseconds. Nano-JASMINE will be launched by Cyclone-4 rocket in August 2011 from Brazil. The current status is in the process of evaluating the performances. A series of performance tests and numerical analysis were conducted. As a result, the engineering model (EM) of the telescope was measured to be achieving a diffraction-limited performance and confirmed that it has enough performance for scientific astrometry.

Evaluating performance of limestone prone to polishing.

DOT National Transportation Integrated Search

2009-12-01

This research project evaluated the effect of blending Vanport limestone and other aggregates on the frictional surface characteristic properties of constructed trial road surfaces. The study undertook the evaluation of the performance of different m...

1999 commuter assistance program evaluation manual

DOT National Transportation Integrated Search

2001-01-01

This manual was developed to assist Florida's Commuter Assistance Programs (CAP) to measure and evaluate their performance. It provides information necessary for a CAP to create and implement its own evaluation program. It discusses performance measu...

Evaluation of experimental flexible pavements : final report.

DOT National Transportation Integrated Search

1979-01-01

The construction and performance of seven Virginia flexible pavements containing at least some experimental features were evaluated. The objective was to evaluate the performance of the pavements incorporating new or timely design concepts and to ass...

Students' Perceptions of Peer Evaluation: An Expectancy Perspective

ERIC Educational Resources Information Center

Chen, Yining; Lou, Hao

2004-01-01

Because of the difficulty of evaluating uneven performance among group members, many researchers suggest incorporating peer evaluations in a grading system that permits an instructor to evaluate and grade individual performance more equitably within a group. In this study, the authors employ expectancy theory to assess key factors that may…

Interim Outcomes Assessment of the Comprehensive Clinical Performance Grid for Student Evaluation.

ERIC Educational Resources Information Center

Tolls, Dorothy Bazzinotti; Carlson, Nancy; Wilson, Roger; Richman, Jack

2001-01-01

Assessed the viability of the Comprehensive Clinical Performance Grid for Student Evaluation, introduced at The New England College of Optometry in 1996 in clinical student assessment. Analyzed faculty and student feedback and consistency with previous evaluations, between evaluators, and between clinical sites and tracts. Found satisfaction with…

Objective and automated protocols for the evaluation of biomedical search engines using No Title Evaluation protocols.

PubMed

Campagne, Fabien

2008-02-29

The evaluation of information retrieval techniques has traditionally relied on human judges to determine which documents are relevant to a query and which are not. This protocol is used in the Text Retrieval Evaluation Conference (TREC), organized annually for the past 15 years, to support the unbiased evaluation of novel information retrieval approaches. The TREC Genomics Track has recently been introduced to measure the performance of information retrieval for biomedical applications. We describe two protocols for evaluating biomedical information retrieval techniques without human relevance judgments. We call these protocols No Title Evaluation (NT Evaluation). The first protocol measures performance for focused searches, where only one relevant document exists for each query. The second protocol measures performance for queries expected to have potentially many relevant documents per query (high-recall searches). Both protocols take advantage of the clear separation of titles and abstracts found in Medline. We compare the performance obtained with these evaluation protocols to results obtained by reusing the relevance judgments produced in the 2004 and 2005 TREC Genomics Track and observe significant correlations between performance rankings generated by our approach and TREC. Spearman's correlation coefficients in the range of 0.79-0.92 are observed comparing bpref measured with NT Evaluation or with TREC evaluations. For comparison, coefficients in the range 0.86-0.94 can be observed when evaluating the same set of methods with data from two independent TREC Genomics Track evaluations. We discuss the advantages of NT Evaluation over the TRels and the data fusion evaluation protocols introduced recently. Our results suggest that the NT Evaluation protocols described here could be used to optimize some search engine parameters before human evaluation. Further research is needed to determine if NT Evaluation or variants of these protocols can fully substitute for human evaluations.

The Effect of Implied Performer Age and Group Membership on Evaluations of Music Performances

ERIC Educational Resources Information Center

Harrington, Ann M.

2018-01-01

This study examined the effects of implied performer age and group membership on listeners' evaluations of music performances. Undergraduate music majors (n = 23), nonmusic majors (n = 17), and members of a New Horizons ensemble (n = 16) were presented with six 30-second excerpts of concert band performances. Excerpts were presented to all…

The Performance Cycle: The Association between Student Achievement and State Policies Tying Together Teacher Performance, Student Achievement, and Accountability

ERIC Educational Resources Information Center

Alexander, Nicola A.; Jang, Sung Tae; Kankane, Shipi

2017-01-01

This article explores the associations between student performance and the presence of state policies that include student achievement in teacher evaluations. We examined performance among states from 2007 through 2013. Including student performance in state teacher evaluation policies is modestly associated with higher reading achievement but had…

Performability modeling with continuous accomplishment sets

NASA Technical Reports Server (NTRS)

Meyer, J. F.

1979-01-01

A general modeling framework that permits the definition, formulation, and evaluation of performability is described. It is shown that performability relates directly to system effectiveness, and is a proper generalization of both performance and reliability. A hierarchical modeling scheme is used to formulate the capability function used to evaluate performability. The case in which performance variables take values in a continuous accomplishment set is treated explicitly.

Performance evaluation using SYSTID time domain simulation. [computer-aid design and analysis for communication systems

NASA Technical Reports Server (NTRS)

Tranter, W. H.; Ziemer, R. E.; Fashano, M. J.

1975-01-01

This paper reviews the SYSTID technique for performance evaluation of communication systems using time-domain computer simulation. An example program illustrates the language. The inclusion of both Gaussian and impulse noise models make accurate simulation possible in a wide variety of environments. A very flexible postprocessor makes possible accurate and efficient performance evaluation.

Performance Evaluation Test of the Rapid Area Preparation Tool (RAPTOR)

DTIC Science & Technology

2008-12-01

the standard SETCO tires. A blast test of the new SETCO tire is scheduled for the spring of...Washington, DC 20301-2500 Performance Evaluation Test of the Rapid Area Preparation Tool (RAPTOR) December 2008 Prepared ...2008 to 00-00-2008 4. TITLE AND SUBTITLE Performance Evaluation Test of the Rapid Area Preparation Tool (RAPTOR) 5a. CONTRACT NUMBER 5b.

Assurance Policy Evaluation - Spacecraft and Strategic Systems

DTIC Science & Technology

2014-09-17

electromechanical (EEE) parts, software, design and workmanship, work instructions, manufacturing and tooling, cleanrooms, electrostatic discharge ...T9001B.  An external group, called the Evaluation and Assessment Team, made up of product assurance subject matter experts from NSWC Corona performs...NSWC, Corona and SSP Technical Branch(es). The FTPE, performed every 3 years, is an objective evaluation of facility performance to assure proper

Linking Political Influence to School Reform with a Focus on the Performance Evaluation Reform Act and Senate Bill 7

ERIC Educational Resources Information Center

Fredericks, Juliane R.

2015-01-01

This study focused on the federal and Illinois State the reform legislation titled the Performance Evaluation Reform Act and Senate Bill 7. The Performance Evaluation Reform Act or "PERA" was created from collaboration between stakeholders as Illinois competed in a federal competition titled "Race to the Top." The legislation…

Arsenic and Uranium Removal from Drinking Water by Adsorptive Media U.S. EPA Demonstration Project at Upper Bodfish in Lake Isabella, CA -Final Performance Evaluation Report

EPA Science Inventory

This report documents the activities performed during and the results obtained from the performance evaluation of an arsenic (As) and uranium (U) removal technology demonstrated at Upper Bodfish in Lake Isabella, CA. The objectives of the project are to evaluate: (1) the effecti...

When the third party observer of a neuropsychological evaluation is an audio-recorder.

PubMed

Constantinou, Marios; Ashendorf, Lee; McCaffrey, Robert J

2002-08-01

The presence of third parties during neuropsychological evaluations is an issue of concern for contemporary neuropsychologists. Previous studies have reported that the presence of an observer during neuropsychological testing alters the performance of individuals under evaluation. The present study sought to investigate whether audio-recording affects the neuropsychological test performance of individuals in the same way that third party observation does. In the presence of an audio-recorder the performance of the participants on memory tests declined. Performance on motor tests, on the other hand, was not affected by the presence of an audio-recorder. The implications of these findings in forensic neuropsychological evaluations are discussed.

Participation in Performance-Evaluation Studies by U.S. Geological Survey National Water Quality Laboratory

USGS Publications Warehouse

Glodt, Stephen R.; Pirkey, Kimberly D.

1998-01-01

Performance-evaluation studies provide customers of the U.S. Geological Survey National Water Quality Laboratory (NWQL) with data needed to evaluate performance and to compare of select laboratories for analytical work. The NWQL participates in national and international performance-evaluation (PE) studies that consist of samples of water, sediment, and aquatic biological materials for the analysis of inorganic constituents, organic compounds, and radionuclides. This Fact Sheet provides a summary of PE study results from January 1993 through April 1997. It should be of particular interest to USGS customers and potential customers of the NWQL, water-quality specialists, cooperators, and agencies of the Federal Government.

Alternative performance measures for evaluating congestion.

DOT National Transportation Integrated Search

2004-04-01

This report summarizes the results of the work performed under the project Alternative Performance Measures for Evaluating : Congestion. The study first outlines existing approaches to looking at congestion. It then builds on the previous work in the...

Conducting effective performance appraisals.

PubMed

2001-01-01

According to experts, performance appraisals rate just below firing someone as the least favorite thing managers do. Many factors contribute to this view--one is that current systems do a poor job of evaluating performance and in fact often impede both evaluation and performance. When used as part of an ongoing supportive process of goal setting and feedback, performance appraisals can enhance performance and morale. One alternative to traditional employee evaluation methods is full-circle or 360-degree feedback. Contained in this issue are practical suggestions for preparing employees for performance appraisals which, when followed daily, encourage employees to put their best feet forward as part of their regular routine. Also included is a template specific to assessing the performance of clinical laboratory technologists . Additionally, numerous resources are provided to help you refine appraisal systems to fit your needs. Full-circle feedback is proving to be a boon to managers. It relieves them from being the exclusive "heavies" in evaluating performance, integrates appraisal input from several sources, and incorporates increasing employee skills, competencies, and satisfaction, thus improving productivity of people and processes. And aren't integration and continuous improvement what the laboratory is all about?

PrismTech Data Distribution Service Java API Evaluation

NASA Technical Reports Server (NTRS)

Riggs, Cortney

2008-01-01

My internship duties with Launch Control Systems required me to start performance testing of an Object Management Group's (OMG) Data Distribution Service (DDS) specification implementation by PrismTech Limited through the Java programming language application programming interface (API). DDS is a networking middleware for Real-Time Data Distribution. The performance testing involves latency, redundant publishers, extended duration, redundant failover, and read performance. Time constraints allowed only for a data throughput test. I have designed the testing applications to perform all performance tests when time is allowed. Performance evaluation data such as megabits per second and central processing unit (CPU) time consumption were not easily attainable through the Java programming language; they required new methods and classes created in the test applications. Evaluation of this product showed the rate that data can be sent across the network. Performance rates are better on Linux platforms than AIX and Sun platforms. Compared to previous C++ programming language API, the performance evaluation also shows the language differences for the implementation. The Java API of the DDS has a lower throughput performance than the C++ API.

Personality traits affect teaching performance of attending physicians: results of a multi-center observational study.

PubMed

Scheepers, Renée A; Lombarts, Kiki M J M H; van Aken, Marcel A G; Heineman, Maas Jan; Arah, Onyebuchi A

2014-01-01

Worldwide, attending physicians train residents to become competent providers of patient care. To assess adequate training, attending physicians are increasingly evaluated on their teaching performance. Research suggests that personality traits affect teaching performance, consistent with studied effects of personality traits on job performance and academic performance in medicine. However, up till date, research in clinical teaching practice did not use quantitative methods and did not account for specialty differences. We empirically studied the relationship of attending physicians' personality traits with their teaching performance across surgical and non-surgical specialties. We conducted a survey across surgical and non-surgical specialties in eighteen medical centers in the Netherlands. Residents evaluated attending physicians' overall teaching performance, as well as the specific domains learning climate, professional attitude, communication, evaluation, and feedback, using the validated 21-item System for Evaluation of Teaching Qualities (SETQ). Attending physicians self-evaluated their personality traits on a 5-point scale using the validated 10-item Big Five Inventory (BFI), yielding the Five Factor model: extraversion, conscientiousness, neuroticism, agreeableness and openness. Overall, 622 (77%) attending physicians and 549 (68%) residents participated. Extraversion positively related to overall teaching performance (regression coefficient, B: 0.05, 95% CI: 0.01 to 0.10, P = 0.02). Openness was negatively associated with scores on feedback for surgical specialties only (B: -0.10, 95% CI: -0.15 to -0.05, P<0.001) and conscientiousness was positively related to evaluation of residents for non-surgical specialties only (B: 0.13, 95% CI: 0.03 to 0.22, p = 0.01). Extraverted attending physicians were consistently evaluated as better supervisors. Surgical attending physicians who display high levels of openness were evaluated as less adequate feedback-givers. Non-surgical attending physicians who were conscientious seem to be good at evaluating residents. These insights could contribute to future work on development paths of attending physicians in medical education.

Personality Traits Affect Teaching Performance of Attending Physicians: Results of a Multi-Center Observational Study

PubMed Central

Scheepers, Renée A.; Lombarts, Kiki M. J. M. H.; van Aken, Marcel A. G.; Heineman, Maas Jan; Arah, Onyebuchi A.

2014-01-01

Background Worldwide, attending physicians train residents to become competent providers of patient care. To assess adequate training, attending physicians are increasingly evaluated on their teaching performance. Research suggests that personality traits affect teaching performance, consistent with studied effects of personality traits on job performance and academic performance in medicine. However, up till date, research in clinical teaching practice did not use quantitative methods and did not account for specialty differences. We empirically studied the relationship of attending physicians' personality traits with their teaching performance across surgical and non-surgical specialties. Method We conducted a survey across surgical and non-surgical specialties in eighteen medical centers in the Netherlands. Residents evaluated attending physicians' overall teaching performance, as well as the specific domains learning climate, professional attitude, communication, evaluation, and feedback, using the validated 21-item System for Evaluation of Teaching Qualities (SETQ). Attending physicians self-evaluated their personality traits on a 5-point scale using the validated 10-item Big Five Inventory (BFI), yielding the Five Factor model: extraversion, conscientiousness, neuroticism, agreeableness and openness. Results Overall, 622 (77%) attending physicians and 549 (68%) residents participated. Extraversion positively related to overall teaching performance (regression coefficient, B: 0.05, 95% CI: 0.01 to 0.10, P = 0.02). Openness was negatively associated with scores on feedback for surgical specialties only (B: −0.10, 95% CI: −0.15 to −0.05, P<0.001) and conscientiousness was positively related to evaluation of residents for non-surgical specialties only (B: 0.13, 95% CI: 0.03 to 0.22, p = 0.01). Conclusions Extraverted attending physicians were consistently evaluated as better supervisors. Surgical attending physicians who display high levels of openness were evaluated as less adequate feedback-givers. Non-surgical attending physicians who were conscientious seem to be good at evaluating residents. These insights could contribute to future work on development paths of attending physicians in medical education. PMID:24844725

Use of an Acoustic Camera to Evaluate the Performance of Tickler Chains and Draghead Deflectors for Sea Turtle Protection during Hopper Dredging in the United States of America

DTIC Science & Technology

2018-05-01

performance nor effectiveness in protecting sea turtles has been documented.This study was the first step in evaluating TTC as a potential replacement for...draghead turtle deflectors. The primary objective was to evaluate and document operational performance of this technology, not effectiveness of reducing...incidental take. TTC operational performance was monitored using underwater camera systems over a short period of time whereas effectiveness for

Acquisition and evaluation of Hamburg wheel-tracking device

DOT National Transportation Integrated Search

1999-04-01

Surrogate performance tests, or "proof" tests, for asphalt mixtures are being evaluated by states to gauge mixture performance potential in the lab. The University of Arkansas constructed, ERSA (Evaluator of Rutting and Stripping in Asphalt) to "scre...

The relationship between the managerial skills and results of "performance evaluation "tool among nursing managers in teaching hospitals of Iran University of Medical Science.

PubMed

Isfahani, Haleh Mousavi; Aryankhesal, Aidin; Haghani, Hamid

2014-09-25

Performance of different organizations, such as hospitals is mainly influenced by their managers' performance. Nursing managers have an important role in hospital performance and their managerial skills can improve the quality of the services. Hence, the present study was conducted in order to assess the relationship between the managerial skills and the results of their performance evaluation in Teaching Hospitals of Iran University of Medical Science in 2013. The research used the cross sectional method in 2013. It was done by distributing a managerial skills assessment questionnaire, with close-ended questions in 5 choice Likert scale, among 181 managers and head nurses of hospitals of Iran university of Medical Sciences; among which 131 answered the questions. Another data collection tools was a forms to record evaluation marks from the personnel records. We used Pearson and Spearman correlation tests and SPSS for analysis and description (frequency, mean and standard deviation). Results showed that the managerial skills of the nursing mangers were fair (2.57 out of 5) and the results of the performance evaluation were in a good condition (98.44). The mangers' evaluation results and the managerial skills scores were not in a meaningful correlation (r=0.047 np=0.856). The research showed no correlation between different domains of managerial skills and the performance evaluation marks: decision making skills (r=0.074 and p=0.399), leadership (correlation coefficient 0.028 and p=0.654), motivation (correlation coefficient 0.118 and p=0.163), communication  (correlation coefficient 0.116 and p=0.122), systematic thinking  (correlation coefficient 0.028 and p=0.828), time management (correlation coefficient 0.077 and p=0.401) and strategic thinking  (correlation coefficient 0.041 and p=0.756). Lack of any correlation and relation between managers' managerial skills and their performance evaluation results shows need to a fundamental revision at managers' performance evaluation form.

Evaluating Preference for Graphic Feedback on Correct versus Incorrect Performance

ERIC Educational Resources Information Center

Sigurdsson, Sigurdur O.; Ring, Brandon M.

2013-01-01

The current study evaluated preferences of undergraduate students for graphic feedback on percentage of incorrect performance versus feedback on percentage of correct performance. A total of 108 participants were enrolled in the study and received graphic feedback on performance on 12 online quizzes. One half of participants received graphic…

Performance measurement for supply chain management and evaluation criteria determination for reverse supply chain management

NASA Astrophysics Data System (ADS)

Kongar, N. Elif

2004-12-01

Today, since customers are able to obtain similar-quality products for similar prices, the lead time has become the only preference criterion for most of the consumers. Therefore, it is crucial that the lead time, i.e., the time spent from the raw material phase till the manufactured good reaches the customer, is minimized. This issue can be investigated under the title of Supply Chain Management (SCM). An efficiently managed supply chain can lead to reduced response time for customers. To achieve this, continuous observation of supply chain efficiency, i.e., a constant performance evaluation of the current SCM is required. Widely used conventional performance measurement methods lack the ability to evaluate a SCM since the supply chain is a dynamic system that requires a more thorough and flexible performance measurement technique. Balanced Scorecard (BS) is an efficient tool for measuring the performance of dynamic systems and has a proven capability of providing the decision makers with the appropriate feedback data. In addition to SCM, a relatively new management field, namely reverse supply chain management (RSCM), also necessitates an appropriate evaluation approach. RSCM differs from SCM in many aspects, i.e., the criteria used for evaluation, the high level of uncertainty involved etc., not allowing the usage of identical evaluation techniques used for SCM. This study proposes a generic Balanced Scorecard to measure the performance of supply chain management while defining the appropriate performance measures for SCM. A scorecard prototype, ESCAPE, is presented to demonstrate the evaluation process.

78 FR 46995 - National Institute on Aging; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-02

... personnel qualifications and performance, and the competence of individual investigators, the disclosure of... evaluate personal qualifications and performance, and competence of individual investigators. Place... evaluate personal qualifications and performance, and competence of individual investigators. Place...

An examination of the relationships between physicians' clinical and hospital-utilization performance.

PubMed Central

Saywell, R M; Bean, J A; Ludke, R L; Redman, R W; McHugh, G J

1981-01-01

To examine the relationships between measures of attending physician teams' clinical and utilization performance, inpatient hospital audits were conducted in 22 Maryland and western Pennsylvania nonfederal short-term hospitals. A total of 6,980 medical records were abstracted from eight diagnostic categories using the Payne and JCAH PEP medical audit procedures. The results indicate weak statistical associations between the two medical care evaluation audits; between clinical performance and utilization performance, as measured by appropriateness of admissions and length of stay; and between three utilization measures. Based on these findings, it does not appear valid to use performance in one area to evaluate performance in the other in order to measure or evaluate and ultimately improve physicians; clinical or utilization performance. PMID:6946048

A Safety Index and Method for Flightdeck Evaluation

NASA Technical Reports Server (NTRS)

Latorella, Kara A.

2000-01-01

If our goal is to improve safety through machine, interface, and training design, then we must define a metric of flightdeck safety that is usable in the design process. Current measures associated with our notions of "good" pilot performance and ultimate safety of flightdeck performance fail to provide an adequate index of safe flightdeck performance for design evaluation purposes. The goal of this research effort is to devise a safety index and method that allows us to evaluate flightdeck performance holistically and in a naturalistic experiment. This paper uses Reason's model of accident causation (1990) as a basis for measuring safety, and proposes a relational database system and method for 1) defining a safety index of flightdeck performance, and 2) evaluating the "safety" afforded by flightdeck performance for the purpose of design iteration. Methodological considerations, limitations, and benefits are discussed as well as extensions to this work.

Using hybrid method to evaluate the green performance in uncertainty.

PubMed

Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

2011-04-01

Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

Evaluative-feedback stimuli selectively activate the self-related brain area: an fMRI study.

PubMed

Pan, Xiaohong; Hu, Yang; Li, Lei; Li, Jianqi

2009-11-06

Evaluative-feedback, occurring in our daily life, generally contains subjective appraisal of one's specific abilities and personality characteristics besides objective right-or-wrong information. Traditional psychological researches have proved it to be important in building up one's self-concept; however, the neural basis underlying its cognitive processing remains unclear. The present neuroimaging study revealed the mechanism of evaluative-feedback processing at the neural level. 19 healthy Chinese subjects participated in this experiment, and completed the time-estimation task to better their performance according to four types of feedback, namely positive evaluative- and performance-feedback as well as negative evaluative- and performance-feedback. Neuroimaging findings showed that evaluative- rather than performance-feedback can induce increased activities mainly distributed in the cortical midline structures (CMS), including medial prefrontal cortex (BA 8/9)/anterior cigulate cortex (ACC, BA 20), precuneus (BA 7/31) adjacent to posterior cingulate gyrus (PCC, BA 23) of both hemispheres, as well as right inferior lobule (BA 40). This phenomenon can provide evidence that evaluative-feedback may significantly elicit the self-related processing in our brain. In addition, our results also revealed that more brain areas, particularly some self-related neural substrates were activated by the positive evaluative-feedback, in comparative with the negative one. In sum, this study suggested that evaluative-feedback was closely correlated with the self-concept processing, which distinguished it from the performance-feedback.

Key results of battery performance and life tests at Argonne National Laboratory

NASA Astrophysics Data System (ADS)

Deluca, W. H.; Gillie, K. R.; Kulaga, J. E.; Smaga, J. A.; Tummillo, A. F.; Webster, C. E.

1991-12-01

Advanced battery technology evaluations are performed under simulated electric vehicle operating conditions at Argonne National Laboratory's & Diagnostic Laboratory (ADL). The ADL provide a common basis for both performance characterization and life evaluation with unbiased application of tests and analyses. This paper summarizes the performance characterizations and life evaluations conducted in 1991 on twelve single cells and eight 3- to 360-cell modules that encompass six battery technologies (Na/S, Li/MS, Ni/MH, Zn/Br, Ni/Fe, and Pb-Acid). These evaluations were performed for the Department of Energy, Office of Transportation Technologies, Electric and Hybrid Propulsion Division. The results measure progress in battery R & D programs, compare battery technologies, and provide basic data for modeling and continuing R & D to battery users, developers, and program managers.

High-density fuel effects. Final report, September 1985-April 1988

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rizk, N.K.; Oechsie, V.L.; Ross, P.T.

1988-08-18

The purpose of this program was to determine, by combustor rig tests and data evaluation, the effects of the high-density fuel properties on the performance and durability of the Allison T56-A-15 combustion system. Four high-density fuels in addition to baseline JP4 were evaluated in the effort. The rig-test program included: nozzle-flow bench testing, aerothermal performance and wall temperature, flame stability and ignition, injector coking and plugging, and flow-transient effect. The data-evaluation effort involved the utilization of empirical correlations in addition to analytical multidimensional tools to analyze the performance of the combustor. The modifications required to optimize the performance with high-densitymore » fuels were suggested and the expected improvement in performance was evaluated.« less

Classroom Performance Evaluation: Stages and Perspectives for Professional Development of Secondary Teachers in Vietnam

ERIC Educational Resources Information Center

Pham, Huy Q.; Roberts, Stacey B.

2012-01-01

This study examined classroom performance evaluation of secondary teachers in Vietnam. Specially, it sought to determine the possibility of applying supervision into the evaluation for teaching development. Data were collected from interviews with 34 (n=34) participants: ten evaluators and 24 teachers in different school contexts: rural areas,…

At-Risk Youth Appearance and Job Performance Evaluation

ERIC Educational Resources Information Center

Freeburg, Beth Winfrey; Workman, Jane E.

2008-01-01

The goal of this study was to identify the relationship of at-risk youth workplace appearance to other job performance criteria. Employers (n = 30; each employing from 1 to 17 youths) evaluated 178 at-risk high school youths who completed a paid summer employment experience. Appearance evaluations were significantly correlated with evaluations of…

National Evaluation of Bologna Implementation in Finland: Procedures and Outcomes

ERIC Educational Resources Information Center

Ahola, Sakari

2012-01-01

Finland has performed, as one of the first Bologna countries, a national evaluation of the outcomes of the implementation of the Bologna process. The evaluation was organized by the Finnish Higher Education Evaluation Council and performed by an independent expert group during 2010. In general, the reform was conceived as a significant development…

Questionnaire Evaluating Teaching Competencies in the University Environment. Evaluation of Teaching Competencies in the University

ERIC Educational Resources Information Center

Moreno-Murcia, Juan Antonio; Silveira Torregrosa, Yolanda; Belando Pedreño, Noelia

2015-01-01

The objective of this study was to design and validate a measuring instrument to evaluate the performance of university professors. The Evaluation of Teaching Performance (CEID [Centro de Estudios e Investigaciones Docentes (Center for Teaching Studies and Research)]) questionnaire was administered to 1297 university students. Various factor…

Performance Measurement for Substance Abuse Treatment Services. Integrated Evaluation Methods. Revised.

ERIC Educational Resources Information Center

Harwood, Henrick; Bazron, Barbara; Fountain, Douglas

This paper presents state-of-the-art models addressing issues related to coordination of treatment and evaluation activities, and integration of clinical, performance, and evaluation information. Specifically, this concept paper contains a discussion of the need for and types of cost analyses for CSAT treatment evaluation and knowledge-generating…

Evaluation and Development of Administrators. AAHE-ERIC/Higher Education Research Report No. 6, 1979.

ERIC Educational Resources Information Center

Nordvall, Robert C.

Needs and methods for the evaluation and development of higher education administrators are reviewed in this monograph. Three major reasons for evaluation are cited: external and internal pressure, improvement of performance of individual administrators, and improvement of performance of the institution. Different approaches to evaluation are…

An Analysis of Critical Issues in Korean Teacher Evaluation Systems

ERIC Educational Resources Information Center

Choi, Hee Jun; Park, Ji-Hye

2016-01-01

Korea has used three different teacher evaluation systems since the 1960s: teacher performance rating, teacher performance-based pay and teacher evaluation for professional development. A number of studies have focused on an analysis of each evaluation system in terms of its advent, development, advantages and disadvantages, but these studies have…

Models and techniques for evaluating the effectiveness of aircraft computing systems

NASA Technical Reports Server (NTRS)

Meyer, J. F.

1978-01-01

Progress in the development of system models and techniques for the formulation and evaluation of aircraft computer system effectiveness is reported. Topics covered include: analysis of functional dependence: a prototype software package, METAPHOR, developed to aid the evaluation of performability; and a comprehensive performability modeling and evaluation exercise involving the SIFT computer.

76 FR 18615 - 30-Day Notice of Proposed Information Collection: Performance Measurement, Evaluation and Public...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-04-04

...: Performance Measurement, Evaluation and Public Diplomacy Program Surveys. OMB Control Number: 1405-0158. Type... and Cultural Affairs, Office of Policy and Evaluation, Evaluation Division (ECA/P/ V). Form Number: SV... State. [FR Doc. 2011-7931 Filed 4-1-11; 8:45 am] BILLING CODE 4710-05-P ...

Extra-Vehicular Activity (EVA) glove evaluation test protocol

NASA Technical Reports Server (NTRS)

Hinman-Sweeney, E. M.

1994-01-01

One of the most critical components of a space suit is the gloves, yet gloves have traditionally presented significant design challenges. With continued efforts at glove development, a method for evaluating glove performance is needed. This paper presents a pressure-glove evaluation protocol. A description of this evaluation protocol, and its development is provided. The protocol allows comparison of one glove design to another, or any one design to bare-handed performance. Gloves for higher pressure suits may be evaluated at current and future design pressures to drive out differences in performance due to pressure effects. Using this protocol, gloves may be evaluated during design to drive out design problems and determine areas for improvement, or fully mature designs may be evaluated with respect to mission requirements. Several different test configurations are presented to handle these cases. This protocol was run on a prototype glove. The prototype was evaluated at two operating pressures and in the unpressurized state, with results compared to bare-handed performance. Results and analysis from this test series are provided, as is a description of the configuration used for this test.

Evaluation of ASR potential in Wyoming aggregates.

DOT National Transportation Integrated Search

2013-10-01

A comprehensive study was performed to evaluate the ASR reactivity of eight Wyoming aggregates. State-of-the-art and standardized test : methods were performed and results were used to evaluate these aggregate sources. Of the eight aggregates: four a...

Performance Evaluation of the United Nations Environment Programme Air Quality Monitoring Unit

EPA Pesticide Factsheets

This report defines the specifics of the environmental test conditions used in the evaluation (systems and conditions), data observations, summarization of key performance evaluation findings, and ease of use features concerning the UNEP pod.

Evaluating performance of limestone prone to polishing : final report, December 31, 2009.

DOT National Transportation Integrated Search

2009-12-21

This research project evaluated the effect of blending Vanport limestone and other aggregates on the frictional surface characteristic properties of constructed trial road surfaces. The study undertook the evaluation of the performance of different m...

Evaluation of experimental flexible pavements : interim report no. 2.

DOT National Transportation Integrated Search

1975-01-01

A program of construction and performance evaluation of seven Virginia flexible pavements containing at least some experimental features is reported. The objective of the program is to evaluate the performance of the pavements incorporating new or ti...

48 CFR 715.305 - Proposal evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

....305 Section 715.305 Federal Acquisition Regulations System AGENCY FOR INTERNATIONAL DEVELOPMENT CONTRACTING METHODS AND CONTRACT TYPES CONTRACTING BY NEGOTIATION Source Selection 715.305 Proposal evaluation... Contractor Performance System to evaluate past performance. (Access to the system by USAID contracting office...

Performance evaluation of seal coat materials and designs.

DOT National Transportation Integrated Search

2011-01-01

"This project presents an evaluation of seal coat materials and design method. The primary objectives of this research are 1) to evaluate seal coat performance : from various combinations of aggregates and emulsions in terms of aggregate loss; 2) to ...

Evaluating evaluation forms form.

PubMed

Smith, Roger P

2004-02-01

To provide a tool for evaluating evaluation forms. A new form has been developed and tested on itself and a sample of evaluation forms obtained from the graduate medical education offices of several local universities. Additional forms from hospital administration were also subjected to analysis. The new form performed well when applied to itself. The form performed equally well when applied to the other (subject) forms, although their scores were embarrassingly poor. A new form for evaluating evaluation forms is needed, useful, and now available.

Performance of the SEAPROG prognosis variant of the forest vegetation simulator.

Treesearch

Michael H. McClellan; Frances E. Biles

2003-01-01

This paper reports the first phase of a recent effort to evaluate the performance and use of the FVS-SEAPROG vegetation growth model. In this paper, we present our evaluation of SEAPROG’s performance in modeling the growth of even-aged stands regenerated by clearcutting, windthrow, or fire. We evaluated the model by comparing model predictions to observed values from...

A Comparative Evaluation of Group IV Personnel Assigned to the U.S.S. Catskill; Followup Performance Evaluation.

ERIC Educational Resources Information Center

Van Matre, Nicholas H.; Harrigan, Robert J.

A followup performance evaluation was conducted on a sample of Group 4 (low ability) personnel who had served 14 months aboard the mine contermeasures support ship U.S.S. Catskill (MCS-1). Shipboard assessments were made of the Group 4 sample and the non-Group 4 comparison sample in terms of performance test proficiency, supervisors' ratings, and…

40 CFR 63.2180 - What notifications must I submit and when?

Code of Federal Regulations, 2010 CFR

2010-07-01

... required in § 63.7(b)(1). (d) If you are required to conduct a performance evaluation as specified in § 63.2163(b), you must submit a notification of the date of the performance evaluation at least 60 days prior to the date the performance evaluation is scheduled to begin as required in § 63.8(e)(2). (e) If...

Performance evaluation of a second-generation elastic loop mobility system

NASA Technical Reports Server (NTRS)

Melzer, K. J.; Swanson, G. D.

1974-01-01

Tests were conducted to evaluate the mobility performance of a second-generation Elastic Loop Mobility System (ELMS II). Performance on level test lanes and slopes of lunar soil simulant (LSS) and obstacle-surmounting and crevasse-crossing capabilities were investigated. In addition, internal losses and contact pressure distributions were evaluated. To evaluate the soft-soil performance, two basic soil conditions were tested: loose (LSS1) and dense (LSS5). These conditions embrace the spectrum of soil strengths tested during recent studies for NASA related to the mobility performance of the LRV. Data indicated that for the tested range of the various performance parameters, performance was independent of unit load (contact pressure) and ELMS II drum angular velocity, but was influenced by soil strength and ELMS pitch mode. Power requirements were smaller at a given system output for dense soil than for loose soil. The total system output in terms of pull developed or slope-climbing capability was larger for the ELMS II operating in restrained-pitch mode than in free-pitch mode.

Evaluation of surface detail reproduction, dimensional stability and gypsum compatibility of monophase polyvinyl-siloxane and polyether elastomeric impression materials under dry and moist conditions

PubMed Central

Vadapalli, Sriharsha Babu; Atluri, Kaleswararao; Putcha, Madhu Sudhan; Kondreddi, Sirisha; Kumar, N. Suman; Tadi, Durga Prasad

2016-01-01

Objectives: This in vitro study was designed to compare polyvinyl-siloxane (PVS) monophase and polyether (PE) monophase materials under dry and moist conditions for properties such as surface detail reproduction, dimensional stability, and gypsum compatibility. Materials and Methods: Surface detail reproduction was evaluated using two criteria. Dimensional stability was evaluated according to American Dental Association (ADA) specification no. 19. Gypsum compatibility was assessed by two criteria. All the samples were evaluated, and the data obtained were analyzed by a two-way analysis of variance (ANOVA) and Pearson's Chi-square tests. Results: When surface detail reproduction was evaluated with modification of ADA specification no. 19, both the groups under the two conditions showed no significant difference statistically. When evaluated macroscopically both the groups showed statistically significant difference. Results for dimensional stability showed that the deviation from standard was significant among the two groups, where Aquasil group showed significantly more deviation compared to Impregum group (P < 0.001). Two conditions also showed significant difference, with moist conditions showing significantly more deviation compared to dry condition (P < 0.001). The results of gypsum compatibility when evaluated with modification of ADA specification no. 19 and by giving grades to the casts for both the groups and under two conditions showed no significant difference statistically. Conclusion: Regarding dimensional stability, both impregum and aquasil performed better in dry condition than in moist; impregum performed better than aquasil in both the conditions. When tested for surface detail reproduction according to ADA specification, under dry and moist conditions both of them performed almost equally. When tested according to macroscopic evaluation, impregum and aquasil performed significantly better in dry condition compared to moist condition. In dry condition, both the materials performed almost equally. In moist condition, aquasil performed significantly better than impregum. Regarding gypsum compatibility according to ADA specification, in dry condition both the materials performed almost equally, and in moist condition aquasil performed better than impregum. When tested by macroscopic evaluation, impregum performed better than aquasil in both the conditions. PMID:27583217

Evaluation of surface detail reproduction, dimensional stability and gypsum compatibility of monophase polyvinyl-siloxane and polyether elastomeric impression materials under dry and moist conditions.

PubMed

Vadapalli, Sriharsha Babu; Atluri, Kaleswararao; Putcha, Madhu Sudhan; Kondreddi, Sirisha; Kumar, N Suman; Tadi, Durga Prasad

2016-01-01

This in vitro study was designed to compare polyvinyl-siloxane (PVS) monophase and polyether (PE) monophase materials under dry and moist conditions for properties such as surface detail reproduction, dimensional stability, and gypsum compatibility. Surface detail reproduction was evaluated using two criteria. Dimensional stability was evaluated according to American Dental Association (ADA) specification no. 19. Gypsum compatibility was assessed by two criteria. All the samples were evaluated, and the data obtained were analyzed by a two-way analysis of variance (ANOVA) and Pearson's Chi-square tests. When surface detail reproduction was evaluated with modification of ADA specification no. 19, both the groups under the two conditions showed no significant difference statistically. When evaluated macroscopically both the groups showed statistically significant difference. Results for dimensional stability showed that the deviation from standard was significant among the two groups, where Aquasil group showed significantly more deviation compared to Impregum group (P < 0.001). Two conditions also showed significant difference, with moist conditions showing significantly more deviation compared to dry condition (P < 0.001). The results of gypsum compatibility when evaluated with modification of ADA specification no. 19 and by giving grades to the casts for both the groups and under two conditions showed no significant difference statistically. Regarding dimensional stability, both impregum and aquasil performed better in dry condition than in moist; impregum performed better than aquasil in both the conditions. When tested for surface detail reproduction according to ADA specification, under dry and moist conditions both of them performed almost equally. When tested according to macroscopic evaluation, impregum and aquasil performed significantly better in dry condition compared to moist condition. In dry condition, both the materials performed almost equally. In moist condition, aquasil performed significantly better than impregum. Regarding gypsum compatibility according to ADA specification, in dry condition both the materials performed almost equally, and in moist condition aquasil performed better than impregum. When tested by macroscopic evaluation, impregum performed better than aquasil in both the conditions.

The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-Career Teachers. NBER Working Paper No. 16877

ERIC Educational Resources Information Center

Taylor, Eric S.; Tyler, John H.

2011-01-01

The effect of evaluation on employee performance is traditionally studied in the context of the principal-agent problem. Evaluation can, however, also be characterized as an investment in the evaluated employee's human capital. We study a sample of mid-career public school teachers where we can consider these two types of evaluation effect…

Nurses' evaluation of physicians' non-clinical performance in emergency departments: advantages, disadvantages and lessons learned.

PubMed

Alameddine, Mohamad; Mufarrij, Afif; Saliba, Miriam; Mourad, Yara; Jabbour, Rima; Hitti, Eveline

2015-02-27

Peer evaluation is increasingly used as a method to assess physicians' interpersonal and communication skills. We report on experience with soliciting registered nurses' feedback on physicians' non-clinical performance in the ED of a large academic medical center in Lebanon. We utilized a secondary analysis of a de-identified database of ED nurses' assessment of physicians' non-clinical performance coupled with an evaluation of interventions carried out as a result of this evaluation. The database was compiled as part of quality/performance improvement initiatives using a cross-sectional design to survey registered nurses working at the ED. The survey instrument included open ended and closed ended questions assessing physicians' communication, professionalism and leadership skills. Three episodes of evaluation were carried out over an 18 month period. Physicians were provided with a communication training carried out after the first cycle of evaluation and a detailed feedback on their assessment by nurses after each evaluation cycle. A paired t-test was carried out to compare mean evaluation scores between the three cycles of evaluation. Thematic analysis of nurses' qualitative comments was carried out. A statistically significant increase in the averages of skills was observed between the first and second evaluations, followed by a significant decrease in the averages of the three skills between the second and third evaluations. Personalized feedback to ED physicians and communication training initially contributed to a significant positive impact on improving ED physicians' non-clinical skills as perceived by the ED nurses. Yet, gains achieved were lost upon reaching the third cycle of evaluation. However, the thematic analysis of the nurses' qualitative responses portrays a decrease in concerns across the various dimensions of non-clinical performance. Nurses' evaluation of the non-clinical performance of physicians has the potential of improving communication, professionalism and leadership skills amongst physicians. For improvement to be realized in a sustainable manner, such programs may need to be offered in a staged and incremental manner over a long period of time with proper dedication of resources and timely monitoring and evaluation of outcomes. Department directors need to be trained on providing peer evaluation feedback in a constructive manner.

Performance Evaluation and Analysis of Rural Drinking Water Safety Project——A Case Study in Jiangsu, China

NASA Astrophysics Data System (ADS)

Du, Xiaorong

2017-04-01

Water is the basic condition for human survival and development. As China is the most populous country, rural drinking water safety problems are most conspicuous. Therefore, the Chinese government keeps increasing investment and has built a large number of rural drinking water safety projects. Scientific evaluation of project performance is of great significance to promote the sustainable operation of the project and the sustainable development of rural economy. Previous studies mainly focus on the economic benefits of the project, while ignoring the fact that the rural drinking water safety project is quasi-public goods, which has economic, social and ecological benefits. This paper establishes a comprehensive evaluation model for rural drinking water safety performance, which adapts the rules of "5E" (economy, efficiency, effectiveness, equity and environment) as the value orientation, and selects a rural drinking water safety project as object in case study at K District, which is in the north of Jiangsu Province, China. The results shows: 1) the comprehensive performance of K project is in good condition; 2) The performance of every part shows that the scores of criteria "efficiency", "environment" and "effect" are higher than the mean performance, while the "economy" is slightly lower than the mean and the "equity" is the lowest. 3) The performance of indicator layer shows that: the planned completion rate of project, the reduction rate of project cost and the penetration rate of water-use population are significantly lower than other indicators. Based on the achievements of previous studies and the characteristics of rural drinking water safety project, this study integrates the evaluation dimensions of equity and environment, which can contribute to a more comprehensive and systematic assessment of project performance and provide empirical data for performance evaluation and management of rural drinking water safety project. Key Words: Rural drinking water safety project; Performance evaluation; 5E rules; Comprehensive evaluation model

Implementation and evaluation of a dilation and evacuation simulation training curriculum.

PubMed

York, Sloane L; McGaghie, William C; Kiley, Jessica; Hammond, Cassing

2016-06-01

To evaluate obstetrics and gynecology resident physicians' performance following a simulation curriculum on dilation and evacuation (D&E) procedures. This study included two phases: simulation curriculum development and resident physician performance evaluation following training on a D&E simulator. Trainees participated in two evaluations. Simulation training evaluated participants performing six cases on a D&E simulator, measuring procedural time and a 26-step checklist of D&E steps. The operative training portion evaluated residents' performance after training on the simulator using mastery learning techniques. Intra-operative evaluation was based on a 21-step checklist score, Objective Structured Assessment of Technical Skills (OSATS), and percentage of cases completed. Twenty-two residents participated in simulation training, demonstrating improved performance from cases one and two to cases five and six, as measured by checklist score and procedural time (p<.001 and p=.001, respectively). Of 10 participants in the operative training, all performed at least three D&Es, while seven performed at least six cases. While checklist scores did not change significantly from the first to sixth case (mean for first case: 18.3; for sixth case: 19.6; p=.593), OSATS ratings improved from case one (19.7) to case three (23.5; p=.001) and to case six (26.8; p=.005). Trainees completed approximately 71.6% of their first case (range: 21.4-100%). By case six, the six participants performed 81.2% of the case (range: 14.3-100%). D&E simulation using a newly-developed uterine model and simulation curriculum improves resident technical skills. Simulation training with mastery learning techniques transferred to high level of performance in OR using checklist. The OSATS measured skills and showed improvement in performance with subsequent cases. Implementation of a D&E simulation curriculum offers potential for improved surgical training and abortion provision. Copyright © 2016 Elsevier Inc. All rights reserved.

Evaluation as a critical factor of success in local public health accreditation programs.

PubMed

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

76 FR 57062 - National Institute on Aging; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2011-09-15

... personnel qualifications and performance, and the competence of individual investigators, the disclosure of... review and evaluate personal qualifications and performance, and competence of individual investigators... and evaluate personal qualifications and performance, and competence of individual investigators...

48 CFR 42.1503 - Procedures.

Code of Federal Regulations, 2010 CFR

2010-10-01

... CONTRACT ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 42.1503 Procedures. (a) Agency procedures for the past performance evaluation system shall generally provide for input to the.... Those individuals identified may obtain information for the evaluation of performance from the program...

Data-driven freeway performance evaluation framework for project prioritization and decision making.

DOT National Transportation Integrated Search

2017-01-01

This report describes methods that potentially can be incorporated into the performance monitoring and planning processes for freeway performance evaluation and decision making. Reliability analysis was conducted on the selected I-15 corridor by empl...

Data-driven freeway performance evaluation framework for project prioritization and decision making.

DOT National Transportation Integrated Search

2015-03-01

This report describes methods that potentially can be incorporated into the performance monitoring and planning : processes for freeway performance evaluation and decision making. Reliability analysis is conducted on the selected : I-15 corridor by e...

Fuzzy logic based sensor performance evaluation of vehicle mounted metal detector systems

NASA Astrophysics Data System (ADS)

Abeynayake, Canicious; Tran, Minh D.

2015-05-01

Vehicle Mounted Metal Detector (VMMD) systems are widely used for detection of threat objects in humanitarian demining and military route clearance scenarios. Due to the diverse nature of such operational conditions, operational use of VMMD without a proper understanding of its capability boundaries may lead to heavy causalities. Multi-criteria fitness evaluations are crucial for determining capability boundaries of any sensor-based demining equipment. Evaluation of sensor based military equipment is a multi-disciplinary topic combining the efforts of researchers, operators, managers and commanders having different professional backgrounds and knowledge profiles. Information acquired through field tests usually involves uncertainty, vagueness and imprecision due to variations in test and evaluation conditions during a single test or series of tests. This report presents a fuzzy logic based methodology for experimental data analysis and performance evaluation of VMMD. This data evaluation methodology has been developed to evaluate sensor performance by consolidating expert knowledge with experimental data. A case study is presented by implementing the proposed data analysis framework in a VMMD evaluation scenario. The results of this analysis confirm accuracy, practicability and reliability of the fuzzy logic based sensor performance evaluation framework.

Evaluation of Flagging Criteria of United States Kidney Transplant Center Performance: How to Best Define Outliers?

PubMed

Schold, Jesse D; Miller, Charles M; Henry, Mitchell L; Buccini, Laura D; Flechner, Stuart M; Goldfarb, David A; Poggio, Emilio D; Andreoni, Kenneth A

2017-06-01

Scientific Registry of Transplant Recipients report cards of US organ transplant center performance are publicly available and used for quality oversight. Low center performance (LP) evaluations are associated with changes in practice including reduced transplant rates and increased waitlist removals. In 2014, Scientific Registry of Transplant Recipients implemented new Bayesian methodology to evaluate performance which was not adopted by Center for Medicare and Medicaid Services (CMS). In May 2016, CMS altered their performance criteria, reducing the likelihood of LP evaluations. Our aims were to evaluate incidence, survival rates, and volume of LP centers with Bayesian, historical (old-CMS) and new-CMS criteria using 6 consecutive program-specific reports (PSR), January 2013 to July 2015 among adult kidney transplant centers. Bayesian, old-CMS and new-CMS criteria identified 13.4%, 8.3%, and 6.1% LP PSRs, respectively. Over the 3-year period, 31.9% (Bayesian), 23.4% (old-CMS), and 19.8% (new-CMS) of centers had 1 or more LP evaluation. For small centers (<83 transplants/PSR), there were 4-fold additional LP evaluations (52 vs 13 PSRs) for 1-year mortality with Bayesian versus new-CMS criteria. For large centers (>183 transplants/PSR), there were 3-fold additional LP evaluations for 1-year mortality with Bayesian versus new-CMS criteria with median differences in observed and expected patient survival of -1.6% and -2.2%, respectively. A significant proportion of kidney transplant centers are identified as low performing with relatively small survival differences compared with expected. Bayesian criteria have significantly higher flagging rates and new-CMS criteria modestly reduce flagging. Critical appraisal of performance criteria is needed to assess whether quality oversight is meeting intended goals and whether further modifications could reduce risk aversion, more efficiently allocate resources, and increase transplant opportunities.

Goal Orientations of General Chemistry Students via the Achievement Goal Framework

ERIC Educational Resources Information Center

Lewis, Scott E.

2018-01-01

The Achievement Goal Framework describes students' goal orientations as: task-based, focusing on the successful completion of the task; self-based, evaluating performance relative to one's own past performance; or other-based, evaluating performance relative to the performance of others. Goal orientations have been used to explain student success…

The Effects of Group Interdependence on Supervisor Performance Evaluations.

ERIC Educational Resources Information Center

Liden, Robert C.; Mitchell, Terence R.

1983-01-01

Tested the effect of group member interdependence on supervisory performance ratings. Students (N=72) played the role of supervisors in charge of evaluating members of a three-person work group. Results showed supervisors rated the poor performer higher and the good performers lower when the group was portrayed as highly interdependent. (JAC)

Orchestra Festival Evaluations: Interjudge Agreement and Relationships between Performance Categories and Final Ratings.

ERIC Educational Resources Information Center

Garman, Barry R.; And Others

1991-01-01

Band, orchestra, and choir festival evaluations are a regular part of many secondary school music programs, and most such festivals engage adjudicators who rate each group's performance. Because music ensemble performance is complex and multi-dimensional, it does not lend itself readily to precise measurement; generally, musical performances are…

The supervisor's performance appraisal: evaluating the evaluator.

PubMed

McConnell, C R

1993-04-01

The focus of much performance appraisal in the coming decade or so will likely be on the level of customer satisfaction achieved through performance. Ultimately, evaluating the evaluator--that is, appraising the supervisor--will likely become a matter of assessing how well the supervisor's department meets the needs of its customers. Since meeting the needs of one's customers can well become the strongest determinant of organizational success or failure, it follows that relative success in ensuring these needs are met can become the primary indicator of one's relative success as a supervisor. This has the effect of placing the emphasis on supervisory performance exactly at the point it belongs, right on the bottom-line results of the supervisor's efforts.

EVALUATION REPORT SCIENCE APPLICATIONS INTERNATIONAL CORPORATION S-CAD CHEMICAL AGENT DETECTION SYSTEM

EPA Science Inventory

The USEPA's National Homeland Security Research Center (NHSRC)Technology Testing and Evaluation Program (TTEP) is carrying out performance tests on homeland security technologies. Under TTEP, Battelle recently evaluated the performance of the Science Applications International Co...

Building Leadership Talent through Performance Evaluation

ERIC Educational Resources Information Center

Clifford, Matthew

2015-01-01

Most states and districts scramble to provide professional development to support principals, but "principal evaluation" is often lost amid competing priorities. Evaluation is an important method for supporting principal growth, communicating performance expectations to principals, and improving leadership practice. It provides leaders…

Between-individual comparisons in performance evaluation: a perspective from prospect theory.

PubMed

Wong, Kin Fai Ellick; Kwong, Jessica Y Y

2005-03-01

This article examines how between-individual comparisons influence performance evaluations in rating tasks. The authors demonstrated a systematic change in the perceived difference across ratees as a result of changing the way performance information is expressed. Study 1 found that perceived performance difference between 2 individuals was greater when their objective performance levels were presented with small numbers (e.g., absence rates of 2% vs. 5%) than when they were presented with large numbers (e.g., attendance rates of 98% vs. 95%). Extending this finding to situations involving trade-offs between multiple performance attributes across ratees, Study 2 showed that the relative preference for 1 ratee over another actually reversed when the presentation format of the performance information changed. The authors draw upon prospect theory to offer a theoretical framework describing the between-individual comparison aspect of performance evaluation.

A comprehensive performance evaluation on the prediction results of existing cooperative transcription factors identification algorithms.

PubMed

Lai, Fu-Jou; Chang, Hong-Tsun; Huang, Yueh-Min; Wu, Wei-Sheng

2014-01-01

Eukaryotic transcriptional regulation is known to be highly connected through the networks of cooperative transcription factors (TFs). Measuring the cooperativity of TFs is helpful for understanding the biological relevance of these TFs in regulating genes. The recent advances in computational techniques led to various predictions of cooperative TF pairs in yeast. As each algorithm integrated different data resources and was developed based on different rationales, it possessed its own merit and claimed outperforming others. However, the claim was prone to subjectivity because each algorithm compared with only a few other algorithms and only used a small set of performance indices for comparison. This motivated us to propose a series of indices to objectively evaluate the prediction performance of existing algorithms. And based on the proposed performance indices, we conducted a comprehensive performance evaluation. We collected 14 sets of predicted cooperative TF pairs (PCTFPs) in yeast from 14 existing algorithms in the literature. Using the eight performance indices we adopted/proposed, the cooperativity of each PCTFP was measured and a ranking score according to the mean cooperativity of the set was given to each set of PCTFPs under evaluation for each performance index. It was seen that the ranking scores of a set of PCTFPs vary with different performance indices, implying that an algorithm used in predicting cooperative TF pairs is of strength somewhere but may be of weakness elsewhere. We finally made a comprehensive ranking for these 14 sets. The results showed that Wang J's study obtained the best performance evaluation on the prediction of cooperative TF pairs in yeast. In this study, we adopted/proposed eight performance indices to make a comprehensive performance evaluation on the prediction results of 14 existing cooperative TFs identification algorithms. Most importantly, these proposed indices can be easily applied to measure the performance of new algorithms developed in the future, thus expedite progress in this research field.

Understanding the Performance and Potential of Cloud Computing for Scientific Applications

DOE PAGES

Sadooghi, Iman; Martin, Jesus Hernandez; Li, Tonglin; ...

2015-02-19

In this paper, commercial clouds bring a great opportunity to the scientific computing area. Scientific applications usually require significant resources, however not all scientists have access to sufficient high-end computing systems, may of which can be found in the Top500 list. Cloud Computing has gained the attention of scientists as a competitive resource to run HPC applications at a potentially lower cost. But as a different infrastructure, it is unclear whether clouds are capable of running scientific applications with a reasonable performance per money spent. This work studies the performance of public clouds and places this performance in context tomore » price. We evaluate the raw performance of different services of AWS cloud in terms of the basic resources, such as compute, memory, network and I/O. We also evaluate the performance of the scientific applications running in the cloud. This paper aims to assess the ability of the cloud to perform well, as well as to evaluate the cost of the cloud running scientific applications. We developed a full set of metrics and conducted a comprehensive performance evlauation over the Amazon cloud. We evaluated EC2, S3, EBS and DynamoDB among the many Amazon AWS services. We evaluated the memory sub-system performance with CacheBench, the network performance with iperf, processor and network performance with the HPL benchmark application, and shared storage with NFS and PVFS in addition to S3. We also evaluated a real scientific computing application through the Swift parallel scripting system at scale. Armed with both detailed benchmarks to gauge expected performance and a detailed monetary cost analysis, we expect this paper will be a recipe cookbook for scientists to help them decide where to deploy and run their scientific applications between public clouds, private clouds, or hybrid clouds.« less

Understanding the Performance and Potential of Cloud Computing for Scientific Applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sadooghi, Iman; Martin, Jesus Hernandez; Li, Tonglin

In this paper, commercial clouds bring a great opportunity to the scientific computing area. Scientific applications usually require significant resources, however not all scientists have access to sufficient high-end computing systems, may of which can be found in the Top500 list. Cloud Computing has gained the attention of scientists as a competitive resource to run HPC applications at a potentially lower cost. But as a different infrastructure, it is unclear whether clouds are capable of running scientific applications with a reasonable performance per money spent. This work studies the performance of public clouds and places this performance in context tomore » price. We evaluate the raw performance of different services of AWS cloud in terms of the basic resources, such as compute, memory, network and I/O. We also evaluate the performance of the scientific applications running in the cloud. This paper aims to assess the ability of the cloud to perform well, as well as to evaluate the cost of the cloud running scientific applications. We developed a full set of metrics and conducted a comprehensive performance evlauation over the Amazon cloud. We evaluated EC2, S3, EBS and DynamoDB among the many Amazon AWS services. We evaluated the memory sub-system performance with CacheBench, the network performance with iperf, processor and network performance with the HPL benchmark application, and shared storage with NFS and PVFS in addition to S3. We also evaluated a real scientific computing application through the Swift parallel scripting system at scale. Armed with both detailed benchmarks to gauge expected performance and a detailed monetary cost analysis, we expect this paper will be a recipe cookbook for scientists to help them decide where to deploy and run their scientific applications between public clouds, private clouds, or hybrid clouds.« less

Strapdown system performance optimization test evaluations (SPOT), volume 1

NASA Technical Reports Server (NTRS)

Blaha, R. J.; Gilmore, J. P.

1973-01-01

A three axis inertial system was packaged in an Apollo gimbal fixture for fine grain evaluation of strapdown system performance in dynamic environments. These evaluations have provided information to assess the effectiveness of real-time compensation techniques and to study system performance tradeoffs to factors such as quantization and iteration rate. The strapdown performance and tradeoff studies conducted include: (1) Compensation models and techniques for the inertial instrument first-order error terms were developed and compensation effectivity was demonstrated in four basic environments; single and multi-axis slew, and single and multi-axis oscillatory. (2) The theoretical coning bandwidth for the first-order quaternion algorithm expansion was verified. (3) Gyro loop quantization was identified to affect proportionally the system attitude uncertainty. (4) Land navigation evaluations identified the requirement for accurate initialization alignment in order to pursue fine grain navigation evaluations.

Logic Modeling as a Tool to Prepare to Evaluate Disaster and Emergency Preparedness, Response, and Recovery in Schools

ERIC Educational Resources Information Center

Zantal-Wiener, Kathy; Horwood, Thomas J.

2010-01-01

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

45 CFR 2522.540 - Do the costs of performance measurement or evaluation count towards the statutory cap on...

Code of Federal Regulations, 2010 CFR

2010-10-01

... evaluation count towards the statutory cap on administrative costs? 2522.540 Section 2522.540 Public Welfare... measurement or evaluation count towards the statutory cap on administrative costs? No, the costs of performance measurement and evaluation do not count towards the statutory five percent cap on administrative...

Effect of Leadership Styles of School Administrators on Teacher Evaluation of Their Job Performance.

ERIC Educational Resources Information Center

Ogletree, Earl J.; Thomas, Vernadine

The effect of leadership styles of school administrators on teacher evaluations of their job performances is examined in this paper. A secondary focus is a comparison of teacher characteristics and their effects on administrator evaluation. A principal evaluation survey was administered to 120 Chicago public and nonpublic school teachers,…

A Critical Review of Violin Solos Section of the "NYSSMA Manual"

ERIC Educational Resources Information Center

Su, Di

2008-01-01

The New York State School Music Association (NYSSMA) runs an annual evaluation of students' musical performance. The purposes of the evaluation are to promote music programs in the schools and communities of New York State, and to provide a means of objective evaluation of musical performance. The evaluation is influential because the selections…

PERFORMANCE EVALUATION OF TYPE I MARINE SANITATION DEVICES

EPA Science Inventory

This performance test was designed to evaluate the effectiveness of two Type I Marine Sanitation Devices (MSDs): the Electro Scan Model EST 12, manufactured by Raritan Engineering Company, Inc., and the Thermopure-2, manufactured by Gross Mechanical Laboratories, Inc. Performance...

Performance evaluation and placement analysis of w-beam guardrails behind curbs.

DOT National Transportation Integrated Search

2014-12-15

This report summarizes the research efforts of using finite element modeling and simulations to evaluate the performance : of NCDOT W-beam guardrails behind curbs under MASH TL-2 impact conditions. A literature review is included on : performance eva...

Performance evaluation of the solar kinetics T-700 line concentrating solar collector

NASA Technical Reports Server (NTRS)

1981-01-01

A performance evaluation of the solar kinetics T-700 line concentrating solar collector is reported. Collector descriptions, summary, test conditions, test equipment, test requirements and procedures, and an analysis of the various tests performed are described.

Simulation and rubrics: technology and grading student performance in nurse anesthesia education.

PubMed

Overstreet, Maria; McCarver, Lewis; Shields, John; Patterson, Jordan

2015-06-01

The use of simulation technology has introduced a challenge for simulation nurse educators: evaluation of student performance. The subjectivity of student performance evaluation has been in need of improvement. It is imperative to provide clear and consistent information to the learner of expectations for their performance. Educators use objectives to define for the learner what the primary focus will be in the learning activities. Creation of rubrics to replace checklists to evaluate learner performance is a team task. Improved rubrics assist instructors in providing valuable, immediate, and postactivity feedback and consistency among instructors, and improved inter-rater reliability. Copyright © 2015 Elsevier Inc. All rights reserved.

A comprehensive health service evaluation and monitoring framework.

PubMed

Reeve, Carole; Humphreys, John; Wakerman, John

2015-12-01

To develop a framework for evaluating and monitoring a primary health care service, integrating hospital and community services. A targeted literature review of primary health service evaluation frameworks was performed to inform the development of the framework specifically for remote communities. Key principles underlying primary health care evaluation were determined and sentinel indicators developed to operationalise the evaluation framework. This framework was then validated with key stakeholders. The framework includes Donabedian's three seminal domains of structure, process and outcomes to determine health service performance. These in turn are dependent on sustainability, quality of patient care and the determinants of health to provide a comprehensive health service evaluation framework. The principles underpinning primary health service evaluation were pertinent to health services in remote contexts. Sentinel indicators were developed to fit the demographic characteristics and health needs of the population. Consultation with key stakeholders confirmed that the evaluation framework was applicable. Data collected routinely by health services can be used to operationalise the proposed health service evaluation framework. Use of an evaluation framework which links policy and health service performance to health outcomes will assist health services to improve performance as part of a continuous quality improvement cycle. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

An Aerodynamic Performance Evaluation of the NASA/Ames Research Center Advanced Concepts Flight Simulator. M.S. Thesis

NASA Technical Reports Server (NTRS)

Donohue, Paul F.

1987-01-01

The results of an aerodynamic performance evaluation of the National Aeronautics and Space Administration (NASA)/Ames Research Center Advanced Concepts Flight Simulator (ACFS), conducted in association with the Navy-NASA Joint Institute of Aeronautics, are presented. The ACFS is a full-mission flight simulator which provides an excellent platform for the critical evaluation of emerging flight systems and aircrew performance. The propulsion and flight dynamics models were evaluated using classical flight test techniques. The aerodynamic performance model of the ACFS was found to realistically represent that of current day, medium range transport aircraft. Recommendations are provided to enhance the capabilities of the ACFS to a level forecast for 1995 transport aircraft. The graphical and tabular results of this study will establish a performance section of the ACFS Operation's Manual.

Integration of Occupational Safety to Contractors` or Subcontractors` Performance Evaluation in Construction Projects

NASA Astrophysics Data System (ADS)

Kozlovská, Mária; Struková, Zuzana

2013-06-01

Several factors should be considered by the owner and general contractor in the process of contractors` and subcontractors` selection and evaluation. The paper reviews the recent models addressed to guide general contractors in subcontractors' selection process and in evaluation of different contractors during the execution of the project. Moreover the paper suggests the impact of different contractors' performance to the overall level of occupational health and safety culture at the sites. It deals with the factors influencing the safety performance of contractors during construction and analyses the methods for assessing the safety performance of construction contractors. The results of contractors' safety performance evaluation could be a useful tool in motivating contractors to achieve better safety outcomes or could have effect on owners` or general contractors' decision making about contractors suitability for future contracting works.

Evaluation of medical command and control using performance indicators in a full-scale, major aircraft accident exercise.

PubMed

Gryth, Dan; Rådestad, Monica; Nilsson, Heléne; Nerf, Ola; Svensson, Leif; Castrén, Maaret; Rüter, Anders

2010-01-01

Large, functional, disaster exercises are expensive to plan and execute, and often are difficult to evaluate objectively. Command and control in disaster medicine organizations can benefit from objective results from disaster exercises to identify areas that must be improved. The objective of this pilot study was to examine if it is possible to use performance indicators for documentation and evaluation of medical command and control in a full-scale major incident exercise at two levels: (1) local level (scene of the incident and hospital); and (2) strategic level of command and control. Staff procedure skills also were evaluated. Trained observers were placed in each of the three command and control locations. These observers recorded and scored the performance of command and control using templates of performance indicators. The observers scored the level of performance by awarding 2, 1, or 0 points according to the template and evaluated content and timing of decisions. Results from 11 performance indicators were recorded at each template and scores greater than 11 were considered as acceptable. Prehospital command and control had the lowest score. This also was expressed by problems at the scene of the incident. The scores in management and staff skills were at the strategic level 15 and 17, respectively; and at the hospital level, 17 and 21, respectively. It is possible to use performance indicators in a full-scale, major incident exercise for evaluation of medical command and control. The results could be used to compare similar exercises and evaluate real incidents in the future.

Reliability and Validity of the Professional Counseling Performance Evaluation

ERIC Educational Resources Information Center

Shepherd, J. Brad; Britton, Paula J.; Kress, Victoria E.

2008-01-01

The definition and measurement of counsellor trainee competency is an issue that has received increased attention yet lacks quantitative study. This research evaluates item responses, scale reliability and intercorrelations, interrater agreement, and criterion-related validity of the Professional Performance Fitness Evaluation/Professional…

13 CFR 306.7 - Performance evaluations of University Centers.

Code of Federal Regulations, 2013 CFR

2013-01-01

... University Centers. 306.7 Section 306.7 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION, DEPARTMENT OF COMMERCE TRAINING, RESEARCH AND TECHNICAL ASSISTANCE INVESTMENTS University Center Economic Development Program § 306.7 Performance evaluations of University Centers. (a) EDA will: (1) Evaluate each...

13 CFR 306.7 - Performance evaluations of University Centers.

Code of Federal Regulations, 2011 CFR

2011-01-01

... University Centers. 306.7 Section 306.7 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION, DEPARTMENT OF COMMERCE TRAINING, RESEARCH AND TECHNICAL ASSISTANCE INVESTMENTS University Center Economic Development Program § 306.7 Performance evaluations of University Centers. (a) EDA will: (1) Evaluate each...

13 CFR 306.7 - Performance evaluations of University Centers.

Code of Federal Regulations, 2012 CFR

2012-01-01

... University Centers. 306.7 Section 306.7 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION, DEPARTMENT OF COMMERCE TRAINING, RESEARCH AND TECHNICAL ASSISTANCE INVESTMENTS University Center Economic Development Program § 306.7 Performance evaluations of University Centers. (a) EDA will: (1) Evaluate each...

13 CFR 306.7 - Performance evaluations of University Centers.

Code of Federal Regulations, 2014 CFR

2014-01-01

... University Centers. 306.7 Section 306.7 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION, DEPARTMENT OF COMMERCE TRAINING, RESEARCH AND TECHNICAL ASSISTANCE INVESTMENTS University Center Economic Development Program § 306.7 Performance evaluations of University Centers. (a) EDA will: (1) Evaluate each...

Teaching leadership in trauma resuscitation: Immediate feedback from a real-time, competency-based evaluation tool shows long-term improvement in resident performance.

PubMed

Gregg, Shea C; Heffernan, Daithi S; Connolly, Michael D; Stephen, Andrew H; Leuckel, Stephanie N; Harrington, David T; Machan, Jason T; Adams, Charles A; Cioffi, William G

2016-10-01

Limited data exist on how to develop resident leadership and communication skills during actual trauma resuscitations. An evaluation tool was developed to grade senior resident performance as the team leader during full-trauma-team activations. Thirty actions that demonstrated the Accreditation Council for Graduate Medical Education core competencies were graded on a Likert scale of 1 (poor) to 5 (exceptional). These actions were grouped by their respective core competencies on 5 × 7-inch index cards. In Phase 1, baseline performance scores were obtained. In Phase 2, trauma-focused communication in-services were conducted early in the academic year, and immediate, personalized feedback sessions were performed after resuscitations based on the evaluation tool. In Phase 3, residents received only evaluation-based feedback following resuscitations. In Phase 1 (October 2009 to April 2010), 27 evaluations were performed on 10 residents. In Phase 2 (April 2010 to October 2010), 28 evaluations were performed on nine residents. In Phase 3 (October 2010 to January 2012), 44 evaluations were performed on 13 residents. Total scores improved significantly between Phases 1 and 2 (p = 0.003) and remained elevated throughout Phase 3. When analyzing performance by competency, significant improvement between Phases 1 and 2 (p < 0.05) was seen in all competencies (patient care, knowledge, system-based practice, practice-based learning) with the exception of "communication and professionalism" (p = 0.56). Statistically similar scores were observed between Phases 2 and 3 in all competencies with the exception of "medical knowledge," which showed ongoing significant improvement (p = 0.003). Directed resident feedback sessions utilizing data from a real-time, competency-based evaluation tool have allowed us to improve our residents' abilities to lead trauma resuscitations over a 30-month period. Given pressures to maximize clinical educational opportunities among work-hour constraints, such a model may help decrease the need for costly simulation-based training. Therapeutic study, level III.

Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF)

PubMed Central

Herrmann-Lingen, Christoph; Brunner, Edgar; Hildenbrand, Sibylle; Loew, Thomas H.; Raupach, Tobias; Spies, Claudia; Treede, Rolf-Detlef; Vahl, Christian-Friedrich; Wenz, Hans-Jürgen

2014-01-01

Objective: The evaluation of medical research performance is a key prerequisite for the systematic advancement of medical faculties, research foci, academic departments, and individual scientists’ careers. However, it is often based on vaguely defined aims and questionable methods and can thereby lead to unwanted regulatory effects. The current paper aims at defining the position of German academic medicine toward the aims, methods, and consequences of its evaluation. Methods: During the Berlin Forum of the Association of the Scientific Medical Societies in Germany (AWMF) held on 18 October 2013, international experts presented data on methods for evaluating medical research performance. Subsequent discussions among representatives of relevant scientific organizations and within three ad-hoc writing groups led to a first draft of this article. Further discussions within the AWMF Committee for Evaluation of Performance in Research and Teaching and the AWMF Executive Board resulted in the final consented version presented here. Results: The AWMF recommends modifications to the current system of evaluating medical research performance. Evaluations should follow clearly defined and communicated aims and consist of both summative and formative components. Informed peer reviews are valuable but feasible in longer time intervals only. They can be complemented by objective indicators. However, the Journal Impact Factor is not an appropriate measure for evaluating individual publications or their authors. The scientific “impact” rather requires multidimensional evaluation. Indicators of potential relevance in this context may include, e.g., normalized citation rates of scientific publications, other forms of reception by the scientific community and the public, and activities in scientific organizations, research synthesis and science communication. In addition, differentiated recommendations are made for evaluating the acquisition of third-party funds and the promotion of junior scientists. Conclusions: With the explicit recommendations presented in the current position paper, the AWMF suggests enhancements to the practice of evaluating medical research performance by faculties, ministries and research funding organizations. PMID:24971044

Evaluation of medical research performance--position paper of the Association of the Scientific Medical Societies in Germany (AWMF).

PubMed

Herrmann-Lingen, Christoph; Brunner, Edgar; Hildenbrand, Sibylle; Loew, Thomas H; Raupach, Tobias; Spies, Claudia; Treede, Rolf-Detlef; Vahl, Christian-Friedrich; Wenz, Hans-Jürgen

2014-01-01

The evaluation of medical research performance is a key prerequisite for the systematic advancement of medical faculties, research foci, academic departments, and individual scientists' careers. However, it is often based on vaguely defined aims and questionable methods and can thereby lead to unwanted regulatory effects. The current paper aims at defining the position of German academic medicine toward the aims, methods, and consequences of its evaluation. During the Berlin Forum of the Association of the Scientific Medical Societies in Germany (AWMF) held on 18 October 2013, international experts presented data on methods for evaluating medical research performance. Subsequent discussions among representatives of relevant scientific organizations and within three ad-hoc writing groups led to a first draft of this article. Further discussions within the AWMF Committee for Evaluation of Performance in Research and Teaching and the AWMF Executive Board resulted in the final consented version presented here. The AWMF recommends modifications to the current system of evaluating medical research performance. Evaluations should follow clearly defined and communicated aims and consist of both summative and formative components. Informed peer reviews are valuable but feasible in longer time intervals only. They can be complemented by objective indicators. However, the Journal Impact Factor is not an appropriate measure for evaluating individual publications or their authors. The scientific "impact" rather requires multidimensional evaluation. Indicators of potential relevance in this context may include, e.g., normalized citation rates of scientific publications, other forms of reception by the scientific community and the public, and activities in scientific organizations, research synthesis and science communication. In addition, differentiated recommendations are made for evaluating the acquisition of third-party funds and the promotion of junior scientists. With the explicit recommendations presented in the current position paper, the AWMF suggests enhancements to the practice of evaluating medical research performance by faculties, ministries and research funding organizations.

40 CFR 60.53b - Standards for municipal waste combustor operating practices.

Code of Federal Regulations, 2011 CFR

2011-07-01

... for the purpose of evaluating system performance, testing new technology or control technologies... evaluating system performance, testing new technology or control technologies, diagnostic testing, or related... (CONTINUED) AIR PROGRAMS (CONTINUED) STANDARDS OF PERFORMANCE FOR NEW STATIONARY SOURCES Standards of...

A PERFORMANCE EVALUATION OF THE 2004 RELEASE OF MODELS-3 CMAQ

EPA Science Inventory

This performance evaluation compares a full annual simulation (2001) of CMAQ (Version4.4) covering the contiguous United States against monitoring data from four nationwide networks. This effort, which represents one of the most spatially and temporally comprehensive performance...

Concept for a Satellite-Based Advanced Air Traffic Management System : Volume 5. System Performance.

DOT National Transportation Integrated Search

1974-02-01

The volume presents the results of the performance evaluation of the Satellite-Based Advanced Air Traffic Management System (SAATMS). The evaluation established the capacity, safety, and delay performance of the system for the Los Angeles Basin termi...

76 FR 27336 - National Institute on Aging; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-11

... personnel qualifications and performance, and the competence of individual investigators, the disclosure of... review and evaluate personal qualifications and performance, and competence of individual investigators.... to 1:15 p.m. Agenda: To review and evaluate personal qualifications and performance, and competence...

77 FR 19675 - National Institute on Aging; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2012-04-02

... personnel qualifications and performance, and the competence of individual investigators, the disclosure of... review and evaluate personal qualifications and performance, and competence of individual investigators.... to 6 p.m. Agenda: To review and evaluate personal qualifications and performance, and competence of...

Unicam Activity Framework (UAF)

ERIC Educational Resources Information Center

Gagliardi, R.; Mauri, M.; Polzonetti, A.

2016-01-01

This presentation illustrates the framework of processing performance of the faculty of the University of Camerino. The evaluation criteria are explained and the technological structure that allows automatic performance assessment available online anywhere and anytime. The designed framework is usually applied to the performance evaluation of…

Finite Element Evaluation of Two Retrofit Options to Enhance the Performance of Cable Media Barriers.

DOT National Transportation Integrated Search

2009-06-30

This report summarizes the finite element modeling and simulation efforts on evaluating the performance of cable median barriers including the current and several proposed retrofit designs. It also synthesizes a literature review of the performance e...

Uniform peanut performance test 2017

USDA-ARS?s Scientific Manuscript database

The Uniform Peanut Performance Tests (UPPT) are designed to evaluate the commercial potential of advanced breeding peanut lines not formally released. The tests are performed in ten locations across the peanut production belt. In this study, 2 controls and 14 entries were evaluated at 8 locations....

40 CFR 63.7191 - What records must I keep?

Code of Federal Regulations, 2010 CFR

2010-07-01

... malfunctions. (3) Records of performance tests and performance evaluations as required in § 63.10(b)(2)(viii... measurements, raw performance evaluation measurements). (3) All required CMS measurements (including monitoring... Section 63.7191 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) AIR PROGRAMS...

Reduction of bias and variance for evaluation of computer-aided diagnostic schemes.

PubMed

Li, Qiang; Doi, Kunio

2006-04-01

Computer-aided diagnostic (CAD) schemes have been developed to assist radiologists in detecting various lesions in medical images. In addition to the development, an equally important problem is the reliable evaluation of the performance levels of various CAD schemes. It is good to see that more and more investigators are employing more reliable evaluation methods such as leave-one-out and cross validation, instead of less reliable methods such as resubstitution, for assessing their CAD schemes. However, the common applications of leave-one-out and cross-validation evaluation methods do not necessarily imply that the estimated performance levels are accurate and precise. Pitfalls often occur in the use of leave-one-out and cross-validation evaluation methods, and they lead to unreliable estimation of performance levels. In this study, we first identified a number of typical pitfalls for the evaluation of CAD schemes, and conducted a Monte Carlo simulation experiment for each of the pitfalls to demonstrate quantitatively the extent of bias and/or variance caused by the pitfall. Our experimental results indicate that considerable bias and variance may exist in the estimated performance levels of CAD schemes if one employs various flawed leave-one-out and cross-validation evaluation methods. In addition, for promoting and utilizing a high standard for reliable evaluation of CAD schemes, we attempt to make recommendations, whenever possible, for overcoming these pitfalls. We believe that, with the recommended evaluation methods, we can considerably reduce the bias and variance in the estimated performance levels of CAD schemes.

The Impact of Level of Performance on Feedback Strategy

ERIC Educational Resources Information Center

Beaulieu, R. P.; Love, Kevin G.

2006-01-01

The primary purpose of this study was to investigate the impact of the level of observed performance on the feedback strategy selected by a performance evaluator. One hundred and twenty-three actual performance evaluators from 15 different organizations and 123 college students reviewed, in groups which ranged from 2 to 20, a job description for…

Measuring human performance on NASA's microgravity aircraft

NASA Technical Reports Server (NTRS)

Morris, Randy B.; Whitmore, Mihriban

1993-01-01

Measuring human performance in a microgravity environment will aid in identifying the design requirements, human capabilities, safety, and productivity of future astronauts. The preliminary understanding of the microgravity effects on human performance can be achieved through evaluations conducted onboard NASA's KC-135 aircraft. These evaluations can be performed in relation to hardware performance, human-hardware interface, and hardware integration. Measuring human performance in the KC-135 simulated environment will contribute to the efforts of optimizing the human-machine interfaces for future and existing space vehicles. However, there are limitations, such as limited number of qualified subjects, unexpected hardware problems, and miscellaneous plane movements which must be taken into consideration. Examples for these evaluations, the results, and their implications are discussed in the paper.

Development and implementation of an independence rating scale and evaluation process for nursing orientation of new graduates.

PubMed

Durkin, Gregory J

2010-01-01

A wide variety of evaluation formats are available for new graduate nurses, but most of them are single-point evaluation tools that do not provide a clear picture of progress for orientee or educator. This article describes the development of a Web-based evaluation tool that combines learning taxonomies with the Synergy model into a rating scale based on independent performance. The evaluation tool and process provides open 24/7 access to evaluation documentation for members of the orientation team, demystifying the process and clarifying expectations. The implementation of the tool has proven to be transformative in the perceptions of evaluation and performance expectations of new graduates. This tool has been successful at monitoring progress, altering education, and opening dialogue about performance for over 125 new graduate nurses since inception.

Evaluating supplier quality performance using fuzzy analytical hierarchy process

NASA Astrophysics Data System (ADS)

Ahmad, Nazihah; Kasim, Maznah Mat; Rajoo, Shanmugam Sundram Kalimuthu

2014-12-01

Evaluating supplier quality performance is vital in ensuring continuous supply chain improvement, reducing the operational costs and risks towards meeting customer's expectation. This paper aims to illustrate an application of Fuzzy Analytical Hierarchy Process to prioritize the evaluation criteria in a context of automotive manufacturing in Malaysia. Five main criteria were identified which were quality, cost, delivery, customer serviceand technology support. These criteria had been arranged into hierarchical structure and evaluated by an expert. The relative importance of each criteria was determined by using linguistic variables which were represented as triangular fuzzy numbers. The Center of Gravity defuzzification method was used to convert the fuzzy evaluations into their corresponding crisps values. Such fuzzy evaluation can be used as a systematic tool to overcome the uncertainty evaluation of suppliers' performance which usually associated with human being subjective judgments.

Training evaluation final report

NASA Technical Reports Server (NTRS)

Sepulveda, Jose A.

1992-01-01

In the area of management training, 'evaluation' refers both to the specific evaluation instrument used to determine whether a training effort was considered effective, and to the procedures followed to evaluate specific training requests. This report recommends to evaluate new training requests in the same way new procurement or new projects are evaluated. This includes examining training requests from the perspective of KSC goals and objectives, and determining expected ROI of proposed training program (does training result in improved productivity, through savings of time, improved outputs, and/or personnel reduction?). To determine whether a specific training course is effective, a statement of what constitutes 'good performance' is required. The user (NOT the Training Branch) must define what is 'required level of performance'. This 'model' will be the basis for the design and development of an objective, performance-based, training evaluation instrument.

Performing well in an evaluative situation: the roles of perceived competence and task-irrelevant interfering thoughts.

PubMed

Van Yperen, Nico W

2007-12-01

This research expands on previous research by arguing and demonstrating that high perceived competence buffers the detrimental effects of an evaluative situation. In Study 1 (n=75, 38.7% male), the situation (evaluative vs. non-evaluative) and perceived competence (high vs. low) were manipulated, whereas in Study 2 (n=42, 33.3% male), perceived competence relied on naturally occurring differences in perceived competence. The results of Study 1 indicate that people may underachieve in an evaluative situation. More importantly, in Study 2 it was demonstrated that such an evaluative situation had only a negative effect on test performance among individuals low in perceived competence. The occurrence of task-irrelevant interfering thoughts during task completion accounted for this inimical effect of an evaluative situation on test performance among these individuals.

Evaluating the use of prior information under different pacing conditions on aircraft inspection performance: The use of virtual reality technology

NASA Astrophysics Data System (ADS)

Bowling, Shannon Raye

The aircraft maintenance industry is a complex system consisting of human and machine components, because of this; much emphasis has been placed on improving aircraft-inspection performance. One proven technique for improving inspection performance is the use of training. There are several strategies that have been implemented for training, one of which is feedforward information. The use of prior information (feedforward) is known to positively affect inspection performance. This information can consist of knowledge about defect characteristics (types, severity/criticality, and location) and the probability of occurrence. Although several studies have been conducted that demonstrate the usefulness of feedforward as a training strategy, there are certain research issues that need to be addressed. This study evaluates the effect of feedforward information in a simulated 3-dimensional environment by the use of virtual reality. A controlled study was conducted to evaluate the effectiveness of feedforward information in a simulated aircraft inspection environment. The study was conducted in two phases. The first phase evaluated the difference between general and detailed inspection at different pacing levels. The second phase evaluated the effect of feedforward information pertaining to severity, probability and location. Analyses of the results showed that subjects performing detailed inspection performed significantly better than while performing general inspection. Pacing also had the effect of reducing performance for both general and detailed inspection. The study also found that as the level of feedforward information increases, performance also increases. In addition to evaluating performance measures, the study also evaluated process and subjective measures. It was found that process measures such as number of fixation points, fixation groups, mean fixation duration, and percent area covered were all affected by the treatment levels. Analyses of the subjective measures also found a correlation between the perceived usefulness of feedforward information and the actual effect on performance. The study also examined the potential of virtual reality as a training tool and analyzed the effect different calculational algorithms have on determining various process measures.

TECHNOLOGY EVALUATION REPORT CEREX ENVIRONMENTAL SERVICES UV HOUND POINT SAMPLE AIR MONITOR

EPA Science Inventory

The USEPA's National Homeland Security Research Center (NHSRC) Technology Testing and Evaluation Program (TTEP) is carrying out performance tests on homeland security technologies. Under TTEP, Battelle evaluated the performance of the Cerex UV Hound point sample air monitor in de...

Multistakeholder Evaluation of Condominial Sewer Services

ERIC Educational Resources Information Center

Nance, Earthea

2005-01-01

A multistakeholder evaluation procedure is presented to address the many challenges in evaluating the performance of condominial sewer projects in Brazil. Condominial sewerage is a promising appropriate technology that is coproduced by users and public agencies, but little is known about project performance. This article shows that…

Mindfulness, burnout, and effects on performance evaluations in internal medicine residents

PubMed Central

Braun, Sarah E; Auerbach, Stephen M; Rybarczyk, Bruce; Lee, Bennett; Call, Stephanie

2017-01-01

Purpose Burnout has been documented at high levels in medical residents with negative effects on performance. Some dispositional qualities, like mindfulness, may protect against burnout. The purpose of the present study was to assess burnout prevalence among internal medicine residents at a single institution, examine the relationship between mindfulness and burnout, and provide preliminary findings on the relation between burnout and performance evaluations in internal medicine residents. Methods Residents (n = 38) completed validated measures of burnout at three time points separated by 2 months and a validated measure of dispositional mindfulness at baseline. Program director end-of-year performance evaluations were also obtained on 22 milestones used to evaluate internal medicine resident performance; notably, these milestones have not yet been validated for research purposes; therefore, the investigation here is exploratory. Results Overall, 71.1% (n = 27) of the residents met criteria for burnout during the study. Lower scores on the “acting with awareness” facet of dispositional mindfulness significantly predicted meeting burnout criteria χ2(5) = 11.88, p = 0.04. Lastly, meeting burnout criteria significantly predicted performance on three of the performance milestones, with positive effects on milestones from the “system-based practices” and “professionalism” domains and negative effects on a milestone from the “patient care” domain. Conclusion Burnout rates were high in this sample of internal medicine residents and rates were consistent with other reports of burnout during medical residency. Dispositional mindfulness was supported as a protective factor against burnout. Importantly, results from the exploratory investigation of the relationship between burnout and resident evaluations suggested that burnout may improve performance on some domains of resident evaluations while compromising performance on other domains. Implications and directions for future research are discussed. PMID:28860889

Mindfulness, burnout, and effects on performance evaluations in internal medicine residents.

PubMed

Braun, Sarah E; Auerbach, Stephen M; Rybarczyk, Bruce; Lee, Bennett; Call, Stephanie

2017-01-01

Burnout has been documented at high levels in medical residents with negative effects on performance. Some dispositional qualities, like mindfulness, may protect against burnout. The purpose of the present study was to assess burnout prevalence among internal medicine residents at a single institution, examine the relationship between mindfulness and burnout, and provide preliminary findings on the relation between burnout and performance evaluations in internal medicine residents. Residents (n = 38) completed validated measures of burnout at three time points separated by 2 months and a validated measure of dispositional mindfulness at baseline. Program director end-of-year performance evaluations were also obtained on 22 milestones used to evaluate internal medicine resident performance; notably, these milestones have not yet been validated for research purposes; therefore, the investigation here is exploratory. Overall, 71.1% (n = 27) of the residents met criteria for burnout during the study. Lower scores on the "acting with awareness" facet of dispositional mindfulness significantly predicted meeting burnout criteria χ 2 (5) = 11.88, p = 0.04. Lastly, meeting burnout criteria significantly predicted performance on three of the performance milestones, with positive effects on milestones from the "system-based practices" and "professionalism" domains and negative effects on a milestone from the "patient care" domain. Burnout rates were high in this sample of internal medicine residents and rates were consistent with other reports of burnout during medical residency. Dispositional mindfulness was supported as a protective factor against burnout. Importantly, results from the exploratory investigation of the relationship between burnout and resident evaluations suggested that burnout may improve performance on some domains of resident evaluations while compromising performance on other domains. Implications and directions for future research are discussed.

Simulation Performance and National Council Licensure Examination for Registered Nurses Outcomes: Field Research Perspectives.

PubMed

Brackney, Dana E; Lane, Susan Hayes; Dawson, Tyia; Koontz, Angie

2017-11-01

This descriptive field study examines processes used to evaluate simulation for senior-level Bachelor of Science in Nursing (BSN) students in a capstone course, discusses challenges related to simulation evaluation, and reports the relationship between faculty evaluation of student performance and National Council Licensure Examination for Registered Nurses (NCLEX-RN) first-time passing rates. Researchers applied seven terms used to rank BSN student performance (n = 41, female, ages 22-24 years) in a senior-level capstone simulation. Faculty evaluation was correlated with students' NCLEX-RN outcomes. Students evaluated as "lacking confidence" and "flawed" were less likely to pass the NCLEX-RN on the first attempt. Faculty evaluation of capstone simulation performance provided additional evidence of student preparedness for practice in the RN role, as evidenced by the relationship between the faculty assessment and NCLEX-RN success. Simulation has been broadly accepted as a powerful educational tool that may also contribute to verification of student achievement of program outcomes and readiness for the RN role.

Evaluation of EIT system performance.

PubMed

Yasin, Mamatjan; Böhm, Stephan; Gaggero, Pascal O; Adler, Andy

2011-07-01

An electrical impedance tomography (EIT) system images internal conductivity from surface electrical stimulation and measurement. Such systems necessarily comprise multiple design choices from cables and hardware design to calibration and image reconstruction. In order to compare EIT systems and study the consequences of changes in system performance, this paper describes a systematic approach to evaluate the performance of the EIT systems. The system to be tested is connected to a saline phantom in which calibrated contrasting test objects are systematically positioned using a position controller. A set of evaluation parameters are proposed which characterize (i) data and image noise, (ii) data accuracy, (iii) detectability of single contrasts and distinguishability of multiple contrasts, and (iv) accuracy of reconstructed image (amplitude, resolution, position and ringing). Using this approach, we evaluate three different EIT systems and illustrate the use of these tools to evaluate and compare performance. In order to facilitate the use of this approach, all details of the phantom, test objects and position controller design are made publicly available including the source code of the evaluation and reporting software.

Regionalized PM2.5 Community Multiscale Air Quality model performance evaluation across a continuous spatiotemporal domain.

PubMed

Reyes, Jeanette M; Xu, Yadong; Vizuete, William; Serre, Marc L

2017-01-01

The regulatory Community Multiscale Air Quality (CMAQ) model is a means to understanding the sources, concentrations and regulatory attainment of air pollutants within a model's domain. Substantial resources are allocated to the evaluation of model performance. The Regionalized Air quality Model Performance (RAMP) method introduced here explores novel ways of visualizing and evaluating CMAQ model performance and errors for daily Particulate Matter ≤ 2.5 micrometers (PM2.5) concentrations across the continental United States. The RAMP method performs a non-homogenous, non-linear, non-homoscedastic model performance evaluation at each CMAQ grid. This work demonstrates that CMAQ model performance, for a well-documented 2001 regulatory episode, is non-homogeneous across space/time. The RAMP correction of systematic errors outperforms other model evaluation methods as demonstrated by a 22.1% reduction in Mean Square Error compared to a constant domain wide correction. The RAMP method is able to accurately reproduce simulated performance with a correlation of r = 76.1%. Most of the error coming from CMAQ is random error with only a minority of error being systematic. Areas of high systematic error are collocated with areas of high random error, implying both error types originate from similar sources. Therefore, addressing underlying causes of systematic error will have the added benefit of also addressing underlying causes of random error.

Combining control input with flight path data to evaluate pilot performance in transport aircraft.

PubMed

Ebbatson, Matt; Harris, Don; Huddlestone, John; Sears, Rodney

2008-11-01

When deriving an objective assessment of piloting performance from flight data records, it is common to employ metrics which purely evaluate errors in flight path parameters. The adequacy of pilot performance is evaluated from the flight path of the aircraft. However, in large jet transport aircraft these measures may be insensitive and require supplementing with frequency-based measures of control input parameters. Flight path and control input data were collected from pilots undertaking a jet transport aircraft conversion course during a series of symmetric and asymmetric approaches in a flight simulator. The flight path data were analyzed for deviations around the optimum flight path while flying an instrument landing approach. Manipulation of the flight controls was subject to analysis using a series of power spectral density measures. The flight path metrics showed no significant differences in performance between the symmetric and asymmetric approaches. However, control input frequency domain measures revealed that the pilots employed highly different control strategies in the pitch and yaw axes. The results demonstrate that to evaluate pilot performance fully in large aircraft, it is necessary to employ performance metrics targeted at both the outer control loop (flight path) and the inner control loop (flight control) parameters in parallel, evaluating both the product and process of a pilot's performance.

Performance evaluation of a mobile satellite system modem using an ALE method

NASA Technical Reports Server (NTRS)

Ohsawa, Tomoki; Iwasaki, Motoya

1990-01-01

Experimental performance of a newly designed demodulation concept is presented. This concept applies an Adaptive Line Enhancer (ALE) to a carrier recovery circuit, which makes pull-in time significantly shorter in noisy and large carrier offset conditions. This new demodulation concept was actually developed as an INMARSAT standard-C modem, and was evaluated. On a performance evaluation, 50 symbol pull-in time is confirmed under 4 dB Eb/No condition.

Teachers' Perceptions of Evaluation and Teachers' Sense of Self-Efficacy in High-Performing High Schools

ERIC Educational Resources Information Center

McCall, James P.

2011-01-01

The evaluation, improvement, and accountability of teachers has been the topic of the nation throughout the era of No Child Left Behind. Where some critics point to a business model of measuring outputs (i.e., student achievement scores on standardized tests) to evaluate teacher performance, others will advocate for a fair evaluation system that…

Performance evaluation of the insurance companies based on AHP

NASA Astrophysics Data System (ADS)

Lu, Manhong; Zhu, Kunping

2018-04-01

With the entry of foreign capital, China's insurance industry is under increasing pressure of competition. The performance of a company is the external manifestation of its comprehensive strength. Therefore, the establishment of a scientific evaluation system is of practical significance for the insurance companies. In this paper, based on the financial and non-financial indicators of the companies, the performance evaluation system is constructed by means of the analytic hierarchy process (AHP). In the system, the weights of the indicators which represent the impact on the performance of the companies will be calculated by the process. The evaluation system is beneficial for the companies to realize their own strengths and weaknesses, so as to take steps to enhance the core competitiveness of the companies.

[Concept extraction of graduate research by modified grounded theory approach and creating of rubric oriented to performance evaluation].

PubMed

Yasuhara, Tomohisa; Sone, Tomomichi; Kohno, Takeyuki; Ogita, Kiyokazu

2015-01-01

  A revised core curriculum model for pharmaceutical education, developed on the basis of the principles of outcome-based education, will be introduced in 2015. Inevitably, appropriate assessments of students' academic achievements will be required. Although evaluations of the cognitive domain can be carried out by paper tests, evaluation methods for the attitude domain and problem-solving abilities need to be established. From the viewpoint of quality assurance for graduates, pharmaceutical education reforms have become vital to evaluation as well as learning strategies. To evaluate student academic achievements on problem-solving abilities, authentic assessment is required. Authentic assessment is the evaluation that mimics the context tried in work and life. Specifically, direct evaluation of performances, demonstration or the learners' own work with integrated variety knowledge and skills, is required. To clarify the process of graduate research, we obtained qualitative data through focus group interviews with six teachers and analyzed the data using the modified grounded theory approach. Based on the results, we clarify the performance students should show in graduate research and create a rubric for evaluation of performance in graduate research.

Implementation of Insight Responsibilities in Process Engineering

NASA Technical Reports Server (NTRS)

Osborne, Deborah M.

1997-01-01

This report describes an approach for evaluating flight readiness (COFR) and contractor performance evaluation (award fee) as part of the insight role of NASA Process Engineering at Kennedy Space Center. Several evaluation methods are presented, including systems engineering evaluations and use of systems performance data. The transition from an oversight function to the insight function is described. The types of analytical tools appropriate for achieving the flight readiness and contractor performance evaluation goals are described and examples are provided. Special emphasis is placed upon short and small run statistical quality control techniques. Training requirements for system engineers are delineated. The approach described herein would be equally appropriate in other directorates at Kennedy Space Center.

Faculty Evaluations Correlate Poorly with Medical Student Examination Performance in a Fourth-Year Emergency Medicine Clerkship.

PubMed

Dubosh, Nicole M; Fisher, Jonathan; Lewis, Jason; Ullman, Edward A

2017-06-01

Clerkship directors routinely evaluate medical students using multiple modalities, including faculty assessment of clinical performance and written examinations. Both forms of evaluation often play a prominent role in final clerkship grade. The degree to which these modalities correlate in an emergency medicine (EM) clerkship is unclear. We sought to correlate faculty clinical evaluations with medical student performance on a written, standardized EM examination of medical knowledge. This is a retrospective study of fourth-year medical students in a 4-week EM elective at one academic medical center. EM faculty performed end of shift evaluations of students via a blinded online system using a 5-point Likert scale for 8 domains: data acquisition, data interpretation, medical knowledge base, professionalism, patient care and communication, initiative/reliability/dependability, procedural skills, and overall evaluation. All students completed the National EM M4 Examination in EM. Means, medians, and standard deviations for end of shift evaluation scores were calculated, and correlations with examination scores were assessed using a Spearman's rank correlation coefficient. Thirty-nine medical students with 224 discrete faculty evaluations were included. The median number of evaluations completed per student was 6. The mean score (±SD) on the examination was 78.6% ± 6.1%. The examination score correlated poorly with faculty evaluations across all 8 domains (ρ 0.074-0.316). Faculty evaluations of medical students across multiple domains of competency correlate poorly with written examination performance during an EM clerkship. Educators need to consider the limitations of examination score in assessing students' ability to provide quality patient clinical care. Copyright © 2016 Elsevier Inc. All rights reserved.

Employee Performance in the Context of the Problems of Measurement and Evaluation in Practice

NASA Astrophysics Data System (ADS)

Szabó, Peter; Mĺkva, Miroslava; Vaňová, Jaromíra; Marková, Petra

2017-09-01

Employee performance is a condition and an assumption for the performance and success of a company on the market. In order to ensure competitive ability, the quality of human resources, their management, and related measurement and performance assessment are at the forefront of company interest. Employee assessment affects the performance, development and motivation of people and also provides the necessary information about the employees. It allows the organization to monitor employee performance and compare their work with other collaborators. Many companies have the problem of setting up evaluation system so that it carried itself elements of responsibility and objectivity. The result of conceptual work in this area is the ultimate use of tools whose deployment, if possible, motivates employees to perform better. The aim of the paper is to refer to problems that arise in companies in evaluating the performance of employees.

The relationship of post-event processing to self-evaluation of performance in social anxiety.

PubMed

Brozovich, Faith; Heimberg, Richard G

2011-06-01

Socially anxious and control participants engaged in a social interaction with a confederate and then wrote about themselves or the other person (i.e., self-focused post-event processing [SF-PEP] vs. other-focused post-event processing [OF-PEP]) and completed several questionnaires. One week later, participants completed measures concerning their evaluation of their performance in the social interaction and the degree to which they engaged in post-event processing (PEP) during the week. Socially anxious individuals evaluated their performance in the social interaction more poorly than control participants, both immediately after and 1 week later. Socially anxious individuals assigned to the SF-PEP condition displayed fewer positive feelings about their performance compared to the socially anxious individuals in the OF-PEP condition as well as controls in either condition. Also, the trait tendency to engage in PEP moderated the effect of social anxiety on participants' evaluation of their performance in the interaction, such that high socially anxious individuals with high trait PEP scores evaluated themselves in the interaction more negatively at the later assessment. These results suggest that PEP and other self-evaluative processes may perpetuate the cycle of social anxiety. Copyright © 2011. Published by Elsevier Ltd.

Small Scale Trace Contaminant Testing of SA9T at Ambient and Reduced Pressure Conditions

NASA Technical Reports Server (NTRS)

Broerman, Craig; Sweterlitsch, Jeffrey

2011-01-01

A principle concern for air revitalization technology in a closed loop system is the capability to control carbon dioxide (CO2) and humidity (H2O). An amine based sorbent technology, SA9T, has long been evaluated for use in this application and several programs are evaluating it for use in both a cabin as well as space suit applications. While the CO2 and H2O performance of the sorbent has been tested extensively, the question of how trace contaminants impact performance requires further evaluation. This paper presents experimental results of small scale SA9T testing that was performed over a variety of test conditions and with a variety of trace contaminants. Testing evaluated the ability of SA9T media to sufficiently remove CO2 and H2O after exposure to a fully saturated trace contaminant at ambient conditions. Testing also evaluated the impact of CO2 and H2O removal performance at suit loop pressures during cyclic operation with a constant inlet contaminant load. In addition, testing evaluated the performance of SA9T at ambient conditions in a continuous 30-day test with a mixed trace contaminant stream.

Connected Vehicle Pilot Deployment Program phase 1 : performance measurement and evaluation support plan : New York City : final report.

DOT National Transportation Integrated Search

2016-07-12

This document describes the Performance Measurement and Evaluation Support Plan for the New York City Department of Transportation New York City (NYC) Connected Vehicle Pilot Deployment (CVPD) Project. The report documents the performance metrics tha...

Connected Vehicle Pilot Deployment Program phase 1 : performance measurement and evaluation support plan : Tampa (THEA) : final report.

DOT National Transportation Integrated Search

2016-03-14

The Performance Measurement and Evaluation Support Plan for the Connected Vehicle Pilot Deployment Program Phase 1, Tampa Hillsborough Expressway Authority, outlines the goals and objectives for the Pilot as well as the proposed performance metrics. ...

76 FR 50486 - National Human Genome Research Institute; Notice of Closed Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-15

... performance, and the competence of individual investigators, the disclosure of which would constitute a... 7 p.m. Agenda: To review and evaluate personal qualifications and performance, and competence of... evaluate personal qualifications and performance, and competence of individual investigators. Place...

Effects of Performers' External Characteristics on Performance Evaluations.

ERIC Educational Resources Information Center

Bermingham, Gudrun A.

2000-01-01

States that fairness has been a major concern in the field of music adjudication. Reviews the research literature to reveal information about three external characteristics (race, gender, and physical attractiveness) that may affect judges' performance evaluations and influence fairness of music adjudication. Includes references. (CMK)

Associations of Physical Fitness and Academic Performance among Schoolchildren

ERIC Educational Resources Information Center

Van Dusen, Duncan P.; Kelder, Steven H.; Kohl, Harold W., III; Ranjit, Nalini; Perry, Cheryl L.

2011-01-01

Background: Public schools provide opportunities for physical activity and fitness surveillance, but are evaluated and funded based on students' academic performance, not their physical fitness. Empirical research evaluating the connections between fitness and academic performance is needed to justify curriculum allocations to physical activity…

40 CFR 63.7952 - What records must I keep?

Code of Federal Regulations, 2010 CFR

2010-07-01

... performance tests and performance evaluations as required by § 63.10(b)(2)(viii). (4) The records of initial... your continuous monitoring system. (2) Performance evaluation plans, including previous (i.e... Section 63.7952 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) AIR PROGRAMS...

Sensor fusion display evaluation using information integration models in enhanced/synthetic vision applications

NASA Technical Reports Server (NTRS)

Foyle, David C.

1993-01-01

Based on existing integration models in the psychological literature, an evaluation framework is developed to assess sensor fusion displays as might be implemented in an enhanced/synthetic vision system. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The pilot's performance with the sensor fusion image is compared to models' predictions based on the pilot's performance when viewing the original component sensor images prior to fusion. This allows for the determination as to when a sensor fusion system leads to: poorer performance than one of the original sensor displays, clearly an undesirable system in which the fused sensor system causes some distortion or interference; better performance than with either single sensor system alone, but at a sub-optimal level compared to model predictions; optimal performance compared to model predictions; or, super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays.

Performance evaluation of automated segmentation software on optical coherence tomography volume data

PubMed Central

Tian, Jing; Varga, Boglarka; Tatrai, Erika; Fanni, Palya; Somfai, Gabor Mark; Smiddy, William E.

2016-01-01

Over the past two decades a significant number of OCT segmentation approaches have been proposed in the literature. Each methodology has been conceived for and/or evaluated using specific datasets that do not reflect the complexities of the majority of widely available retinal features observed in clinical settings. In addition, there does not exist an appropriate OCT dataset with ground truth that reflects the realities of everyday retinal features observed in clinical settings. While the need for unbiased performance evaluation of automated segmentation algorithms is obvious, the validation process of segmentation algorithms have been usually performed by comparing with manual labelings from each study and there has been a lack of common ground truth. Therefore, a performance comparison of different algorithms using the same ground truth has never been performed. This paper reviews research-oriented tools for automated segmentation of the retinal tissue on OCT images. It also evaluates and compares the performance of these software tools with a common ground truth. PMID:27159849

Evaluation of Seismic Performance and Effectiveness of Multiple Slim-Type Damper System for Seismic Response Control of Building Structures

PubMed Central

Kim, David; Sung, Eun Hee; Park, Kwan-Soon; Park, Jaegyun

2014-01-01

This paper presents the evaluation of seismic performance and cost-effectiveness of a multiple slim-type damper system developed for the vibration control of earthquake excited buildings. The multiple slim-type damper (MSD) that consists of several small slim-type dampers and linkage units can control damping capacity easily by changing the number of small dampers. To evaluate the performance of the MSD, dynamic loading tests are performed with three slim-type dampers manufactured at a real scale. Numerical simulations are also carried out by nonlinear time history analysis with a ten-story earthquake excited building structure. The seismic performance and cost-effectiveness of the MSD system are investigated according to the various installation configurations of the MSD system. From the results of numerical simulation and cost-effectiveness evaluation, it is shown that combinations of the MSD systems can effectively improve the seismic performance of earthquake excited building structures. PMID:25301387

Mothers' negative evaluations of their children's performances enhance boys' memories for crafts.

PubMed

Dunsmore, Julie C; Halberstadt, Amy G; Robinson, Megan L

2004-12-01

The authors predicted that mothers' evaluative comments would affect their preschool-aged children's learning during a craft-making activity. Each mother (N = 67) taught her child 6 crafts in a playroom in a university setting. Three weeks later, the child returned to the playroom to redo the crafts. Evaluators tested the children's memories of the procedures for completing the crafts. The authors used videotapes of the mothers' teaching to code for statements that positively evaluated their children's performances (praise) or that negatively evaluated their children's performances (criticism). Maternal praise did not affect children's memories. Maternal criticism did not affect their daughters' memories. However, sons were more likely to more accurately redo craft steps for which their mothers had made at least 1 comment criticizing their performances. The authors proposed that emotional arousal was a reason for girls' and boys' differential responses to maternal criticism.

Performance Evaluation of 14 Neural Network Architectures Used for Predicting Heat Transfer Characteristics of Engine Oils

NASA Astrophysics Data System (ADS)

Al-Ajmi, R. M.; Abou-Ziyan, H. Z.; Mahmoud, M. A.

2012-01-01

This paper reports the results of a comprehensive study that aimed at identifying best neural network architecture and parameters to predict subcooled boiling characteristics of engine oils. A total of 57 different neural networks (NNs) that were derived from 14 different NN architectures were evaluated for four different prediction cases. The NNs were trained on experimental datasets performed on five engine oils of different chemical compositions. The performance of each NN was evaluated using a rigorous statistical analysis as well as careful examination of smoothness of predicted boiling curves. One NN, out of the 57 evaluated, correctly predicted the boiling curves for all cases considered either for individual oils or for all oils taken together. It was found that the pattern selection and weight update techniques strongly affect the performance of the NNs. It was also revealed that the use of descriptive statistical analysis such as R2, mean error, standard deviation, and T and slope tests, is a necessary but not sufficient condition for evaluating NN performance. The performance criteria should also include inspection of the smoothness of the predicted curves either visually or by plotting the slopes of these curves.

On Applying the Prognostic Performance Metrics

NASA Technical Reports Server (NTRS)

Saxena, Abhinav; Celaya, Jose; Saha, Bhaskar; Saha, Sankalita; Goebel, Kai

2009-01-01

Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.

34 CFR 361.82 - Evaluation standards.

Code of Federal Regulations, 2011 CFR

2011-07-01

... with disabilities under the VR program. (b) A DSU must achieve successful performance on both evaluation standards during each performance period. (c) The evaluation standards for the VR program are— (1... equal access to VR services. (Approved by the Office of Management and Budget under control number 1820...

34 CFR 361.82 - Evaluation standards.

Code of Federal Regulations, 2010 CFR

2010-07-01

... with disabilities under the VR program. (b) A DSU must achieve successful performance on both evaluation standards during each performance period. (c) The evaluation standards for the VR program are— (1... equal access to VR services. (Approved by the Office of Management and Budget under control number 1820...

The Myth of Rational Evaluation.

ERIC Educational Resources Information Center

Losak, John

A management by objectives approach to evaluation develops performance objectives as a means of minimizing the bias related to individual judgment. This paper focuses on three variables which contribute to the presence of subjectivity in performance evaluation. The first of these is psychological and includes such factors as judgment, power…

34 CFR 361.82 - Evaluation standards.

Code of Federal Regulations, 2012 CFR

2012-07-01

... with disabilities under the VR program. (b) A DSU must achieve successful performance on both evaluation standards during each performance period. (c) The evaluation standards for the VR program are— (1... equal access to VR services. (Approved by the Office of Management and Budget under control number 1820...

34 CFR 361.82 - Evaluation standards.

Code of Federal Regulations, 2013 CFR

2013-07-01

... with disabilities under the VR program. (b) A DSU must achieve successful performance on both evaluation standards during each performance period. (c) The evaluation standards for the VR program are— (1... equal access to VR services. (Approved by the Office of Management and Budget under control number 1820...

34 CFR 361.82 - Evaluation standards.

Code of Federal Regulations, 2014 CFR

2014-07-01

... with disabilities under the VR program. (b) A DSU must achieve successful performance on both evaluation standards during each performance period. (c) The evaluation standards for the VR program are— (1... equal access to VR services. (Approved by the Office of Management and Budget under control number 1820...

MASH TL-4 evaluation of the TxDOT type C2P bridge rail.

DOT National Transportation Integrated Search

2017-02-01

The objective of this research was to evaluate the impact performance of the Texas Department of Transportation (TxDOT) Type C2P Bridge Rail according to the safety-performance evaluation guidelines included in the American Association of State Highw...

Performance Indicators in Education.

ERIC Educational Resources Information Center

Irvine, David J.

Evaluation of education involves assessing the effectiveness of schools and trying to determine how best to improve them. Since evaluation often deals only with the question of effectiveness, performance indicators in education are designed to make evaluation more complete. They are a set of statistical models which relate several important…

A Conceptual Framework for Evaluating Higher Education Institutions

ERIC Educational Resources Information Center

Chinta, Ravi; Kebritchi, Mansureh; Ellias, Janelle

2016-01-01

Purpose: Performance evaluation is a topic that has been researched and practiced extensively in business organizations but has received scant attention in higher education institutions. A review of literature revealed that context, input, process, product (CIPP) model is an appropriate performance evaluation model for higher education…

Guidance on New York State's Annual Professional Performance Review Law and Regulations

ERIC Educational Resources Information Center

New York State Education Department, 2011

2011-01-01

Education Law Section 3012-c requires a new performance evaluation system for classroom teachers ("teachers") and building principals ("principals"). New York State will implement a statewide comprehensive evaluation system for school districts and boards of cooperative educational services (BOCES). The evaluation system is…

Evaluation of video detection systems, volume 2 : effects of illumination conditions in the performance of video detection systems.

DOT National Transportation Integrated Search

2009-05-01

The evaluation of three Video Detection Systems (VDS) at an instrumented signalized intersection in Rantoul : Illinois, at both stop bar and advance detection zones, was performed under a wide range of lighting and : weather conditions. The evaluated...

Evaluating SPP/APR Improvement Activities

ERIC Educational Resources Information Center

National Early Childhood Technical Assistance Center (NECTAC), 2009

2009-01-01

This document is intended to assist State Education Agency (SEA) and Lead Agency (LA) staff and technical assistance providers in designing a meaningful evaluation for the State Performance Plan (SPP)/Annual Performance Report (APR) improvement activities. It provides: (1) information about the relevance of evaluation in the context of improvement…

Performance evaluation of two black nickel and two black chrome solar collectors

NASA Technical Reports Server (NTRS)

Losey, R.

1977-01-01

The test program was based on the evaluation of four unique solar collectors described below: (1) black nickel collector surface with a desiccant drying bed, (2) black nickel collector surface without a desiccant drying bed, (3) black chrome collector surface with a dessicant drying bed, and (4) black chrome collector surface without a desiccant drying bed. The test program included three distinct phases: Initial performance evaluation, natural environmental aging, and post-aging performance evaluation. Results of Phase III testing conclusively indicated a higher normalized efficiency for Black Chrome surfaces when compared to Black Nickel.

EVALUATIONS ON ASR DAMAGE OF CONCRETE STRUCTURE AND ITS STRUCTURAL PERFORMANCE

NASA Astrophysics Data System (ADS)

Ueda, Naoshi; Nakamura, Hikaru; Kunieda, Minoru; Maeno, Hirofumi; Morishit, Noriaki; Asai, Hiroshi

In this paper, experiments and finite element analyses were conducted in order to evaluate effects of ASR on structural performance of RC and PC structures. From the experimental results, it was confirmed that the ASR expansion was affected by the restraint of reinforcement and the magnitude of prestress. The material properties of concrete damaged by ASR had anisotropic characteristics depending on the degree of ASR expansion. Therefore, when the structural performance of RC and PC structures were evaluated by using the material properties of core concrete, the direction and place where cylinder specimens were cored should be considered. On the other hand, by means of proposed analytical method, ASR expansion behaviors of RC and PC beams and changing of their structural performance were evaluated. As the results, it was confirmed that PC structure had much advantage comparing with RC structure regarding the structural performance under ASR damage because of restraint by prestress against the ASR.

Evaluation plan for space station network interface units

NASA Technical Reports Server (NTRS)

Weaver, Alfred C.

1990-01-01

Outlined here is a procedure for evaluating network interface units (NIUs) produced for the Space Station program. The procedures should be equally applicable to the data management system (DMS) testbed NIUs produced by Honeywell and IBM. The evaluation procedures are divided into four areas. Performance measurement tools are hardware and software that must be developed in order to evaluate NIU performance. Performance tests are a series of tests, each of which documents some specific characteristic of NIU and/or network performance. In general, these performance tests quantify the speed, capacity, latency, and reliability of message transmission under a wide variety of conditions. Functionality tests are a series of tests and code inspections that demonstrate the functionality of the particular subset of ISO protocols which have been implemented in a given NIU. Conformance tests are a series of tests which would expose whether or not selected features within the ISO protocols are present and interoperable.

A Rotatable Quality Control Phantom for Evaluating the Performance of Flat Panel Detectors in Imaging Moving Objects.

PubMed

Haga, Yoshihiro; Chida, Koichi; Inaba, Yohei; Kaga, Yuji; Meguro, Taiichiro; Zuguchi, Masayuki

2016-02-01

As the use of diagnostic X-ray equipment with flat panel detectors (FPDs) has increased, so has the importance of proper management of FPD systems. To ensure quality control (QC) of FPD system, an easy method for evaluating FPD imaging performance for both stationary and moving objects is required. Until now, simple rotatable QC phantoms have not been available for the easy evaluation of the performance (spatial resolution and dynamic range) of FPD in imaging moving objects. We developed a QC phantom for this purpose. It consists of three thicknesses of copper and a rotatable test pattern of piano wires of various diameters. Initial tests confirmed its stable performance. Our moving phantom is very useful for QC of FPD images of moving objects because it enables visual evaluation of image performance (spatial resolution and dynamic range) easily.

Performability evaluation of the SIFT computer

NASA Technical Reports Server (NTRS)

Meyer, J. F.; Furchtgott, D. G.; Wu, L. T.

1979-01-01

Performability modeling and evaluation techniques are applied to the SIFT computer as it might operate in the computational evironment of an air transport mission. User-visible performance of the total system (SIFT plus its environment) is modeled as a random variable taking values in a set of levels of accomplishment. These levels are defined in terms of four attributes of total system behavior: safety, no change in mission profile, no operational penalties, and no economic process whose states describe the internal structure of SIFT as well as relavant conditions of the environment. Base model state trajectories are related to accomplishment levels via a capability function which is formulated in terms of a 3-level model hierarchy. Performability evaluation algorithms are then applied to determine the performability of the total system for various choices of computer and environment parameter values. Numerical results of those evaluations are presented and, in conclusion, some implications of this effort are discussed.

Student performance and course evaluations before and after use of the Classroom Performance System ™ in a third-year veterinary radiology course.

PubMed

Hecht, Silke; Adams, W H; Cunningham, M A; Lane, I F; Howell, N E

2013-01-01

Effective teaching of veterinary radiology can be challenging in a traditional classroom environment. Audience response systems, colloquially known as "clickers," provide a means of encouraging student interaction. The purpose of this study was to compare student performance and course evaluations before and after using the Classroom Performance System™ in the third-year (fifth semester) didactic radiology course at the University of Tennessee College of Veterinary Medicine. Overall student performance was assessed by comparing median numeric final course grades (%) between years without and with use of the Classroom Performance System™. Grades of students were determined for individual instructors' sections. Student evaluations of the radiology course were compared for the years available (2007-2010). Student interactions were also evaluated subjectively by instructors who used the Classroom Performance System™. There was a significant difference (p = 0.009) between the median student grade before (2005 - 2008, median 82.2%; interquartile range 77.6-85.7%; range 61.9-95.5%) and after use of the classroom performance system (2009-2010, median 83.6%; interquartile range 79.9-87.9%; range 68.2-93.2%). There was no statistically significant difference in median student grades for individual instructors over the study period. The radiology course student evaluation scores were significantly higher in years where the Classroom Performance System™ was used in comparison to previous years (P = 0.019). Subjectively, students appeared more involved when using clickers. Findings indicated that the Classroom Performance System™ may be a useful tool for enhancing veterinary radiology education. © 2012 Veterinary Radiology & Ultrasound.

Performance perceptions and self-focused attention predict post-event processing after a real-life social performance situation.

PubMed

Helbig-Lang, Sylvia; Poels, Vanja; Lincoln, Tania M

2016-11-01

Cognitive approaches to social anxiety suggest that an excessive brooding about one's performance in a social situation (post-event processing; PEP) is involved in the maintenance of anxiety. To date, most studies investigating PEP were conducted in laboratory settings. The present study sought to replicate previous findings on predictors of PEP after a naturalistic social performance situation. Sixty-five students, who had to give an evaluated presentation for credits, completed measures of trait social anxiety. Immediately after their presentation, participants rated state anxiety and attentional focus during the presentation, and provided an overall evaluation of their performance. One week after the presentation, they rated PEP during the preceding week, and reappraised their performance. Regression analyses demonstrated that the performance ratings after and self-focused attention during the presentation were unique predictors of PEP over and above the effects of trait and state anxiety. There was no evidence that PEP was associated with a biased recall of individual performance evaluations. The results support cognitive theories that emphasize the importance of negative self-perceptions in the development of social anxiety and related processes, and underline self-focused attention and self-evaluative processes as important targets during treatment.

Performance Assessment as a Diagnostic Tool for Science Teachers

NASA Astrophysics Data System (ADS)

Kruit, Patricia; Oostdam, Ron; van den Berg, Ed; Schuitema, Jaap

2018-04-01

Information on students' development of science skills is essential for teachers to evaluate and improve their own education, as well as to provide adequate support and feedback to the learning process of individual students. The present study explores and discusses the use of performance assessments as a diagnostic tool for formative assessment to inform teachers and guide instruction of science skills in primary education. Three performance assessments were administered to more than 400 students in grades 5 and 6 of primary education. Students performed small experiments using real materials while following the different steps of the empirical cycle. The mutual relationship between the three performance assessments is examined to provide evidence for the value of performance assessments as useful tools for formative evaluation. Differences in response patterns are discussed, and the diagnostic value of performance assessments is illustrated with examples of individual student performances. Findings show that the performance assessments were difficult for grades 5 and 6 students but that much individual variation exists regarding the different steps of the empirical cycle. Evaluation of scores as well as a more substantive analysis of students' responses provided insight into typical errors that students make. It is concluded that performance assessments can be used as a diagnostic tool for monitoring students' skill performance as well as to support teachers in evaluating and improving their science lessons.

Dynamic online peer evaluations to improve group assignments in nursing e-learning environment.

PubMed

Adwan, Jehad

2016-06-01

The purpose of this research was to evaluate the use of online peer evaluation forms for online group activities in improving group project outcomes. The investigator developed and used a web-based Google Forms® self and peer evaluation form of 2 group assignments' rubric for junior and senior nursing students. The form covered elements of the assignments including: research activity, analysis of the literature, writing of report, participation in making of presentation, overall contribution to the project, and participation in the weekly group discussions. Items were rated from 1 (did not contribute) to 5 (outstanding contribution) in addition to NA when one activity did not apply. The self and peer evaluation process was conducted twice: once after group assignment 1 and once after group assignment 2. The group assignments final products were done in the form of VoiceThread online presentations that were shared with the rest of the class reflecting the groups' work on a health informatics topic of interest. Data collected as the students completed self and peer evaluations for group assignments 1 and 2. Also, optional comments regarding member performance were collected to add contextual information in addition to ratings. Students received credit for completing the peer evaluations and the grade for the particular assignment was affected by their performance based on peer evaluations of their contributions. Students' peer evaluations showed in a color-coded spreadsheet which enabled the course faculty to view real time results of students' ratings after each assignment. The faculty provided timely and tailored feedback to groups or individuals as needed, using positive feedback and commending high performance while urging struggling individual students and groups to improve lower ratings in specific areas. Comparing evaluations of both assignments, there were statistically significant improvements among all students. The mean scores of the entire sample were skewed toward the higher end of the scale, suggesting an overall high performance group. However, analysis of the lower performing individuals showed consistent and statistically significant improvements in all areas of the evaluation criteria. Anonymous peer evaluation activities and timely faculty feedback in e-Learning environment can be a useful tool to faculty to improve group performance over time by engaging the learners within their groups. Peer evaluations provided real time view of group mid-semester formative evaluations that allowed the faculty to provide timely and tailored feedback on student performance which allowed for better outcomes. Copyright © 2016 Elsevier Ltd. All rights reserved.

Capacity Loss Studies on High Capacity Li-ion Cells for the Orbiter Advanced Hydraulic Power System

NASA Technical Reports Server (NTRS)

Jeevarajan, Judith A.; Irlbeck, Bradley W.

2004-01-01

Contents include the following: Introduction. Physical and electrochemical characteristics. Performance evaluation. Rate performance. Internal resistance. Performance at different temperatures. Safety evaluation. Overcharge. Overdischarge. External short. Simulated internal short. Heat-to-vent. Vibration. Drop rest. Vent and burst pressure.

Evaluating Faculty Work: Expectations and Standards of Faculty Performance in Research Universities

ERIC Educational Resources Information Center

Hardre, Patricia; Cox, Michelle

2009-01-01

Expectations and the way they are communicated can influence employees' motivation and performance. Previous research has demonstrated individual effects of workplace climate and individual differences on faculty productivity. The present study focused on the characteristics of institutional performance standards, evaluation processes and…

Informal Mentoring

ERIC Educational Resources Information Center

Weber, Daniel

2017-01-01

A best practice regarding annual employee performance evaluations is that there should be no surprises. Issues regarding a person's performance should be addressed as they occur throughout the year. This has been the approach of the author when evaluating staff performance. However, this practice did not prepare the author to manage his surprise…

Ecological Regional Analysis Applied to Campus Sustainability Performance

ERIC Educational Resources Information Center

Weber, Shana; Newman, Julie; Hill, Adam

2017-01-01

Purpose: Sustainability performance in higher education is often evaluated at a generalized large scale. It remains unknown to what extent campus efforts address regional sustainability needs. This study begins to address this gap by evaluating trends in performance through the lens of regional environmental characteristics.…

Evaluation and Application of Enhancements to the Performance of the ASDE-3 Radar in Heavy Rain

DOT National Transportation Integrated Search

1982-03-01

This report presents the results of a study performed by the Transportation Systems Center (TSC) to evaluate two proposed enhancements to the performance of the ASDE-3 Radar in heavy rain: Adaptive gain and adaptive clutter thresholding, (operating w...

PERFORMANCE EVALUATION AT A LONG-TERM FOOD PROCESSING LAND TREATMENT SITE

EPA Science Inventory

The objective of this project was to determine the performance of a full scale, operating overland flow land (GEL) treatment system treating nonhazardous waste. Performance was evaluated in terms of treatment of the applied waste and the environmental impact of the system, partic...

78 FR 48123 - Federal Acquisition Regulation; Contractor Comment Period, Past Performance Evaluations

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-07

... Regulation; Contractor Comment Period, Past Performance Evaluations AGENCY: Department of Defense (DoD...) to implement provisions of law limiting the periods allowed for contractor comments on past....S.C. 2302 Note). Section 853, entitled ``Inclusion of Data on Contractor Performance in Past...

Instructors' Evaluation as an Instrument to Improve Performance and Determine Competence

ERIC Educational Resources Information Center

Laei, Soosan; Abdi, Ali; Karamaerouz, Mohamad Javad; Shirkhani, Nassim

2014-01-01

Experts in human resources management have suggested common objectives for evaluating performance of all organizations, including motivation and improvement of staff performance, identification of competence and skills, identification of educational needs and developmental contexts, etc. Achievement to these objectives is -a responsibility of…

Safety and operational performance evaluation of four types of exit ramps on Florida's freeways (final report).

DOT National Transportation Integrated Search

2010-12-01

This project mainly focuses on exit ramp performance analysis of safety and operations. In addition, issues of advance guide sign for exit ramp are also mentioned. : Safety analysis evaluates safety performances of different exit ramps used in Florid...

The Evaluation of Higher Education Expenditure Performance and Investment Mechanism Reform

ERIC Educational Resources Information Center

Wang, De; Fu, Meiying

2009-01-01

Along with the reform of Chinese Government public finance, higher education belongs to the public product, gradually changes from "fund investment management" to the "expenditure performance management". The evaluation of expenditure performance system becomes the key point of higher education investment mechanism reform. This…

Tribo-performance evaluation of ecofriendly brake friction composite materials

NASA Astrophysics Data System (ADS)

Kumar, Naresh; Singh, Tej; Grewal, G. S.

2018-05-01

This paper presents the potential of natural fibre in brake friction materials. Natural fibre filled ecofriendly brake friction materials were developed without Kevlar fibre evaluated for tribo-performance on a chase friction testing machine following SAE J 661a standard. Experimental results indicated that natural fibre enhances the fade performance, but depresses the friction and wear performance, whereas Kevlar fibre improves the friction, wear and recovery performance but depresses the fade performance. Also the results revealed that with the increase in natural fibre content, the friction and fade performances enhanced.

Influence of socioeconomic status on trauma center performance evaluations in a Canadian trauma system.

PubMed

Moore, Lynne; Turgeon, Alexis F; Sirois, Marie-Josée; Murat, Valérie; Lavoie, André

2011-09-01

Trauma center performance evaluations generally include adjustment for injury severity, age, and comorbidity. However, disparities across trauma centers may be due to other differences in source populations that are not accounted for, such as socioeconomic status (SES). We aimed to evaluate whether SES influences trauma center performance evaluations in an inclusive trauma system with universal access to health care. The study was based on data collected between 1999 and 2006 in a Canadian trauma system. Patient SES was quantified using an ecologic index of social and material deprivation. Performance evaluations were based on mortality adjusted using the Trauma Risk Adjustment Model. Agreement between performance results with and without additional adjustment for SES was evaluated with correlation coefficients. The study sample comprised a total of 71,784 patients from 48 trauma centers, including 3,828 deaths within 30 days (4.5%) and 5,549 deaths within 6 months (7.7%). The proportion of patients in the highest quintile of social and material deprivation varied from 3% to 43% and from 11% to 90% across hospitals, respectively. The correlation between performance results with or without adjustment for SES was almost perfect (r = 0.997; 95% CI 0.995-0.998) and the same hospital outliers were identified. We observed an important variation in SES across trauma centers but no change in risk-adjusted mortality estimates when SES was added to adjustment models. Results suggest that after adjustment for injury severity, age, comorbidity, and transfer status, disparities in SES across trauma center source populations do not influence trauma center performance evaluations in a system offering universal health coverage. Copyright © 2011 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Evaluating building performance in healthcare facilities: an organizational perspective.

PubMed

Steinke, Claudia; Webster, Lynn; Fontaine, Marie

2010-01-01

Using the environment as a strategic tool is one of the most cost-effective and enduring approaches for improving public health; however, it is one that requires multiple perspectives. The purpose of this article is to highlight an innovative methodology that has been developed for conducting comprehensive performance evaluations in public sector health facilities in Canada. The building performance evaluation methodology described in this paper is a government initiative. The project team developed a comprehensive building evaluation process for all new capital health projects that would respond to the aforementioned need for stakeholders to be more accountable and to better integrate the larger organizational strategy of facilities. The Balanced Scorecard, which is a multiparadigmatic, performance-based business framework, serves as the underlying theoretical framework for this initiative. It was applied in the development of the conceptual model entitled the Building Performance Evaluation Scorecard, which provides the following benefits: (1) It illustrates a process to link facilities more effectively to the overall mission and goals of an organization; (2) It is both a measurement and a management system that has the ability to link regional facilities to measures of success and larger business goals; (3) It provides a standardized methodology that ensures consistency in assessing building performance; and (4) It is more comprehensive than traditional building evaluations. The methodology presented in this paper is both a measurement and management system that integrates the principles of evidence-based design with the practices of pre- and post-occupancy evaluation. It promotes accountability and continues throughout the life cycle of a project. The advantage of applying this framework is that it engages health organizations in clarifying a vision and strategy for their facilities and helps translate those strategies into action and measurable performance outcomes.

Development of an Online Toolkit for Measuring Performance in Health Emergency Response Exercises.

PubMed

Agboola, Foluso; Bernard, Dorothy; Savoia, Elena; Biddinger, Paul D

2015-10-01

Exercises that simulate emergency scenarios are accepted widely as an essential component of a robust Emergency Preparedness program. Unfortunately, the variability in the quality of the exercises conducted, and the lack of standardized processes to measure performance, has limited the value of exercises in measuring preparedness. In order to help health organizations improve the quality and standardization of the performance data they collect during simulated emergencies, a model online exercise evaluation toolkit was developed using performance measures tested in over 60 Emergency Preparedness exercises. The exercise evaluation toolkit contains three major components: (1) a database of measures that can be used to assess performance during an emergency response exercise; (2) a standardized data collection tool (form); and (3) a program that populates the data collection tool with the measures that have been selected by the user from the database. The evaluation toolkit was pilot tested from January through September 2014 in collaboration with 14 partnering organizations representing 10 public health agencies and four health care agencies from eight states across the US. Exercise planners from the partnering organizations were asked to use the toolkit for their exercise evaluation process and were interviewed to provide feedback on the use of the toolkit, the generated evaluation tool, and the usefulness of the data being gathered for the development of the exercise after-action report. Ninety-three percent (93%) of exercise planners reported that they found the online database of performance measures appropriate for the creation of exercise evaluation forms, and they stated that they would use it again for future exercises. Seventy-two percent (72%) liked the exercise evaluation form that was generated from the toolkit, and 93% reported that the data collected by the use of the evaluation form were useful in gauging their organization's performance during the exercise. Seventy-nine percent (79%) of exercise planners preferred the evaluation form generated by the toolkit to other forms of evaluations. Results of this project show that users found the newly developed toolkit to be user friendly and more relevant to measurement of specific public health and health care capabilities than other tools currently available. The developed toolkit may contribute to the further advancement of developing a valid approach to exercise performance measurement.

Access to Teacher Evaluations Divides Advocates

ERIC Educational Resources Information Center

Sawchuk, Stephen

2012-01-01

As the movement to overhaul teacher evaluation marches onward, an emerging question is splitting the swath of advocates who support the new tools used to gauge teacher performance: Who should get access to the resulting information? Supporters of typing teacher evaluations to student performance differ over whether individuals' results should be…

Performance-Based Evaluation and School Librarians

ERIC Educational Resources Information Center

Church, Audrey P.

2015-01-01

Evaluation of instructional personnel is standard procedure in our Pre-K-12 public schools, and its purpose is to document educator effectiveness. With Race to the Top and No Child Left Behind waivers, states are required to implement performance-based evaluations that demonstrate student academic progress. This three-year study describes the…

Evaluating Organizational Performance: Rational, Natural, and Open System Models

ERIC Educational Resources Information Center

Martz, Wes

2013-01-01

As the definition of organization has evolved, so have the approaches used to evaluate organizational performance. During the past 60 years, organizational theorists and management scholars have developed a comprehensive line of thinking with respect to organizational assessment that serves to inform and be informed by the evaluation discipline.…

The Relationship of Teacher Evaluation Scores Generated by a Process-Product Evaluation Instrument to Selected Variables.

ERIC Educational Resources Information Center

Tadlock, James; Nesbit, Lamar

The Jackson Municipal Separate School District, Mississippi, has instituted a mixed-criteria reduction-in-force procedure emphasizing classroom performance to a greater degree than seniority, certification, and staff development participation. The district evaluation process--measuring classroom teaching performance--generated data for the present…

Legal Aspects of Evaluating Teacher Performance.

ERIC Educational Resources Information Center

Beckham, Joseph C.

Chapter 14 in a book on school law concerns the legal aspects of evaluating teacher performance. Careful analysis of recent decisions makes it clear the courts will compel uniform standards and unprecedented rigor in teacher evaluation practices. Particularly in the consideration of equitable standards, state and federal courts are relying on…

FIELD EVALUATION OF LOW-EMISSION COAL BURNER TECHNOLOGY ON UTILITY BOILERS. VOLUME I. DISTRIBUTED MIXING BURNER EVALUATION

EPA Science Inventory

The report gives results of a study in which NOx emissions and general combustion performance characteristics of four burners were evaluated under experimental furnace conditions. Of primary interest was the performance of a low NOx Distributed Mixing Burner (DMB), which was test...

Evaluating Fluid and Crystallized Abilities in the Performance of an Educational Process

ERIC Educational Resources Information Center

Blanch, Angel

2015-01-01

The fluid and crystallized ("Gf-Gc") intelligence theory has been used extensively to evaluate the influence of cognitive abilities on educational outcomes within cross-sectional and longitudinal research designs. This study evaluated the contribution of fluid and crystallized abilities in the performance of a 1-week instructional…

Air Traffic Control Experimentation and Evaluation with the NASA ATS-6 Satellite : Volume 6. Modem Evaluation Test

DOT National Transportation Integrated Search

1976-09-01

Results of performance evaluation of voice, digital data and ranging modems in the aeronautical satellite environment are given. Approximately 80 hours of modem performance data were acquired on board an FAA KC-135 jet aircraft operating over the Nor...

Using Conjoint Analysis to Evaluate and Reward Teaching Performance

ERIC Educational Resources Information Center

Bacon, Donald R.; Zheng, Yilong; Stewart, Kim A.; Johnson, Carol J.; Paul, Pallab

2016-01-01

Although widely used, student evaluations of teaching do not address several factors that should be considered in evaluating teaching performance such as new course preparations, teaching larger classes, and inconvenient class times. Consequently, the incentive exists to avoid certain teaching assignments to achieve high SET scores while…

29 CFR 1960.11 - Evaluation of occupational safety and health performance.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 9 2012-07-01 2012-07-01 false Evaluation of occupational safety and health performance. 1960.11 Section 1960.11 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Administration § 1960.11 Evaluation of occupational safety and...

29 CFR 1960.11 - Evaluation of occupational safety and health performance.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 9 2013-07-01 2013-07-01 false Evaluation of occupational safety and health performance. 1960.11 Section 1960.11 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Administration § 1960.11 Evaluation of occupational safety and...

29 CFR 1960.11 - Evaluation of occupational safety and health performance.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 9 2014-07-01 2014-07-01 false Evaluation of occupational safety and health performance. 1960.11 Section 1960.11 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Administration § 1960.11 Evaluation of occupational safety and...

29 CFR 1960.11 - Evaluation of occupational safety and health performance.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 9 2011-07-01 2011-07-01 false Evaluation of occupational safety and health performance. 1960.11 Section 1960.11 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Administration § 1960.11 Evaluation of occupational safety and...

Evaluation of the Anaheim Advanced Traffic Control System Field Operational Test : introduction and Task A : evaluation of SCOOT performance

DOT National Transportation Integrated Search

1999-03-01

This report provides an overview of both the Anaheim Advanced Traffic Control System Field Operations Test (FOT) and of the technical issues associated with the evaluation of SCOOT performance during the test. The primary objective of the FOT was to ...

MULTI-SITE PERFORMANCE EVALUATIONS OF CANDIDATE METHODOLOGIES FOR DETERMINING COARSE PARTICULATE MATTER (PMC) CONCENTRATIONS

EPA Science Inventory

Comprehensive field studies were conducted to evaluate the performance of sampling methods for measuring the coarse fraction of PM10 in ambient air. Five separate sampling approaches were evaluated at each of three sampling sites. As the primary basis of comparison, a discret...

48 CFR 3052.216-71 - Determination of award fee.

Code of Federal Regulations, 2013 CFR

2013-10-01

... periodically informed of the quality of its performance and areas in which improvements are expected. (c) The... was not earned. The contractor may submit a performance self-evaluation for each evaluation period. The amount of award is at the sole discretion of the Government but any self-evaluation received...

48 CFR 3052.216-71 - Determination of award fee.

Code of Federal Regulations, 2010 CFR

2010-10-01

... periodically informed of the quality of its performance and areas in which improvements are expected. (c) The... was not earned. The contractor may submit a performance self-evaluation for each evaluation period. The amount of award is at the sole discretion of the Government but any self-evaluation received...

48 CFR 1252.216-71 - Determination of award fee.

Code of Federal Regulations, 2014 CFR

2014-10-01

... contractor shall be periodically informed of the quality of its performance and areas in which improvements... reasons why the award fee was or was not earned. The contractor may submit a performance self-evaluation... self-evaluation received within ___ (insert number) days after the end of the current evaluation period...

48 CFR 1252.216-71 - Determination of award fee.

Code of Federal Regulations, 2010 CFR

2010-10-01

... contractor shall be periodically informed of the quality of its performance and areas in which improvements... reasons why the award fee was or was not earned. The contractor may submit a performance self-evaluation... self-evaluation received within ___ (insert number) days after the end of the current evaluation period...

48 CFR 3052.216-71 - Determination of award fee.

Code of Federal Regulations, 2014 CFR

2014-10-01

... periodically informed of the quality of its performance and areas in which improvements are expected. (c) The... was not earned. The contractor may submit a performance self-evaluation for each evaluation period. The amount of award is at the sole discretion of the Government but any self-evaluation received...

48 CFR 1252.216-71 - Determination of award fee.

Code of Federal Regulations, 2013 CFR

2013-10-01

... contractor shall be periodically informed of the quality of its performance and areas in which improvements... reasons why the award fee was or was not earned. The contractor may submit a performance self-evaluation... self-evaluation received within ___ (insert number) days after the end of the current evaluation period...

48 CFR 1252.216-71 - Determination of award fee.

Code of Federal Regulations, 2012 CFR

2012-10-01

... contractor shall be periodically informed of the quality of its performance and areas in which improvements... reasons why the award fee was or was not earned. The contractor may submit a performance self-evaluation... self-evaluation received within ___ (insert number) days after the end of the current evaluation period...

48 CFR 1252.216-71 - Determination of award fee.

Code of Federal Regulations, 2011 CFR

2011-10-01

... contractor shall be periodically informed of the quality of its performance and areas in which improvements... reasons why the award fee was or was not earned. The contractor may submit a performance self-evaluation... self-evaluation received within ___ (insert number) days after the end of the current evaluation period...

48 CFR 3052.216-71 - Determination of award fee.

Code of Federal Regulations, 2012 CFR

2012-10-01

... periodically informed of the quality of its performance and areas in which improvements are expected. (c) The... was not earned. The contractor may submit a performance self-evaluation for each evaluation period. The amount of award is at the sole discretion of the Government but any self-evaluation received...

48 CFR 3052.216-71 - Determination of award fee.

Code of Federal Regulations, 2011 CFR

2011-10-01

... periodically informed of the quality of its performance and areas in which improvements are expected. (c) The... was not earned. The contractor may submit a performance self-evaluation for each evaluation period. The amount of award is at the sole discretion of the Government but any self-evaluation received...

Electric and Plug-In Hybrid Electric Vehicle Publications | Transportation

Science.gov Websites

, Kandler Smith, and Kevin Walkowicz. (2016) Medium-Duty Plug-in Electric Delivery Truck Fleet Evaluation . (2014) Smith Newton Electric Delivery Trucks Smith Newton Vehicle Performance Evaluation (Gen 1 ), Cumulative Report: November 2011-June 2014. Adam Ragatz. (2014) Smith Newton Vehicle Performance Evaluation

29 CFR 1960.11 - Evaluation of occupational safety and health performance.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Evaluation of occupational safety and health performance. 1960.11 Section 1960.11 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Administration § 1960.11 Evaluation of occupational safety and...

Annual Application and Evaluation of the Online Coupled WRF‐CMAQ System over North America under AQMEII Phase 2

EPA Science Inventory

We present an application of the online coupled WRF-CMAQ modeling system to two annual simulations over North America performed under Phase 2 of the Air Quality Model Evaluation International Initiative (AQMEII). Operational evaluation shows that model performance is comparable t...

An experimental study on CHVE's performance evaluation.

PubMed

Paiva, Paulo V F; Machado, Liliane S; Oliveira, Jauvane C

2012-01-01

Virtual reality-based training simulators, with collaborative capabilities, are known to improve the way users interact with one another while learning or improving skills on a given medical procedure. Performance evaluation of Collaborative Haptic Virtual Environments (CHVE) allows us to understand how such systems can work in the Internet, as well as the requirements for multisensorial and real-time data. This work discloses new performance evaluation results for the collaborative module of the CyberMed VR framework.

Surface evaluation of UV-degraded contamination

NASA Technical Reports Server (NTRS)

Connatser, Robert; Hadaway, James B.

1992-01-01

Three different areas of work were accomplished under this contract: (1) contamination testing and evaluation; (2) UV irradiation testing; and (3) surface evaluation testing. Contamination testing was generally performed in the In-Situ Contamination Effects Facility at Marshall Space Flight Center (MSFC). UV irradiation testing was also performed primarily at MSFC, utilizing facilities there. Finally, the surface evaluation was done at facilities at UAH Center for Applied Optics.

40 CFR Appendix A to Part 58 - Quality Assurance Requirements for SLAMS, SPMs and PSD Air Monitoring

Code of Federal Regulations, 2011 CFR

2011-07-01

... in section 4.3.1 of this appendix. 3.2.7PM2.5 Performance Evaluation Program (PEP) Procedures. The... evaluation audit means that both the primary monitor and PEP audit concentrations are valid and above 3 µg/m3... Evaluation Program (PEP) Procedures. Each year, one performance evaluation audit, as described in section 3.2...

40 CFR Appendix A to Part 58 - Quality Assurance Requirements for SLAMS, SPMs and PSD Air Monitoring

Code of Federal Regulations, 2012 CFR

2012-07-01

... in section 4.3.1 of this appendix. 3.2.7PM2.5 Performance Evaluation Program (PEP) Procedures. The... evaluation audit means that both the primary monitor and PEP audit concentrations are valid and above 3 µg/m3... Evaluation Program (PEP) Procedures. Each year, one performance evaluation audit, as described in section 3.2...

[Evaluation of Livestock Carcasses and Performance.] Student Materials. V.A. III. [II-B-1 through II-B-2; II-D-1].

ERIC Educational Resources Information Center

Texas A and M Univ., College Station. Vocational Instructional Services.

Part of a series of eight student learning modules in vocational agriculture, this booklet deals with evaluation of livestock. It contains sections on carcass evaluation, the evaluation of performance and production, and the design of livestock production facilities. Each of the first two sections has a glossary, and all three conclude with a…

The effects of arousal reappraisal on stress responses, performance and attention.

PubMed

Sammy, Nadine; Anstiss, Paul A; Moore, Lee J; Freeman, Paul; Wilson, Mark R; Vine, Samuel J

2017-11-01

This study examined the effects of arousal reappraisal on cardiovascular responses, demand and resource evaluations, self-confidence, performance and attention under pressurized conditions. A recent study by Moore et al. [2015. Reappraising threat: How to optimize performance under pressure. Journal of Sport and Exercise Psychology, 37(3), 339-343. doi: 10.1123/jsep.2014-0186 ] suggested that arousal reappraisal is beneficial to the promotion of challenge states and leads to improvements in single-trial performance. This study aimed to further the work of Moore and colleagues (2015) by examining the effects of arousal reappraisal on cardiovascular responses, demand and resource evaluations, self-confidence, performance and attention in a multi-trial pressurized performance situation. Participants were randomly assigned to either an arousal reappraisal intervention or control condition, and completed a pressurized dart throwing task. The intervention encouraged participants to view their physiological arousal as facilitative rather than debilitative to performance. Measures of cardiovascular reactivity, demand and resource evaluations, self-confidence, task performance and attention were recorded. The reappraisal group displayed more favorable cardiovascular reactivity and reported higher resource evaluations and higher self-confidence than the control group but no task performance or attention effects were detected. These findings demonstrate the strength of arousal reappraisal in promoting adaptive stress responses, perceptions of resources and self-confidence.

Multiple performance measures are needed to evaluate triage systems in the emergency department.

PubMed

Zachariasse, Joany M; Nieboer, Daan; Oostenbrink, Rianne; Moll, Henriëtte A; Steyerberg, Ewout W

2018-02-01

Emergency department triage systems can be considered prediction rules with an ordinal outcome, where different directions of misclassification have different clinical consequences. We evaluated strategies to compare the performance of triage systems and aimed to propose a set of performance measures that should be used in future studies. We identified performance measures based on literature review and expert knowledge. Their properties are illustrated in a case study evaluating two triage modifications in a cohort of 14,485 pediatric emergency department visits. Strengths and weaknesses of the performance measures were systematically appraised. Commonly reported performance measures are measures of statistical association (34/60 studies) and diagnostic accuracy (17/60 studies). The case study illustrates that none of the performance measures fulfills all criteria for triage evaluation. Decision curves are the performance measures with the most attractive features but require dichotomization. In addition, paired diagnostic accuracy measures can be recommended for dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R 2 for ordinal analyses. Other performance measures provide limited additional information. When comparing modifications of triage systems, decision curves and diagnostic accuracy measures should be used in a dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R 2 in an ordinal approach. Copyright © 2017 Elsevier Inc. All rights reserved.

Shuttle orbiter Ku-band radar/communications system design evaluation

NASA Technical Reports Server (NTRS)

Dodds, J.; Holmes, J.; Huth, G. K.; Iwasaki, R.; Maronde, R.; Polydoros, A.; Weber, C.; Broad, P.

1980-01-01

Tasks performed in an examination and critique of a Ku-band radar communications system for the shuttle orbiter are reported. Topics cover: (1) Ku-band high gain antenna/widebeam horn design evaluation; (2) evaluation of the Ku-band SPA and EA-1 LRU software; (3) system test evaluation; (4) critical design review and development test evaluation; (5) Ku-band bent pipe channel performance evaluation; (6) Ku-band LRU interchangeability analysis; and (7) deliverable test equipment evaluation. Where discrepancies were found, modifications and improvements to the Ku-band system and the associated test procedures are suggested.

Student Performance Evaluation. Physical Educators for Equity. Module 7.

ERIC Educational Resources Information Center

Uhlir, Ann

Guidelines are presented to aid secondary school physical education teachers in evaluating student performance in a way that avoids sex-role stereotyping and sex discrimination. Suggestions made for conducting testing in a bias-free setting include: (1) avoid sex-differentiated role tasks; (2) organize motor-performance testing procedures so that…

Research, Teaching and Performance Evaluation in Academia: The Salience of Quality

ERIC Educational Resources Information Center

Cadez, Simon; Dimovski, Vlado; Zaman Groff, Maja

2017-01-01

The workload of most academics involves two main activities: research and teaching. Despite the dual nature of the work, career advancement usually chiefly depends on research performance. Since academics are rational actors, warnings are beginning to emerge that current predominantly research-based performance evaluation systems may be…

45 CFR 2516.810 - What types of evaluations are grantees and subgrantees required to perform?

Code of Federal Regulations, 2010 CFR

2010-10-01

... Welfare (Continued) CORPORATION FOR NATIONAL AND COMMUNITY SERVICE SCHOOL-BASED SERVICE-LEARNING PROGRAMS...? All grantees and subgrantees are required to perform internal evaluations which are ongoing efforts to assess performance and improve quality. Grantees and subgrantees may, but are not required to, arrange...

Framework for Teacher Evaluation: Examining the Relationship between Teacher Performance and Student Achievement

ERIC Educational Resources Information Center

Parker, Neelie B.

2017-01-01

This action research study examined the relationship between teacher performance and student achievement in reading language arts and mathematics. The study sought to determine if teacher evaluation methods used to determine teacher performance, had a relationship in improving student achievement. The researcher investigated the topic using…

Chinese Middle School Teachers' Preferences Regarding Performance Evaluation Measures

ERIC Educational Resources Information Center

Liu, Shujie; Xu, Xianxuan; Stronge, James H.

2016-01-01

Teacher performance evaluation currently is receiving unprecedented attention from policy makers, scholars, and practitioners worldwide. This study is one of the few studies of teacher perceptions regarding teacher performance measures that focus on China. We employed a quantitative dominant mixed research design to investigate Chinese teachers'…

HEAT TRANSFER EVALUATION OF HFC-236EA WITH HIGH PERFORMANCE ENHANCED TUBES IN CONDENSATION AND EVAPORATION

EPA Science Inventory

The report gives results of an evaluation of the heat transfer performance of pure hydrofluorocarbon (HFC)-236ea for high performance enhanced tubes which had not been previously used in Navy shipboard chillers. Shell-side heat transfer coefficient data are presented for condensa...

Performance Measurement for Public Services in Academic and Research Libraries. Occasional Paper Number #9.

ERIC Educational Resources Information Center

Cronin, Mary J.

This paper defines performance measurement as the clarification of objectives and standards, identification of key activities, data collection and analysis, and formative evaluation of services. It then examines some of the factors involved in using performance measurement to evaluate public services activities, and analyzes performance…

Defining Administrative Tasks, Evaluating Performance, and Developing Skills.

ERIC Educational Resources Information Center

Herman, Janice L.; Herman, Jerry J.

1995-01-01

To ensure high performance, administrators should develop an articulated structure and process systems approach that identifies the critical success factors (CSFs) of performance for each position; appropriate indicators and scales; and a personal-improvement plan based on last year's evaluation. Once CSFs are identified and written into the…

MEASUREMENT OF VOLATILE ORGANIC COMPOUNDS BY THE US ENVIRONMENTAL PROTECTION AGENCY COMPENDIUM METHOD TO-17 - EVALUATION OF PERFORMANCE CRITERIA

EPA Science Inventory

An evaluation of performance criteria for US Environmental Protection Agency Compendium Method TO-17 for monitoring volatile organic compounds (VOCs) in air has been accomplished. The method is a solid adsorbent-based sampling and analytical procedure including performance crit...

A versus F: The Effects of Implicit Letter Priming on Cognitive Performance

ERIC Educational Resources Information Center

Ciani, Keith D.; Sheldon, Kennon M.

2010-01-01

Background: It has been proposed that motivational responses outside people's conscious awareness can be primed to affect academic performance. The current research focused on the relationship between primed evaluative letters (A and F), explicit and implicit achievement motivation, and cognitive performance. Aim: Given the evaluative connotation…

VI-G, Sec. 661, P.L. 91-230. Final Performance Report.

ERIC Educational Resources Information Center

1976

Presented is the final performance report of the CSDC model which is designed to provide services for learning disabled high school students. Sections cover the following program aspects: organizational structure, inservice sessions, identification of students, materials and equipment, evaluation of student performance, evaluation of the model,…

Calibration of automatic performance measures - speed and volume data : volume 1, evaluation of the accuracy of traffic volume counts collected by microwave sensors.

DOT National Transportation Integrated Search

2015-09-01

Over the past few years, the Utah Department of Transportation (UDOT) has developed a system called the : Signal Performance Metrics System (SPMS) to evaluate the performance of signalized intersections. This system : currently provides data summarie...

40 CFR Table 7 to Subpart Vvvv of... - Applicability and Timing of Notifications

Code of Federal Regulations, 2010 CFR

2010-07-01

... § 63.9(e). b. A notification of the date for the continuous monitoring system performance evaluation as... control device performance test and continuous monitoring system performance evaluation. ... Notifications 7 Table 7 to Subpart VVVV of Part 63 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY...

A modified F-test for evaluating model performance by including both experimental and simulation uncertainties

USDA-ARS?s Scientific Manuscript database

Experimental and simulation uncertainties have not been included in many of the statistics used in assessing agricultural model performance. The objectives of this study were to develop an F-test that can be used to evaluate model performance considering experimental and simulation uncertainties, an...

12 CFR 228.41 - Assessment area delineation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... does not evaluate the bank's delineation of its assessment area(s) as a separate performance criterion..., such as those consumer loans on which the bank elects to have its performance assessed). (d... area(s) delineated by a bank in its evaluation of the bank's CRA performance unless the Board...

Evaluation of Knowledge Development in a Healthcare Setting

NASA Astrophysics Data System (ADS)

Schaffer, Scott P.

Healthcare organizations worldwide have recently increased efforts to improve performance, quality, and knowledge transfer using information and communication technologies. Evaluation of the effectiveness and quality of such efforts is challenging. A macro and micro-level system evaluation conducted with a 14000 member US hospital administrative services organization examined the appropriateness of a blended face-to-face and technology-enabled performance improvement and knowledge development system. Furthermore, a successful team or microsystem in a high performing hospital was studied in-depth. Several types of data methods including interview, observation, and questionnaire were used to address evaluation questions within a knowledge development framework created for the study. Results of this preliminary study focus on how this organization attempted to organize clinical improvement efforts around quality and performance improvement processes supported by networked technologies.

Blinded evaluation of interrater reliability of an operative competency assessment tool for direct laryngoscopy and rigid bronchoscopy.

PubMed

Ishman, Stacey L; Benke, James R; Johnson, Kaalan Erik; Zur, Karen B; Jacobs, Ian N; Thorne, Marc C; Brown, David J; Lin, Sandra Y; Bhatti, Nasir; Deutsch, Ellen S

2012-10-01

OBJECTIVES To confirm interrater reliability using blinded evaluation of a skills-assessment instrument to assess the surgical performance of resident and fellow trainees performing pediatric direct laryngoscopy and rigid bronchoscopy in simulated models. DESIGN Prospective, paired, blinded observational validation study. SUBJECTS Paired observers from multiple institutions simultaneously evaluated residents and fellows who were performing surgery in an animal laboratory or using high-fidelity manikins. The evaluators had no previous affiliation with the residents and fellows and did not know their year of training. INTERVENTIONS One- and 2-page versions of an objective structured assessment of technical skills (OSATS) assessment instrument composed of global and a task-specific surgical items were used to evaluate surgical performance. RESULTS Fifty-two evaluations were completed by 17 attending evaluators. The instrument agreement for the 2-page assessment was 71.4% when measured as a binary variable (ie, competent vs not competent) (κ = 0.38; P = .08). Evaluation as a continuous variable revealed a 42.9% percentage agreement (κ = 0.18; P = .14). The intraclass correlation was 0.53, considered substantial/good interrater reliability (69% reliable). For the 1-page instrument, agreement was 77.4% when measured as a binary variable (κ = 0.53, P = .0015). Agreement when evaluated as a continuous measure was 71.0% (κ = 0.54, P < .001). The intraclass correlation was 0.73, considered high interrater reliability (85% reliable). CONCLUSIONS The OSATS assessment instrument is an effective tool for evaluating surgical performance among trainees with acceptable interrater reliability in a simulator setting. Reliability was good for both the 1- and 2-page OSATS checklists, and both serve as excellent tools to provide immediate formative feedback on operational competency.

Theory-Informed Interventions to Improve the Quality of Tuberculosis Evaluation at Ugandan Health Centers: A Quasi-Experimental Study.

PubMed

Chaisson, Lelia H; Katamba, Achilles; Haguma, Priscilla; Ochom, Emmanuel; Ayakaka, Irene; Mugabe, Frank; Miller, Cecily; Vittinghoff, Eric; Davis, J Lucian; Handley, Margaret A; Cattamanchi, Adithya

2015-01-01

Tuberculosis (TB) remains under-diagnosed in many countries, in part due to poor evaluation practices at health facilities. Theory-informed strategies are needed to improve implementation of TB evaluation guidelines. We aimed to evaluate the impact of performance feedback and same-day smear microscopy on the quality of TB evaluation at 6 health centers in rural Uganda. We tested components of a multi-faceted intervention to improve adherence to the International Standards for Tuberculosis Care (ISTC): performance feedback and same-day smear microscopy. The strategies were selected based on a qualitative assessment guided by the Theory of Planned Behavior and the PRECEDE model. We collected patient data 6 months before and after the introduction of each intervention component, and compared ISTC adherence in the pre- and post-intervention periods for adults with cough ≥ 2 weeks' duration. The performance feedback evaluation included 1,446 adults; 838 (58%) were evaluated during the pre-intervention period and 608 (42%) during the post-intervention period. Performance feedback resulted in a 15% (95%CI +10% to +20%, p<0.001) increase in the proportion of patients receiving ISTC-adherent care. The same-day microscopy evaluation included 1,950 adults; 907 (47%) were evaluated during the pre-intervention period and 1,043 (53%) during the post-intervention period. Same-day microscopy was associated with a 14% (95%CI +10% to +18%, p<0.001) increase in the proportion of patients receiving ISTC-adherent care. Performance feedback and same-day microscopy should be considered along with ISTC training as part of a multi-faceted intervention to improve the quality of TB evaluation in other high TB burden countries.

Theory-Informed Interventions to Improve the Quality of Tuberculosis Evaluation at Ugandan Health Centers: A Quasi-Experimental Study

PubMed Central

Haguma, Priscilla; Ochom, Emmanuel; Ayakaka, Irene; Mugabe, Frank; Miller, Cecily; Vittinghoff, Eric; Davis, J. Lucian; Handley, Margaret A.; Cattamanchi, Adithya

2015-01-01

Background Tuberculosis (TB) remains under-diagnosed in many countries, in part due to poor evaluation practices at health facilities. Theory-informed strategies are needed to improve implementation of TB evaluation guidelines. We aimed to evaluate the impact of performance feedback and same-day smear microscopy on the quality of TB evaluation at 6 health centers in rural Uganda. Methods We tested components of a multi-faceted intervention to improve adherence to the International Standards for Tuberculosis Care (ISTC): performance feedback and same-day smear microscopy. The strategies were selected based on a qualitative assessment guided by the Theory of Planned Behavior and the PRECEDE model. We collected patient data 6 months before and after the introduction of each intervention component, and compared ISTC adherence in the pre- and post-intervention periods for adults with cough ≥ 2 weeks’ duration. Results The performance feedback evaluation included 1,446 adults; 838 (58%) were evaluated during the pre-intervention period and 608 (42%) during the post-intervention period. Performance feedback resulted in a 15% (95%CI +10% to +20%, p<0.001) increase in the proportion of patients receiving ISTC-adherent care. The same-day microscopy evaluation included 1,950 adults; 907 (47%) were evaluated during the pre-intervention period and 1,043 (53%) during the post-intervention period. Same-day microscopy was associated with a 14% (95%CI +10% to +18%, p<0.001) increase in the proportion of patients receiving ISTC-adherent care. Conclusions Performance feedback and same-day microscopy should be considered along with ISTC training as part of a multi-faceted intervention to improve the quality of TB evaluation in other high TB burden countries. PMID:26172948

Does performance management affect nurses' well-being?

PubMed

Decramer, Adelien; Audenaert, Mieke; Van Waeyenberg, Thomas; Claeys, Tine; Claes, Claudia; Vandevelde, Stijn; van Loon, Jos; Crucke, Saskia

2015-04-01

This article focuses on employee performance-management practices in the healthcare sector. We specifically aim to contribute to a better understanding of the impact of employee performance-management practices on affective well-being of nurses in hospitals. Theory suggests that the features of employee-performance management (planning and evaluation of individual performances) predict affective well-being (in this study: job satisfaction and affective commitment). Performance-management planning and evaluation and affective well-being were drawn from a survey of nurses at a Flemish hospital. Separate estimations were performed for different aspects of affective well-being. Performance planning has a negative effect on job satisfaction of nurses. Both vertical alignment and satisfaction with the employee performance-management system increase the affective well-being of nurses; however, the impact of vertical alignment differs for different aspects of affective well-being (i.e. job satisfaction and affective commitment). Performance-management planning and evaluation of nurses are associated with attitudinal outcomes. The results indicate that employee performance-management features have different impacts on different aspects of well-being. Copyright © 2014 Elsevier Ltd. All rights reserved.

Multi-objective optimization for generating a weighted multi-model ensemble

NASA Astrophysics Data System (ADS)

Lee, H.

2017-12-01

Many studies have demonstrated that multi-model ensembles generally show better skill than each ensemble member. When generating weighted multi-model ensembles, the first step is measuring the performance of individual model simulations using observations. There is a consensus on the assignment of weighting factors based on a single evaluation metric. When considering only one evaluation metric, the weighting factor for each model is proportional to a performance score or inversely proportional to an error for the model. While this conventional approach can provide appropriate combinations of multiple models, the approach confronts a big challenge when there are multiple metrics under consideration. When considering multiple evaluation metrics, it is obvious that a simple averaging of multiple performance scores or model ranks does not address the trade-off problem between conflicting metrics. So far, there seems to be no best method to generate weighted multi-model ensembles based on multiple performance metrics. The current study applies the multi-objective optimization, a mathematical process that provides a set of optimal trade-off solutions based on a range of evaluation metrics, to combining multiple performance metrics for the global climate models and their dynamically downscaled regional climate simulations over North America and generating a weighted multi-model ensemble. NASA satellite data and the Regional Climate Model Evaluation System (RCMES) software toolkit are used for assessment of the climate simulations. Overall, the performance of each model differs markedly with strong seasonal dependence. Because of the considerable variability across the climate simulations, it is important to evaluate models systematically and make future projections by assigning optimized weighting factors to the models with relatively good performance. Our results indicate that the optimally weighted multi-model ensemble always shows better performance than an arithmetic ensemble mean and may provide reliable future projections.

Measuring the performance of super-resolution reconstruction algorithms

NASA Astrophysics Data System (ADS)

Dijk, Judith; Schutte, Klamer; van Eekeren, Adam W. M.; Bijl, Piet

2012-06-01

For many military operations situational awareness is of great importance. This situational awareness and related tasks such as Target Acquisition can be acquired using cameras, of which the resolution is an important characteristic. Super resolution reconstruction algorithms can be used to improve the effective sensor resolution. In order to judge these algorithms and the conditions under which they operate best, performance evaluation methods are necessary. This evaluation, however, is not straightforward for several reasons. First of all, frequency-based evaluation techniques alone will not provide a correct answer, due to the fact that they are unable to discriminate between structure-related and noise-related effects. Secondly, most super-resolution packages perform additional image enhancement techniques such as noise reduction and edge enhancement. As these algorithms improve the results they cannot be evaluated separately. Thirdly, a single high-resolution ground truth is rarely available. Therefore, evaluation of the differences in high resolution between the estimated high resolution image and its ground truth is not that straightforward. Fourth, different artifacts can occur due to super-resolution reconstruction, which are not known on forehand and hence are difficult to evaluate. In this paper we present a set of new evaluation techniques to assess super-resolution reconstruction algorithms. Some of these evaluation techniques are derived from processing on dedicated (synthetic) imagery. Other evaluation techniques can be evaluated on both synthetic and natural images (real camera data). The result is a balanced set of evaluation algorithms that can be used to assess the performance of super-resolution reconstruction algorithms.

Data on the sensory evaluation of potatoes (Solanum tuberosum) from different areas of Hokkaido, Japan, performed by untrained young adults.

PubMed

Sato, Hiroaki; Koizumi, Ryosuke; Nakazawa, Yozo; Yamazaki, Masao; Itoyama, Ryuichi; Ichisawa, Megumi; Negishi, Junko; Sakuma, Rui; Furusho, Tadasu; Sagane, Yoshimasa; Takano, Katsumi

2017-12-01

This data article describes a sensory evaluation of potatoes used in food processing from the Tokachi, Kamikawa, and Abashiri geographic areas of Hokkaido, Japan, performed by untrained young adults. We gathered sensory data on potatoes from the four cultivars 'Toyoshiro,' 'Kitahime,' 'Snowden,' and 'Poroshiri.' The sensory evaluation was performed on steamed potatoes from each cultivar; these potatoes were harvested from each of the three geographic areas. Table 1 provides the data from the evaluation of the five basic tastes (sweet, salty, sour, bitter, and umami), as well as the evaluation of the egumi taste, which is a Japanese term indicating a taste that is acrid, astringent, and slightly bitter.

The use of individualized contract plans as a method of performance evaluation for allied health faculty.

PubMed

Mitcham, M D; Vericella, B J

1985-11-01

Results from a two-year study of the individualized contract plan (ICP) approach to faculty evaluation indicate this is a workable method of performance evaluation for allied health faculty. The ICP was found to be individualized, systematic, flexible, and objective. Faculty members and department chairpersons differed in their perception of the effectiveness of the ICP, but both groups supported its continued use. Five major recommendations were made regarding the continued use of the ICP as a method of faculty performance evaluation: (1) separate evaluation and professional development aspects, (2) link results to the institutional reward structure, (3) administer the ICP uniformly among departments, (4) develop a monitoring mechanism, and (5) foster open communication among all participants in the system.

Apollo experience report: Engineering and analysis mission support

NASA Technical Reports Server (NTRS)

Fricke, R. W., Jr.

1975-01-01

The tasks performed by the team of specialists that evaluated hardware performance during prelaunch checkout and in-flight operation are discussed. The organizational structure, operational procedures, and interfaces as well as the facilities and software required to perform these tasks are discussed. The scope of the service performed by the team and the evaluation philosophy are described. Summaries of problems and their resolution are included as appendixes.

Effect of prior performance on subsequent performance evaluation by field independent-dependent raters.

PubMed

Sisco, Howard; Leventhal, Gloria

2007-12-01

The importance of accurate performance appraisals is central to many aspects of personnel activities in organizations. This study examined threats due to past performance to accuracy of evaluation of subsequent performance by raters differing in scores on field dependence. 162 college students were classified as Field-dependent (n = 81) or Field-independent (n = 81), using a median split on the Group Embedded Figures Test. Past performance (a lecture) was good or poor, presented directly via a videotape or indirectly via a written evaluation to the Field-independent or Field-dependent groups. Analysis indicated the hypothesized contrast effect (ratings in the opposite direction from that of prior ratings) in the Direct condition and an unexpected, albeit smaller, contrast effect in the Indirect condition. There were also differential effects of performance, presentation, and field dependency on rating of lecturer's style and ability.

Anesthesiology resident personality type correlates with faculty assessment of resident performance.

PubMed

Schell, Randall M; Dilorenzo, Amy N; Li, Hsin-Fang; Fragneto, Regina Y; Bowe, Edwin A; Hessel, Eugene A

2012-11-01

To study the association between anesthesiology residents' personality preference types, faculty evaluations of residents' performance, and knowledge. Convenience sample and prospective study. Academic department of anesthesiology. Consenting anesthesiology residents (n = 36). All participants completed the Myers Briggs Type Indicator® (MBTI®). All residents' 6-month summation of daily focal evaluations completed by faculty [daily performance score (DPS); 1 = unsatisfactory, 2 = needs improvement, 3 = meets expectations, 4 = exceeds expectations], as well as a global assessment of performance (GAP) score based on placement of each resident into perceived quartile compared with their peers (ie,1 = first, or top, quartile) by senior faculty (n = 7) who also completed the MBTI, were obtained. The resident MBTI personality preferences were compared with the DPS and GAP scores, the United States Medical Licensing Examination (USMLE) I and II scores, and faculty MBTI personality type. There was no association between personality preference type and performance on standardized examinations (USMLE I, II). The mean GAP score was better (higher quartile score) for Extraverts than Introverts (median 2.0 vs 2.6, P = 0.0047) and for Sensing versus Intuition (median 2.0 vs 2.6, P = 0.0206) preference. Faculty evaluator MBTI preference type did not influence the GAP scores they assigned residents. Like GAP, the DPS was better for residents with Sensing versus Intuition preference (median 3.5 vs 3.3, P = 0.0111). No difference in DPS was noted between Extraverts and Introverts. Personality preference type was not associated with resident performance on standardized examinations, but it was associated with faculty evaluations of resident performance. Residents with Sensing personality preference were evaluated more favorably on global and focal faculty evaluations than those residents who chose the Intuition preference. Extraverted residents were evaluated more favorably on global but not focal assessment of performance. Copyright © 2012 Elsevier Inc. All rights reserved.

Experimental heat and mass transfer of the separated and coupled rotating desiccant wheel and heat wheel

DOE Office of Scientific and Technical Information (OSTI.GOV)

Enteria, Napoleon; Yoshino, Hiroshi; Mochida, Akashi

The experimental evaluation of the separated and coupled rotating desiccant wheel and heat wheel is reported. The study aims to investigate the performance of the desiccant wheel and of the heat wheel both when operated separately and jointly. The performance evaluation of the desiccant wheel is based on its moisture removal capacity (MRC), moisture removal regeneration (MRR), and moisture mass balance (MMB). In addition, the study used the total energy balance (TEB), sensible coefficient of performance (COP{sub Sensible}), latent coefficient of performance (COP{sub Latent}) and, total coefficient of performance (COP{sub Total}). The performance of the heat wheel is based onmore » its effectiveness. The COP{sub Sensible}, COP{sub Latent} and, COP{sub Total} are used in the performance evaluation of the coupled desiccant wheel and heat wheel. The general results of the study show that the MRC, MRR and MMB coupled with the TEB, COP{sub Latent}, COP{sub Sensible} and COP{sub Total} predict adequately the performance of the desiccant wheel. In addition, the coupled operation of the desiccant wheel and heat wheel, contributed to the reduction of the external thermal energy requirement for the regeneration of the desiccant wheel. This study can be applied in other researches seeking evaluation of the desiccant wheel, heat wheel, and their combined operation. Moreover, the data presented here are significant for the desiccant wheel benchmarking and for evaluation of the desiccant wheel models. (author)« less

An Investigation to Improve Quality Evaluations of Primers and Propellant for 20mm Munitions

NASA Technical Reports Server (NTRS)

Bement, L. J.; Holmes, C.; McGrory, J.; Schimmel, M. L.

1997-01-01

To reduce the frequency of electrically initiated, 20mm munition hangfires (delayed ignitions), a joint Army/NASA investigation was conducted to recommend quality evaluation improvements for acceptance of both primers and gun propellant. This effort focused only on evaluating ignition and combustion performance as potential causes of hangfires: poor electrical initiation of the primer, low output performance of the primer, low ignition sensitivity of the gun propellant, and the effects of cold temperature. The goal was to determine the "best" of the Army and NASA test methods to assess the functional performance of primers and gun propellants. The approach was to evaluate the performance of both high-quality and deliberately defective primers to challenge the sensitivity of test methods. In addition, the ignition sensitivity of different manufacturing batches of gun propellants was evaluated. The results of the investigation revealed that improvements can be made in functional evaluations that can assist in identifying and reducing ignition and performance variations. The "best" functional evaluation of primers and propellant is achieved through a combination of both Army and NASA test methods. Incorporating the recommendations offered in this report may provide for considerable savings in reducing the number of cartridge firings, while significantly lowering the rejection rate of primer, propellant and cartridge lots. The most probable causes for ignition and combustion-related hangfires were the lack of calcium silicide in the primer mix, a low output performance of primers, and finally, poor ignition sensitivity of gun propellant. Cold temperatures further reduce propellant ignition sensitivity, as well as reducing burn rate and chamber pressures.

Predictors of duodenal bulb biopsy performance in the evaluation of coeliac disease in children.

PubMed

Tanpowpong, Pornthep; Broder-Fingert, Sarabeth; Katz, Aubrey J; Camargo, Carlos A

2012-09-01

Studies on the role of duodenal bulb biopsy (DBB) in coeliac disease (CD) evaluation have increased in recent years; growing evidence suggests that the disease can present solely in the duodenal bulb. Moreover, recent CD guidelines recommend obtaining a DBB. The study aim was to examine DBB performance in children undergoing CD evaluation and to identify independent predictors of DBB performance. The authors performed a structured chart review of children aged <18 years who underwent CD evaluation between 2000 and 2010 at a large teaching hospital. The authors collected data including demographics, serology, endoscopy and histopathological findings. Predictors of DBB performance (obtained vs not obtained) were determined using multivariable logistic regression. Among 616 children who underwent endoscopy, DBB was performed in 103 children (17%, 95% CI 14% to 20%) with an increasing trend in the more recent years (2008-2010, 25%; 2004-2007, 16%; and 2000-2003, 5%, p<0.001). Three independent predictors of DBB performance were older age at endoscopy (OR 1.05 per year of age), gross gastric antral abnormalities (OR 2.81) and gross duodenal abnormalities (OR 5.55). Regarding the DBB histological findings, patchiness of CD was found in 15%. Positive Marsh III biopsy presented solely on the DBB in 6/103 (6%, 95% CI 2% to 12%) children. The authors found a significant increase in DBB performance over time, but the overall performance remains suboptimal. Improving education on obtaining a DBB for CD evaluation is crucial, especially among those children in whom DBB is more likely to be omitted.

Associations of medical student personality and health/wellness characteristics with their medical school performance across the curriculum.

PubMed

Haight, Scott J; Chibnall, John T; Schindler, Debra L; Slavin, Stuart J

2012-04-01

To assess the relationships of cognitive and noncognitive performance predictors to medical student preclinical and clinical performance indicators across medical school years 1 to 3 and to evaluate the association of psychological health/wellness factors with performance. In 2010, the authors conducted a cross-sectional, correlational, retrospective study of all 175 students at the Saint Louis University School of Medicine who had just completed their third (first clinical) year. Students were asked to complete assessments of personality, stress, anxiety, depression, social support, and community cohesion. Performance measures included total Medical College Admission Test (MCAT) score, preclinical academic grades, National Board of Medical Examiners subject exam scores, United States Medical Licensing Examination Step 1 score, clinical evaluations, and Humanism in Medicine Honor Society nominations. A total of 152 students (87%) participated. MCAT scores predicted cognitive performance indicators (academic tests), whereas personality variables (conscientiousness, extraversion, empathy) predicted noncognitive indicators (clinical evaluations, humanism nominations). Conscientiousness predicted all clinical skills, extraversion predicted clinical skills reflecting interpersonal behavior, and empathy predicted motivation. Health/wellness variables had limited associations with performance. In multivariate analyses that included control for shelf exam scores, conscientiousness predicted clinical evaluations, and extraversion and empathy predicted humanism nominations. This study identified two sets of skills (cognitive, noncognitive) used during medical school, with minimal overlap across the types of performance (e.g., exam performance versus clinical interpersonal skills) they predict. Medical school admission and evaluation efforts may need to be modified to reflect the importance of personality and other noncognitive factors.

Apollo 15 mission report, supplement 4: Descent propulsion system final flight evaluation

NASA Technical Reports Server (NTRS)

Avvenire, A. T.; Wood, S. C.

1972-01-01

The results of a postflight analysis of the LM-10 Descent Propulsion System (DPS) during the Apollo 15 Mission are reported. The analysis determined the steady state performance of the DPS during the descent phase of the manned lunar landing. Flight measurement discrepancies are discussed. Simulated throttle performance results are cited along with overall performance results. Evaluations of the propellant quantity gaging system, propellant loading, pressurization system, and engine are reported. Graphic illustrations of the evaluations are included.

Modular biowaste monitoring system

NASA Technical Reports Server (NTRS)

Fogal, G. L.

1975-01-01

The objective of the Modular Biowaste Monitoring System Program was to generate and evaluate hardware for supporting shuttle life science experimental and diagnostic programs. An initial conceptual design effort established requirements and defined an overall modular system for the collection, measurement, sampling and storage of urine and feces biowastes. This conceptual design effort was followed by the design, fabrication and performance evaluation of a flight prototype model urine collection, volume measurement and sampling capability. No operational or performance deficiencies were uncovered as a result of the performance evaluation tests.

Performance Evaluation of Steam Traps and Orifice Plates.

DTIC Science & Technology

1980-10-01

ADlAO9dl 229 JOHNS - MANVILLE SALES CORP DENVER CO RESEARCH AND DEV-’ETC F/S 13/1 PERFOR1ANCE EVALUATION OF STEAM TRAPS AND ORIFICE PLATES.(U)/ OCT 80...AGENCY t REPORT FESA-TS-2085 41! PERFORMANCE EVALUATION OF STEAM TRAPS AND ORIFICE PLATES P. B. SHEPHERD JOHNS - MANVILLE SALES CORPORATION w RESEARCH...PERFORMING ORGANIZATION NAME ANED ADDPESS!_ i lFioC’iA.TCr ’.ETPlJ A~ Johns - Manville Sales Corporation &00* 0 - Research & Development Center qOll Ken

Performance evaluation of candidate space suit elements for the next generation orbital EMU

NASA Technical Reports Server (NTRS)

West, Philip R.; Trausch, Stephanie V.

1992-01-01

The AX-5 all metallic, multibearing technologies developed at the Ames Research Center and the Mk III fabric and metallic technologies developed at the Johnson Space Center were evaluated using the current Space Shuttle space suit technologies as a baseline. Manned evaluations were performed in the Weightless Environment Training Facility and KC-135 zero-gravity aircraft. Joint torque, range, cycle life, and environmental protection characteristics were analyzed during unmanned tests. Both numerical results and test subject comments on performance are presented.

Avoidance temperament and social-evaluative threat in college students' math performance: a mediation model of math and test anxiety.

PubMed

Liew, Jeffrey; Lench, Heather C; Kao, Grace; Yeh, Yu-Chen; Kwok, Oi-man

2014-01-01

Standardized testing has become a common form of student evaluation with high stakes, and limited research exists on understanding the roles of students' personality traits and social-evaluative threat on their academic performance. This study examined the roles of avoidance temperament (i.e., fear and behavioral inhibition) and evaluative threat (i.e., fear of failure and being viewed as unintelligent) in standardized math test and course grades in college students. Undergraduate students (N=184) from a large public university were assessed on temperamental fear and behavioral inhibition. They were then given 15 minutes to complete a standardized math test. After the test, students provided data on evaluative threat and their math performance (scores on standardized college entrance exam and average grades in college math courses). Results indicate that avoidance temperament was linked to social-evaluative threat and low standardized math test scores. Furthermore, evaluative threat mediated the influence of avoidance temperament on both types of math performance. Results have educational and clinical implications, particularly for students at risk for test anxiety and underperformance. Interventions targeting emotion regulation and stress management skills may help individuals reduce their math and test anxieties.

Rising to the challenge: acute stress appraisals and selection centre performance in applicants to postgraduate specialty training in anaesthesia.

PubMed

Roberts, Martin J; Gale, Thomas C E; McGrath, John S; Wilson, Mark R

2016-05-01

The ability to work under pressure is a vital non-technical skill for doctors working in acute medical specialties. Individuals who evaluate potentially stressful situations as challenging rather than threatening may perform better under pressure and be more resilient to stress and burnout. Training programme recruitment processes provide an important opportunity to examine applicants' reactions to acute stress. In the context of multi-station selection centres for recruitment to anaesthesia training programmes, we investigated the factors influencing candidates' pre-station challenge/threat evaluations and the extent to which their evaluations predicted subsequent station performance. Candidates evaluated the perceived stress of upcoming stations using a measure of challenge/threat evaluation-the cognitive appraisal ratio (CAR)-and consented to release their demographic details and station scores. Using regression analyses we determined which candidate and station factors predicted variation in the CAR and whether, after accounting for these factors, the CAR predicted candidate performance in the station. The CAR was affected by the nature of the station and candidate gender, but not age, ethnicity, country of training or clinical experience. Candidates perceived stations involving work related tasks as more threatening. After controlling for candidates' demographic and professional profiles, the CAR significantly predicted station performance: 'challenge' evaluations were associated with better performance, though the effect was weak. Our selection centre model can help recruit prospective anaesthetists who are able to rise to the challenge of performing in stressful situations but results do not support the direct use of challenge/threat data for recruitment decisions.

Using the arthroscopic surgery skill evaluation tool as a pass-fail examination.

PubMed

Koehler, Ryan J; Nicandri, Gregg T

2013-12-04

Examination of arthroscopic skill requires evaluation tools that are valid and reliable with clear criteria for passing. The Arthroscopic Surgery Skill Evaluation Tool was developed as a video-based assessment of technical skill with criteria for passing established by a panel of experts. The purpose of this study was to test the validity and reliability of the Arthroscopic Surgery Skill Evaluation Tool as a pass-fail examination of arthroscopic skill. Twenty-eight residents and two sports medicine faculty members were recorded performing diagnostic knee arthroscopy on a left and right cadaveric specimen in our arthroscopic skills laboratory. Procedure videos were evaluated with use of the Arthroscopic Surgery Skill Evaluation Tool by two raters blind to subject identity. Subjects were considered to pass the Arthroscopic Surgery Skill Evaluation Tool when they attained scores of ≥ 3 on all eight assessment domains. The raters agreed on a pass-fail rating for fifty-five of sixty videos rated with an interclass correlation coefficient value of 0.83. Ten of thirty participants were assigned passing scores by both raters for both diagnostic arthroscopies performed in the laboratory. Receiver operating characteristic analysis demonstrated that logging more than eighty arthroscopic cases or performing more than thirty-five arthroscopic knee cases was predictive of attaining a passing Arthroscopic Surgery Skill Evaluation Tool score on both procedures performed in the laboratory. The Arthroscopic Surgery Skill Evaluation Tool is valid and reliable as a pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. This study demonstrates that the Arthroscopic Surgery Skill Evaluation Tool may be a useful tool for pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. Further study is necessary to determine whether the Arthroscopic Surgery Skill Evaluation Tool can be used for the assessment of multiple arthroscopic procedures and whether it can be used to evaluate arthroscopic procedures performed in the operating room.

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

PubMed Central

Jaafaripooyan, Ebrahim

2014-01-01

Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

Algorithms for detecting and predicting influenza outbreaks: metanarrative review of prospective evaluations

PubMed Central

Spreco, A; Timpka, T

2016-01-01

Objectives Reliable monitoring of influenza seasons and pandemic outbreaks is essential for response planning, but compilations of reports on detection and prediction algorithm performance in influenza control practice are largely missing. The aim of this study is to perform a metanarrative review of prospective evaluations of influenza outbreak detection and prediction algorithms restricted settings where authentic surveillance data have been used. Design The study was performed as a metanarrative review. An electronic literature search was performed, papers selected and qualitative and semiquantitative content analyses were conducted. For data extraction and interpretations, researcher triangulation was used for quality assurance. Results Eight prospective evaluations were found that used authentic surveillance data: three studies evaluating detection and five studies evaluating prediction. The methodological perspectives and experiences from the evaluations were found to have been reported in narrative formats representing biodefence informatics and health policy research, respectively. The biodefence informatics narrative having an emphasis on verification of technically and mathematically sound algorithms constituted a large part of the reporting. Four evaluations were reported as health policy research narratives, thus formulated in a manner that allows the results to qualify as policy evidence. Conclusions Awareness of the narrative format in which results are reported is essential when interpreting algorithm evaluations from an infectious disease control practice perspective. PMID:27154479

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

PubMed

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Performance characteristics of ambient temperature secondary lithium cells

NASA Technical Reports Server (NTRS)

Deligiannis, F.; Shen, D.; Subbarao, S.; Whitcanack, L.; Halpert, G.

1988-01-01

State of art ambient temperature secondary lithium cells were evaluated to determine their performance capability and limitations and to assess the present status of the technology of these cells. Li-MoS2, Li-NbSe3 and Li-TiS2 cells were evaluated for their charge/discharge characteristics, rate capability, and cycle life performance. The cells evaluated have a cycle life of 100-250 cycles at moderate discharge rates (C/5). The specific energy of these cells is between 50 and 100 Wh/Kg, depending upon the system. This paper describes the details of the cell designs, the test procedures, and the results of the evaluation studies.

Gum-compliant uncertainty propagations for Pu and U concentration measurements using the 1st-prototype XOS/LANL hiRX instrument; an SRNL H-Canyon Test Bed performance evaluation project

DOE Office of Scientific and Technical Information (OSTI.GOV)

Holland, Michael K.; O'Rourke, Patrick E.

An SRNL H-Canyon Test Bed performance evaluation project was completed jointly by SRNL and LANL on a prototype monochromatic energy dispersive x-ray fluorescence instrument, the hiRX. A series of uncertainty propagations were generated based upon plutonium and uranium measurements performed using the alpha-prototype hiRX instrument. Data reduction and uncertainty modeling provided in this report were performed by the SRNL authors. Observations and lessons learned from this evaluation were also used to predict the expected uncertainties that should be achievable at multiple plutonium and uranium concentration levels provided instrument hardware and software upgrades being recommended by LANL and SRNL are performed.

Using Personal Selling Techniques to Influence Student Evaluation of Faculty Instruction

ERIC Educational Resources Information Center

Adrian, C. Mitchell; Phelps, Lonnie D.; Totten, Jeffery W.

2017-01-01

Use of Student Evaluation of Instruction (SEI) in higher education was originally intended as a source of feedback to faculty, but it has developed into a significant part of faculty performance evaluations. Administrators supporting the use of SEI's as a performance indicator assume students recognize and reward "good teaching." It is…

Promotion Factors For Enlisted Infantry Marines

DTIC Science & Technology

2017-06-01

description , billet accomplishments, mission accomplishment, individual character, leadership, intellect and wisdom, fulfillment of evaluation , RS...staff sergeant. To assess which ranks proportionally promote more high-quality Marines, we compare two performance evaluation methods: proficiency and...adverse fitness reports. From the two performance evaluation methods we find that the Marine Corps promotes proportionally more high-quality Marines

A New Tool for Identifying Research Standards and Evaluating Research Performance

ERIC Educational Resources Information Center

Bacon, Donald R.; Paul, Pallab; Stewart, Kim A.; Mukhopadhyay, Kausiki

2012-01-01

Much has been written about the evaluation of faculty research productivity in promotion and tenure decisions, including many articles that seek to determine the rank of various marketing journals. Yet how faculty evaluators combine journal quality, quantity, and author contribution to form judgments of a scholar's performance is unclear. A…

Performance Evaluation of the Educational Leader (PEEL): Another Breakthrough in Competency Based Educational Administration.

ERIC Educational Resources Information Center

Metzger, Christa; Lynch, Steven B.

1974-01-01

This paper describes the Performance Evaluation of the Education Leader (PEEL) program, initiated from a study to define the competent school administrator and to develop an instrument to measure administrative competence objectively and accurately. The resulting PEEL materials include the following: (a) "Guidelines for Evaluation: The School…

Comparing IndexedHBase and Riak for Serving Truthy: Performance of Data Loading and Query Evaluation

DTIC Science & Technology

2013-08-01

Research Triangle Park, NC 27709-2211 15. SUBJECT TERMS performance evaluation, distributed database, noSQL , HBase, indexing Xiaoming Gao, Judy Qiu...common hashtags created during a given time window. With the purpose of finding a solution for these challenges, we evaluate NoSQL databases such as

Design and Implementation of Performance Metrics for Evaluation of Assessments Data

ERIC Educational Resources Information Center

Ahmed, Irfan; Bhatti, Arif

2016-01-01

Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though…

Towards a Better Understanding of the Legibility Bias in Performance Assessments: The Case of Gender-Based Inferences

ERIC Educational Resources Information Center

Greifeneder, Rainer; Zelt, Sarah; Seele, Tim; Bottenberg, Konstantin; Alt, Alexander

2012-01-01

Background: Handwriting legibility systematically biases evaluations in that highly legible handwriting results in more positive evaluations than less legible handwriting. Because performance assessments in educational contexts are not only based on computerized or multiple choice tests but often include the evaluation of handwritten work samples,…

The Role of Accompaniment Quality in the Evaluation of Solo Instrumental Performance

ERIC Educational Resources Information Center

Springer, D. Gregory; Silvey, Brian A.

2018-01-01

The purpose of this study was to examine the effect of accompaniment quality on the evaluation of solo instrumental performance. Undergraduate instrumental music education majors (N = 71) listened to and evaluated the accuracy and expressivity of six excerpts of Haydn's "Concerto for Trumpet in E-Flat Major," which we created by…

Stationary plasma thruster evaluation in Russia

NASA Technical Reports Server (NTRS)

Brophy, John R.

1992-01-01

A team of electric propulsion specialists from U.S. government laboratories experimentally evaluated the performance of a 1.35-kW Stationary Plasma Thruster (SPT) at the Scientific Research Institute of Thermal Processes in Moscow and at 'Fakel' Enterprise in Kaliningrad, Russia. The evaluation was performed using a combination of U.S. and Russian instrumentation and indicated that the actual performance of the thruster appears to be close to the claimed performance. The claimed performance was a specific impulse of 16,000 m/s, an overall efficiency of 50 percent, and an input power of 1.35 kW, and is superior to the performance of western electric thrusters at this specific impulse. The unique performance capabilities of the stationary plasma thruster, along with claims that more than fifty of the 660-W thrusters have been flown in space on Russian spacecraft, attracted the interest of western spacecraft propulsion specialists. A two-phase program was initiated to evaluate the stationary plasma thruster performance and technology. The first phase of this program, to experimentally evaluate the performance of the thruster with U.S. instrumentation in Russia, is described in this report. The second phase objective is to determine the suitability of the stationary plasma thruster technology for use on western spacecraft. This will be accomplished by bringing stationary plasma thrusters to the U.S. for quantification of thruster erosion rates, measurements of the performance variation as a function of long-duration operation, quantification of the exhaust beam divergence angle, and determination of the non-propellant efflux from the thruster. These issues require quantification in order to maximize the probability for user application of the SPT technology and significantly increase the propulsion capabilities of U.S. spacecraft.

A new method to evaluate human-robot system performance

NASA Technical Reports Server (NTRS)

Rodriguez, G.; Weisbin, C. R.

2003-01-01

One of the key issues in space exploration is that of deciding what space tasks are best done with humans, with robots, or a suitable combination of each. In general, human and robot skills are complementary. Humans provide as yet unmatched capabilities to perceive, think, and act when faced with anomalies and unforeseen events, but there can be huge potential risks to human safety in getting these benefits. Robots provide complementary skills in being able to work in extremely risky environments, but their ability to perceive, think, and act by themselves is currently not error-free, although these capabilities are continually improving with the emergence of new technologies. Substantial past experience validates these generally qualitative notions. However, there is a need for more rigorously systematic evaluation of human and robot roles, in order to optimize the design and performance of human-robot system architectures using well-defined performance evaluation metrics. This article summarizes a new analytical method to conduct such quantitative evaluations. While the article focuses on evaluating human-robot systems, the method is generally applicable to a much broader class of systems whose performance needs to be evaluated.

Evaluation of adding item-response theory analysis for evaluation of the European Board of Ophthalmology Diploma examination.

PubMed

Mathysen, Danny G P; Aclimandos, Wagih; Roelant, Ella; Wouters, Kristien; Creuzot-Garcher, Catherine; Ringens, Peter J; Hawlina, Marko; Tassignon, Marie-José

2013-11-01

To investigate whether introduction of item-response theory (IRT) analysis, in parallel to the 'traditional' statistical analysis methods available for performance evaluation of multiple T/F items as used in the European Board of Ophthalmology Diploma (EBOD) examination, has proved beneficial, and secondly, to study whether the overall assessment performance of the current written part of EBOD is sufficiently high (KR-20≥ 0.90) to be kept as examination format in future EBOD editions. 'Traditional' analysis methods for individual MCQ item performance comprise P-statistics, Rit-statistics and item discrimination, while overall reliability is evaluated through KR-20 for multiple T/F items. The additional set of statistical analysis methods for the evaluation of EBOD comprises mainly IRT analysis. These analysis techniques are used to monitor whether the introduction of negative marking for incorrect answers (since EBOD 2010) has a positive influence on the statistical performance of EBOD as a whole and its individual test items in particular. Item-response theory analysis demonstrated that item performance parameters should not be evaluated individually, but should be related to one another. Before the introduction of negative marking, the overall EBOD reliability (KR-20) was good though with room for improvement (EBOD 2008: 0.81; EBOD 2009: 0.78). After the introduction of negative marking, the overall reliability of EBOD improved significantly (EBOD 2010: 0.92; EBOD 2011:0.91; EBOD 2012: 0.91). Although many statistical performance parameters are available to evaluate individual items, our study demonstrates that the overall reliability assessment remains the only crucial parameter to be evaluated allowing comparison. While individual item performance analysis is worthwhile to undertake as secondary analysis, drawing final conclusions seems to be more difficult. Performance parameters need to be related, as shown by IRT analysis. Therefore, IRT analysis has proved beneficial for the statistical analysis of EBOD. Introduction of negative marking has led to a significant increase in the reliability (KR-20 > 0.90), indicating that the current examination format can be kept for future EBOD examinations. © 2013 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Results of advanced battery technology evaluations for electric vehicle applications

NASA Astrophysics Data System (ADS)

Deluca, W. H.; Gillie, K. R.; Kulaga, J. E.; Smaga, J. A.; Tummillo, A. F.; Webster, C. E.

1992-10-01

Advanced battery technology evaluations are performed under simulated electric-vehicle operating conditions at the Analysis and Diagnostic Laboratory (ADL) of Argonne National Laboratory. The ADL results provide insight into those factors that limit battery performance and life. The ADL facilities include a test laboratory to conduct battery experimental evaluations under simulated application conditions and a post-test analysis laboratory to determine, in a protected atmosphere if needed, component compositional changes and failure mechanisms. This paper summarizes the performance characterizations and life evaluations conducted during 1991-1992 on both single cells and multi-cell modules that encompass eight battery technologies (Na/S, Li/MS (M=metal), Ni/MH, Ni/Cd, Ni/Zn, Ni/Fe, Zn/Br, and Pb-acid). These evaluations were performed for the Department of Energy, Office of Transportation Technologies, Electric and Hybrid Propulsion Division, and the Electric Power Research Institute. The ADL provides a common basis for battery performance characterization and life evaluations with unbiased application of tests and analyses. The results help identify the most-promising R&D approaches for overcoming battery limitations, and provide battery users, developers, and program managers with a measure of the progress being made in battery R&D programs, a comparison of battery technologies, and basic data for modeling.

Evaluating markers for the early detection of cancer: overview of study designs and methods.

PubMed

Baker, Stuart G; Kramer, Barnett S; McIntosh, Martin; Patterson, Blossom H; Shyr, Yu; Skates, Steven

2006-01-01

The field of cancer biomarker development has been evolving rapidly. New developments both in the biologic and statistical realms are providing increasing opportunities for evaluation of markers for both early detection and diagnosis of cancer. To review the major conceptual and methodological issues in cancer biomarker evaluation, with an emphasis on recent developments in statistical methods together with practical recommendations. We organized this review by type of study: preliminary performance, retrospective performance, prospective performance and cancer screening evaluation. For each type of study, we discuss methodologic issues, provide examples and discuss strengths and limitations. Preliminary performance studies are useful for quickly winnowing down the number of candidate markers; however their results may not apply to the ultimate target population, asymptomatic subjects. If stored specimens from cohort studies with clinical cancer endpoints are available, retrospective studies provide a quick and valid way to evaluate performance of the markers or changes in the markers prior to the onset of clinical symptoms. Prospective studies have a restricted role because they require large sample sizes, and, if the endpoint is cancer on biopsy, there may be bias due to overdiagnosis. Cancer screening studies require very large sample sizes and long follow-up, but are necessary for evaluating the marker as a trigger of early intervention.

Sustainability performance evaluation: Literature review and future directions.

PubMed

Büyüközkan, Gülçin; Karabulut, Yağmur

2018-07-01

Current global economic activities are increasingly being perceived as unsustainable. Despite the high number of publications, sustainability science remains highly dispersed over diverse approaches and topics. This article aims to provide a structured overview of sustainability performance evaluation related publications and to document the current state of literature, categorize publications, analyze and link trends, as well as highlight gaps and provide research recommendations. 128 articles between 2007 and 2018 are identified. The results suggest that sustainability performance evaluation models shall be more balanced, suitable criteria and their interrelations shall be well defined and subjectivity of qualitative criteria inherent to sustainability indicators shall be considered. To address this subjectivity, group decision-making techniques and other analytical methods that can deal with uncertainty, conflicting indicators, and linguistic evaluations can be used in future works. By presenting research gaps, this review stimulates researchers to establish practically applicable sustainability performance evaluation frameworks to help assess and compare the degree of sustainability, leading to more sustainable business practices. The review is unique in defining corporate sustainability performance evaluation for the first time, exploring the gap between sustainability accounting and sustainability assessment, and coming up with a structured overview of innovative research recommendations about integrating analytical assessment methods into conceptual sustainability frameworks. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Relationship Between Core Members' Social Capital and Perceived and Externally Evaluated Prestige and Cooperation Among HIV/AIDS-Related Civil Society Organizations in China.

PubMed

Wang, Danni; Xu, Xiaoru; Mei, Guangliang; Ma, Ying; Chen, Ren; Qin, Xia; Hu, Zhi

2017-03-01

The purpose of this study was to investigate whether the core members' social capital was associated with individually perceived and externally evaluated prestige and cooperation among the HIV/AIDS-related civil society organizations (CSOs). To accomplish this, a cross-sectional study using multistage sampling was carried out in eight provinces of China. Data were collected from the 327 core members via questionnaires and self-evaluated performance of the respondents were evaluated and measured. The interviews were conducted with all core members and the supervisory staff of the local Centers for Disease Control and Prevention. Multivariate logistic regression analysis indicated that social support (adjusted odds ratio [a OR] = 1.87) and organizational commitment (a OR = 1.57) were significantly associated with a higher odds of prestige performance in self-evaluation. Furthermore, social support (a OR = 1.65), trust (a OR = 1.33), and organizational commitment (a OR = 1.52) were significantly correlated with cooperation performance. Trust was positively associated with the cooperation performance on external evaluation. These findings may provide a new perspective on challenges that the CSOs face in response to a growing HIV/AIDS epidemic in China. Social capital may increase performance and accelerate organizational growth, ultimately improving HIV/AIDS prevention and care.

Use of an objective structured clinical exam (OSCE) for early identification of communication skills deficits in interns.

PubMed

Goldhamer, Mary Ellen J; Cohen, Amy; Brooks, Michelle; Macklin, Eric A; Co, John Patrick T; Weinstein, Debra

2018-01-01

There is limited information about whether OSCE during GME orientation can identify trainee communication deficits before these become evident via clinical performance evaluations. Ninety-seven interns matriculating to eight residency programs in six specialties at four hospitals participated in a nine-station communication skills OSCE. Ratings were based on the "Kalamazoo, adapted" communication skills checklist. Possible association with intern performance evaluations was assessed by repeated-measures logistic regression and ROC curves were generated. The mean OSCE score was 4.08 ± 0.27 with a range of 3.3-4.6. Baseline OSCE scores were associated with subsequent communication concerns recorded by faculty, based on 1591 evaluations. A 0.1-unit decrease in the OSCE communication score was associated with an 18% higher odds of being identified with a communication concern by faculty evaluation (odds ratio 1.18, 95% CI 1.01-1.36, p = 0.034). ROC curves did not demonstrate a "cut-off" score (AUC= 0.558). Non-faculty evaluators were 3-5 times more likely than faculty evaluators to identify communication deficits, based on 1900 evaluations. Lower OSCE performance was associated with faculty communication concerns on performance evaluations; however, a "cut-off" score was not demonstrated that could identify trainees for potential early intervention. Multi-source evaluation also identified trainees with communication skills deficits.

Functional assessment and performance evaluation for assistive robotic manipulators: Literature review.

PubMed

Chung, Cheng-Shiu; Wang, Hongwu; Cooper, Rory A

2013-07-01

The user interface development of assistive robotic manipulators can be traced back to the 1960s. Studies include kinematic designs, cost-efficiency, user experience involvements, and performance evaluation. This paper is to review studies conducted with clinical trials using activities of daily living (ADLs) tasks to evaluate performance categorized using the International Classification of Functioning, Disability, and Health (ICF) frameworks, in order to give the scope of current research and provide suggestions for future studies. We conducted a literature search of assistive robotic manipulators from 1970 to 2012 in PubMed, Google Scholar, and University of Pittsburgh Library System - PITTCat. Twenty relevant studies were identified. Studies were separated into two broad categories: user task preferences and user-interface performance measurements of commercialized and developing assistive robotic manipulators. The outcome measures and ICF codes associated with the performance evaluations are reported. Suggestions for the future studies include (1) standardized ADL tasks for the quantitative and qualitative evaluation of task efficiency and performance to build comparable measures between research groups, (2) studies relevant to the tasks from user priority lists and ICF codes, and (3) appropriate clinical functional assessment tests with consideration of constraints in assistive robotic manipulator user interfaces. In addition, these outcome measures will help physicians and therapists build standardized tools while prescribing and assessing assistive robotic manipulators.

The Context Matters: Outcome Probability and Expectation Mismatch Modulate the Feedback Negativity When Self-Evaluation of Response Correctness Is Possible

PubMed Central

Leue, Anja; Cano Rodilla, Carmen; Beauducel, André

2015-01-01

Individuals typically evaluate whether their performance and the obtained feedback match. Previous research has shown that feedback negativity (FN) depends on outcome probability and feedback valence. It is, however, less clear to what extent previous effects of outcome probability on FN depend on self-evaluations of response correctness. Therefore, we investigated the effects of outcome probability on FN amplitude in a simple go/no-go task that allowed for the self-evaluation of response correctness. We also investigated effects of performance incompatibility and feedback valence. In a sample of N = 22 participants, outcome probability was manipulated by means of precues, feedback valence by means of monetary feedback, and performance incompatibility by means of feedback that induced a match versus mismatch with individuals' performance. We found that the 100% outcome probability condition induced a more negative FN following no-loss than the 50% outcome probability condition. The FN following loss was more negative in the 50% compared to the 100% outcome probability condition. Performance-incompatible loss resulted in a more negative FN than performance-compatible loss. Our results indicate that the self-evaluation of the correctness of responses should be taken into account when the effects of outcome probability and expectation mismatch on FN are investigated. PMID:26783525

The Context Matters: Outcome Probability and Expectation Mismatch Modulate the Feedback Negativity When Self-Evaluation of Response Correctness Is Possible.

PubMed

Leue, Anja; Cano Rodilla, Carmen; Beauducel, André

2015-01-01

Individuals typically evaluate whether their performance and the obtained feedback match. Previous research has shown that feedback negativity (FN) depends on outcome probability and feedback valence. It is, however, less clear to what extent previous effects of outcome probability on FN depend on self-evaluations of response correctness. Therefore, we investigated the effects of outcome probability on FN amplitude in a simple go/no-go task that allowed for the self-evaluation of response correctness. We also investigated effects of performance incompatibility and feedback valence. In a sample of N = 22 participants, outcome probability was manipulated by means of precues, feedback valence by means of monetary feedback, and performance incompatibility by means of feedback that induced a match versus mismatch with individuals' performance. We found that the 100% outcome probability condition induced a more negative FN following no-loss than the 50% outcome probability condition. The FN following loss was more negative in the 50% compared to the 100% outcome probability condition. Performance-incompatible loss resulted in a more negative FN than performance-compatible loss. Our results indicate that the self-evaluation of the correctness of responses should be taken into account when the effects of outcome probability and expectation mismatch on FN are investigated.

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation

PubMed Central

Chen, Quan; Tsai, Sang-Bing; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-01

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees’ low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees’ job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice. PMID:29301375

Influenza detection and prediction algorithms: comparative accuracy trial in Östergötland county, Sweden, 2008-2012.

PubMed

Spreco, A; Eriksson, O; Dahlström, Ö; Timpka, T

2017-07-01

Methods for the detection of influenza epidemics and prediction of their progress have seldom been comparatively evaluated using prospective designs. This study aimed to perform a prospective comparative trial of algorithms for the detection and prediction of increased local influenza activity. Data on clinical influenza diagnoses recorded by physicians and syndromic data from a telenursing service were used. Five detection and three prediction algorithms previously evaluated in public health settings were calibrated and then evaluated over 3 years. When applied on diagnostic data, only detection using the Serfling regression method and prediction using the non-adaptive log-linear regression method showed acceptable performances during winter influenza seasons. For the syndromic data, none of the detection algorithms displayed a satisfactory performance, while non-adaptive log-linear regression was the best performing prediction method. We conclude that evidence was found for that available algorithms for influenza detection and prediction display satisfactory performance when applied on local diagnostic data during winter influenza seasons. When applied on local syndromic data, the evaluated algorithms did not display consistent performance. Further evaluations and research on combination of methods of these types in public health information infrastructures for 'nowcasting' (integrated detection and prediction) of influenza activity are warranted.

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation.

PubMed

Chen, Quan; Tsai, Sang-Bing; Zhai, Yuming; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-03

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees' low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees' job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice.

10 CFR 1045.9 - RD classification performance evaluation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... Program Management of the Restricted Data and Formerly Restricted Data Classification System § 1045.9 RD classification performance evaluation. (a) Heads of agencies shall ensure that RD management officials and those...

75 FR 34110 - Agency Information Collection Activities; Proposed Collection; Comment Request; Performance...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-06-16

...; Performance Evaluation Studies on Wastewater Laboratories (Renewal) AGENCY: Environmental Protection Agency... Evaluation Studies on Wastewater Laboratories (Renewal) ICR numbers: EPA ICR No. 0234.10, OMB Control No...

75 FR 64724 - Agency Information Collection Activities; Submission to OMB for Review and Approval; Comment...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-10-20

...; Comment Request; Performance Evaluation Studies on Wastewater Laboratories (Renewal) AGENCY: Environmental... docket, go to http://www.regulations.gov . Title: Performance Evaluation Studies on Wastewater...

A numerical algorithm with preference statements to evaluate the performance of scientists.

PubMed

Ricker, Martin

Academic evaluation committees have been increasingly receptive for using the number of published indexed articles, as well as citations, to evaluate the performance of scientists. It is, however, impossible to develop a stand-alone, objective numerical algorithm for the evaluation of academic activities, because any evaluation necessarily includes subjective preference statements. In a market, the market prices represent preference statements, but scientists work largely in a non-market context. I propose a numerical algorithm that serves to determine the distribution of reward money in Mexico's evaluation system, which uses relative prices of scientific goods and services as input. The relative prices would be determined by an evaluation committee. In this way, large evaluation systems (like Mexico's Sistema Nacional de Investigadores ) could work semi-automatically, but not arbitrarily or superficially, to determine quantitatively the academic performance of scientists every few years. Data of 73 scientists from the Biology Institute of Mexico's National University are analyzed, and it is shown that the reward assignation and academic priorities depend heavily on those preferences. A maximum number of products or activities to be evaluated is recommended, to encourage quality over quantity.

"Keep on Truckin'" Literacy Program [for Adults]: Performance Report; Teacher's Handbook; Final External Evaluation Report.

ERIC Educational Resources Information Center

Indian Hills Community Coll., Ottumwa, IA.

This document is composed of a performance report, a teacher's handbook, and an evaluation report of a workplace literacy program to prepare drivers for the Commercial Drivers' License examination. The performance report addresses actual accomplishments of five objectives. It identifies the number and characteristics of project participants who…

Subjective Performance Evaluation in the Public Sector: Evidence from School Inspections. CEE DP 135

ERIC Educational Resources Information Center

Hussain, Iftikhar

2012-01-01

Performance measurement in the public sector is largely based on objective metrics, which may be subject to gaming behaviour. This paper investigates a novel subjective performance evaluation system where independent inspectors visit schools at very short notice, publicly disclose their findings and sanction schools rated fail. First, I…

Performance Evaluation of Reliable Multicast Protocol for Checkout and Launch Control Systems

NASA Technical Reports Server (NTRS)

Shu, Wei Wennie; Porter, John

2000-01-01

The overall objective of this project is to study reliability and performance of Real Time Critical Network (RTCN) for checkout and launch control systems (CLCS). The major tasks include reliability and performance evaluation of Reliable Multicast (RM) package and fault tolerance analysis and design of dual redundant network architecture.

48 CFR 1852.216-77 - Award fee for end item contracts.

Code of Federal Regulations, 2010 CFR

2010-10-01

... Contractor's performance for the entire contract will be evaluated to determine total earned award fee. No award fee or base fee will be paid to the Contractor if the final award fee evaluation is “poor... the Contractor's interim performance every 6* months to monitor Contractor performance prior to...

40 CFR 63.1210 - What are the notification requirements?

Code of Federal Regulations, 2013 CFR

2013-07-01

... change in information already provided under § 63.9. 63.1206(b)(5)(i) Notification of changes in design...), 63.9(e) 63.9(g)(1) and (3) Notification of performance test and continuous monitoring system evaluation, including the performance test plan and CMS performance evaluation plan.1 63.1210(b) Notification...

40 CFR 63.1210 - What are the notification requirements?

Code of Federal Regulations, 2014 CFR

2014-07-01

... change in information already provided under § 63.9. 63.1206(b)(5)(i) Notification of changes in design...), 63.9(e) 63.9(g)(1) and (3) Notification of performance test and continuous monitoring system evaluation, including the performance test plan and CMS performance evaluation plan.1 63.1210(b) Notification...

Analytically Quantifying Gains in the Test and Evaluation Process through Capabilities-Based Analysis

DTIC Science & Technology

2011-09-01

Evaluation Process through Capabilities-Based Analysis 5. FUNDING NUMBERS 6. AUTHOR(S) Eric J. Lednicky 7. PERFORMING ORGANIZATION NAME(S) AND...ADDRESS(ES) Naval Postgraduate School Monterey, CA 93943-5000 8. PERFORMING ORGANIZATION REPORT NUMBER 9. SPONSORING /MONITORING AGENCY NAME(S...14 C. MEASURES OF EFFECTIVENESS / MEASURES OF PERFORMANCE

Promoting Accountability and Continual Improvement: A Review of the Respective Roles of Performance Measurement, Auditing, Evaluation, and Reporting.

ERIC Educational Resources Information Center

Reid, William

1999-01-01

Provides a synthesis of the literature pertaining to the principles and practices of performance measurement, auditing, evaluation, and reporting. Discusses how bringing these elements together in a performance management system can be achieved through refinement of strategic direction, reporting on key measures, and periodic, systematic…

6- And 8-Year-Olds' Performance Evaluations: Do They Differ between Self And Unknown Others?

ERIC Educational Resources Information Center

Destan, Nesrin; Spiess, Manuela A.; de Bruin, Anique; van Loon, Mariëtte; Roebers, Claudia M.

2017-01-01

The current study investigated kindergarteners and second graders' ability to monitor and evaluate their own and a virtual peer's performance in a paired-associate learning task. Participants provided confidence judgments (CJs) for their own responses and performance-based judgments (judgments provided "after" receiving feedback on their…

Performance Evaluation of Indian Technical Institutions Using PROMETHEE-GAIA Approach

ERIC Educational Resources Information Center

Ranjan, Rajeev; Chakraborty, Shankar

2015-01-01

It has now become an important issue to evaluate the performance of technical institutions to develop better research and enrich the existing teaching processes. The results of such performance appraisal would serve as a reference point for decisions to choose a particular institution, hire manpower, and provide financial support for the…

Development and Validation of a Clarinet Performance Adjudication Scale

ERIC Educational Resources Information Center

Abeles, Harold F.

1973-01-01

A basic assumption of this study is that there are generally agreed upon performance standards as evidenced by the use of adjudicators for evaluations at contests and festivals. An evaluation instrument was developed to enable raters to measure effectively those aspects of performance that have common standards of proficiency. (Author/RK)

Mining Formative Evaluation Rules Using Web-Based Learning Portfolios for Web-Based Learning Systems

ERIC Educational Resources Information Center

Chen, Chih-Ming; Hong, Chin-Ming; Chen, Shyuan-Yi; Liu, Chao-Yu

2006-01-01

Learning performance assessment aims to evaluate what knowledge learners have acquired from teaching activities. Objective technical measures of learning performance are difficult to develop, but are extremely important for both teachers and learners. Learning performance assessment using learning portfolios or web server log data is becoming an…

Credentials versus Performance: Review of the Teacher Performance Pay Research

ERIC Educational Resources Information Center

Podgursky, Michael; Springer, Matthew G.

2007-01-01

In this article we examine the economic case for merit or performance-based pay for K-12 teachers. We review several areas of germane research. The direct evaluation literature on these incentive plans is slender; highly diverse in terms of methodology, targeted populations, and programs evaluated; and primarily focused on short-run motivational…

Unrealistic Optimism in the Pursuit of Academic Success

ERIC Educational Resources Information Center

Lewine, Rich; Sommers, Alison A.

2016-01-01

Although the ability to evaluate one's own knowledge and performance is critical to learning, the correlation between students' self-evaluation and actual performance measures is modest at best. In this study we examine the effect of offering extra credit for students' accurate prediction (self-accuracy) of their performance on four exams in two…

40 CFR 63.9642 - What records must I keep?

Code of Federal Regulations, 2010 CFR

2010-07-01

...) Records of performance tests and performance evaluations as required in § 63.10(b)(2)(viii). (b) For each... described in § 63.10(b)(2)(vi) through (xi). (2) Monitoring data for COMS during a performance evaluation as... Section 63.9642 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) AIR PROGRAMS...

Final Pilot Performance Rating Scales.

ERIC Educational Resources Information Center

Horner, Walter R.; And Others

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

Use of the Marshall Space Flight Center solar simulator in collector performance evaluation

NASA Technical Reports Server (NTRS)

Humphries, W. R.

1978-01-01

Actual measured values from simulator checkout tests are detailed. Problems encountered during initial startup are discussed and solutions described. Techniques utilized to evaluate collector performance from simulator test data are given. Performance data generated in the simulator are compared to equivalent data generated during natural outdoor testing. Finally, a summary of collector performance parameters generated to date as a result of simulator testing are given.

Modeling and Performance Evaluation of Backoff Misbehaving Nodes in CSMA/CA Networks

DTIC Science & Technology

2012-08-01

Modeling and Performance Evaluation of Backoff Misbehaving Nodes in CSMA/CA Networks Zhuo Lu, Student Member, IEEE, Wenye Wang, Senior Member, IEEE... misbehaving nodes can obtain, we define and study two general classes of backoff misbehavior: continuous misbehavior, which keeps manipulating the backoff...misbehavior sporadically. Our approach is to introduce a new performance metric, namely order gain, to characterize the performance benefits of misbehaving

Factors affecting construction performance: exploratory factor analysis

NASA Astrophysics Data System (ADS)

Soewin, E.; Chinda, T.

2018-04-01

The present work attempts to develop a multidimensional performance evaluation framework for a construction company by considering all relevant measures of performance. Based on the previous studies, this study hypothesizes nine key factors, with a total of 57 associated items. The hypothesized factors, with their associated items, are then used to develop questionnaire survey to gather data. The exploratory factor analysis (EFA) was applied to the collected data which gave rise 10 factors with 57 items affecting construction performance. The findings further reveal that the items constituting ten key performance factors (KPIs) namely; 1) Time, 2) Cost, 3) Quality, 4) Safety & Health, 5) Internal Stakeholder, 6) External Stakeholder, 7) Client Satisfaction, 8) Financial Performance, 9) Environment, and 10) Information, Technology & Innovation. The analysis helps to develop multi-dimensional performance evaluation framework for an effective measurement of the construction performance. The 10 key performance factors can be broadly categorized into economic aspect, social aspect, environmental aspect, and technology aspects. It is important to understand a multi-dimension performance evaluation framework by including all key factors affecting the construction performance of a company, so that the management level can effectively plan to implement an effective performance development plan to match with the mission and vision of the company.

An Evaluation Method for PV Systems by using Limited Data Item

NASA Astrophysics Data System (ADS)

Oozeki, Takashi; Izawa, Toshiyasu; Otani, Kenji; Tsuzuku, Ken; Koike, Hisafumi; Kurokawa, Kosuke

Beside photovoltaic (PV) systems are recently expected to introduce around Japan, almost all of them have not been taken care after established since PV systems are called maintenance free. In fact, there are few troubles about PV operations behind owners of PV systems because characteristics of them cannot be identified completely such as the ideal output energy. Therefore, it is very important to evaluate the characteristics of them. For evaluating them, equipments of measuring are required, and they, especially Pyrheliometer, are expensive as much as owners of the PV system cannot equip usually. Consequently, An evaluation method which can reveal the performance of operation such as the performance ratio with a very few kinds of data is necessary. In this paper, proposed method can evaluate performance ratio, shading losses, inverter efficiency losses by using only system output data items. The adequacies of the method are indicated by comparing with actual data and field survey results. As a result, the method is intended to be checking tool of PV system performance.

Error Reduction Program. [combustor performance evaluation codes

NASA Technical Reports Server (NTRS)

Syed, S. A.; Chiappetta, L. M.; Gosman, A. D.

1985-01-01

The details of a study to select, incorporate and evaluate the best available finite difference scheme to reduce numerical error in combustor performance evaluation codes are described. The combustor performance computer programs chosen were the two dimensional and three dimensional versions of Pratt & Whitney's TEACH code. The criteria used to select schemes required that the difference equations mirror the properties of the governing differential equation, be more accurate than the current hybrid difference scheme, be stable and economical, be compatible with TEACH codes, use only modest amounts of additional storage, and be relatively simple. The methods of assessment used in the selection process consisted of examination of the difference equation, evaluation of the properties of the coefficient matrix, Taylor series analysis, and performance on model problems. Five schemes from the literature and three schemes developed during the course of the study were evaluated. This effort resulted in the incorporation of a scheme in 3D-TEACH which is usuallly more accurate than the hybrid differencing method and never less accurate.

Evaluation of Calibration Laboratories Performance

NASA Astrophysics Data System (ADS)

Filipe, Eduarda

2011-12-01

One of the main goals of interlaboratory comparisons (ILCs) is the evaluation of the laboratories performance for the routine calibrations they perform for the clients. In the frame of Accreditation of Laboratories, the national accreditation boards (NABs) in collaboration with the national metrology institutes (NMIs) organize the ILCs needed to comply with the requirements of the international accreditation organizations. In order that an ILC is a reliable tool for a laboratory to validate its best measurement capability (BMC), it is needed that the NMI (reference laboratory) provides a better traveling standard—in terms of accuracy class or uncertainty—than the laboratories BMCs. Although this is the general situation, there are cases where the NABs ask the NMIs to evaluate the performance of the accredited laboratories when calibrating industrial measuring instruments. The aim of this article is to discuss the existing approaches for the evaluation of ILCs and propose a basis for the validation of the laboratories measurement capabilities. An example is drafted with the evaluation of the results of mercury-in-glass thermometers ILC with 12 participant laboratories.

Nursing students' self-evaluation using a video recording of foley catheterization: effects on students' competence, communication skills, and learning motivation.

PubMed

Yoo, Moon Sook; Yoo, Il Young; Lee, Hyejung

2010-07-01

An opportunity for a student to evaluate his or her own performance enhances self-awareness and promotes self-directed learning. Using three outcome measures of competency of procedure, communication skills, and learning motivation, the effects of self-evaluation using a video recording of the student's Foley catheterization was investigated in this study. The students in the experimental group (n = 20) evaluated their Foley catheterization performance by reviewing the video recordings of their own performance, whereas students in the control group (n = 20) received written evaluation guidelines only. The results showed that the students in the experimental group had better scores on competency (p < 0.001), communication skills (p < 0.001), and learning motivation (p = 0.018) than the control group at the post-test, which was conducted 8 weeks after the pretest. Self-awareness of one's own performance developed by reviewing a videotape appears to increase the competency of clinical skills in nursing students. Copyright 2010, SLACK Incorporated.

Performance evaluation of Louisiana superpave mixtures : tech summary.

DOT National Transportation Integrated Search

2008-12-01

The primary objective of this research was to evaluate the fundamental engineering : properties and mixture performance of Superpave hot mix asphalt (HMA) mixtures : in Louisiana through laboratory mechanistic tests, aggregate gradation analysis, and...

Model Performance Evaluation and Scenario Analysis (MPESA) Tutorial

EPA Pesticide Factsheets

The model performance evaluation consists of metrics and model diagnostics. These metrics provides modelers with statistical goodness-of-fit measures that capture magnitude only, sequence only, and combined magnitude and sequence errors.

Evaluation of pavement marking performance.

DOT National Transportation Integrated Search

2008-06-01

The objective of the investigation was to evaluate the useful life of pavement markings. The Manual on Uniform Traffic Control Devices (MUTCD) provides general guidelines for the application and installation of pavement markings. However, performance...

Experimental flexible pavements.

DOT National Transportation Integrated Search

1971-01-01

A program of construction and the performance evaluation of three major Virginia experimental flexible pavements is reported. The objective of the program was to evaluate the performance of pavements incorporating new or timely design concepts and to...

ATAMM enhancement and multiprocessor performance evaluation

NASA Technical Reports Server (NTRS)

Stoughton, John W.; Mielke, Roland R.; Som, Sukhamoy; Obando, Rodrigo; Malekpour, Mahyar R.; Jones, Robert L., III; Mandala, Brij Mohan V.

1991-01-01

ATAMM (Algorithm To Architecture Mapping Model) enhancement and multiprocessor performance evaluation is discussed. The following topics are included: the ATAMM model; ATAMM enhancement; ADM (Advanced Development Model) implementation of ATAMM; and ATAMM support tools.

NREL Evaluates Performance of Fast-Charge Electric Buses

DOE Office of Scientific and Technical Information (OSTI.GOV)

2016-09-16

This real-world performance evaluation is designed to enhance understanding of the overall usage and effectiveness of electric buses in transit operation and to provide unbiased technical information to other agencies interested in adding such vehicles to their fleets. Initial results indicate that the electric buses under study offer significant fuel and emissions savings. The final results will help Foothill Transit optimize the energy-saving potential of its transit fleet. NREL's performance evaluations help vehicle manufacturers fine-tune their designs and help fleet managers select fuel-efficient, low-emission vehicles that meet their bottom line and operational goals. help Foothill Transit optimize the energy-saving potentialmore » of its transit fleet. NREL's performance evaluations help vehicle manufacturers fine-tune their designs and help fleet managers select fuel-efficient, low-emission vehicles that meet their bottom line and operational goals.« less