The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-Career Teachers. NBER Working Paper No. 16877

ERIC Educational Resources Information Center

Taylor, Eric S.; Tyler, John H.

2011-01-01

The effect of evaluation on employee performance is traditionally studied in the context of the principal-agent problem. Evaluation can, however, also be characterized as an investment in the evaluated employee's human capital. We study a sample of mid-career public school teachers where we can consider these two types of evaluation effect…

Evaluating the use of prior information under different pacing conditions on aircraft inspection performance: The use of virtual reality technology

NASA Astrophysics Data System (ADS)

Bowling, Shannon Raye

The aircraft maintenance industry is a complex system consisting of human and machine components, because of this; much emphasis has been placed on improving aircraft-inspection performance. One proven technique for improving inspection performance is the use of training. There are several strategies that have been implemented for training, one of which is feedforward information. The use of prior information (feedforward) is known to positively affect inspection performance. This information can consist of knowledge about defect characteristics (types, severity/criticality, and location) and the probability of occurrence. Although several studies have been conducted that demonstrate the usefulness of feedforward as a training strategy, there are certain research issues that need to be addressed. This study evaluates the effect of feedforward information in a simulated 3-dimensional environment by the use of virtual reality. A controlled study was conducted to evaluate the effectiveness of feedforward information in a simulated aircraft inspection environment. The study was conducted in two phases. The first phase evaluated the difference between general and detailed inspection at different pacing levels. The second phase evaluated the effect of feedforward information pertaining to severity, probability and location. Analyses of the results showed that subjects performing detailed inspection performed significantly better than while performing general inspection. Pacing also had the effect of reducing performance for both general and detailed inspection. The study also found that as the level of feedforward information increases, performance also increases. In addition to evaluating performance measures, the study also evaluated process and subjective measures. It was found that process measures such as number of fixation points, fixation groups, mean fixation duration, and percent area covered were all affected by the treatment levels. Analyses of the subjective measures also found a correlation between the perceived usefulness of feedforward information and the actual effect on performance. The study also examined the potential of virtual reality as a training tool and analyzed the effect different calculational algorithms have on determining various process measures.

An hierarchical approach to performance evaluation of expert systems

NASA Technical Reports Server (NTRS)

Dominick, Wayne D. (Editor); Kavi, Srinu

1985-01-01

The number and size of expert systems is growing rapidly. Formal evaluation of these systems - which is not performed for many systems - increases the acceptability by the user community and hence their success. Hierarchical evaluation that had been conducted for computer systems is applied for expert system performance evaluation. Expert systems are also evaluated by treating them as software systems (or programs). This paper reports many of the basic concepts and ideas in the Performance Evaluation of Expert Systems Study being conducted at the University of Southwestern Louisiana.

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Study on evaluation index system of operational performance of municipal wastewater treatment plants in China

NASA Astrophysics Data System (ADS)

Xiaoxin, Zhang; Jin, Huang; Ling, Lin; Yan, Li

2018-05-01

According to the undeveloped evaluation method for the operational performance of the municipal wastewater treatment plants, this paper analyzes the policies related to sewage treatment industry based on the investigation of the municipal wastewater treatment plants. The applicable evaluation method for the operational performance was proposed from environmental protection performance, resources and energy consumption, technical and economic performance, production management and main equipment, providing a reliable basis for scientific evaluation of the operation as well as improving the operational performance of municipal wastewater treatment plant.

Multiple performance measures are needed to evaluate triage systems in the emergency department.

PubMed

Zachariasse, Joany M; Nieboer, Daan; Oostenbrink, Rianne; Moll, Henriëtte A; Steyerberg, Ewout W

2018-02-01

Emergency department triage systems can be considered prediction rules with an ordinal outcome, where different directions of misclassification have different clinical consequences. We evaluated strategies to compare the performance of triage systems and aimed to propose a set of performance measures that should be used in future studies. We identified performance measures based on literature review and expert knowledge. Their properties are illustrated in a case study evaluating two triage modifications in a cohort of 14,485 pediatric emergency department visits. Strengths and weaknesses of the performance measures were systematically appraised. Commonly reported performance measures are measures of statistical association (34/60 studies) and diagnostic accuracy (17/60 studies). The case study illustrates that none of the performance measures fulfills all criteria for triage evaluation. Decision curves are the performance measures with the most attractive features but require dichotomization. In addition, paired diagnostic accuracy measures can be recommended for dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R 2 for ordinal analyses. Other performance measures provide limited additional information. When comparing modifications of triage systems, decision curves and diagnostic accuracy measures should be used in a dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R 2 in an ordinal approach. Copyright © 2017 Elsevier Inc. All rights reserved.

Performance Evaluation and Analysis of Rural Drinking Water Safety Project——A Case Study in Jiangsu, China

NASA Astrophysics Data System (ADS)

Du, Xiaorong

2017-04-01

Water is the basic condition for human survival and development. As China is the most populous country, rural drinking water safety problems are most conspicuous. Therefore, the Chinese government keeps increasing investment and has built a large number of rural drinking water safety projects. Scientific evaluation of project performance is of great significance to promote the sustainable operation of the project and the sustainable development of rural economy. Previous studies mainly focus on the economic benefits of the project, while ignoring the fact that the rural drinking water safety project is quasi-public goods, which has economic, social and ecological benefits. This paper establishes a comprehensive evaluation model for rural drinking water safety performance, which adapts the rules of "5E" (economy, efficiency, effectiveness, equity and environment) as the value orientation, and selects a rural drinking water safety project as object in case study at K District, which is in the north of Jiangsu Province, China. The results shows: 1) the comprehensive performance of K project is in good condition; 2) The performance of every part shows that the scores of criteria "efficiency", "environment" and "effect" are higher than the mean performance, while the "economy" is slightly lower than the mean and the "equity" is the lowest. 3) The performance of indicator layer shows that: the planned completion rate of project, the reduction rate of project cost and the penetration rate of water-use population are significantly lower than other indicators. Based on the achievements of previous studies and the characteristics of rural drinking water safety project, this study integrates the evaluation dimensions of equity and environment, which can contribute to a more comprehensive and systematic assessment of project performance and provide empirical data for performance evaluation and management of rural drinking water safety project. Key Words: Rural drinking water safety project; Performance evaluation; 5E rules; Comprehensive evaluation model

75 FR 34110 - Agency Information Collection Activities; Proposed Collection; Comment Request; Performance...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-06-16

...; Performance Evaluation Studies on Wastewater Laboratories (Renewal) AGENCY: Environmental Protection Agency... Evaluation Studies on Wastewater Laboratories (Renewal) ICR numbers: EPA ICR No. 0234.10, OMB Control No...

75 FR 64724 - Agency Information Collection Activities; Submission to OMB for Review and Approval; Comment...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-10-20

...; Comment Request; Performance Evaluation Studies on Wastewater Laboratories (Renewal) AGENCY: Environmental... docket, go to http://www.regulations.gov . Title: Performance Evaluation Studies on Wastewater...

When the third party observer of a neuropsychological evaluation is an audio-recorder.

PubMed

Constantinou, Marios; Ashendorf, Lee; McCaffrey, Robert J

2002-08-01

The presence of third parties during neuropsychological evaluations is an issue of concern for contemporary neuropsychologists. Previous studies have reported that the presence of an observer during neuropsychological testing alters the performance of individuals under evaluation. The present study sought to investigate whether audio-recording affects the neuropsychological test performance of individuals in the same way that third party observation does. In the presence of an audio-recorder the performance of the participants on memory tests declined. Performance on motor tests, on the other hand, was not affected by the presence of an audio-recorder. The implications of these findings in forensic neuropsychological evaluations are discussed.

Performance evaluation of TDT soil water content and watermark soil water potential sensors

USDA-ARS?s Scientific Manuscript database

This study evaluated the performance of digitized Time Domain Transmissometry (TDT) soil water content sensors (Acclima, Inc., Meridian, ID) and resistance-based soil water potential sensors (Watermark 200, Irrometer Company, Inc., Riverside, CA) in two soils. The evaluation was performed by compar...

Performance evaluation of Louisiana superpave mixtures.

DOT National Transportation Integrated Search

2008-12-01

This report documents the performance of Louisiana Superpave mixtures through laboratory mechanistic tests, mixture : volumetric properties, gradation analysis, and early field performance. Thirty Superpave mixtures were evaluated in this : study. Fo...

Framework for Teacher Evaluation: Examining the Relationship between Teacher Performance and Student Achievement

ERIC Educational Resources Information Center

Parker, Neelie B.

2017-01-01

This action research study examined the relationship between teacher performance and student achievement in reading language arts and mathematics. The study sought to determine if teacher evaluation methods used to determine teacher performance, had a relationship in improving student achievement. The researcher investigated the topic using…

Chinese Middle School Teachers' Preferences Regarding Performance Evaluation Measures

ERIC Educational Resources Information Center

Liu, Shujie; Xu, Xianxuan; Stronge, James H.

2016-01-01

Teacher performance evaluation currently is receiving unprecedented attention from policy makers, scholars, and practitioners worldwide. This study is one of the few studies of teacher perceptions regarding teacher performance measures that focus on China. We employed a quantitative dominant mixed research design to investigate Chinese teachers'…

Functional assessment and performance evaluation for assistive robotic manipulators: Literature review

PubMed Central

Chung, Cheng-Shiu; Wang, Hongwu; Cooper, Rory A.

2013-01-01

Context The user interface development of assistive robotic manipulators can be traced back to the 1960s. Studies include kinematic designs, cost-efficiency, user experience involvements, and performance evaluation. This paper is to review studies conducted with clinical trials using activities of daily living (ADLs) tasks to evaluate performance categorized using the International Classification of Functioning, Disability, and Health (ICF) frameworks, in order to give the scope of current research and provide suggestions for future studies. Methods We conducted a literature search of assistive robotic manipulators from 1970 to 2012 in PubMed, Google Scholar, and University of Pittsburgh Library System – PITTCat. Results Twenty relevant studies were identified. Conclusion Studies were separated into two broad categories: user task preferences and user-interface performance measurements of commercialized and developing assistive robotic manipulators. The outcome measures and ICF codes associated with the performance evaluations are reported. Suggestions for the future studies include (1) standardized ADL tasks for the quantitative and qualitative evaluation of task efficiency and performance to build comparable measures between research groups, (2) studies relevant to the tasks from user priority lists and ICF codes, and (3) appropriate clinical functional assessment tests with consideration of constraints in assistive robotic manipulator user interfaces. In addition, these outcome measures will help physicians and therapists build standardized tools while prescribing and assessing assistive robotic manipulators. PMID:23820143

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation

PubMed Central

Chen, Quan; Tsai, Sang-Bing; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-01

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees’ low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees’ job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice. PMID:29301375

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation.

PubMed

Chen, Quan; Tsai, Sang-Bing; Zhai, Yuming; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-03

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees' low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees' job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice.

Rutting performance of cold bituminous emulsion mixtures

NASA Astrophysics Data System (ADS)

Arshad, Ahmad Kamil; Ali, Noor Azilatom; Shaffie, Ekarizan; Hashim, Wardati; Rahman, Zanariah Abd

2017-10-01

Cold Bituminous Emulsion Mixture (CBEM) is an environmentally friendly alternative to hot mix asphalt (HMA) for road surfacing, due to its low energy requirements. However, CBEM has generally been perceived to be less superior in performance, compared to HMA. This paper details a laboratory study on the rutting performance of CBEM. The main objective of this study is to determine the Marshall properties of CBEM and to evaluate the rutting performance. The effect of cement in CBEM was also evaluated in this study. The specimens were prepared using Marshall Mix Design Method and rutting performance was evaluated using the Asphalt Pavement Analyzer (APA). Marshall Properties were analysed to confirm compliance with the PWD Malaysia's specification requirements. The rutting performance for specimens with cement was also found to perform better than specimens without cement. It can be concluded that Cold Bituminous Emulsion Mixtures (CBEM) with cement is a viable alternative to Hot Mix Asphalt (HMA) as their Marshall Properties and performance obtained from this study meets the requirements of the specifications. It is recommended that further study be conducted on CBEM for other performance criteria such as moisture susceptibility and fatigue.

Balanced scorecard-based performance evaluation of Chinese county hospitals in underdeveloped areas.

PubMed

Gao, Hongda; Chen, He; Feng, Jun; Qin, Xianjing; Wang, Xuan; Liang, Shenglin; Zhao, Jinmin; Feng, Qiming

2018-05-01

Objective Since the Guangxi government implemented public county hospital reform in 2009, there have been no studies of county hospitals in this underdeveloped area of China. This study aimed to establish an evaluation indicator system for Guangxi county hospitals and to generate recommendations for hospital development and policymaking. Methods A performance evaluation indicator system was developed based on balanced scorecard theory. Opinions were elicited from 25 experts from administrative units, universities and hospitals and the Delphi method was used to modify the performance indicators. The indicator system and the Topsis method were used to evaluate the performance of five county hospitals randomly selected from the same batch of 2015 Guangxi reform pilots. Results There were 4 first-level indicators, 9 second-level indicators and 36 third-level indicators in the final performance evaluation indicator system that showed good consistency, validity and reliability. The performance rank of the hospitals was B > E > A > C > D. Conclusions The performance evaluation indicator system established using the balanced scorecard is practical and scientific. Analysis of the results based on this indicator system identified several factors affecting hospital performance, such as resource utilisation efficiency, medical service price, personnel structure and doctor-patient relationships.

Evaluation of Knowledge Development in a Healthcare Setting

NASA Astrophysics Data System (ADS)

Schaffer, Scott P.

Healthcare organizations worldwide have recently increased efforts to improve performance, quality, and knowledge transfer using information and communication technologies. Evaluation of the effectiveness and quality of such efforts is challenging. A macro and micro-level system evaluation conducted with a 14000 member US hospital administrative services organization examined the appropriateness of a blended face-to-face and technology-enabled performance improvement and knowledge development system. Furthermore, a successful team or microsystem in a high performing hospital was studied in-depth. Several types of data methods including interview, observation, and questionnaire were used to address evaluation questions within a knowledge development framework created for the study. Results of this preliminary study focus on how this organization attempted to organize clinical improvement efforts around quality and performance improvement processes supported by networked technologies.

Family incivility and job performance: a moderated mediation model of psychological distress and core self-evaluation.

PubMed

Lim, Sandy; Tai, Kenneth

2014-03-01

This study extends the stress literature by exploring the relationship between family incivility and job performance. We examine whether psychological distress mediates the link between family incivility and job performance. We also investigate how core self-evaluation might moderate this mediated relationship. Data from a 2-wave study indicate that psychological distress mediates the relationship between family incivility and job performance. In addition, core self-evaluation moderates the relationship between family incivility and psychological distress but not the relationship between psychological distress and job performance. The results hold while controlling for general job stress, family-to-work conflict, and work-to-family conflict. The findings suggest that family incivility is linked to poor performance at work, and psychological distress and core self-evaluation are key mechanisms in the relationship.

Evaluating performance of limestone prone to polishing.

DOT National Transportation Integrated Search

2009-12-01

This research project evaluated the effect of blending Vanport limestone and other aggregates on the frictional surface characteristic properties of constructed trial road surfaces. The study undertook the evaluation of the performance of different m...

Evaluative-feedback stimuli selectively activate the self-related brain area: an fMRI study.

PubMed

Pan, Xiaohong; Hu, Yang; Li, Lei; Li, Jianqi

2009-11-06

Evaluative-feedback, occurring in our daily life, generally contains subjective appraisal of one's specific abilities and personality characteristics besides objective right-or-wrong information. Traditional psychological researches have proved it to be important in building up one's self-concept; however, the neural basis underlying its cognitive processing remains unclear. The present neuroimaging study revealed the mechanism of evaluative-feedback processing at the neural level. 19 healthy Chinese subjects participated in this experiment, and completed the time-estimation task to better their performance according to four types of feedback, namely positive evaluative- and performance-feedback as well as negative evaluative- and performance-feedback. Neuroimaging findings showed that evaluative- rather than performance-feedback can induce increased activities mainly distributed in the cortical midline structures (CMS), including medial prefrontal cortex (BA 8/9)/anterior cigulate cortex (ACC, BA 20), precuneus (BA 7/31) adjacent to posterior cingulate gyrus (PCC, BA 23) of both hemispheres, as well as right inferior lobule (BA 40). This phenomenon can provide evidence that evaluative-feedback may significantly elicit the self-related processing in our brain. In addition, our results also revealed that more brain areas, particularly some self-related neural substrates were activated by the positive evaluative-feedback, in comparative with the negative one. In sum, this study suggested that evaluative-feedback was closely correlated with the self-concept processing, which distinguished it from the performance-feedback.

Performance evaluation for pinhole collimators of small gamma camera by MTF and NNPS analysis: Monte Carlo simulation study

NASA Astrophysics Data System (ADS)

Jeon, Hosang; Kim, Hyunduk; Cha, Bo Kyung; Kim, Jong Yul; Cho, Gyuseong; Chung, Yong Hyun; Yun, Jong-Il

2009-06-01

Presently, the gamma camera system is widely used in various medical diagnostic, industrial and environmental fields. Hence, the quantitative and effective evaluation of its imaging performance is essential for design and quality assurance. The National Electrical Manufacturers Association (NEMA) standards for gamma camera evaluation are insufficient to perform sensitive evaluation. In this study, modulation transfer function (MTF) and normalized noise power spectrum (NNPS) will be suggested to evaluate the performance of small gamma camera with changeable pinhole collimators using Monte Carlo simulation. We simulated the system with a cylinder and a disk source, and seven different pinhole collimators from 1- to 4-mm-diameter pinhole with lead. The MTF and NNPS data were obtained from output images and were compared with full-width at half-maximum (FWHM), sensitivity and differential uniformity. In the result, we found that MTF and NNPS are effective and novel standards to evaluate imaging performance of gamma cameras instead of conventional NEMA standards.

U1108 performance model

NASA Technical Reports Server (NTRS)

Trachta, G.

1976-01-01

A model of Univac 1108 work flow has been developed to assist in performance evaluation studies and configuration planning. Workload profiles and system configurations are parameterized for ease of experimental modification. Outputs include capacity estimates and performance evaluation functions. The U1108 system is conceptualized as a service network; classical queueing theory is used to evaluate network dynamics.

Shared Features of High-Performing After-School Programs: A Follow-Up to the TASC Evaluation

ERIC Educational Resources Information Center

Birmingham, Jennifer; Pechman, Ellen M.; Russell, Christina A.; Mielke, Monica

2005-01-01

This study examined high-performing after-school projects funded by The After-School Corporation (TASC), to determine what characteristics, if any, these projects shared. Evaluators reanalyzed student performance data collected during the multi-year evaluation of the TASC initiative to identify projects where the after-school program was…

Alternative performance measures for evaluating congestion.

DOT National Transportation Integrated Search

2004-04-01

This report summarizes the results of the work performed under the project Alternative Performance Measures for Evaluating : Congestion. The study first outlines existing approaches to looking at congestion. It then builds on the previous work in the...

Content Analysis of Evaluation Instruments Used for Student Evaluation of Classroom Teaching Performance in Higher Education.

ERIC Educational Resources Information Center

Tagomori, Harry T.; Bishop, Laurence A.

A major argument against evaluation of teacher performance by students pertains to the instruments being used. Colleges conduct instructional evaluation using instruments they devise, borrow, adopt, or adapt from other institutions. Whether these instruments are tested for content validity is unknown. This study determined how evaluation questions…

Using a human patient simulator to study the relationship between communication and nursing students' team performance.

PubMed

Hirokawa, Randy Y; Daub, Katharyn; Lovell, Eileen; Smith, Sarah; Davis, Alice; Beck, Christine

2012-11-01

This study examined the relationship between communication and nursing students' team performance by determining whether variations in team performance are related to differences in communication regarding five task-relevant functions: assessment, diagnosis, planning, implementation, and evaluation. The study results indicate a positive relationship between nursing students' team performance and comments focused on the implementation of treatment(s) and the evaluation of treatment options. A negative relationship between nursing students' team performance and miscellaneous comments made by team members was also observed. Copyright 2012, SLACK Incorporated.

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

PubMed Central

Jaafaripooyan, Ebrahim

2014-01-01

Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

Algorithms for detecting and predicting influenza outbreaks: metanarrative review of prospective evaluations

PubMed Central

Spreco, A; Timpka, T

2016-01-01

Objectives Reliable monitoring of influenza seasons and pandemic outbreaks is essential for response planning, but compilations of reports on detection and prediction algorithm performance in influenza control practice are largely missing. The aim of this study is to perform a metanarrative review of prospective evaluations of influenza outbreak detection and prediction algorithms restricted settings where authentic surveillance data have been used. Design The study was performed as a metanarrative review. An electronic literature search was performed, papers selected and qualitative and semiquantitative content analyses were conducted. For data extraction and interpretations, researcher triangulation was used for quality assurance. Results Eight prospective evaluations were found that used authentic surveillance data: three studies evaluating detection and five studies evaluating prediction. The methodological perspectives and experiences from the evaluations were found to have been reported in narrative formats representing biodefence informatics and health policy research, respectively. The biodefence informatics narrative having an emphasis on verification of technically and mathematically sound algorithms constituted a large part of the reporting. Four evaluations were reported as health policy research narratives, thus formulated in a manner that allows the results to qualify as policy evidence. Conclusions Awareness of the narrative format in which results are reported is essential when interpreting algorithm evaluations from an infectious disease control practice perspective. PMID:27154479

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

PubMed

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Building China's municipal healthcare performance evaluation system: a Tuscan perspective.

PubMed

Li, Hao; Barsanti, Sara; Bonini, Anna

2012-08-01

Regional healthcare performance evaluation systems can help optimize healthcare resources on regional basis and improve the performance of healthcare services provided. The Tuscany region in Italy is a good example of an institution which meets these requirements. China has yet to build such a system based on international experience. In this paper, based on comparative studies between Tuscany and China, we propose that the managing institutions in China's experimental cities can select and commission a third-party agency to, respectively, evaluate the performance of their affiliated hospitals and community health service centers. Following some features of the Tuscan experience, the Chinese municipal healthcare performance evaluation system can be built by focusing on the selection of an appropriate performance evaluation agency, the design of an adequate performance evaluation mechanism and the formulation of a complete set of laws, rules and regulations. When a performance evaluation system at city level is formed, the provincial government can extend the successful experience to other cities.

A Study of How Secondary School Principals in Minnesota Perceive the Evaluation of Their Performance

ERIC Educational Resources Information Center

Muenich, John Andrew

2014-01-01

The purpose for this study was to ascertain the perceptions principals of public secondary schools in Minnesota have in relation to the evaluation of their job performance. Responding principals reported that past evaluations have been fair and consistent but have questioned their value with regard to professional growth. When asked if student…

Teacher Perspectives of the Use of Student Performance Data in Teacher Evaluations

ERIC Educational Resources Information Center

Hopkins, Paul Thomas

2013-01-01

The purpose of this study was to determine how K-12 public school teachers perceive the use of student performance data in teacher evaluations. The proprietary, utility, feasibility, and accuracy standards created by the Joint Committee on Standards for Education Evaluation (JCSEE) served as a framework for the study. An online survey was deployed…

Classroom Teacher's Performance-Based Evaluation Form (CTPBEF) for Public Education Schools in the State of Kuwait: A Framework

ERIC Educational Resources Information Center

Al-Shammari, Zaid; Yawkey, Thomas D.

2008-01-01

This investigation using Grounded Theory focuses on developing, designing and testing out an evaluation method used as a framework for this study. This framework evolved into the instrument entitled, "Classroom Teacher's Performance Based Evaluation Form (CTPBEF)". This study shows the processes and procedures used in CTPBEF's…

Study on corporate social responsibility evaluation system based on stakeholder theory

NASA Astrophysics Data System (ADS)

Ma, J.; Deng, Liming

2011-10-01

The issue of Corporate Social Responsibility (CSR) has been attracting the attention from many disciplines such as economics, management, laws, sociality and philosophy since last century. The purpose of this study is to explore the impact of CSR on performance and develop a CSR evaluation system. Building on the definition of CSR and Stakeholder theory, this article built a path-relationship model of CSR and business operation performance. The paper also constructed CSR evaluation system based on KLD index, GRJ report, CSR accounting account, SA8000, ISO14000 etc. The research provides a basis for future studies about the relationship between CSR and business performance and shed some light on the evaluation of CSR practices.

A Component Analysis of the Impact of Evaluative and Objective Feedback on Performance

ERIC Educational Resources Information Center

Johnson, Douglas A.

2013-01-01

Despite the frequency with which performance feedback interventions are used in organizational behavior management, component analyses of such feedback are rare. It has been suggested that evaluation of performance and objective details about performance are two necessary components for performance feedback. The present study was designed to help…

Using hybrid method to evaluate the green performance in uncertainty.

PubMed

Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

2011-04-01

Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

Student Self-evaluation After Nursing Examinations: That's a Wrap.

PubMed

Butzlaff, Alice; Gaylle, Debrayh; O'Leary Kelley, Colleen

2018-04-13

Examination wrappers are a self-evaluation tool that uses metacognition to help students reflect on test performance. After examinations, rather than focus on points earned, students learn to self-identify study strategies and recognize methods of test preparation. The purpose of the study was to determine if the use of an examination wrapper after each test would encourage students to self-evaluate performance and adjust study strategies. A total of 120 undergraduate nursing students completed self-evaluations after each examination, which were analyzed using content analysis. Three general patterns emerged from student self-evaluation: effective and ineffective study strategies, understanding versus memorization of content, and nurse educator assistance.

Experimental heat and mass transfer of the separated and coupled rotating desiccant wheel and heat wheel

DOE Office of Scientific and Technical Information (OSTI.GOV)

Enteria, Napoleon; Yoshino, Hiroshi; Mochida, Akashi

The experimental evaluation of the separated and coupled rotating desiccant wheel and heat wheel is reported. The study aims to investigate the performance of the desiccant wheel and of the heat wheel both when operated separately and jointly. The performance evaluation of the desiccant wheel is based on its moisture removal capacity (MRC), moisture removal regeneration (MRR), and moisture mass balance (MMB). In addition, the study used the total energy balance (TEB), sensible coefficient of performance (COP{sub Sensible}), latent coefficient of performance (COP{sub Latent}) and, total coefficient of performance (COP{sub Total}). The performance of the heat wheel is based onmore » its effectiveness. The COP{sub Sensible}, COP{sub Latent} and, COP{sub Total} are used in the performance evaluation of the coupled desiccant wheel and heat wheel. The general results of the study show that the MRC, MRR and MMB coupled with the TEB, COP{sub Latent}, COP{sub Sensible} and COP{sub Total} predict adequately the performance of the desiccant wheel. In addition, the coupled operation of the desiccant wheel and heat wheel, contributed to the reduction of the external thermal energy requirement for the regeneration of the desiccant wheel. This study can be applied in other researches seeking evaluation of the desiccant wheel, heat wheel, and their combined operation. Moreover, the data presented here are significant for the desiccant wheel benchmarking and for evaluation of the desiccant wheel models. (author)« less

Students' Perceptions of Peer Evaluation: An Expectancy Perspective

ERIC Educational Resources Information Center

Chen, Yining; Lou, Hao

2004-01-01

Because of the difficulty of evaluating uneven performance among group members, many researchers suggest incorporating peer evaluations in a grading system that permits an instructor to evaluate and grade individual performance more equitably within a group. In this study, the authors employ expectancy theory to assess key factors that may…

Evaluation of ASR potential in Wyoming aggregates.

DOT National Transportation Integrated Search

2013-10-01

A comprehensive study was performed to evaluate the ASR reactivity of eight Wyoming aggregates. State-of-the-art and standardized test : methods were performed and results were used to evaluate these aggregate sources. Of the eight aggregates: four a...

Evaluating performance of limestone prone to polishing : final report, December 31, 2009.

DOT National Transportation Integrated Search

2009-12-21

This research project evaluated the effect of blending Vanport limestone and other aggregates on the frictional surface characteristic properties of constructed trial road surfaces. The study undertook the evaluation of the performance of different m...

Mild test anxiety influences neurocognitive performance among African Americans and European Americans: identifying interfering and facilitating sources.

PubMed

Thames, April D; Panos, Stella E; Arentoft, Alyssa; Byrd, Desiree A; Hinkin, Charles H; Arbid, Natalie

2015-01-01

The current study examined ethnic/racial differences in test-related anxiety and its relationship to neurocognitive performance in a community sample of African American (n = 40) and European American (n = 36) adults. The authors hypothesized the following: (a) Test-anxiety related to negative performance evaluation would be associated with lower neurocognitive performance, whereas anxiety unrelated to negative evaluation would be associated with higher neurocognitive performance. (b) African American participants would report higher levels of anxiety about negative performance evaluation than European Americans. (c) European Americans would report higher levels of anxiety unrelated to negative performance evaluation. The first two hypotheses were supported: Ethnic/racial differences in test-taking anxiety emerged such that African Americans reported significantly higher levels of negative performance evaluation, which was associated with lower cognitive performance. The third hypothesis was not supported: African Americans and European Americans reported similar levels of test-anxiety unrelated to negative evaluation. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

The effects of spatially displaced visual feedback on remote manipulator performance

NASA Technical Reports Server (NTRS)

Smith, Randy L.; Stuart, Mark A.

1993-01-01

The results of this evaluation have important implications for the arrangement of remote manipulation worksites and the design of workstations for telerobot operations. This study clearly illustrates the deleterious effects that can accompany the performance of remote manipulator tasks when viewing conditions are less than optimal. Future evaluations should emphasize telerobot camera locations and the use of image/graphical enhancement techniques in an attempt to lessen the adverse effects of displaced visual feedback. An important finding in this evaluation is the extent to which results from previously performed direct manipulation studies can be generalized to remote manipulation studies. Even though the results obtained were very similar to those of the direct manipulation evaluations, there were differences as well. This evaluation has demonstrated that generalizations to remote manipulation applications based upon the results of direct manipulation studies are quite useful, but they should be made cautiously.

Between-individual comparisons in performance evaluation: a perspective from prospect theory.

PubMed

Wong, Kin Fai Ellick; Kwong, Jessica Y Y

2005-03-01

This article examines how between-individual comparisons influence performance evaluations in rating tasks. The authors demonstrated a systematic change in the perceived difference across ratees as a result of changing the way performance information is expressed. Study 1 found that perceived performance difference between 2 individuals was greater when their objective performance levels were presented with small numbers (e.g., absence rates of 2% vs. 5%) than when they were presented with large numbers (e.g., attendance rates of 98% vs. 95%). Extending this finding to situations involving trade-offs between multiple performance attributes across ratees, Study 2 showed that the relative preference for 1 ratee over another actually reversed when the presentation format of the performance information changed. The authors draw upon prospect theory to offer a theoretical framework describing the between-individual comparison aspect of performance evaluation.

Strapdown system performance optimization test evaluations (SPOT), volume 1

NASA Technical Reports Server (NTRS)

Blaha, R. J.; Gilmore, J. P.

1973-01-01

A three axis inertial system was packaged in an Apollo gimbal fixture for fine grain evaluation of strapdown system performance in dynamic environments. These evaluations have provided information to assess the effectiveness of real-time compensation techniques and to study system performance tradeoffs to factors such as quantization and iteration rate. The strapdown performance and tradeoff studies conducted include: (1) Compensation models and techniques for the inertial instrument first-order error terms were developed and compensation effectivity was demonstrated in four basic environments; single and multi-axis slew, and single and multi-axis oscillatory. (2) The theoretical coning bandwidth for the first-order quaternion algorithm expansion was verified. (3) Gyro loop quantization was identified to affect proportionally the system attitude uncertainty. (4) Land navigation evaluations identified the requirement for accurate initialization alignment in order to pursue fine grain navigation evaluations.

Head-camera video recordings of trauma core competency procedures can evaluate surgical resident's technical performance as well as colocated evaluators.

PubMed

Mackenzie, Colin F; Pasley, Jason; Garofalo, Evan; Shackelford, Stacy; Chen, Hegang; Longinaker, Nyaradzo; Granite, Guinevere; Pugh, Kristy; Hagegeorge, George; Tisherman, Samuel A

2017-07-01

Unbiased evaluation of trauma core competency procedures is necessary to determine if residency and predeployment training courses are useful. We tested whether a previously validated individual procedure score (IPS) for individual procedure vascular exposure and fasciotomy (FAS) performance skills could discriminate training status by comparing IPS of evaluators colocated with surgeons to blind video evaluations. Performance of axillary artery (AA), brachial artery (BA), and femoral artery (FA) vascular exposures and lower extremity FAS on fresh cadavers by 40 PGY-2 to PGY-6 residents was video-recorded from head-mounted cameras. Two colocated trained evaluators assessed IPS before and after training. One surgeon in each pretraining tertile of IPS for each procedure was randomly identified for blind video review. The same 12 surgeons were video-recorded repeating the procedures less than 4 weeks after training. Five evaluators independently reviewed all 96 randomly arranged deidentified videos. Inter-rater reliability/consistency, intraclass correlation coefficients were compared by colocated versus video review of IPS, and errors. Study methodology and bias were judged by Medical Education Research Study Quality Instrument and the Quality Assessment of Diagnostic Accuracy Studies criteria. There were no differences (p ≥ 0.5) in IPS for AA, FA, FAS, whether evaluators were colocated or reviewed video recordings. Evaluator consistency was 0.29 (BA) - 0.77 (FA). Video and colocated evaluators were in total agreement (p = 1.0) for error recognition. Intraclass correlation coefficient was 0.73 to 0.92, dependent on procedure. Correlations video versus colocated evaluations were 0.5 to 0.9. Except for BA, blinded video evaluators discriminated (p < 0.002) whether procedures were performed before training versus after training. Study methodology by Medical Education Research Study Quality Instrument criteria scored 15.5/19, Quality Assessment of Diagnostic Accuracy Studies 2 showed low bias risk. Video evaluations of AA, FA, and FAS procedures with IPS are unbiased, valid, and have potential for formative assessments of competency. Prognostic study, level II.

Performance and Symptom Validity Testing as a Function of Medical Board Evaluation in U.S. Military Service Members with a History of Mild Traumatic Brain Injury.

PubMed

Armistead-Jehle, Patrick; Cole, Wesley R; Stegman, Robert L

2018-02-01

The study was designed to replicate and extend pervious findings demonstrating the high rates of invalid neuropsychological testing in military service members (SMs) with a history of mild traumatic brain injury (mTBI) assessed in the context of a medical evaluation board (MEB). Two hundred thirty-one active duty SMs (61 of which were undergoing an MEB) underwent neuropsychological assessment. Performance validity (Word Memory Test) and symptom validity (MMPI-2-RF) test data were compared across those evaluated within disability (MEB) and clinical contexts. As with previous studies, there were significantly more individuals in an MEB context that failed performance (MEB = 57%, non-MEB = 31%) and symptom validity testing (MEB = 57%, non-MEB = 22%) and performance validity testing had a notable affect on cognitive test scores. Performance and symptom validity test failure rates did not vary as a function of the reason for disability evaluation when divided into behavioral versus physical health conditions. These data are consistent with past studies, and extends those studies by including symptom validity testing and investigating the effect of reason for MEB. This and previous studies demonstrate that more than 50% of SMs seen in the context of an MEB will fail performance validity tests and over-report on symptom validity measures. These results emphasize the importance of using both performance and symptom validity testing when evaluating SMs with a history of mTBI, especially if they are being seen for disability evaluations, in order to ensure the accuracy of cognitive and psychological test data. Published by Oxford University Press 2017. This work is written by (a) US Government employee(s) and is in the public domain in the US.

Validity evidence for the Simulated Colonoscopy Objective Performance Evaluation scoring system.

PubMed

Trinca, Kristen D; Cox, Tiffany C; Pearl, Jonathan P; Ritter, E Matthew

2014-02-01

Low-cost, objective systems to assess and train endoscopy skills are needed. The aim of this study was to evaluate the ability of Simulated Colonoscopy Objective Performance Evaluation to assess the skills required to perform endoscopy. Thirty-eight subjects were included in this study, all of whom performed 4 tasks. The scoring system measured performance by calculating precision and efficiency. Data analysis assessed the relationship between colonoscopy experience and performance on each task and the overall score. Endoscopic trainees' Simulated Colonoscopy Objective Performance Evaluation scores correlated significantly with total colonoscopy experience (r = .61, P = .003) and experience in the past 12 months (r = .63, P = .002). Significant differences were seen among practicing endoscopists, nonendoscopic surgeons, and trainees (P < .0001). When the 4 tasks were analyzed, each showed significant correlation with colonoscopy experience (scope manipulation, r = .44, P = .044; tool targeting, r = .45, P = .04; loop management, r = .47, P = .032; mucosal inspection, r = .65, P = .001) and significant differences in performance between the endoscopist groups, except for mucosal inspection (scope manipulation, P < .0001; tool targeting, P = .002; loop management, P = .0008; mucosal inspection, P = .27). Simulated Colonoscopy Objective Performance Evaluation objectively assesses the technical skills required to perform endoscopy and shows promise as a platform for proficiency-based skills training. Published by Elsevier Inc.

Clinical Observed Performance Evaluation: A Prospective Study in Final Year Students of Surgery

ERIC Educational Resources Information Center

Markey, G. C.; Browne, K.; Hunter, K.; Hill, A. D.

2011-01-01

We report a prospective study of clinical observed performance evaluation (COPE) for 197 medical students in the pre-qualification year of clinical education. Psychometric quality was the main endpoint. Students were assessed in groups of 5 in 40-min patient encounters, with each student the focus of evaluation for 8 min. Each student had a series…

The Effect of Implied Performer Age and Group Membership on Evaluations of Music Performances

ERIC Educational Resources Information Center

Harrington, Ann M.

2018-01-01

This study examined the effects of implied performer age and group membership on listeners' evaluations of music performances. Undergraduate music majors (n = 23), nonmusic majors (n = 17), and members of a New Horizons ensemble (n = 16) were presented with six 30-second excerpts of concert band performances. Excerpts were presented to all…

Personality traits affect teaching performance of attending physicians: results of a multi-center observational study.

PubMed

Scheepers, Renée A; Lombarts, Kiki M J M H; van Aken, Marcel A G; Heineman, Maas Jan; Arah, Onyebuchi A

2014-01-01

Worldwide, attending physicians train residents to become competent providers of patient care. To assess adequate training, attending physicians are increasingly evaluated on their teaching performance. Research suggests that personality traits affect teaching performance, consistent with studied effects of personality traits on job performance and academic performance in medicine. However, up till date, research in clinical teaching practice did not use quantitative methods and did not account for specialty differences. We empirically studied the relationship of attending physicians' personality traits with their teaching performance across surgical and non-surgical specialties. We conducted a survey across surgical and non-surgical specialties in eighteen medical centers in the Netherlands. Residents evaluated attending physicians' overall teaching performance, as well as the specific domains learning climate, professional attitude, communication, evaluation, and feedback, using the validated 21-item System for Evaluation of Teaching Qualities (SETQ). Attending physicians self-evaluated their personality traits on a 5-point scale using the validated 10-item Big Five Inventory (BFI), yielding the Five Factor model: extraversion, conscientiousness, neuroticism, agreeableness and openness. Overall, 622 (77%) attending physicians and 549 (68%) residents participated. Extraversion positively related to overall teaching performance (regression coefficient, B: 0.05, 95% CI: 0.01 to 0.10, P = 0.02). Openness was negatively associated with scores on feedback for surgical specialties only (B: -0.10, 95% CI: -0.15 to -0.05, P<0.001) and conscientiousness was positively related to evaluation of residents for non-surgical specialties only (B: 0.13, 95% CI: 0.03 to 0.22, p = 0.01). Extraverted attending physicians were consistently evaluated as better supervisors. Surgical attending physicians who display high levels of openness were evaluated as less adequate feedback-givers. Non-surgical attending physicians who were conscientious seem to be good at evaluating residents. These insights could contribute to future work on development paths of attending physicians in medical education.

Personality Traits Affect Teaching Performance of Attending Physicians: Results of a Multi-Center Observational Study

PubMed Central

Scheepers, Renée A.; Lombarts, Kiki M. J. M. H.; van Aken, Marcel A. G.; Heineman, Maas Jan; Arah, Onyebuchi A.

2014-01-01

Background Worldwide, attending physicians train residents to become competent providers of patient care. To assess adequate training, attending physicians are increasingly evaluated on their teaching performance. Research suggests that personality traits affect teaching performance, consistent with studied effects of personality traits on job performance and academic performance in medicine. However, up till date, research in clinical teaching practice did not use quantitative methods and did not account for specialty differences. We empirically studied the relationship of attending physicians' personality traits with their teaching performance across surgical and non-surgical specialties. Method We conducted a survey across surgical and non-surgical specialties in eighteen medical centers in the Netherlands. Residents evaluated attending physicians' overall teaching performance, as well as the specific domains learning climate, professional attitude, communication, evaluation, and feedback, using the validated 21-item System for Evaluation of Teaching Qualities (SETQ). Attending physicians self-evaluated their personality traits on a 5-point scale using the validated 10-item Big Five Inventory (BFI), yielding the Five Factor model: extraversion, conscientiousness, neuroticism, agreeableness and openness. Results Overall, 622 (77%) attending physicians and 549 (68%) residents participated. Extraversion positively related to overall teaching performance (regression coefficient, B: 0.05, 95% CI: 0.01 to 0.10, P = 0.02). Openness was negatively associated with scores on feedback for surgical specialties only (B: −0.10, 95% CI: −0.15 to −0.05, P<0.001) and conscientiousness was positively related to evaluation of residents for non-surgical specialties only (B: 0.13, 95% CI: 0.03 to 0.22, p = 0.01). Conclusions Extraverted attending physicians were consistently evaluated as better supervisors. Surgical attending physicians who display high levels of openness were evaluated as less adequate feedback-givers. Non-surgical attending physicians who were conscientious seem to be good at evaluating residents. These insights could contribute to future work on development paths of attending physicians in medical education. PMID:24844725

The effects of arousal reappraisal on stress responses, performance and attention.

PubMed

Sammy, Nadine; Anstiss, Paul A; Moore, Lee J; Freeman, Paul; Wilson, Mark R; Vine, Samuel J

2017-11-01

This study examined the effects of arousal reappraisal on cardiovascular responses, demand and resource evaluations, self-confidence, performance and attention under pressurized conditions. A recent study by Moore et al. [2015. Reappraising threat: How to optimize performance under pressure. Journal of Sport and Exercise Psychology, 37(3), 339-343. doi: 10.1123/jsep.2014-0186 ] suggested that arousal reappraisal is beneficial to the promotion of challenge states and leads to improvements in single-trial performance. This study aimed to further the work of Moore and colleagues (2015) by examining the effects of arousal reappraisal on cardiovascular responses, demand and resource evaluations, self-confidence, performance and attention in a multi-trial pressurized performance situation. Participants were randomly assigned to either an arousal reappraisal intervention or control condition, and completed a pressurized dart throwing task. The intervention encouraged participants to view their physiological arousal as facilitative rather than debilitative to performance. Measures of cardiovascular reactivity, demand and resource evaluations, self-confidence, task performance and attention were recorded. The reappraisal group displayed more favorable cardiovascular reactivity and reported higher resource evaluations and higher self-confidence than the control group but no task performance or attention effects were detected. These findings demonstrate the strength of arousal reappraisal in promoting adaptive stress responses, perceptions of resources and self-confidence.

Linking Political Influence to School Reform with a Focus on the Performance Evaluation Reform Act and Senate Bill 7

ERIC Educational Resources Information Center

Fredericks, Juliane R.

2015-01-01

This study focused on the federal and Illinois State the reform legislation titled the Performance Evaluation Reform Act and Senate Bill 7. The Performance Evaluation Reform Act or "PERA" was created from collaboration between stakeholders as Illinois competed in a federal competition titled "Race to the Top." The legislation…

Classroom Performance Evaluation: Stages and Perspectives for Professional Development of Secondary Teachers in Vietnam

ERIC Educational Resources Information Center

Pham, Huy Q.; Roberts, Stacey B.

2012-01-01

This study examined classroom performance evaluation of secondary teachers in Vietnam. Specially, it sought to determine the possibility of applying supervision into the evaluation for teaching development. Data were collected from interviews with 34 (n=34) participants: ten evaluators and 24 teachers in different school contexts: rural areas,…

At-Risk Youth Appearance and Job Performance Evaluation

ERIC Educational Resources Information Center

Freeburg, Beth Winfrey; Workman, Jane E.

2008-01-01

The goal of this study was to identify the relationship of at-risk youth workplace appearance to other job performance criteria. Employers (n = 30; each employing from 1 to 17 youths) evaluated 178 at-risk high school youths who completed a paid summer employment experience. Appearance evaluations were significantly correlated with evaluations of…

Reliability and Validity of the Professional Counseling Performance Evaluation

ERIC Educational Resources Information Center

Shepherd, J. Brad; Britton, Paula J.; Kress, Victoria E.

2008-01-01

The definition and measurement of counsellor trainee competency is an issue that has received increased attention yet lacks quantitative study. This research evaluates item responses, scale reliability and intercorrelations, interrater agreement, and criterion-related validity of the Professional Performance Fitness Evaluation/Professional…

Citation Ranking versus Peer Evaluation of Senior Faculty Research Performance: A Case Study of Kurdish Scholarship.

ERIC Educational Resources Information Center

Meho, Lokman I.; Sonnenwald, Diane H.

2000-01-01

Analyzes the relationship between citation ranking and peer evaluation in assessing senior faculty research performance. Describes a study of faculty specializing in Kurdish studies that investigated to what degree citation ranking correlates with data from citation content analysis, book reviews, and peer ranking. (Contains 72 references.)…

Program for the development of high temperature electrical materials and components

NASA Technical Reports Server (NTRS)

Neff, W. S.; Lowry, L. R.

1972-01-01

Evaluation of high temperature, space-vacuum performance of selected electrical materials and components, high temperature capacitor development, and evaluation, construction, and endurance testing of compression sealed pyrolytic boron nitride slot insulation are described. The first subject above covered the aging evaluation of electrical devices constructed from selected electrical materials. Individual materials performances were also evaluated and reported. The second subject included study of methods of improving electrical performance of pyrolytic boron nitride capacitors. The third portion was conducted to evaluate the thermal and electrical performance of pyrolytic boron nitride as stator slot liner material under varied temperature and compressive loading. Conclusions and recommendations are presented.

Uniform peanut performance test 2017

USDA-ARS?s Scientific Manuscript database

The Uniform Peanut Performance Tests (UPPT) are designed to evaluate the commercial potential of advanced breeding peanut lines not formally released. The tests are performed in ten locations across the peanut production belt. In this study, 2 controls and 14 entries were evaluated at 8 locations....

Electronic prescribing: criteria for evaluating handheld prescribing systems and an evaluation of a new, handheld, wireless wide area network (WWAN) prescribing system.

PubMed

Goldblum, O M

2001-02-01

The objectives of this study were: 1) to establish criteria for evaluating handheld computerized prescribing systems; and 2) to evaluate out-of-box performance and features of a new, Palm Operating System (OS)-based, handheld, wireless wide area network (WWAN) prescribing system. The system consisted of a Palm Vx handheld organizer, a Novatel Minstrel V wireless modem, OmniSky wireless internet access and ePhysician ePad 1.1, the Palm OS electronic prescribing software program. A dermatologist familiar with healthcare information technology conducted an evaluation of the performance and features of a new, handheld, WWAN electronic prescribing system in an office practice during a three-month period in 2000. System performance, defined as transmission success rate, was determined from data collected during the three-month trial. Evaluation criteria consisted of an analysis of features found in electronic prescribing systems. All prescriptions written for all patients seen during a three-month period (August - November, 2000) were eligible for inclusion. Prescriptions written for patients who intended to fill them at pharmacies without known facsimile receiving capabilities were excluded from the study. The performance of the system was evaluated using data collected during the study. Criteria for evaluating features of electronic prescribing systems were developed and used to analyze the system employed in this study. During this three-month trial, 200 electronic prescriptions were generated for 132 patients included in the study. Of these prescriptions, 92.5 percent were successfully transmitted to pharmacies. Transmission failures resulted from incorrect facsimile numbers and non-functioning facsimile machines. Criteria established for evaluation of electronic prescribing systems included System (Hardware & Software), Costs, System Features, Printing & Transmission, Formulary & Insurance, Customization, Drug Safety and Security. This study is the first effort to establish comprehensive criteria for evaluating handheld prescribing systems and to evaluate the performance and features of a handheld, electronic prescribing system. The results demonstrated that the evaluated system: 1) was simple to install; 2) successfully interfaced with a commonly used practice management system; 3) was user-friendly and easy to operate; 4) offered a robust variety of standard features; and, 5) resulted in a high rate of success for transmitting electronic prescriptions. The criteria established for the evaluation of features of an electronic prescribing system can be used to critically evaluate the performance and features of other handheld and personal computer-based electronic prescribing systems.

WE-E-217A-02: Methodologies for Evaluation of Standalone CAD System Performance.

PubMed

Sahiner, B

2012-06-01

Standalone performance evaluation of a CAD system provides information about the abnormality detection or classification performance of the computerized system alone. Although the performance of the reader with CAD is the final step in CAD system assessment, standalone performance evaluation is an important component for several reasons: First, standalone evaluation informs the reader about the performance level of the CAD system and may have an impact on how the reader uses the system. Second, it provides essential information to the system designer for algorithm optimization during system development. Third, standalone evaluation can provide a detailed description of algorithm performance (e.g., on subgroups of the population) because a larger data set with more samples from different subgroups can be included in standalone studies compared to reader studies. Proper standalone evaluation of a CAD system involves a number of key components, some of which are shared with the assessment of reader performance with CAD. These include (1) selection of a test data set that allows performance assessment with little or no bias and acceptable uncertainty; (2) a reference standard that indicates disease status as well as the location and extent of disease; (3) a clearly defined method for labeling each CAD mark as a true-positive or false-positive; and (4) a properly selected set of metrics to summarize the accuracy of the computer marks and their corresponding scores. In this lecture, we will discuss various approaches for the key components of standalone CAD performance evaluation listed above, and present some of the recommendations and opinions from the AAPM CAD subcommittee on these issues. Learning Objectives 1. Identify basic components and metrics in the assessment of standalone CAD systems 2. Understand how each component may affect the assessed performance 3. Learn about AAPM CAD subcommittee's opinions and recommendations on factors and metrics related to the evaluation of standalone CAD system performance. © 2012 American Association of Physicists in Medicine.

Results of the 1980 NACUBO Comparative Performance Study and Investment Questionnaire.

ERIC Educational Resources Information Center

Dresner, Bruce M.

The purpose of the annual National Association of College and University Business Officers' (NACUBO) Comparative Performance Study is to aid administrators in evaluating the performance of their investment pools. The 1980 study contains two parts: (1) comparative performance information and related investment performance statistics; and (2) other…

Results of the 1979 NACUBO Comparative Performance Study and Investment Questionnaire.

ERIC Educational Resources Information Center

Dresner, Bruce M.

Results of the 1979 Comparative Performance Study of the National Association of College and Business Officers are presented. The study is designed to aid administrators in evaluating the performance of their investment pools. The report covers comparative performance information and related investment performance statistics and other endowment…

A model for evaluating the social performance of construction waste management.

PubMed

Yuan, Hongping

2012-06-01

It has been determined by existing literature that a lot of research efforts have been made to the economic performance of construction waste management (CWM), but less attention is paid to investigation of the social performance of CWM. This study therefore attempts to develop a model for quantitatively evaluating the social performance of CWM by using a system dynamics (SD) approach. Firstly, major variables affecting the social performance of CWM are identified and a holistic system for assessing the social performance of CWM is formulated in line with feedback relationships underlying these variables. The developed system is then converted into a SD model through the software iThink. An empirical case study is finally conducted to demonstrate application of the model. Results of model validation indicate that the model is robust and reasonable to reflect the situation of the real system under study. Findings of the case study offer helpful insights into effectively promoting the social performance of CWM of the project investigated. Furthermore, the model exhibits great potential to function as an experimental platform for dynamically evaluating effects of management measures on improving the social performance of CWM of construction projects. Copyright © 2012 Elsevier Ltd. All rights reserved.

Testing of state roadside safety systems. Volume XI, Appendix J -- Crash testing and evaluation of existing guardrail systems

DOT National Transportation Integrated Search

1999-04-01

The purpose of this study is to crash test and evaluate new or modified roadside safety hardware and, where necessary, redesign the devices to improve their impact performance. The three major areas addressed in this study are the impact performance ...

Teacher Evaluation, Performance-Related Pay, and Constructivist Instruction

ERIC Educational Resources Information Center

Liang, Guodong; Akiba, Motoko

2015-01-01

Using statewide longitudinal teacher survey data collected in 2009 and 2010, this study examined the characteristics of teacher evaluation used to determine performance-related pay (PRP), and the association between PRP and improvement in the practice of constructivist instruction. The study found that 10.9% of middle school mathematics teachers…

Performance Evaluation Process.

ERIC Educational Resources Information Center

1998

This document contains four papers from a symposium on the performance evaluation process and human resource development (HRD). "Assessing the Effectiveness of OJT (On the Job Training): A Case Study Approach" (Julie Furst-Bowe, Debra Gates) is a case study of the effectiveness of OJT in one of a high-tech manufacturing company's product…

Performance evaluation of the NASA/KSC CAD/CAE and office automation LAN's

NASA Technical Reports Server (NTRS)

Zobrist, George W.

1994-01-01

This study's objective is the performance evaluation of the existing CAD/CAE (Computer Aided Design/Computer Aided Engineering) network at NASA/KSC. This evaluation also includes a similar study of the Office Automation network, since it is being planned to integrate this network into the CAD/CAE network. The Microsoft mail facility which is presently on the CAD/CAE network was monitored to determine its present usage. This performance evaluation of the various networks will aid the NASA/KSC network managers in planning for the integration of future workload requirements into the CAD/CAE network and determining the effectiveness of the planned FDDI (Fiber Distributed Data Interface) migration.

The Impact of Level of Performance on Feedback Strategy

ERIC Educational Resources Information Center

Beaulieu, R. P.; Love, Kevin G.

2006-01-01

The primary purpose of this study was to investigate the impact of the level of observed performance on the feedback strategy selected by a performance evaluator. One hundred and twenty-three actual performance evaluators from 15 different organizations and 123 college students reviewed, in groups which ranged from 2 to 20, a job description for…

Use of an Acoustic Camera to Evaluate the Performance of Tickler Chains and Draghead Deflectors for Sea Turtle Protection during Hopper Dredging in the United States of America

DTIC Science & Technology

2018-05-01

performance nor effectiveness in protecting sea turtles has been documented.This study was the first step in evaluating TTC as a potential replacement for...draghead turtle deflectors. The primary objective was to evaluate and document operational performance of this technology, not effectiveness of reducing...incidental take. TTC operational performance was monitored using underwater camera systems over a short period of time whereas effectiveness for

Association between social factors and performance during Functional Capacity Evaluations: a systematic review.

PubMed

Ansuategui Echeita, Jone; van Holland, Berry J; Gross, Douglas P; Kool, Jan; Oesch, Peter; Trippolini, Maurizio A; Reneman, Michiel F

2018-03-09

Determine the association of different social factors with Functional Capacity Evaluation (FCE) performance in adults. A systematic literature search was performed in MEDLINE, CINAHL, and PsycINFO electronic databases. Studies were eligible if they studied social factor's association with the performance of adults undergoing FCE. Studies were assessed on methodological quality and quality of evidence. The review was performed using best-evidence synthesis methods. Thirteen studies were eligible and 11 social factors were studied. Considerable heterogeneity regarding measurements, populations, and methods existed among the studies. High quality of evidence was found for the association of FCE performance with the country of FCE and examiner's fear behavior; moderate quality of evidence with previous job salary; and low or very low quality of evidence with compensation status, litigation status, type of instruction, time of day (workday), primary or mother language, and ethnicity. Other social factors were not studied. Evidence for associations of various social factors with FCE performance was found, but robust conclusions about the strength of the associations cannot be made. Quality of evidence ranged from high to very low. Further research on social factors, also within a biopsychosocial context, is necessary to provide a better understanding of FCE performance. Implications for Rehabilitation Research on Functional Capacity Evaluation (FCE) performance and its association with biopsychosocial factors have scarcely addressed the impact of social factors, limiting full understanding of FCE results. The social factors, healthcare (examiner's fear behavior and type of instruction), personal or cultural systems (country of FCE, primary or mother language, and ethnicity), workplace system (previous job salary, time of day (workday)), and legislative and insurance system (compensation and litigation status), have a bearing in FCE performance. Better understanding of factors associating with functional capacity provide insights in FCE, allowing clinicians to improve the evaluations and interpretations of the assessment and better design the rehabilitation program. Better understanding of factors that influence FCE performance, and of unstudied factors, will allow researchers guidance to further investigate the construct of functional capacity.

Capacity Loss Studies on High Capacity Li-ion Cells for the Orbiter Advanced Hydraulic Power System

NASA Technical Reports Server (NTRS)

Jeevarajan, Judith A.; Irlbeck, Bradley W.

2004-01-01

Contents include the following: Introduction. Physical and electrochemical characteristics. Performance evaluation. Rate performance. Internal resistance. Performance at different temperatures. Safety evaluation. Overcharge. Overdischarge. External short. Simulated internal short. Heat-to-vent. Vibration. Drop rest. Vent and burst pressure.

Evaluating Faculty Work: Expectations and Standards of Faculty Performance in Research Universities

ERIC Educational Resources Information Center

Hardre, Patricia; Cox, Michelle

2009-01-01

Expectations and the way they are communicated can influence employees' motivation and performance. Previous research has demonstrated individual effects of workplace climate and individual differences on faculty productivity. The present study focused on the characteristics of institutional performance standards, evaluation processes and…

Ecological Regional Analysis Applied to Campus Sustainability Performance

ERIC Educational Resources Information Center

Weber, Shana; Newman, Julie; Hill, Adam

2017-01-01

Purpose: Sustainability performance in higher education is often evaluated at a generalized large scale. It remains unknown to what extent campus efforts address regional sustainability needs. This study begins to address this gap by evaluating trends in performance through the lens of regional environmental characteristics.…

Evaluation and Application of Enhancements to the Performance of the ASDE-3 Radar in Heavy Rain

DOT National Transportation Integrated Search

1982-03-01

This report presents the results of a study performed by the Transportation Systems Center (TSC) to evaluate two proposed enhancements to the performance of the ASDE-3 Radar in heavy rain: Adaptive gain and adaptive clutter thresholding, (operating w...

Performance-Based Evaluation and School Librarians

ERIC Educational Resources Information Center

Church, Audrey P.

2015-01-01

Evaluation of instructional personnel is standard procedure in our Pre-K-12 public schools, and its purpose is to document educator effectiveness. With Race to the Top and No Child Left Behind waivers, states are required to implement performance-based evaluations that demonstrate student academic progress. This three-year study describes the…

FIELD EVALUATION OF LOW-EMISSION COAL BURNER TECHNOLOGY ON UTILITY BOILERS. VOLUME I. DISTRIBUTED MIXING BURNER EVALUATION

EPA Science Inventory

The report gives results of a study in which NOx emissions and general combustion performance characteristics of four burners were evaluated under experimental furnace conditions. Of primary interest was the performance of a low NOx Distributed Mixing Burner (DMB), which was test...

Evaluating Fluid and Crystallized Abilities in the Performance of an Educational Process

ERIC Educational Resources Information Center

Blanch, Angel

2015-01-01

The fluid and crystallized ("Gf-Gc") intelligence theory has been used extensively to evaluate the influence of cognitive abilities on educational outcomes within cross-sectional and longitudinal research designs. This study evaluated the contribution of fluid and crystallized abilities in the performance of a 1-week instructional…

MULTI-SITE PERFORMANCE EVALUATIONS OF CANDIDATE METHODOLOGIES FOR DETERMINING COARSE PARTICULATE MATTER (PMC) CONCENTRATIONS

EPA Science Inventory

Comprehensive field studies were conducted to evaluate the performance of sampling methods for measuring the coarse fraction of PM10 in ambient air. Five separate sampling approaches were evaluated at each of three sampling sites. As the primary basis of comparison, a discret...

An analysis of alumni performance: A study of the quality of nursing education.

PubMed

Altuntaş, Serap; Baykal, Ülkü

2017-02-01

The professional performance level of their alumni is one of the quality indicators of educational institutions. Nursing education institutions can use their alumni's performance analysis results to enhance their curricula, eliminate deficiencies, improve the quality of education and graduate more highly qualified nurses. This is a descriptive, cross-sectional and comparative study, which aimed to determine the professional performances of nurses who graduated from the same nursing faculty. The study sample included alumni of Turkey's first nursing faculty, part of the nation's first public university in Istanbul, and their administrative supervisors. The study data were collected using the self-assessment forms of 314 alumni who worked as bedside nurses in 36 Istanbul hospitals, and 314 evaluations by the 195 nurse managers who supervised them. The study's response rate was 82.6%. To collect the study data, the researchers created a performance evaluation form based on the relevant literature. The same form was administered both to the nurse managers and the alumni. The researchers obtained ethical board approval and official permissions from the relevant hospitals to conduct the study. The study data were analyzed by a statistics expert. According to the study results, the alumni's perceptions of themselves as well as the nurse managers' perceptions of the alumni were different from those of the other nurses with undergraduate degrees in terms of professional knowledge, expectations and ideals. The performance evaluation results showed that the alumni evaluated themselves more positively than their managers did. It was determined that there were highly significant differences (p=0.000) between the values provided by the five sub-dimensions of the scale and the total scale. In addition, the performance level was low in the sub-dimension focusing on research, and there was a significant difference in this sub-dimension (p=0.040). The study found that the alumni mainly had better evaluations of their own performances than their nurse managers, and that the research skills of the alumni should be enhanced. Copyright © 2016 Elsevier Ltd. All rights reserved.

On the Performance Evaluation of 3D Reconstruction Techniques from a Sequence of Images

NASA Astrophysics Data System (ADS)

Eid, Ahmed; Farag, Aly

2005-12-01

The performance evaluation of 3D reconstruction techniques is not a simple problem to solve. This is not only due to the increased dimensionality of the problem but also due to the lack of standardized and widely accepted testing methodologies. This paper presents a unified framework for the performance evaluation of different 3D reconstruction techniques. This framework includes a general problem formalization, different measuring criteria, and a classification method as a first step in standardizing the evaluation process. Performance characterization of two standard 3D reconstruction techniques, stereo and space carving, is also presented. The evaluation is performed on the same data set using an image reprojection testing methodology to reduce the dimensionality of the evaluation domain. Also, different measuring strategies are presented and applied to the stereo and space carving techniques. These measuring strategies have shown consistent results in quantifying the performance of these techniques. Additional experiments are performed on the space carving technique to study the effect of the number of input images and the camera pose on its performance.

An integrated evaluation for the performance of clinical engineering department.

PubMed

Yousry, Ahmed M; Ouda, Bassem K; Eldeib, Ayman M

2014-01-01

Performance benchmarking have become a very important component in all successful organizations nowadays that must be used by Clinical Engineering Department (CED) in hospitals. Many researchers identified essential mainstream performance indicators needed to improve the CED's performance. These studies revealed mainstream performance indicators that use the database of a CED to evaluate its performance. In this work, we believe that those indicators are insufficient for hospitals. Additional important indicators should be included to improve the evaluation accuracy. Therefore, we added new indicators: technical/maintenance indicators, economic indicators, intrinsic criticality indicators, basic hospital indicators, equipment acquisition, and safety indicators. Data is collected from 10 hospitals that cover different types of healthcare organizations. We developed a software tool that analyses collected data to provide a score for each CED under evaluation. Our results indicate that there is an average gap of 67% between the CEDs' performance and the ideal target. The reasons for the noncompliance are discussed in order to improve performance of CEDs under evaluation.

Conductor gestures influence evaluations of ensemble performance

PubMed Central

Morrison, Steven J.; Price, Harry E.; Smedley, Eric M.; Meals, Cory D.

2014-01-01

Previous research has found that listener evaluations of ensemble performances vary depending on the expressivity of the conductor’s gestures, even when performances are otherwise identical. It was the purpose of the present study to test whether this effect of visual information was evident in the evaluation of specific aspects of ensemble performance: articulation and dynamics. We constructed a set of 32 music performances that combined auditory and visual information and were designed to feature a high degree of contrast along one of two target characteristics: articulation and dynamics. We paired each of four music excerpts recorded by a chamber ensemble in both a high- and low-contrast condition with video of four conductors demonstrating high- and low-contrast gesture specifically appropriate to either articulation or dynamics. Using one of two equivalent test forms, college music majors and non-majors (N = 285) viewed sixteen 30 s performances and evaluated the quality of the ensemble’s articulation, dynamics, technique, and tempo along with overall expressivity. Results showed significantly higher evaluations for performances featuring high rather than low conducting expressivity regardless of the ensemble’s performance quality. Evaluations for both articulation and dynamics were strongly and positively correlated with evaluations of overall ensemble expressivity. PMID:25104944

Evaluation of DuPont Qualicon Bax System PCR assay for yeast and mold.

PubMed

Wallace, F Morgan; Burns, Frank; Fleck, Lois; Andaloro, Bridget; Farnum, Andrew; Tice, George; Ruebl, Joanne

2010-01-01

Evaluations were conducted to test the performance of the BAX System PCR assay which was certified as Performance Tested Method 010902 for screening yeast and mold in yogurt, corn starch, and milk-based powdered infant formula. Method comparison studies performed on samples with low-level inoculates showed that the BAX System demonstrates a sensitivity equivalent to the U.S. Food and Drug Administration's Bacteriological Analytical Manual culture method, but with a significantly shorter time to obtain results. Tests to evaluate inclusivity and exclusivity returned no false-negative and no false-positive results on a diverse panel of isolates, and tests for lot-to-lot variability and tablet stability demonstrated consistent performance. Ruggedness studies determined that none of the factors examined affected the performance of the assay.

Performance study of a data flow architecture

NASA Technical Reports Server (NTRS)

Adams, George

1985-01-01

Teams of scientists studied data flow concepts, static data flow machine architecture, and the VAL language. Each team mapped its application onto the machine and coded it in VAL. The principal findings of the study were: (1) Five of the seven applications used the full power of the target machine. The galactic simulation and multigrid fluid flow teams found that a significantly smaller version of the machine (16 processing elements) would suffice. (2) A number of machine design parameters including processing element (PE) function unit numbers, array memory size and bandwidth, and routing network capability were found to be crucial for optimal machine performance. (3) The study participants readily acquired VAL programming skills. (4) Participants learned that application-based performance evaluation is a sound method of evaluating new computer architectures, even those that are not fully specified. During the course of the study, participants developed models for using computers to solve numerical problems and for evaluating new architectures. These models form the bases for future evaluation studies.

A modified F-test for evaluating model performance by including both experimental and simulation uncertainties

USDA-ARS?s Scientific Manuscript database

Experimental and simulation uncertainties have not been included in many of the statistics used in assessing agricultural model performance. The objectives of this study were to develop an F-test that can be used to evaluate model performance considering experimental and simulation uncertainties, an...

Performance evaluations of continuous glucose monitoring systems: precision absolute relative deviation is part of the assessment.

PubMed

Obermaier, Karin; Schmelzeisen-Redeker, Günther; Schoemaker, Michael; Klötzer, Hans-Martin; Kirchsteiger, Harald; Eikmeier, Heino; del Re, Luigi

2013-07-01

Even though a Clinical and Laboratory Standards Institute proposal exists on the design of studies and performance criteria for continuous glucose monitoring (CGM) systems, it has not yet led to a consistent evaluation of different systems, as no consensus has been reached on the reference method to evaluate them or on acceptance levels. As a consequence, performance assessment of CGM systems tends to be inconclusive, and a comparison of the outcome of different studies is difficult. Published information and available data (as presented in this issue of Journal of Diabetes Science and Technology by Freckmann and coauthors) are used to assess the suitability of several frequently used methods [International Organization for Standardization, continuous glucose error grid analysis, mean absolute relative deviation (MARD), precision absolute relative deviation (PARD)] when assessing performance of CGM systems in terms of accuracy and precision. The combined use of MARD and PARD seems to allow for better characterization of sensor performance. The use of different quantities for calibration and evaluation, e.g., capillary blood using a blood glucose (BG) meter versus venous blood using a laboratory measurement, introduces an additional error source. Using BG values measured in more or less large intervals as the only reference leads to a significant loss of information in comparison with the continuous sensor signal and possibly to an erroneous estimation of sensor performance during swings. Both can be improved using data from two identical CGM sensors worn by the same patient in parallel. Evaluation of CGM performance studies should follow an identical study design, including sufficient swings in glycemia. At least a part of the study participants should wear two identical CGM sensors in parallel. All data available should be used for evaluation, both by MARD and PARD, a good PARD value being a precondition to trust a good MARD value. Results should be analyzed and presented separately for clinically different categories, e.g., hypoglycemia, exercise, or night and day. © 2013 Diabetes Technology Society.

Advanced Video Analysis Needs for Human Performance Evaluation

NASA Technical Reports Server (NTRS)

Campbell, Paul D.

1994-01-01

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

Effects of task performance, helping, voice, and organizational loyalty on performance appraisal ratings.

PubMed

Whiting, Steven W; Podsakoff, Philip M; Pierce, Jason R

2008-01-01

Despite the fact that several studies have investigated the relationship between organizational citizenship behavior and performance appraisal ratings, the vast majority of these studies have been cross-sectional, correlational investigations conducted in organizational settings that do not allow researchers to establish the causal nature of this relationship. To address this lack of knowledge regarding causality, the authors conducted 2 studies designed to investigate the effects of task performance, helping behavior, voice, and organizational loyalty on performance appraisal evaluations. Findings demonstrated that each of these forms of behavior has significant effects on performance evaluation decisions and suggest that additional attention should be directed at both voice and organizational loyalty as important forms of citizenship behavior aimed at the organization. 2008 APA

Performance perceptions and self-focused attention predict post-event processing after a real-life social performance situation.

PubMed

Helbig-Lang, Sylvia; Poels, Vanja; Lincoln, Tania M

2016-11-01

Cognitive approaches to social anxiety suggest that an excessive brooding about one's performance in a social situation (post-event processing; PEP) is involved in the maintenance of anxiety. To date, most studies investigating PEP were conducted in laboratory settings. The present study sought to replicate previous findings on predictors of PEP after a naturalistic social performance situation. Sixty-five students, who had to give an evaluated presentation for credits, completed measures of trait social anxiety. Immediately after their presentation, participants rated state anxiety and attentional focus during the presentation, and provided an overall evaluation of their performance. One week after the presentation, they rated PEP during the preceding week, and reappraised their performance. Regression analyses demonstrated that the performance ratings after and self-focused attention during the presentation were unique predictors of PEP over and above the effects of trait and state anxiety. There was no evidence that PEP was associated with a biased recall of individual performance evaluations. The results support cognitive theories that emphasize the importance of negative self-perceptions in the development of social anxiety and related processes, and underline self-focused attention and self-evaluative processes as important targets during treatment.

The effects of non-evaluative feedback on drivers' self-evaluation and performance.

PubMed

Dogan, Ebru; Steg, Linda; Delhomme, Patricia; Rothengatter, Talib

2012-03-01

Drivers' tend to overestimate their competences, which may result in risk taking behavior. Providing drivers with feedback has been suggested as one of the solutions to overcome drivers' inaccurate self-evaluations. In practice, many tests and driving simulators provide drivers with non-evaluative feedback, which conveys information on the level of performance but not on what caused the performance. Is this type of feedback indeed effective in reducing self-enhancement biases? The current study aimed to investigate the effect of non-evaluative performance feedback on drivers' self-evaluations using a computerized hazard perception test. A between-subjects design was used with one group receiving feedback on performance in the hazard perception test while the other group not receiving any feedback. The results indicated that drivers had a robust self-enhancement bias in their self-evaluations regardless of the presence of performance feedback and that they systematically estimated their performance to be higher than they actually achieved in the test. Furthermore, they devalued the credibility of the test instead of adjusting their self-evaluations in order to cope with the negative feelings following the failure feedback. We discuss the theoretical and practical implications of these counterproductive effects of non-evaluative feedback. Copyright © 2011 Elsevier Ltd. All rights reserved.

Assessment of Anatomical Knowledge and Core Trauma Competency Vascular Skills.

PubMed

Granite, Guinevere; Pugh, Kristy; Chen, Hegang; Longinaker, Nyaradzo; Garofalo, Evan; Shackelford, Stacy; Shalin, Valerie; Puche, Adam; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin

2018-03-01

Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training, and 12-18 mo later. We hypothesize that residents will better judge their own skill after ASSET than before when compared with evaluator ratings. Forty PGY2-7 surgical residents performed four procedures: axillary artery (AA), brachial artery (BA), femoral artery exposure and control (FA), and lower extremity fasciotomy (FAS) at the three evaluations. Using 5-point Likert scales, surgeons self-assessed their confidence in anatomical understanding and procedure performance after each procedure and evaluators rated each surgeon accordingly. For all the three evaluations, residents consistently rated their anatomical understanding (p < 0.04) and surgical performance (p < 0.03) higher than evaluators for both FA and FAS. Residents rated their anatomical understanding and surgical performance higher (p < 0.005) than evaluators for BA after training and up to 18 mo later. Only for third AA evaluation were there no rating differences. Residents overrate their anatomical understanding and performance abilities for BA, FA, and FAS even after performing the procedures and being debriefed three times in 18 mo.

Examining the effect of goal clarity on faculty performance

NASA Astrophysics Data System (ADS)

Waychal, Pradeep

2018-07-01

Performance of faculty members is the prime factor in the success of any academic organisation and certainly engineering academic organisation. The performance depends on various factors. This study tests our hypothesis, in the context of an Indian engineering college, that goal clarity is one such factor that significantly impacts faculty performance. Our experiment emphasised the importance of goal clarity by screening a relevant movie and by seeking professional goals from the faculty members. After a year, we evaluated the faculty performance using peer evaluation method and triangulated the data with course evaluation by students where faculty member's goal was to be a better teacher, to ensure the trustworthiness of peer evaluation. We found that the performance of faculty, who had goal clarity, was significantly better than the performance of those who did not have goal clarity.

Evaluation of Oral Performance in Outsourced Call Centres: An Exploratory Case Study

ERIC Educational Resources Information Center

Friginal, Eric

2013-01-01

This case study discusses the development and use of an oral performance assessment instrument intended to evaluate Filipino agents' customer service transactions with callers from the United States (US). The design and applications of the instrument were based on a longitudinal, qualitative observation of language training and customer service…

Shifting Practices in Teacher Performance Evaluation: A Qualitative Examination of Administrator Change Readiness

ERIC Educational Resources Information Center

Spina, Nancy; Buckley, Phillip; Puchner, Laurel

2014-01-01

This study examines the perceptions, attitudes and beliefs of administrators and teachers in a Southwestern Illinois School District regarding the recent reforms in teacher performance evaluation. This study uses a qualitative approach and provides data from individual and focus group interviews to determine the extent to which the district is…

AATA AOS evaluation : transfer and on-time performance study : before and after AOS implementation, October 1996 - May 1999

DOT National Transportation Integrated Search

1999-01-01

This study develops, using data before AOS in 1996 and 1997 and after AOS in 1998 and 1999, implementation data on AATAs on-time performance and vehicle-to-vehicle timing of transfers at four major transfer location. Systematic evaluation of on-ti...

The Evaluation of Teachers' Job Performance Based on Total Quality Management (TQM)

ERIC Educational Resources Information Center

Shahmohammadi, Nayereh

2017-01-01

This study aimed to evaluate teachers' job performance based on total quality management (TQM) model. This was a descriptive survey study. The target population consisted of all primary school teachers in Karaj (N = 2917). Using Cochran formula and simple random sampling, 340 participants were selected as sample. A total quality management…

Using Summative and Formative Assessments to Evaluate EFL Teachers' Teaching Performance

ERIC Educational Resources Information Center

Wei, Wei

2015-01-01

Using classroom observations (formative) and student course experience survey results (summative) to evaluate English lecturers' teaching performances is not new in practice, but surprisingly only a few studies have investigated this issue in a higher education context. This study was conducted in an English department of a large university in…

Meta-analysis of the technical performance of an imaging procedure: guidelines and statistical methodology.

PubMed

Huang, Erich P; Wang, Xiao-Feng; Choudhury, Kingshuk Roy; McShane, Lisa M; Gönen, Mithat; Ye, Jingjing; Buckler, Andrew J; Kinahan, Paul E; Reeves, Anthony P; Jackson, Edward F; Guimaraes, Alexander R; Zahlmann, Gudrun

2015-02-01

Medical imaging serves many roles in patient care and the drug approval process, including assessing treatment response and guiding treatment decisions. These roles often involve a quantitative imaging biomarker, an objectively measured characteristic of the underlying anatomic structure or biochemical process derived from medical images. Before a quantitative imaging biomarker is accepted for use in such roles, the imaging procedure to acquire it must undergo evaluation of its technical performance, which entails assessment of performance metrics such as repeatability and reproducibility of the quantitative imaging biomarker. Ideally, this evaluation will involve quantitative summaries of results from multiple studies to overcome limitations due to the typically small sample sizes of technical performance studies and/or to include a broader range of clinical settings and patient populations. This paper is a review of meta-analysis procedures for such an evaluation, including identification of suitable studies, statistical methodology to evaluate and summarize the performance metrics, and complete and transparent reporting of the results. This review addresses challenges typical of meta-analyses of technical performance, particularly small study sizes, which often causes violations of assumptions underlying standard meta-analysis techniques. Alternative approaches to address these difficulties are also presented; simulation studies indicate that they outperform standard techniques when some studies are small. The meta-analysis procedures presented are also applied to actual [18F]-fluorodeoxyglucose positron emission tomography (FDG-PET) test-retest repeatability data for illustrative purposes. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Meta-analysis of the technical performance of an imaging procedure: Guidelines and statistical methodology

PubMed Central

Huang, Erich P; Wang, Xiao-Feng; Choudhury, Kingshuk Roy; McShane, Lisa M; Gönen, Mithat; Ye, Jingjing; Buckler, Andrew J; Kinahan, Paul E; Reeves, Anthony P; Jackson, Edward F; Guimaraes, Alexander R; Zahlmann, Gudrun

2017-01-01

Medical imaging serves many roles in patient care and the drug approval process, including assessing treatment response and guiding treatment decisions. These roles often involve a quantitative imaging biomarker, an objectively measured characteristic of the underlying anatomic structure or biochemical process derived from medical images. Before a quantitative imaging biomarker is accepted for use in such roles, the imaging procedure to acquire it must undergo evaluation of its technical performance, which entails assessment of performance metrics such as repeatability and reproducibility of the quantitative imaging biomarker. Ideally, this evaluation will involve quantitative summaries of results from multiple studies to overcome limitations due to the typically small sample sizes of technical performance studies and/or to include a broader range of clinical settings and patient populations. This paper is a review of meta-analysis procedures for such an evaluation, including identification of suitable studies, statistical methodology to evaluate and summarize the performance metrics, and complete and transparent reporting of the results. This review addresses challenges typical of meta-analyses of technical performance, particularly small study sizes, which often causes violations of assumptions underlying standard meta-analysis techniques. Alternative approaches to address these difficulties are also presented; simulation studies indicate that they outperform standard techniques when some studies are small. The meta-analysis procedures presented are also applied to actual [18F]-fluorodeoxyglucose positron emission tomography (FDG-PET) test–retest repeatability data for illustrative purposes. PMID:24872353

Assessing the validity and reliability of the Malagasy version of Oral Impacts on Daily Performance (OIDP): a cross-sectional study.

PubMed

Razanamihaja, Noeline; Ranivoharilanto, Eva

2017-01-01

Evaluating health needs includes measures of the impact of state of health on the quality of life. This entails evaluating the psychosocial aspects of health. To achieve this, several tools for measuring the quality of life related to oral health have been developed. However, it is vital to evaluate the psychometric properties of these tools so they can be used in a new context and on a new population. The purpose of this study was to evaluate the reliability and validity of the Malagasy version of a questionnaire for studying the impacts of oral-dental health on daily activities (Oral Impacts on Daily Performance), and analyse the interrelations between the scores obtained and the oral health indicators. A cross-sectional study was performed for the transcultural adaptation of the Oral Impacts on Daily Performance questionnaire forward translated and back-translated from English to Malagasy and from Malagasy to English, respectively. The psychometric characteristics of the Malagasy version of the Oral Impacts on Daily Performance were then evaluated in terms of internal reliability, test-retest, and construct, criteria and discriminant validity. Four hundred and six adults responded in face-to-face interviews to the Malagasy version of the Oral Impacts on Daily Performance questionnaire. Nearly 74% of the participants indicated impacts of their oral health on their performance in their daily lives during the 6 months prior to the survey. The activities most affected were: "smiling", "eating" and "sleeping and relaxing". Cronbach's alpha was 0.87. The construct validity was demonstrated by a significant association between the Oral Impacts on Daily Performance scores and the subjective evaluation of oral health ( p <0.001). Discriminant validity was demonstrated by the fact that the Oral Impacts on Daily Performance scores were significantly higher in subjects with more than ten missing teeth, compared to those with fewer than ten missing teeth ( p  < 0.001). The Malagasy version of the Oral Impacts on Daily Performance index is a valid and reliable measure for use in Malagasy adults over 55 years old.

Error Reduction Program. [combustor performance evaluation codes

NASA Technical Reports Server (NTRS)

Syed, S. A.; Chiappetta, L. M.; Gosman, A. D.

1985-01-01

The details of a study to select, incorporate and evaluate the best available finite difference scheme to reduce numerical error in combustor performance evaluation codes are described. The combustor performance computer programs chosen were the two dimensional and three dimensional versions of Pratt & Whitney's TEACH code. The criteria used to select schemes required that the difference equations mirror the properties of the governing differential equation, be more accurate than the current hybrid difference scheme, be stable and economical, be compatible with TEACH codes, use only modest amounts of additional storage, and be relatively simple. The methods of assessment used in the selection process consisted of examination of the difference equation, evaluation of the properties of the coefficient matrix, Taylor series analysis, and performance on model problems. Five schemes from the literature and three schemes developed during the course of the study were evaluated. This effort resulted in the incorporation of a scheme in 3D-TEACH which is usuallly more accurate than the hybrid differencing method and never less accurate.

Partnering to Establish and Study Simulation in International Nursing Education.

PubMed

Garner, Shelby L; Killingsworth, Erin; Raj, Leena

The purpose of this article was to describe an international partnership to establish and study simulation in India. A pilot study was performed to determine interrater reliability among faculty new to simulation when evaluating nursing student competency performance. Interrater reliability was below the ideal agreement level. Findings in this study underscore the need to obtain baseline interrater reliability data before integrating competency evaluation into a simulation program.

Performance Evaluation of the Educational Leader (PEEL): Another Breakthrough in Competency Based Educational Administration.

ERIC Educational Resources Information Center

Metzger, Christa; Lynch, Steven B.

1974-01-01

This paper describes the Performance Evaluation of the Education Leader (PEEL) program, initiated from a study to define the competent school administrator and to develop an instrument to measure administrative competence objectively and accurately. The resulting PEEL materials include the following: (a) "Guidelines for Evaluation: The School…

The Role of Accompaniment Quality in the Evaluation of Solo Instrumental Performance

ERIC Educational Resources Information Center

Springer, D. Gregory; Silvey, Brian A.

2018-01-01

The purpose of this study was to examine the effect of accompaniment quality on the evaluation of solo instrumental performance. Undergraduate instrumental music education majors (N = 71) listened to and evaluated the accuracy and expressivity of six excerpts of Haydn's "Concerto for Trumpet in E-Flat Major," which we created by…

We're all in this together now: group performance feedback to increase classroom team data collection.

PubMed

Pellecchia, Melanie; Connell, James E; Eisenhart, Donald; Kane, Meghan; Schoener, Christine; Turkel, Kimberly; Riley, Megan; Mandell, David S

2011-08-01

This study's primary goal was to evaluate the use of performance feedback procedures delivered to a classroom team to increase daily data collection. Performance feedback (PFB) was delivered to four classroom teams responsible for the daily collection of data representing student performance during prescribed instructional activities. Using a multiple-baseline design, the effects of the team performance-feedback were evaluated for the target student, and for generalization to data collection for all classroom students. A secondary question evaluated if student on-task behavior correlated with increased data collection. Finally, social validity was investigated to evaluate team satisfaction with the PFB intervention. The results demonstrate improved data collection across all four classroom teams for the target student in each classroom and generalization within classrooms to all remaining students. Slight increases in student on-task behavior were observed in three of the four classrooms, and teacher satisfaction ratings were high. Copyright © 2011 Society for the Study of School Psychology. Published by Elsevier Ltd. All rights reserved.

Objective evaluation of acute adverse events and image quality of gadolinium-based contrast agents (gadobutrol and gadobenate dimeglumine) by blinded evaluation. Pilot study.

PubMed

Semelka, Richard C; Hernandes, Mateus de A; Stallings, Clifton G; Castillo, Mauricio

2013-01-01

The purpose was to objectively evaluate a recently FDA-approved gadolinium-based contrast agent (GBCA) in comparison to our standard GBCA for acute adverse events and image quality by blinded evaluation. Evaluation was made of a recently FDA-approved GBCA, gadobutrol (Gadavist; Bayer), in comparison to our standard GBCA, gadobenate dimeglumine (MultiHance; Bracco), in an IRB- and HIPAA-compliant study. Both the imaging technologist and patient were not aware of the brand of the GBCA used. A total of 59 magnetic resonance studies were evaluated (59 patients, 31 men, 28 women, age range of 5-85 years, mean age of 52 years). Twenty-nine studies were performed with gadobutrol (22 abdominal and 7 brain studies), and 30 studies were performed with gadobenate dimeglumine (22 abdominal and 8 brain studies). Assessment was made of acute adverse events focusing on objective observations of vomiting, hives, and moderate and severe reactions. Adequacy of enhancement was rated as poor, fair and good by one of two experienced radiologists who were blinded to the type of agent evaluated. No patient experienced acute adverse events with either agent. The target minor adverse events of vomiting or hives, and moderate and severe reactions were not observed in any patient. Adequacy of enhancement was rated as good for both agents in all patients. Objective, blinded evaluation is feasible and readily performable for the evaluation of GBCAs. This proof-of-concept study showed that both GBCAs evaluated exhibited consistent good image quality and no noteworthy adverse events. Copyright © 2013 Elsevier Inc. All rights reserved.

Using the arthroscopic surgery skill evaluation tool as a pass-fail examination.

PubMed

Koehler, Ryan J; Nicandri, Gregg T

2013-12-04

Examination of arthroscopic skill requires evaluation tools that are valid and reliable with clear criteria for passing. The Arthroscopic Surgery Skill Evaluation Tool was developed as a video-based assessment of technical skill with criteria for passing established by a panel of experts. The purpose of this study was to test the validity and reliability of the Arthroscopic Surgery Skill Evaluation Tool as a pass-fail examination of arthroscopic skill. Twenty-eight residents and two sports medicine faculty members were recorded performing diagnostic knee arthroscopy on a left and right cadaveric specimen in our arthroscopic skills laboratory. Procedure videos were evaluated with use of the Arthroscopic Surgery Skill Evaluation Tool by two raters blind to subject identity. Subjects were considered to pass the Arthroscopic Surgery Skill Evaluation Tool when they attained scores of ≥ 3 on all eight assessment domains. The raters agreed on a pass-fail rating for fifty-five of sixty videos rated with an interclass correlation coefficient value of 0.83. Ten of thirty participants were assigned passing scores by both raters for both diagnostic arthroscopies performed in the laboratory. Receiver operating characteristic analysis demonstrated that logging more than eighty arthroscopic cases or performing more than thirty-five arthroscopic knee cases was predictive of attaining a passing Arthroscopic Surgery Skill Evaluation Tool score on both procedures performed in the laboratory. The Arthroscopic Surgery Skill Evaluation Tool is valid and reliable as a pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. This study demonstrates that the Arthroscopic Surgery Skill Evaluation Tool may be a useful tool for pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. Further study is necessary to determine whether the Arthroscopic Surgery Skill Evaluation Tool can be used for the assessment of multiple arthroscopic procedures and whether it can be used to evaluate arthroscopic procedures performed in the operating room.

Note on evaluating safety performance of road infrastructure to motivate safety competition.

PubMed

Han, Sangjin

2016-01-01

Road infrastructures are usually developed and maintained by governments or public sectors. There is no competitor in the market of their jurisdiction. This monopolic feature discourages road authorities from improving the level of safety with proactive motivation. This study suggests how to apply a principle of competition for roads, in particular by means of performance evaluation. It first discusses why road infrastructure has been slow in safety oriented development and management in respect of its business model. Then it suggests some practical ways of how to promote road safety between road authorities, particularly by evaluating safety performance of road infrastructure. These are summarized as decision of safety performance indicators, classification of spatial boundaries, data collection, evaluation, and reporting. Some consideration points are also discussed to make safety performance evaluation on road infrastructure lead to better road safety management.

Performance evaluation of thin wearing courses through scaled accelerated trafficking.

DOT National Transportation Integrated Search

2014-01-01

The primary objective of this study was to evaluate the permanent deformation (rutting) and fatigue performance of : several thin asphalt concrete wearing courses using a scaled-down accelerated pavement testing device. The accelerated testing : was ...

Performance Evaluation of Thin Wearing Courses Through Scaled Accelerated Trafficking.

DOT National Transportation Integrated Search

2014-01-01

"The primary objective of this study was to evaluate the permanent deformation (rutting) and fatigue performance of : several thin asphalt concrete wearing courses using a scaled-down accelerated pavement testing device. The accelerated testing : was...

Evaluating the performance and safety effectiveness of roundabouts.

DOT National Transportation Integrated Search

2011-12-01

This report documents the evaluation of the performance and safety effectiveness of roundabouts within the State of Michigan. The study began with the identification of roundabouts within Michigan. This was followed by collecting data on the geometri...

An evaluation of improved structural materials in marine piling.

DOT National Transportation Integrated Search

1980-11-01

A study to evaluate the production and field performance of marine piling fabricated with improved structural materials is currently being performed by the Oregon State Highway Division under the sponsorship of the Federal Highway Administration. In ...

Performance Evaluation of Reliable Multicast Protocol for Checkout and Launch Control Systems

NASA Technical Reports Server (NTRS)

Shu, Wei Wennie; Porter, John

2000-01-01

The overall objective of this project is to study reliability and performance of Real Time Critical Network (RTCN) for checkout and launch control systems (CLCS). The major tasks include reliability and performance evaluation of Reliable Multicast (RM) package and fault tolerance analysis and design of dual redundant network architecture.

6- And 8-Year-Olds' Performance Evaluations: Do They Differ between Self And Unknown Others?

ERIC Educational Resources Information Center

Destan, Nesrin; Spiess, Manuela A.; de Bruin, Anique; van Loon, Mariëtte; Roebers, Claudia M.

2017-01-01

The current study investigated kindergarteners and second graders' ability to monitor and evaluate their own and a virtual peer's performance in a paired-associate learning task. Participants provided confidence judgments (CJs) for their own responses and performance-based judgments (judgments provided "after" receiving feedback on their…

Development and Validation of a Clarinet Performance Adjudication Scale

ERIC Educational Resources Information Center

Abeles, Harold F.

1973-01-01

A basic assumption of this study is that there are generally agreed upon performance standards as evidenced by the use of adjudicators for evaluations at contests and festivals. An evaluation instrument was developed to enable raters to measure effectively those aspects of performance that have common standards of proficiency. (Author/RK)

Unrealistic Optimism in the Pursuit of Academic Success

ERIC Educational Resources Information Center

Lewine, Rich; Sommers, Alison A.

2016-01-01

Although the ability to evaluate one's own knowledge and performance is critical to learning, the correlation between students' self-evaluation and actual performance measures is modest at best. In this study we examine the effect of offering extra credit for students' accurate prediction (self-accuracy) of their performance on four exams in two…

Evaluation of background parenchymal enhancement on breast MRI: a systematic review

PubMed Central

Signori, Alessio; Valdora, Francesca; Rossi, Federica; Calabrese, Massimo; Durando, Manuela; Mariscotto, Giovanna; Tagliafico, Alberto

2017-01-01

Objective: To perform a systematic review of the methods used for background parenchymal enhancement (BPE) evaluation on breast MRI. Methods: Studies dealing with BPE assessment on breast MRI were retrieved from major medical libraries independently by four reviewers up to 6 October 2015. The keywords used for database searching are “background parenchymal enhancement”, “parenchymal enhancement”, “MRI” and “breast”. The studies were included if qualitative and/or quantitative methods for BPE assessment were described. Results: Of the 420 studies identified, a total of 52 articles were included in the systematic review. 28 studies performed only a qualitative assessment of BPE, 13 studies performed only a quantitative assessment and 11 studies performed both qualitative and quantitative assessments. A wide heterogeneity was found in the MRI sequences and in the quantitative methods used for BPE assessment. Conclusion: A wide variability exists in the quantitative evaluation of BPE on breast MRI. More studies focused on a reliable and comparable method for quantitative BPE assessment are needed. Advances in knowledge: More studies focused on a quantitative BPE assessment are needed. PMID:27925480

Evaluation of performance, safety, subject acceptance, and compliance of a disposable autoinjector for subcutaneous injections in healthy volunteers.

PubMed

Berteau, Cecile; Schwarzenbach, Florence; Donazzolo, Yves; Latreille, Mathilde; Berube, Julie; Abry, Herve; Cotten, Joël; Feger, Celine; Laurent, Philippe E

2010-10-05

A disposable autoinjector was developed for subcutaneous (SC) self-injection by patients with chronic diseases. To verify its performance and evaluate its acceptance, a clinical study was conducted in healthy volunteers, comparing SC injections performed by subjects using the autoinjector with SC injections performed by nurses using a syringe. This was a randomized, single-center, crossover study comparing SC self-injection using an autoinjector with SC nurse-administered injection using a syringe. Two volumes (0.2 mL and 1 mL) were injected into healthy volunteers. Study objectives included assessment of the accuracy and consistency of the volume injected by the injection systems, and skin reaction and pain associated with the injection. The fluid depot in the SC tissue layer was evaluated by ultrasound. Subject acceptance was evaluated using questionnaires on attitudes and emotions towards the injection technique, and challenged by seeking the subjects' preferred system for a final study injection or future treatment. A total of 960 injections (480 with autoinjector, 480 with syringe) were performed in 40 subjects. There were no significant differences in mean fluid leakage and injected volumes between the systems. Pain associated with the injection was significantly lower with the auto-injector than with the syringe. Local skin reaction at the injection site was overall satisfactory. Injections were appropriately performed by all subjects. At study end, all 40 subjects preferred the autoinjector for a final study injection and for future treatment. This study indicated that the autoinjector used by the subject was similar to a syringe used by a nurse in terms of performance and safety in administering the injections, and better in terms of pain, overall acceptance, and preference.

Technology efficacy in active prosthetic knees for transfemoral amputees: a quantitative evaluation.

PubMed

El-Sayed, Amr M; Hamzaid, Nur Azah; Abu Osman, Noor Azuan

2014-01-01

Several studies have presented technological ensembles of active knee systems for transfemoral prosthesis. Other studies have examined the amputees' gait performance while wearing a specific active prosthesis. This paper combined both insights, that is, a technical examination of the components used, with an evaluation of how these improved the gait of respective users. This study aims to offer a quantitative understanding of the potential enhancement derived from strategic integration of core elements in developing an effective device. The study systematically discussed the current technology in active transfemoral prosthesis with respect to its functional walking performance amongst above-knee amputee users, to evaluate the system's efficacy in producing close-to-normal user performance. The performances of its actuator, sensory system, and control technique that are incorporated in each reported system were evaluated separately and numerical comparisons were conducted based on the percentage of amputees' gait deviation from normal gait profile points. The results identified particular components that contributed closest to normal gait parameters. However, the conclusion is limitedly extendable due to the small number of studies. Thus, more clinical validation of the active prosthetic knee technology is needed to better understand the extent of contribution of each component to the most functional development.

Efficacy of pre-exercise low-level laser therapy on isokinetic muscle performance in individuals with type 2 diabetes mellitus: study protocol for a randomized controlled trial

PubMed Central

2014-01-01

Background Type 2 diabetes, also known non-insulin-dependent diabetes, is the most prevalent type of the disease and involves defects in the secretion and action of insulin. The aim of the proposed study is to evaluate the efficacy of pre-exercise low-level laser therapy (LLLT) on muscle performance of the quadriceps femoris in individuals with type 2 diabetes. Methods/Design A double-blind, randomized, controlled clinical trial will be carried out in two treatment phases. In the first phase, quadriceps muscle performance will be evaluated using an isokinetic dynamometer and the levels of creatine kinase and lactate dehydrogenase (biochemical markers of muscle damage) will be determined. The participants will then be allocated to four LLLT groups through a randomization process using opaque envelopes: Group A (4 Joules), Group B (6 Joules), Group C (8 Joules) and Group D (0 Joules; placebo). Following the administration of LLLT, the participants will be submitted to an isokinetic eccentric muscle fatigue protocol involving the quadriceps muscle bilaterally. Muscle performance and biochemical markers of muscle damage will be evaluated again immediately after as well as 24 and 48 hours after the experimental protocol. One week after the last evaluation the second phase will begin, during which Groups A, B and C will receive the LLLT protocol that achieved the best muscle performance in phase 1 for a period of 4 weeks. At the end of this period, muscle performance will be evaluated again. The protocol for this study is registered with the World Health Organization under Universal Trial Number U1111-1146-7109. Discussion The purpose of this randomized clinical trial is to evaluate the efficacy of pre-exercise LLLT on the performance of the quadriceps muscle (peak torque, total muscle work, maximum power and fatigue index – normalized by body mass) in individuals with DM-2. The study will support the practice of evidence-based to the use of LLLT in improving muscle performance in Individuals with DM-2. Data will be published after the study is completed. PMID:24716713

Efficacy of pre-exercise low-level laser therapy on isokinetic muscle performance in individuals with type 2 diabetes mellitus: study protocol for a randomized controlled trial.

PubMed

Gomes, Cid André Fidelis de Paula; Leal-Junior, Ernesto Cesar Pinto; Biasotto-Gonzalez, Daniela Aparecida; El-Hage, Yasmin; Politti, Fabiano; Gonzalez, Tabajara de Oliveira; Dibai-Filho, Almir Vieira; de Oliveira, Adriano Rodrigues; Frigero, Marcelo; Antonialli, Fernanda Colella; Vanin, Adriane Aver; de Tarso Camillo de Carvalho, Paulo

2014-04-09

Type 2 diabetes, also known non-insulin-dependent diabetes, is the most prevalent type of the disease and involves defects in the secretion and action of insulin. The aim of the proposed study is to evaluate the efficacy of pre-exercise low-level laser therapy (LLLT) on muscle performance of the quadriceps femoris in individuals with type 2 diabetes. A double-blind, randomized, controlled clinical trial will be carried out in two treatment phases. In the first phase, quadriceps muscle performance will be evaluated using an isokinetic dynamometer and the levels of creatine kinase and lactate dehydrogenase (biochemical markers of muscle damage) will be determined. The participants will then be allocated to four LLLT groups through a randomization process using opaque envelopes: Group A (4 Joules), Group B (6 Joules), Group C (8 Joules) and Group D (0 Joules; placebo). Following the administration of LLLT, the participants will be submitted to an isokinetic eccentric muscle fatigue protocol involving the quadriceps muscle bilaterally. Muscle performance and biochemical markers of muscle damage will be evaluated again immediately after as well as 24 and 48 hours after the experimental protocol. One week after the last evaluation the second phase will begin, during which Groups A, B and C will receive the LLLT protocol that achieved the best muscle performance in phase 1 for a period of 4 weeks. At the end of this period, muscle performance will be evaluated again. The protocol for this study is registered with the World Health Organization under Universal Trial Number U1111-1146-7109. The purpose of this randomized clinical trial is to evaluate the efficacy of pre-exercise LLLT on the performance of the quadriceps muscle (peak torque, total muscle work, maximum power and fatigue index - normalized by body mass) in individuals with DM-2. The study will support the practice of evidence-based to the use of LLLT in improving muscle performance in Individuals with DM-2. Data will be published after the study is completed.

How to perform a critically appraised topic: part 2, appraise, evaluate, generate, and recommend.

PubMed

Kelly, Aine Marie; Cronin, Paul

2011-11-01

This article continues the discussion of a critically appraised topic started in Part 1. A critically appraised topic is a practical tool for learning and applying critical appraisal skills. This article outlines steps 4-7 involved in performing a critically appraised topic for studies of diagnostic tests: Appraise, Appraise the literature; Evaluate, evaluate the strength of the evidence from the literature; Generate, generate graphs of conditional probability; and Recommend, draw conclusions and make recommendations. For steps 4-7 of performing a critically appraised topic, the main study results are summarized and translated into clinically useful measures of accuracy, efficacy, or risk.

How Identification Facilitates Effective Learning: The Evaluation of Generic versus Localized Professionalization Training

ERIC Educational Resources Information Center

Bjerregaard, Kirstien; Haslam, S. Alexander; Morton, Thomas

2016-01-01

Worldwide, organizations are keen to ensure that they achieve a performance return from the large investment they make in employee training. This study examines the way in which workgroup identification facilitates trainees' motivation to transfer learning into workplace performance. A 2 × 2 longitudinal study evaluated the effects of a new…

An Evaluative Study of the Nurse Education Program. Research Report Number 82-1.

ERIC Educational Resources Information Center

Capoor, Madan

An evaluation of the nurse education program at Middlesex County College (MCC) was conducted in response to an increasing dropout rate and a decline in the passing rate of program graduates on the Licensing Board Examination (LBE). The study focused on the relationship between student background and performance and between student performance in…

Evaluating Language Environment Analysis System Performance for Chinese: A Pilot Study in Shanghai

ERIC Educational Resources Information Center

Gilkerson, Jill; Zhang, Yiwen; Xu, Dongxin; Richards, Jeffrey A.; Xu, Xiaojuan; Jiang, Fan; Harnsberger, James; Topping, Keith

2015-01-01

Purpose: The purpose of this study was to evaluate performance of the Language Environment Analysis (LENA) automated language-analysis system for the Chinese Shanghai dialect and Mandarin (SDM) languages. Method: Volunteer parents of 22 children aged 3-23 months were recruited in Shanghai. Families provided daylong in-home audio recordings using…

DETERMINING COARSE PARTICULATE MATTER CONCENTRATIONS: A PERFORMANCE EVALUATION OF CANDIDATE METHODOLOGIES - STUDY DESIGN AND RESULTS FROM THE RTP EQUIPMENT SHAKEDOWN

EPA Science Inventory

The main objective of this study is to evaluate the performance of candidate sampling methods for potential use as a Federal Reference Method (FRM) capable of providing an estimate of coarse particle (PMc: particulate matter with an aerodynamic diameter between 2.5 um and 10 um...

The Evaluation of Hospital Performance in Iran: A Systematic Review Article

PubMed Central

BAHADORI, Mohammadkarim; IZADI, Ahmad Reza; GHARDASHI, Fatemeh; RAVANGARD, Ramin; HOSSEINI, Seyed Mojtaba

2016-01-01

Background: This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. Methods: In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. Results: The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Conclusion: Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them. PMID:27516991

The Evaluation of Hospital Performance in Iran: A Systematic Review Article.

PubMed

Bahadori, Mohammadkarim; Izadi, Ahmad Reza; Ghardashi, Fatemeh; Ravangard, Ramin; Hosseini, Seyed Mojtaba

2016-07-01

This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them.

Accuracy Evaluation of 19 Blood Glucose Monitoring Systems Manufactured in the Asia-Pacific Region: A Multicenter Study.

PubMed

Yu-Fei, Wang; Wei-Ping, Jia; Ming-Hsun, Wu; Miao-O, Chien; Ming-Chang, Hsieh; Chi-Pin, Wang; Ming-Shih, Lee

2017-09-01

System accuracy of current blood glucose monitors (BGMs) in the market has already been evaluated extensively, yet mostly focused on European and North American manufacturers. Data on BGMs manufactured in the Asia-Pacific region remain to be established. In this study, we sought to assess the accuracy performance of 19 BGMs manufactured in the Asia-pacific region. A total of 19 BGMs were obtained from local pharmacies in China. The study was conducted at three hospitals located in the Asia-Pacific region. Measurement results of each system were compared with results of the reference instrument (YSI 2300 PLUS Glucose Analyzer), and accuracy evaluation was performed in accordance to the ISO 15197:2003 and updated 2015 guidelines. Radar plots, which is a new method, are described herein to visualize the analytical performance of the 19 BGMs evaluated. Consensus error grid is a tool for evaluating the clinical significance of the results. The 19 BGMs resulted in a satisfaction rate between 83.5% and 100.0% within ISO 15197:2003 error limits, and between 71.3% and 100.0% within EN ISO 15197:2015 (ISO 15197:2013) error limits. Of the 19 BGMs evaluated, 12 met the minimal accuracy requirement of the ISO 15197:2003 standard, whereas only 4 met the tighter EN ISO 15197:2015 (ISO 15197:2013) requirements. Accuracy evaluation of BGMs should be performed regularly to maximize patient safety.

An experimental study on CHVE's performance evaluation.

PubMed

Paiva, Paulo V F; Machado, Liliane S; Oliveira, Jauvane C

2012-01-01

Virtual reality-based training simulators, with collaborative capabilities, are known to improve the way users interact with one another while learning or improving skills on a given medical procedure. Performance evaluation of Collaborative Haptic Virtual Environments (CHVE) allows us to understand how such systems can work in the Internet, as well as the requirements for multisensorial and real-time data. This work discloses new performance evaluation results for the collaborative module of the CyberMed VR framework.

Malaria rapid diagnostic test as point-of-care test: study protocol for evaluating the VIKIA Malaria Ag Pf/Pan.

PubMed

Kim, Saorin; Nhem, Sina; Dourng, Dany; Ménard, Didier

2015-03-14

Malaria rapid diagnostic tests (RDTs) are generally considered as point-of-care tests. However, most of the studies assessing the performance of malaria RDTs are conducted by research teams that are not representative of the classical end-users, who are typically unskilled in traditional laboratory techniques for diagnosing malaria. To evaluate the performance of a malaria RDT by end-users in a malaria-endemic area, a study protocol was designed and the VIKIA Malaria Ag Pf/Pan test, previously evaluated in 2013, was re-evaluated by representative end-users. Twenty end-users with four different profiles in seven communes in Kampot Province (Cambodia) were selected. A set of 20 calibrated aliquots, including negative samples, low positive samples (200 parasites/μL of Plasmodium falciparum and Plasmodium vivax) and high positive samples (2,000 parasites/μL of P. falciparum and P. vivax) was used. Testing was performed directly by the end-users without any practical training on the VIKIA Malaria Ag Pf/Pan kit. All results obtained by the end-users were consistent with the expected results, except for the low positive (200 parasites/μL) P. vivax aliquot (35% of concordant results). No significant difference was observed between the different end-users. End-user interviews evaluating ease-of-use and ease-of-reading of the VIKIA Malaria Ag Pf/Pan kit recorded 159 positive answers and only one negative answer. Out of 20 end-users, only one considered the test was not easy to perform with the support of the quick guide. The data presented in this study clearly demonstrate that the performance of the VIKIA Malaria Ag Pf/Pan test when performed by traditional end-users in field conditions is similar to that obtained by a research team and that this RDT can be considered as a point-of-care tool/assay. Furthermore, the protocol designed for this study could be used systematically in parallel to conventional evaluation studies to determine the performance of malaria RDTs in field conditions.

Human factors phase III : effects of train control technology on operator performance

DOT National Transportation Integrated Search

2005-01-01

This report describes a study evaluating the effects of train control technology on locomotive engineer performance. Several types : of train control systems were evaluated: partial automation (cruise control and programmed stop) and full automation ...

Evaluating the performance and safety effectiveness of roundabouts : appendix.

DOT National Transportation Integrated Search

2011-12-01

This report documents the evaluation of the performance and safety effectiveness of roundabouts within the State of Michigan. The study began with the identification of roundabouts within Michigan. This was followed by collecting data on the geometri...

Human factors phase III : effects of train control technology on operator performance.

DOT National Transportation Integrated Search

2005-01-31

This report describes a study evaluating the effects of train control technology on locomotive engineer performance. Several types of train control systems were evaluated: partial automation (cruise control and programmed stop) and full automation we...

Evaluation of full depth asphaltic concrete pavements : final report.

DOT National Transportation Integrated Search

1982-10-01

the aim of this study was to evaluate the full depth asphaltic concrete pavement design concept by observing the performance characteristics of two 13-inch pavements constructed in 1970. Pavement performance measurements, over an 11-year period, incl...

DOTD evaluates and integrates pavement management system performance to yield savings : [fact sheet].

DOT National Transportation Integrated Search

2015-07-01

A research study was initiated by the Louisiana Department of Transportation and : Development (DOTD) in conjunction with the Federal Highway Administration : (FHWA) to evaluate the overall performance and e ectiveness of DOTDs : Pavement Manag...

Performance evaluation of the Sysmex(®) XP-300 in an oncology setting: evaluation and comparison of hematological parameters with the Sysmex(®) XN-3000.

PubMed

van Dievoet, M A; Louagie, H; Ghys, T

2016-10-01

The Sysmex XP-300(®) (XP-300) is a new, fully automated hematology analyzer, designed to generate complete blood counts (CBC) with 3-part differential. In our study, the XP-300 was evaluated as a point-of-care (POC) analyzer in an oncology setting. In which blood samples from patients with different pathologies and treatments, affecting hematopoiesis, were analyzed. Performance was evaluated according to the International Council for Standardization in Haematology (ICSH) guidelines and CLSI protocol H20-A2 . Beside precision, linearity and carry-over, a comparison study with the Sysmex(®) XN-3000 (XN-3000) and a manual reference leukocyte differential was performed. Flagging performance was also evaluated. XP-300 showed excellent precision and linearity results. For within- and between-run precision, the criteria, according to Ricos et al. , were met for all parameters tested, except for platelets in the low level. Less than or equal to 0.5% carry-over was seen for all parameters tested. Comparison studies showed an acceptable correlation with both XN-3000 and the manual reference leukocyte count. A suboptimal flagging performance was demonstrated. In the context of diagnosing cytopenia due to myelosuppressing agents or leukocytosis due to infection, the XP-300 showed good analytical performance. However, in the thrombocytopenic range, precision was suboptimal. In follow-up of hematological malignancies with the occurrence of abnormal cells, we advise verification with a more advanced analyzer or with microscopic review, although further studies with a higher prevalence of abnormal cells are needed. © 2016 John Wiley & Sons Ltd.

Advanced controls for airbreathing engines, volume 3: Allison gas turbine

NASA Technical Reports Server (NTRS)

Bough, R. M.

1993-01-01

The application of advanced control concepts to airbreathing engines may yield significant improvements in aircraft/engine performance and operability. Screening studies of advanced control concepts for airbreathing engines were conducted by three major domestic aircraft engine manufacturers to determine the potential impact of concepts on turbine engine performance and operability. The purpose of the studies was to identify concepts which offered high potential yet may incur high research and development risk. A target suite of proposed advanced control concepts was formulated and evaluated in a two-phase study to quantify each concept's impact on desired engine characteristics. To aid in the evaluation specific aircraft/engine combinations were considered: a Military High Performance Fighter mission, a High Speed Civil Transport mission, and a Civil Tiltrotor mission. Each of the advanced control concepts considered in the study are defined and described. The concept potential impact on engine performance was determined. Relevant figures of merit on which to evaluate the concepts are determined. Finally, the concepts are ranked with respect to the target aircraft/engine missions. A final report describing the screening studies was prepared by each engine manufacturer. Volume 3 of these reports describes the studies performed by the Allison Gas Turbine Division.

Advanced control for airbreathing engines, volume 1: Pratt and Whitney

NASA Technical Reports Server (NTRS)

Ralph, J. A.

1993-01-01

The application of advanced control concepts to air breathing engines may yield significant improvements in aircraft/engine performance and operability. Screening studies of advanced control concepts for air breathing engines were conducted by three major domestic aircraft engine manufacturers to determine the potential impact of concepts on turbine engine performance and operability. The purpose of the studies was to identify concepts which offered high potential yet may incur high research and development risk. A target suite of proposed advanced control concepts was formulated and evaluated in a two phase study to quantify each concept's impact on desired engine characteristics. To aid in the evaluation specific aircraft/engine combinations were considered: a Military High Performance Fighter mission, a High Speed Civil Transport mission, and a Civil Tiltrotor mission. Each of the advanced control concepts considered in the study are defined and described. The concept potential impact on engine performance was determined. Relevant figures of merit on which to evaluate the concepts are determined. Finally, the concepts are ranked with respect to the target aircraft/engine missions. A final report describing the screening studies was prepared by each engine manufacturer. Volume 1 of these reports describes the studies performed by Pratt & Whitney.

Advanced control for airbreathing engines, volume 2: General Electric aircraft engines

NASA Technical Reports Server (NTRS)

Bansal, Indar

1993-01-01

The application of advanced control concepts to air breathing engines may yield significant improvements in aircraft/engine performance and operability. Screening studies of advanced control concepts for air breathing engines were conducted by three major domestic aircraft engine manufacturers to determine the potential impact of concepts on turbine engine performance and operability. The purpose of the studies was to identify concepts which offered high potential yet may incur high research and development risk. A target suite of proposed advanced control concepts was formulated and evaluated in a two phase study to quantify each concept's impact on desired engine characteristics. To aid in the evaluation specific aircraft/engine combinations were considered: a Military High Performance Fighter mission, a High Speed Civil Transport mission, and a Civil Tiltrotor mission. Each of the advanced control concepts considered in the study are defined and described. The concept potential impact on engine performance was determined. Relevant figures of merit on which to evaluate the concepts are determined. Finally, the concepts are ranked with respect to the target aircraft/engine missions. A final report describing the screening studies was prepared by each engine manufacturer. Volume 2 of these reports describes the studies performed by GE Aircraft Engines.

Factors affecting construction performance: exploratory factor analysis

NASA Astrophysics Data System (ADS)

Soewin, E.; Chinda, T.

2018-04-01

The present work attempts to develop a multidimensional performance evaluation framework for a construction company by considering all relevant measures of performance. Based on the previous studies, this study hypothesizes nine key factors, with a total of 57 associated items. The hypothesized factors, with their associated items, are then used to develop questionnaire survey to gather data. The exploratory factor analysis (EFA) was applied to the collected data which gave rise 10 factors with 57 items affecting construction performance. The findings further reveal that the items constituting ten key performance factors (KPIs) namely; 1) Time, 2) Cost, 3) Quality, 4) Safety & Health, 5) Internal Stakeholder, 6) External Stakeholder, 7) Client Satisfaction, 8) Financial Performance, 9) Environment, and 10) Information, Technology & Innovation. The analysis helps to develop multi-dimensional performance evaluation framework for an effective measurement of the construction performance. The 10 key performance factors can be broadly categorized into economic aspect, social aspect, environmental aspect, and technology aspects. It is important to understand a multi-dimension performance evaluation framework by including all key factors affecting the construction performance of a company, so that the management level can effectively plan to implement an effective performance development plan to match with the mission and vision of the company.

Clinical Performance Evaluations of Third-Year Medical Students and Association With Student and Evaluator Gender.

PubMed

Riese, Alison; Rappaport, Leah; Alverson, Brian; Park, Sangshin; Rockney, Randal M

2017-06-01

Clinical performance evaluations are major components of medical school clerkship grades. But are they sufficiently objective? This study aimed to determine whether student and evaluator gender is associated with assessment of overall clinical performance. This was a retrospective analysis of 4,272 core clerkship clinical performance evaluations by 829 evaluators of 155 third-year students, within the Alpert Medical School grading database for the 2013-2014 academic year. Overall clinical performance, assessed on a three-point scale (meets expectations, above expectations, exceptional), was extracted from each evaluation, as well as evaluator gender, age, training level, department, student gender and age, and length of observation time. Hierarchical ordinal regression modeling was conducted to account for clustering of evaluations. Female students were more likely to receive a better grade than males (adjusted odds ratio [AOR] 1.30, 95% confidence interval [CI] 1.13-1.50), and female evaluators awarded lower grades than males (AOR 0.72, 95% CI 0.55-0.93), adjusting for department, observation time, and student and evaluator age. The interaction between student and evaluator gender was significant (P = .03), with female evaluators assigning higher grades to female students, while male evaluators' grading did not differ by student gender. Students who spent a short time with evaluators were also more likely to get a lower grade. A one-year examination of all third-year clerkship clinical performance evaluations at a single institution revealed that male and female evaluators rated male and female students differently, even when accounting for other measured variables.

Performance evaluation of extension education centers in universities based on the balanced scorecard.

PubMed

Wu, Hung-Yi; Lin, Yi-Kuei; Chang, Chi-Hsiang

2011-02-01

This study aims at developing a set of appropriate performance evaluation indices mainly based on balanced scorecard (BSC) for extension education centers in universities by utilizing multiple criteria decision making (MCDM). Through literature reviews and experts who have real practical experiences in extension education, adequate performance evaluation indices have been selected and then utilizing the decision making trial and evaluation laboratory (DEMATEL) and analytic network process (ANP), respectively, further establishes the causality between the four BSC perspectives as well as the relative weights between evaluation indices. According to this previous result, an empirical analysis of the performance evaluation of extension education centers of three universities at Taoyuan County in Taiwan is illustrated by applying VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR). From the analysis results, it indicates that "Learning and growth" is the significant influential factor and it would affect the other three perspectives. In addition, it is discovered that "Internal process" perspective as well as "Financial" perspective play important roles in the performance evaluation of extension education centers. The top three key performance indices are "After-sales service", "Turnover volume", and "Net income". The proposed evaluation model could be considered as a reference for extension education centers in universities to prioritize their improvements on the key performance indices after performing VIKOR analyses. 2010 Elsevier Ltd. All rights reserved.

Computer-aided detection (CAD) of breast cancer on full field digital and screening film mammograms

NASA Astrophysics Data System (ADS)

Sun, Xuejun; Qian, Wei; Song, Xiaoshan; Qian, Yuyan; Song, Dansheng; Clark, Robert A.

2003-05-01

Full-field digital mammography (FFDM) as a new breast imaging modality has potential to detect more breast cancers or to detect them at smaller sizes and earlier stages compared with screening film mammography (SFM). However, its performance needs verification, and it would pose new problems for the development of CAD methods for breast cancer detection and diagnosis. Performance evaluation of CAD systems on FFDM and SFM has been conducted in this study, respectively. First, an adaptive CAD system employing a series of advanced modules has been developed on FFDM. Second, a standardization approach has been developed to make the CAD system independent of characteristics of digitizer or imaging modalities for mammography. CAD systems developed previously for SFM and developed in this study for FFDM have been evaluated on FFDM and SFM images without and with standardization, respectively, to examine the performance improvement of the CAD system developed in this study. Computerized free-response receiver operating characteristic (FROC) analysis has been adopted as performance evaluation method. Compared with previous one, the CAD system developed in this study demonstrated significantly performance improvements. However, the comparison results have shown that the performances of final CAD system in this study are not significantly different on FFDM and on SFM after standardization. It needs further study on the assessment of CAD system performance on FFDM and SFM modalities.

Evaluating Web-Based Learning and Instruction (WBLI): A Case Study and Framework for Evaluation.

ERIC Educational Resources Information Center

Michalski, Greg V.

The purpose of this paper is to suggest an alternative approach to perform relevant and useful evaluations of Web-based learning and instruction (WBLI) that will accommodate performance and keep pace with the growing capabilities of the Internet. Discussion includes the advantages of WBLI, multimedia and streaming use in WBLI, building the…

The Effects of Band Labels on Evaluators' Judgments of Musical Performance

ERIC Educational Resources Information Center

Silvey, Brian A.

2009-01-01

This study investigates the effects of band labels on evaluators' judgments of musical performance. High school concert band members (n = 72), wind ensemble members ( n = 77), and band directors (n = 8) were randomly assigned to a band label or no label group. Only the band label group was given evaluation forms that specified the group playing…

Evaluating Web 2.0 Technologies in Higher Education Using Students' Perceptions and Performance

ERIC Educational Resources Information Center

Karvounidis, T.; Chimos, K.; Bersimis, S.; Douligeris, C.

2014-01-01

In this work, Web 2.0 technologies in higher education are evaluated using students' perceptions, satisfaction, performance and behaviour. The study evaluates the Web 2.0 tools as stand-alone entities as well in terms of their cross-operability and integration (confluence) to synergistic contributions towards the enhancement of student…

Teacher Evaluation: Organizational Maintenance Versus Stimulation of Improved Teaching Performance. The New Mexico Principalship Study.

ERIC Educational Resources Information Center

Wood, Carolyn J.; Pohland, Paul A.

Teacher evaluation procedures appear to focus on organizational maintenance aspects more heavily than on helping teachers improve their teaching performance. This conclusion was reached after a content analysis of teacher evaluation instruments used in New Mexico schools. Items focusing on the instructional role constituted only 28% of the items…

Evaluating the Effect of Learning Style and Student Background on Self-Assessment Accuracy

ERIC Educational Resources Information Center

Alaoutinen, Satu

2012-01-01

This study evaluates a new taxonomy-based self-assessment scale and examines factors that affect assessment accuracy and course performance. The scale is based on Bloom's Revised Taxonomy and is evaluated by comparing students' self-assessment results with course performance in a programming course. Correlation has been used to reveal possible…

To twist, roll, stroke or poke? A study of input devices for menu navigation in the cockpit.

PubMed

Stanton, Neville A; Harvey, Catherine; Plant, Katherine L; Bolton, Luke

2013-01-01

Modern interfaces within the aircraft cockpit integrate many flight management system (FMS) functions into a single system. The success of a user's interaction with an interface depends upon the optimisation between the input device, tasks and environment within which the system is used. In this study, four input devices were evaluated using a range of Human Factors methods, in order to assess aspects of usability including task interaction times, error rates, workload, subjective usability and physical discomfort. The performance of the four input devices was compared using a holistic approach and the findings showed that no single input device produced consistently high performance scores across all of the variables evaluated. The touch screen produced the highest number of 'best' scores; however, discomfort ratings for this device were high, suggesting that it is not an ideal solution as both physical and cognitive aspects of performance must be accounted for in design. This study evaluated four input devices for control of a screen-based flight management system. A holistic approach was used to evaluate both cognitive and physical performance. Performance varied across the dependent variables and between the devices; however, the touch screen produced the largest number of 'best' scores.

Foster youth evaluate the performance of group home services in California.

PubMed

Green, Rex S; Ellis, Peter T

2008-05-01

In 2003 foster youth employed by a foster youth advocacy organization suggested that an evaluation of group home services to foster youth be conducted in Alameda County, California. This report presents the development and conduct of this evaluation study; how funding was obtained; and how foster youth were hired, trained, and employed to produce a timely and informative evaluation of the performance of 32 group homes where some of the foster youth formerly resided. The results of the study are described in another paper. This report contributes to evaluation practice in the newly emerging field of youth-led evaluations. The achievements of this project in utilizing group home clients to evaluate services with which they were familiar may stimulate other evaluators to develop similar projects, thereby enriching the development of our youth and promoting more informative evaluation findings.

Performance evaluation methodology for historical document image binarization.

PubMed

Ntirogiannis, Konstantinos; Gatos, Basilis; Pratikakis, Ioannis

2013-02-01

Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization evaluation methodology for historical handwritten/machine-printed document images. In the proposed evaluation scheme, the recall and precision evaluation measures are properly modified using a weighting scheme that diminishes any potential evaluation bias. Additional performance metrics of the proposed evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based evaluation measures demonstrate the validity of the proposed evaluation scheme.

The Relationship Between Core Members' Social Capital and Perceived and Externally Evaluated Prestige and Cooperation Among HIV/AIDS-Related Civil Society Organizations in China.

PubMed

Wang, Danni; Xu, Xiaoru; Mei, Guangliang; Ma, Ying; Chen, Ren; Qin, Xia; Hu, Zhi

2017-03-01

The purpose of this study was to investigate whether the core members' social capital was associated with individually perceived and externally evaluated prestige and cooperation among the HIV/AIDS-related civil society organizations (CSOs). To accomplish this, a cross-sectional study using multistage sampling was carried out in eight provinces of China. Data were collected from the 327 core members via questionnaires and self-evaluated performance of the respondents were evaluated and measured. The interviews were conducted with all core members and the supervisory staff of the local Centers for Disease Control and Prevention. Multivariate logistic regression analysis indicated that social support (adjusted odds ratio [a OR] = 1.87) and organizational commitment (a OR = 1.57) were significantly associated with a higher odds of prestige performance in self-evaluation. Furthermore, social support (a OR = 1.65), trust (a OR = 1.33), and organizational commitment (a OR = 1.52) were significantly correlated with cooperation performance. Trust was positively associated with the cooperation performance on external evaluation. These findings may provide a new perspective on challenges that the CSOs face in response to a growing HIV/AIDS epidemic in China. Social capital may increase performance and accelerate organizational growth, ultimately improving HIV/AIDS prevention and care.

Effect of shoe type on descending a curb.

PubMed

George, Juff; Heller, Michelle; Kuzel, Michael

2012-01-01

The aim of this study was to evaluate the effect of shoe type on the performance of women during curb descent. Performance during curb stepping may be explained by biomechanical research that has evaluated the kinematics of overground walking and stair ascent and descent. Studies have reported that women exhibit performance differences when wearing high heels, flip flops and sneakers during overground walking and stair ascent and descent. Thus, in addition to features of the curb, the type of shoe being worn may also affect performance. Although several studies have investigated curb stepping, no known studies have investigated the effects of different types of footwear on curb descent performance. This research was conducted in a real-world environment where participants wore three different types of shoes and performed a series of activities that involved curb stepping. The subjects were videotaped while descending a curb, allowing for observation of changes in gait parameters. Results of this study indicate that wearing high heels leads to performance differences as compared to wearing flip flops or sneakers.

Study to perform preliminary experiments to evaluate particle generation and characterization techniques for zero-gravity cloud physics experiments

NASA Technical Reports Server (NTRS)

Katz, U.

1982-01-01

Methods of particle generation and characterization with regard to their applicability for experiments requiring cloud condensation nuclei (CCN) of specified properties were investigated. Since aerosol characterization is a prerequisite to assessing performance of particle generation equipment, techniques for characterizing aerosol were evaluated. Aerosol generation is discussed, and atomizer and photolytic generators including preparation of hydrosols (used with atomizers) and the evaluation of a flight version of an atomizer are studied.

A model for evaluating the social performance of construction waste management

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yuan Hongping, E-mail: hpyuan2005@gmail.com

Highlights: Black-Right-Pointing-Pointer Scant attention is paid to social performance of construction waste management (CWM). Black-Right-Pointing-Pointer We develop a model for assessing the social performance of CWM. Black-Right-Pointing-Pointer With the model, the social performance of CWM can be quantitatively simulated. - Abstract: It has been determined by existing literature that a lot of research efforts have been made to the economic performance of construction waste management (CWM), but less attention is paid to investigation of the social performance of CWM. This study therefore attempts to develop a model for quantitatively evaluating the social performance of CWM by using a system dynamicsmore » (SD) approach. Firstly, major variables affecting the social performance of CWM are identified and a holistic system for assessing the social performance of CWM is formulated in line with feedback relationships underlying these variables. The developed system is then converted into a SD model through the software iThink. An empirical case study is finally conducted to demonstrate application of the model. Results of model validation indicate that the model is robust and reasonable to reflect the situation of the real system under study. Findings of the case study offer helpful insights into effectively promoting the social performance of CWM of the project investigated. Furthermore, the model exhibits great potential to function as an experimental platform for dynamically evaluating effects of management measures on improving the social performance of CWM of construction projects.« less

Mindfulness, burnout, and effects on performance evaluations in internal medicine residents

PubMed Central

Braun, Sarah E; Auerbach, Stephen M; Rybarczyk, Bruce; Lee, Bennett; Call, Stephanie

2017-01-01

Purpose Burnout has been documented at high levels in medical residents with negative effects on performance. Some dispositional qualities, like mindfulness, may protect against burnout. The purpose of the present study was to assess burnout prevalence among internal medicine residents at a single institution, examine the relationship between mindfulness and burnout, and provide preliminary findings on the relation between burnout and performance evaluations in internal medicine residents. Methods Residents (n = 38) completed validated measures of burnout at three time points separated by 2 months and a validated measure of dispositional mindfulness at baseline. Program director end-of-year performance evaluations were also obtained on 22 milestones used to evaluate internal medicine resident performance; notably, these milestones have not yet been validated for research purposes; therefore, the investigation here is exploratory. Results Overall, 71.1% (n = 27) of the residents met criteria for burnout during the study. Lower scores on the “acting with awareness” facet of dispositional mindfulness significantly predicted meeting burnout criteria χ2(5) = 11.88, p = 0.04. Lastly, meeting burnout criteria significantly predicted performance on three of the performance milestones, with positive effects on milestones from the “system-based practices” and “professionalism” domains and negative effects on a milestone from the “patient care” domain. Conclusion Burnout rates were high in this sample of internal medicine residents and rates were consistent with other reports of burnout during medical residency. Dispositional mindfulness was supported as a protective factor against burnout. Importantly, results from the exploratory investigation of the relationship between burnout and resident evaluations suggested that burnout may improve performance on some domains of resident evaluations while compromising performance on other domains. Implications and directions for future research are discussed. PMID:28860889

Mindfulness, burnout, and effects on performance evaluations in internal medicine residents.

PubMed

Braun, Sarah E; Auerbach, Stephen M; Rybarczyk, Bruce; Lee, Bennett; Call, Stephanie

2017-01-01

Burnout has been documented at high levels in medical residents with negative effects on performance. Some dispositional qualities, like mindfulness, may protect against burnout. The purpose of the present study was to assess burnout prevalence among internal medicine residents at a single institution, examine the relationship between mindfulness and burnout, and provide preliminary findings on the relation between burnout and performance evaluations in internal medicine residents. Residents (n = 38) completed validated measures of burnout at three time points separated by 2 months and a validated measure of dispositional mindfulness at baseline. Program director end-of-year performance evaluations were also obtained on 22 milestones used to evaluate internal medicine resident performance; notably, these milestones have not yet been validated for research purposes; therefore, the investigation here is exploratory. Overall, 71.1% (n = 27) of the residents met criteria for burnout during the study. Lower scores on the "acting with awareness" facet of dispositional mindfulness significantly predicted meeting burnout criteria χ 2 (5) = 11.88, p = 0.04. Lastly, meeting burnout criteria significantly predicted performance on three of the performance milestones, with positive effects on milestones from the "system-based practices" and "professionalism" domains and negative effects on a milestone from the "patient care" domain. Burnout rates were high in this sample of internal medicine residents and rates were consistent with other reports of burnout during medical residency. Dispositional mindfulness was supported as a protective factor against burnout. Importantly, results from the exploratory investigation of the relationship between burnout and resident evaluations suggested that burnout may improve performance on some domains of resident evaluations while compromising performance on other domains. Implications and directions for future research are discussed.

Student performance and course evaluations before and after use of the Classroom Performance System ™ in a third-year veterinary radiology course.

PubMed

Hecht, Silke; Adams, W H; Cunningham, M A; Lane, I F; Howell, N E

2013-01-01

Effective teaching of veterinary radiology can be challenging in a traditional classroom environment. Audience response systems, colloquially known as "clickers," provide a means of encouraging student interaction. The purpose of this study was to compare student performance and course evaluations before and after using the Classroom Performance System™ in the third-year (fifth semester) didactic radiology course at the University of Tennessee College of Veterinary Medicine. Overall student performance was assessed by comparing median numeric final course grades (%) between years without and with use of the Classroom Performance System™. Grades of students were determined for individual instructors' sections. Student evaluations of the radiology course were compared for the years available (2007-2010). Student interactions were also evaluated subjectively by instructors who used the Classroom Performance System™. There was a significant difference (p = 0.009) between the median student grade before (2005 - 2008, median 82.2%; interquartile range 77.6-85.7%; range 61.9-95.5%) and after use of the classroom performance system (2009-2010, median 83.6%; interquartile range 79.9-87.9%; range 68.2-93.2%). There was no statistically significant difference in median student grades for individual instructors over the study period. The radiology course student evaluation scores were significantly higher in years where the Classroom Performance System™ was used in comparison to previous years (P = 0.019). Subjectively, students appeared more involved when using clickers. Findings indicated that the Classroom Performance System™ may be a useful tool for enhancing veterinary radiology education. © 2012 Veterinary Radiology & Ultrasound.

Evaluation of the performance, cost-effectiveness, and timing of various preventive maintenances : interim report.

DOT National Transportation Integrated Search

2010-10-01

This research study evaluated the performance of various pavement preservation treatments over time and under different : environmental conditions to quantify the economics of each treatment type. There are three primary techniques utilized in Colora...

Evaluating the performance and making best use of passing relief lanes.

DOT National Transportation Integrated Search

2011-12-01

This report documents the evaluation of the performance and safety effectiveness of passing relief lanes within the State of Michigan. The study began with the identification of passing relief lanes within Michigan. This was followed by collecting hi...

Flight Evaluation of an Aircraft with Side and Center Stick Controllers and Rate-Limited Ailerons

NASA Technical Reports Server (NTRS)

Deppe, P. R.; Chalk, C. R.; Shafer, M. F.

1996-01-01

As part of an ongoing government and industry effort to study the flying qualities of aircraft with rate-limited control surface actuators, two studies were previously flown to examine an algorithm developed to reduce the tendency for pilot-induced oscillation when rate limiting occurs. This algorithm, when working properly, greatly improved the performance of the aircraft in the first study. In the second study, however, the algorithm did not initially offer as much improvement. The differences between the two studies caused concern. The study detailed in this paper was performed to determine whether the performance of the algorithm was affected by the characteristics of the cockpit controllers. Time delay and flight control system noise were also briefly evaluated. An in-flight simulator, the Calspan Learjet 25, was programmed with a low roll actuator rate limit, and the algorithm was programmed into the flight control system. Side- and center-stick controllers, force and position command signals, a rate-limited feel system, a low-frequency feel system, and a feel system damper were evaluated. The flight program consisted of four flights and 38 evaluations of test configurations. Performance of the algorithm was determined to be unaffected by using side- or center-stick controllers or force or position command signals. The rate-limited feel system performed as well as the rate-limiting algorithm but was disliked by the pilots. The low-frequency feel system and the feel system damper were ineffective. Time delay and noise were determined to degrade the performance of the algorithm.

Modeling and Performance Evaluation of Backoff Misbehaving Nodes in CSMA/CA Networks

DTIC Science & Technology

2012-08-01

Modeling and Performance Evaluation of Backoff Misbehaving Nodes in CSMA/CA Networks Zhuo Lu, Student Member, IEEE, Wenye Wang, Senior Member, IEEE... misbehaving nodes can obtain, we define and study two general classes of backoff misbehavior: continuous misbehavior, which keeps manipulating the backoff...misbehavior sporadically. Our approach is to introduce a new performance metric, namely order gain, to characterize the performance benefits of misbehaving

A Database Evaluation Based on Information Needs of Academic Social Scientists.

ERIC Educational Resources Information Center

Buterbaugh, Nancy Toth

This study evaluates two databases, "Historical Abstracts" and REESWeb, to determine their effectiveness in supporting academic social science research. While many performance evaluations gather quantitative data from isolated query and response transactions, this study is a qualitative evaluation of the databases in the context of…

An evaluation of the performance of a WRF multi-physics ensemble for heatwave events over the city of Melbourne in southeast Australia

NASA Astrophysics Data System (ADS)

Imran, H. M.; Kala, J.; Ng, A. W. M.; Muthukumaran, S.

2018-04-01

Appropriate choice of physics options among many physics parameterizations is important when using the Weather Research and Forecasting (WRF) model. The responses of different physics parameterizations of the WRF model may vary due to geographical locations, the application of interest, and the temporal and spatial scales being investigated. Several studies have evaluated the performance of the WRF model in simulating the mean climate and extreme rainfall events for various regions in Australia. However, no study has explicitly evaluated the sensitivity of the WRF model in simulating heatwaves. Therefore, this study evaluates the performance of a WRF multi-physics ensemble that comprises 27 model configurations for a series of heatwave events in Melbourne, Australia. Unlike most previous studies, we not only evaluate temperature, but also wind speed and relative humidity, which are key factors influencing heatwave dynamics. No specific ensemble member for all events explicitly showed the best performance, for all the variables, considering all evaluation metrics. This study also found that the choice of planetary boundary layer (PBL) scheme had largest influence, the radiation scheme had moderate influence, and the microphysics scheme had the least influence on temperature simulations. The PBL and microphysics schemes were found to be more sensitive than the radiation scheme for wind speed and relative humidity. Additionally, the study tested the role of Urban Canopy Model (UCM) and three Land Surface Models (LSMs). Although the UCM did not play significant role, the Noah-LSM showed better performance than the CLM4 and NOAH-MP LSMs in simulating the heatwave events. The study finally identifies an optimal configuration of WRF that will be a useful modelling tool for further investigations of heatwaves in Melbourne. Although our results are invariably region-specific, our results will be useful to WRF users investigating heatwave dynamics elsewhere.

A comprehensive performance evaluation on the prediction results of existing cooperative transcription factors identification algorithms.

PubMed

Lai, Fu-Jou; Chang, Hong-Tsun; Huang, Yueh-Min; Wu, Wei-Sheng

2014-01-01

Eukaryotic transcriptional regulation is known to be highly connected through the networks of cooperative transcription factors (TFs). Measuring the cooperativity of TFs is helpful for understanding the biological relevance of these TFs in regulating genes. The recent advances in computational techniques led to various predictions of cooperative TF pairs in yeast. As each algorithm integrated different data resources and was developed based on different rationales, it possessed its own merit and claimed outperforming others. However, the claim was prone to subjectivity because each algorithm compared with only a few other algorithms and only used a small set of performance indices for comparison. This motivated us to propose a series of indices to objectively evaluate the prediction performance of existing algorithms. And based on the proposed performance indices, we conducted a comprehensive performance evaluation. We collected 14 sets of predicted cooperative TF pairs (PCTFPs) in yeast from 14 existing algorithms in the literature. Using the eight performance indices we adopted/proposed, the cooperativity of each PCTFP was measured and a ranking score according to the mean cooperativity of the set was given to each set of PCTFPs under evaluation for each performance index. It was seen that the ranking scores of a set of PCTFPs vary with different performance indices, implying that an algorithm used in predicting cooperative TF pairs is of strength somewhere but may be of weakness elsewhere. We finally made a comprehensive ranking for these 14 sets. The results showed that Wang J's study obtained the best performance evaluation on the prediction of cooperative TF pairs in yeast. In this study, we adopted/proposed eight performance indices to make a comprehensive performance evaluation on the prediction results of 14 existing cooperative TFs identification algorithms. Most importantly, these proposed indices can be easily applied to measure the performance of new algorithms developed in the future, thus expedite progress in this research field.

Building-integrated photovoltaics: A case study

NASA Astrophysics Data System (ADS)

Kiss, G.; Kinkead, J.; Raman, M.

1995-03-01

In 1992, Kiss Cathcart Anders Architects performed a study for NREL on Building-Integrated Photovoltaics (BIPV) issues as seen from the perspective of the building community. In general, the purpose of the study was to list major issues and potential applications; by it's nature it asked more questions than it answered. This second phase study was to produce quantitative data on the performance of specific BIPV systems. Only roof systems are evaluated. The energy performance, construction cost and simple payback for five different BIPV roof options are evaluated in six different locations: Oakland, New York, Miami, Phoenix, Chicago, and Cincinnati. The roof options evaluated include the following: single-glazed PV roof using glass-substrate PVs; double-glazed PV roof with insulating PV modules; ballasted roof-mounted system; sawtooth light monitor roof with indirect north daylighting; sawtooth roof with north light and active heat recovery.

Learning from Evaluation by Peer Team: A Case Study of a Family Counselling Organization

ERIC Educational Resources Information Center

Muniute-Cobb, Eivina I.; Alfred, Mary V.

2010-01-01

This qualitative study explores how employees learn from Team Primacy Concept-based employee evaluation and how they use the feedback in performing their jobs. Team Primacy Concept-based evaluation is a type of multirater evaluation. The distinctive characteristic of such evaluation is its peer feedback component during which the employee's…

Evaluation of the Relationship between Literacy and Mathematics Skills as Assessed by Curriculum-Based Measures

ERIC Educational Resources Information Center

Rutherford-Becker, Kristy J.; Vanderwood, Michael L.

2009-01-01

The purpose of this study was to evaluate the extent that reading performance (as measured by curriculum-based measures [CBM] of oral reading fluency [ORF] and Maze reading comprehension), is related to math performance (as measured by CBM math computation and applied math). Additionally, this study examined which of the two reading measures was a…

The Relationship between Teachers' Performance on the Ventures for Excellence and Their Teaching Effectiveness

ERIC Educational Resources Information Center

Winters, Michael Joseph

2017-01-01

This quantitative correlational study examined the relationship between teacher pre-hiring effectiveness evaluation and their performance evaluation scores at the end of the first year of teaching. Prior to this study, it was not known if and to what degree teachers' scores on the Ventures for Excellence B-22 screening interview correlated to…

Experimental Evaluation of High Performance Integrated Heat Pump

DOE Office of Scientific and Technical Information (OSTI.GOV)

Miller, William A; Berry, Robert; Durfee, Neal

2016-01-01

Integrated heat pump (IHP) technology provides significant potential for energy savings and comfort improvement for residential buildings. In this study, we evaluate the performance of a high performance IHP that provides space heating, cooling, and water heating services. Experiments were conducted according to the ASHRAE Standard 206-2013 where 24 test conditions were identified in order to evaluate the IHP performance indices based on the airside performance. Empirical curve fits of the unit s compressor maps are used in conjunction with saturated condensing and evaporating refrigerant conditions to deduce the refrigerant mass flowrate, which, in turn was used to evaluate themore » refrigerant side performance as a check on the airside performance. Heat pump (compressor, fans, and controls) and water pump power were measured separately per requirements of Standard 206. The system was charged per the system manufacturer s specifications. System test results are presented for each operating mode. The overall IHP performance metrics are determined from the test results per the Standard 206 calculation procedures.« less

The 100 cm solar telescope primary mirror study

NASA Technical Reports Server (NTRS)

1975-01-01

The manufacturing impact of primary mirror configuration on the performance of a 100 cm aperture solar telescope was studied. Three primary mirror configurations were considered: solid, standard lightweight, and mushroom. All of these are of low expansion material. Specifically, the study consisted of evaluating the mirrors with regard to: manufacturing metrology, manufacturing risk factors and ultimate quality assessment. As a result of this evaluation, a performance comparison of the configurations was made, and a recommendation of mirror configuration is the final output. These evaluations, comparisons and recommendations are discussed in detail. Other investigations were completed and are documented in the appendices.

Performance evaluation of Louisiana's AASHO satellite test sections : final report.

DOT National Transportation Integrated Search

1979-07-01

It is beyond the scope of this study to attempt to isolate the effect of individual design assumptions on pavement life. : A performance evaluation (to determine present serviceability, end of life, etc.) of selected Portland Cement Concrete (P.C.C.)...

ASBESTOS IN DRINKING WATER PERFORMANCE EVALUATION STUDIES

EPA Science Inventory

Performance evaluations of laboratories testing for asbestos in drinking water according to USEPA Test Method 100.1 or 100.2 are complicated by the difficulty of providing stable sample dispersions of asbestos in water. Reference samples of a graduated series of chrysotile asbes...

ASBESTOS IN DRINKING WATER PERFORMANCE EVALUATION STUDIES

EPA Science Inventory

Performance evaluations of laboratories testing for asbestos in drinking water according to USEPA Test Method 100.1 or 100.2 are complicated by the difficulty of providing stable sample dispersions of asbestos in water. Reference samples of a graduated series of chrysotile asbest...

An Evaluation of Crack, Seat and Overlay in California (Phase II)

DOT National Transportation Integrated Search

2011-01-18

During the past 20 years hundreds of highway miles in California have been rehabilitated employing CS&O technique with little performance data : available. This study was conducted to evaluate the performance of CS&O for sections built in different c...

Evaluating Comparability in the Scoring of Performance Assessments for Accountability Purposes

ERIC Educational Resources Information Center

Lyons, Susan; Evans, Carla

2017-01-01

This brief summarizes "Comparability in Balanced Assessment Systems for State Accountability," published in "Educational Measurement: Issues and Practice" (Evans & Lyons 2017). The study evaluated comparability claims in local scoring of performance assessments across districts participating in New Hampshire's Performance…

Evaluation of urethane and carbide-tipped blades on wheel-supported snow plows.

DOT National Transportation Integrated Search

1997-01-01

The objective of this study was to evaluate the performance of urethane and carbide-tipped snow plow blades on wheel supported plows. Their performance was compared to that of VDOT's standard blade arrangement: carbide-tipped blades on plows without ...

Stereotype Threat among Students with Disabilities: The Importance of The Evaluative Context on Their Cognitive Performance

ERIC Educational Resources Information Center

Desombre, Caroline; Anegmar, Souad; Delelis, Gérald

2018-01-01

This study investigated the hypothesis that cognitive performance of students with physical disabilities may be influenced by the evaluators' identity. Students with or without a physical disability completed a logic test and were informed that they would be evaluated by students from their own group (ingroup condition) or from an other group…

Development and psychometric evaluation of the nursing instructors' clinical teaching performance inventory.

PubMed

A Farahani, Mansoureh; Emamzadeh Ghasemi, Hormat Sadat; Nikpaima, Nasrin; Fereidooni, Zhila; Rasoli, Maryam

2014-10-29

Evaluation of nursing instructors' clinical teaching performance is a prerequisite to the quality assurance of nursing education. One of the most common procedures for this purpose is using student evaluations. This study was to develop and evaluate the psychometric properties of Nursing Instructors' Clinical Teaching Performance Inventory (NICTPI). The primary items of the inventory were generated by reviewing the published literature and the existing questionnaires as well as consulting with the members of the Faculties Evaluation Committee of the study setting. Psychometric properties were assessed by calculating its content validity ratio and index, and test-retest correlation coefficient as well as conducting an exploratory factor analysis and an internal consistency assessment. The content validity ratios and indices of the items were respectively higher than 0.85 and 0.79. The final version of the inventory consisted of 25 items, and in the exploratory factor analysis, items were loaded on three factors which jointly accounting for 72.85% of the total variance. The test-retest correlation coefficient and the Cronbach's alpha of the inventory were 0.93 and 0.973, respectively. The results revealed that the developed inventory is an appropriate, valid, and reliable instrument for evaluating nursing instructors' clinical teaching performance.

Influence of socioeconomic status on trauma center performance evaluations in a Canadian trauma system.

PubMed

Moore, Lynne; Turgeon, Alexis F; Sirois, Marie-Josée; Murat, Valérie; Lavoie, André

2011-09-01

Trauma center performance evaluations generally include adjustment for injury severity, age, and comorbidity. However, disparities across trauma centers may be due to other differences in source populations that are not accounted for, such as socioeconomic status (SES). We aimed to evaluate whether SES influences trauma center performance evaluations in an inclusive trauma system with universal access to health care. The study was based on data collected between 1999 and 2006 in a Canadian trauma system. Patient SES was quantified using an ecologic index of social and material deprivation. Performance evaluations were based on mortality adjusted using the Trauma Risk Adjustment Model. Agreement between performance results with and without additional adjustment for SES was evaluated with correlation coefficients. The study sample comprised a total of 71,784 patients from 48 trauma centers, including 3,828 deaths within 30 days (4.5%) and 5,549 deaths within 6 months (7.7%). The proportion of patients in the highest quintile of social and material deprivation varied from 3% to 43% and from 11% to 90% across hospitals, respectively. The correlation between performance results with or without adjustment for SES was almost perfect (r = 0.997; 95% CI 0.995-0.998) and the same hospital outliers were identified. We observed an important variation in SES across trauma centers but no change in risk-adjusted mortality estimates when SES was added to adjustment models. Results suggest that after adjustment for injury severity, age, comorbidity, and transfer status, disparities in SES across trauma center source populations do not influence trauma center performance evaluations in a system offering universal health coverage. Copyright © 2011 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

NASA Tech House: An early evaluation

NASA Technical Reports Server (NTRS)

1977-01-01

An architect-engineering firm, as well as university participants, performed system studies, evaluated construction methods, performed cost effectiveness studies, and prepared construction drawings which incorporated the selected technology features into a final design. A Technology Utilization House (Tech House) based on this design was constructed at the NASA Langley Research Center in Hampton, Virginia. The Tech House is instrumented so that the performance of the design features and energy systems can be evaluated during a planned family live-in period. As such, the house is both a demonstration unit and a research laboratory. The Tech House is to demonstrate the kind of single-family residence that will probably be available within the next five years.

Village health volunteers’ social capital related to their performance in Lao People’s Democratic Republic: a cross-sectional study

PubMed Central

2014-01-01

Background Improving the performance of community health workers (CHWs) is a global issue. The relationship between CHWs and their community may impact their performance. In Lao People’s Democratic Republic (Lao PDR), CHW are called village health volunteers (VHV). Lao PDR has a problem with VHV inactivity, especially in rural areas. This study focused on which aspects of social capital are related to VHV performance. Methods This research represents a cross-sectional study with a quantitative survey based primarily on interviews using a semi-structured questionnaire. Interviews were conducted with 149 VHVs living and working in the Sepon District. VHV performance evaluation was measured with scores on a 5-point scale, and the cutoff point for designating performance as good or poor was set at the median score. This evaluation of VHV performance was conducted as a self-evaluation by VHVs and by health center staff who were supervisors of the VHVs. Measurement of social capital was accomplished using the short version of the Adapted Social Capital Assessment Tool (SASCAT). For statistical analyses, logistic regression was used to calculate adjusted odds ratios (OR) and 95% confidence intervals (CI). Results The results of multiple logistic regression adjusted by moderator variables showed that citizenship activities in the structural social capital component of SASCAT were significantly related to performance in self-evaluation by VHVs (adjusted OR: 2.10, 95% CI: 1.19-3.71) and the evaluations by health center staff (adjusted OR: 1.67, 95% CI: 1.01-2.77). Support from groups (adjusted OR: 1.87, 95% CI: 1.27-2.76) and cognitive social capital (adjusted OR: 7.48, 95% CI: 2.14-26.10) were found to be significantly associated but only for VHV self-evaluation. Conclusions The results suggest that individuals who interact with important figures in the community and who cooperate with other villagers whenever problems arise, i.e., have social capital, exhibit good performance as VHVs. These findings suggest that increasing citizenship activities could increase the retention rate of CHWs and help improve their performance. Citizenship activities could also be used as a predictive indicator when selecting new CHWs. PMID:24620729

Electrochemical impedance spectroscopy (EIS) as a tool for measuring corrosion of polymer-coated fasteners used in treated wood

Treesearch

Samuel L. Zelinka; Lorraine Ortiz-Candelaria; Donald S. Stone; Douglas R. Rammer

2009-01-01

Currently, many of the polymer-coated fasteners on the market are designed for improved corrosion performance in treated wood; yet, there is no way to evaluate their corrosion performance. In this study, a common technique for measuring the corrosion performance of polymer-coated metals, electrochemical impedance spectroscopy (EIS), was used to evaluate commercial...

THE RELATIONSHIP OF CERTAIN PREDICTION AND SELF-EVALUATION DISCREPANCIES TO ART PERFORMANCE AND ART JUDGMENT.

ERIC Educational Resources Information Center

HARVEY, THEODORE E.

NINTH-GRADE STUDENTS WERE SELECTED AS A SAMPLE TO STUDY THE RELATIONSHIP OF CERTAIN PREDICTION AND SELF-EVALUATION DISCREPANCIES TO ART PERFORMANCE AND ART JUDGMENT. STUDENTS WERE REQUIRED TO DEVELOP AN OIL CRAYON DRAWING, RESULTING FROM AN IMAGINARY SENTENCE SPOKEN TO AND SEEN BY ALL PARTICIPANTS. PREDICTIONS OF PERFORMANCE WERE ASKED PRIOR TO…

Investigating the Influences of Core Self-Evaluations, Job Autonomy, and Intrinsic Motivation on In-Role Job Performance

ERIC Educational Resources Information Center

Joo, Baek-Kyoo; Jeung, Chang-Wook; Yoon, Hea Jun

2010-01-01

This study investigates the effects of core self-evaluations, job autonomy, and intrinsic motivation on employees' perceptions of their in-role job performance, based on a cross-sectional survey of 283 employees in a Fortune Global 100 company in Korea. The results suggest that employees perceived higher in-role job performance when they had…

Predictors of duodenal bulb biopsy performance in the evaluation of coeliac disease in children.

PubMed

Tanpowpong, Pornthep; Broder-Fingert, Sarabeth; Katz, Aubrey J; Camargo, Carlos A

2012-09-01

Studies on the role of duodenal bulb biopsy (DBB) in coeliac disease (CD) evaluation have increased in recent years; growing evidence suggests that the disease can present solely in the duodenal bulb. Moreover, recent CD guidelines recommend obtaining a DBB. The study aim was to examine DBB performance in children undergoing CD evaluation and to identify independent predictors of DBB performance. The authors performed a structured chart review of children aged <18 years who underwent CD evaluation between 2000 and 2010 at a large teaching hospital. The authors collected data including demographics, serology, endoscopy and histopathological findings. Predictors of DBB performance (obtained vs not obtained) were determined using multivariable logistic regression. Among 616 children who underwent endoscopy, DBB was performed in 103 children (17%, 95% CI 14% to 20%) with an increasing trend in the more recent years (2008-2010, 25%; 2004-2007, 16%; and 2000-2003, 5%, p<0.001). Three independent predictors of DBB performance were older age at endoscopy (OR 1.05 per year of age), gross gastric antral abnormalities (OR 2.81) and gross duodenal abnormalities (OR 5.55). Regarding the DBB histological findings, patchiness of CD was found in 15%. Positive Marsh III biopsy presented solely on the DBB in 6/103 (6%, 95% CI 2% to 12%) children. The authors found a significant increase in DBB performance over time, but the overall performance remains suboptimal. Improving education on obtaining a DBB for CD evaluation is crucial, especially among those children in whom DBB is more likely to be omitted.

Associations of medical student personality and health/wellness characteristics with their medical school performance across the curriculum.

PubMed

Haight, Scott J; Chibnall, John T; Schindler, Debra L; Slavin, Stuart J

2012-04-01

To assess the relationships of cognitive and noncognitive performance predictors to medical student preclinical and clinical performance indicators across medical school years 1 to 3 and to evaluate the association of psychological health/wellness factors with performance. In 2010, the authors conducted a cross-sectional, correlational, retrospective study of all 175 students at the Saint Louis University School of Medicine who had just completed their third (first clinical) year. Students were asked to complete assessments of personality, stress, anxiety, depression, social support, and community cohesion. Performance measures included total Medical College Admission Test (MCAT) score, preclinical academic grades, National Board of Medical Examiners subject exam scores, United States Medical Licensing Examination Step 1 score, clinical evaluations, and Humanism in Medicine Honor Society nominations. A total of 152 students (87%) participated. MCAT scores predicted cognitive performance indicators (academic tests), whereas personality variables (conscientiousness, extraversion, empathy) predicted noncognitive indicators (clinical evaluations, humanism nominations). Conscientiousness predicted all clinical skills, extraversion predicted clinical skills reflecting interpersonal behavior, and empathy predicted motivation. Health/wellness variables had limited associations with performance. In multivariate analyses that included control for shelf exam scores, conscientiousness predicted clinical evaluations, and extraversion and empathy predicted humanism nominations. This study identified two sets of skills (cognitive, noncognitive) used during medical school, with minimal overlap across the types of performance (e.g., exam performance versus clinical interpersonal skills) they predict. Medical school admission and evaluation efforts may need to be modified to reflect the importance of personality and other noncognitive factors.

Insight into Evaluation Practice: A Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation-Focused Journals

ERIC Educational Resources Information Center

Christie, Christina A.; Fleischer, Dreolin Nesbitt

2010-01-01

To describe the recent practice of evaluation, specifically method and design choices, the authors performed a content analysis on 117 evaluation studies published in eight North American evaluation-focused journals for a 3-year period (2004-2006). The authors chose this time span because it follows the scientifically based research (SBR)…

Technology Efficacy in Active Prosthetic Knees for Transfemoral Amputees: A Quantitative Evaluation

PubMed Central

El-Sayed, Amr M.; Abu Osman, Noor Azuan

2014-01-01

Several studies have presented technological ensembles of active knee systems for transfemoral prosthesis. Other studies have examined the amputees' gait performance while wearing a specific active prosthesis. This paper combined both insights, that is, a technical examination of the components used, with an evaluation of how these improved the gait of respective users. This study aims to offer a quantitative understanding of the potential enhancement derived from strategic integration of core elements in developing an effective device. The study systematically discussed the current technology in active transfemoral prosthesis with respect to its functional walking performance amongst above-knee amputee users, to evaluate the system's efficacy in producing close-to-normal user performance. The performances of its actuator, sensory system, and control technique that are incorporated in each reported system were evaluated separately and numerical comparisons were conducted based on the percentage of amputees' gait deviation from normal gait profile points. The results identified particular components that contributed closest to normal gait parameters. However, the conclusion is limitedly extendable due to the small number of studies. Thus, more clinical validation of the active prosthetic knee technology is needed to better understand the extent of contribution of each component to the most functional development. PMID:25110727

Handwriting performance versus arm forward reach and grasp abilities among post-stroke patients, a case-control study.

PubMed

Israely, Sharon; Carmeli, Eli

2017-01-01

Evidence-based studies regarding deficits in handwriting performance relative to hand reaching and grasping after a stroke are lacking. To evaluate the extent of damage to handwriting skills compared to arm reach and grasp task among post-stroke patients. Eighteen patients and 19 healthy subjects were recruited to this case-control study. Patients were evaluated 15.2 days (±6.5) after the stroke using a Computerized Penmanship Evaluation Tool, surface Electromyography and Fugl-Meyer assessment. This study compared motor deficits in hand reaching and grasping and in handwriting between stroke patients and healthy subjects. Damage to handwriting performance relative to hand reaching and grasping skills was also evaluated. Significant differences were found between groups in handwriting performance (p < 0.05). The performance of the trapezius, biceps, and triceps muscles can predict 63.5% of the variance in the ability to write a short sentence (p < 0.023). Pen pressure can predict 74.9% of the hand motor performance from Fugl-Meyer assessment (p < 0.05). Handwriting was more damaged than was the pattern of activation of the proximal muscles of the shoulder and arm (p < 0.05). FM scores were highly, negatively correlated with the in-air writing time across tasks (r = -0.819, p < 0.004). This study confirms the clinical observation that dexterity skills are more damaged than are arm forward reach after a stroke. However, these differences in motor performance were not significant in mildly disabled patients, demonstrating the feasibility of handwriting rehabilitation in these patients. Therefore, we modestly recommend focusing on handwriting rehabilitation of the hemiparetic upper extremity in mildly impaired patients after a stroke.

Receiver design, performance analysis, and evaluation for space-borne laser altimeters and space-to-space laser ranging systems

NASA Technical Reports Server (NTRS)

Davidson, Frederic M.; Sun, Xiaoli; Field, Christopher T.

1994-01-01

Accomplishments in the following areas of research are presented: receiver performance study of spaceborne laser altimeters and cloud and aerosol lidars; receiver performance analysis for space-to-space laser ranging systems; and receiver performance study for the Mars Environmental Survey (MESUR).

Grade/Study-Performance Contracts, Enhanced Communication, Cooperative Learning, and Student Performance in Undergraduate Organic Chemistry.

ERIC Educational Resources Information Center

Dougherty, Ralph C.

1997-01-01

Describes and evaluates a teaching strategy, designed to increase student retention while maintaining academic performance levels in undergraduate organic chemistry, that uses grade/study-performance contracts, enhanced communication using electronic mail, and cooperative learning. Concludes that a series of interventions can substantially…

Quantitative evaluation of the memory bias effect in ROC studies with PET/CT

NASA Astrophysics Data System (ADS)

Kallergi, Maria; Pianou, Nicoletta; Georgakopoulos, Alexandros; Kafiri, Georgia; Pavlou, Spiros; Chatziioannou, Sofia

2012-02-01

PURPOSE. The purpose of the study was to evaluate the memory bias effect in ROC experiments with tomographic data and, specifically, in the evaluation of two different PET/CT protocols for the detection and diagnosis of recurrent thyroid cancer. MATERIALS AND METHODS. Two readers participated in an ROC experiment that evaluated tomographic images from 43 patients followed up for thyroid cancer recurrence. Readers evaluated first whole body PET/CT scans of the patients and then a combination of whole body and high-resolution head and neck scans of the same patients. The second set was read twice. Once within 48 hours of the first set and the second time at least a month later. The detection and diagnostic performances of the readers in the three reading sessions were assessed with the DBMMRMC and LABMRMC software using the area under the ROC curve as a performance index. Performances were also evaluated by comparing the number and the size of the detected abnormal foci among the three readings. RESULTS. There was no performance difference between first and second treatments. There were statistically significant differences between first and third, and second and third treatments showing that memory can seriously affect the outcome of ROC studies. CONCLUSION. Despite the fact that tomographic data involve numerous image slices per patient, the memory bias effect is present and substantial and should be carefully eliminated from analogous ROC experiments.

Multi-objective optimization for generating a weighted multi-model ensemble

NASA Astrophysics Data System (ADS)

Lee, H.

2017-12-01

Many studies have demonstrated that multi-model ensembles generally show better skill than each ensemble member. When generating weighted multi-model ensembles, the first step is measuring the performance of individual model simulations using observations. There is a consensus on the assignment of weighting factors based on a single evaluation metric. When considering only one evaluation metric, the weighting factor for each model is proportional to a performance score or inversely proportional to an error for the model. While this conventional approach can provide appropriate combinations of multiple models, the approach confronts a big challenge when there are multiple metrics under consideration. When considering multiple evaluation metrics, it is obvious that a simple averaging of multiple performance scores or model ranks does not address the trade-off problem between conflicting metrics. So far, there seems to be no best method to generate weighted multi-model ensembles based on multiple performance metrics. The current study applies the multi-objective optimization, a mathematical process that provides a set of optimal trade-off solutions based on a range of evaluation metrics, to combining multiple performance metrics for the global climate models and their dynamically downscaled regional climate simulations over North America and generating a weighted multi-model ensemble. NASA satellite data and the Regional Climate Model Evaluation System (RCMES) software toolkit are used for assessment of the climate simulations. Overall, the performance of each model differs markedly with strong seasonal dependence. Because of the considerable variability across the climate simulations, it is important to evaluate models systematically and make future projections by assigning optimized weighting factors to the models with relatively good performance. Our results indicate that the optimally weighted multi-model ensemble always shows better performance than an arithmetic ensemble mean and may provide reliable future projections.

Screening studies of advanced control concepts for airbreathing engines

NASA Technical Reports Server (NTRS)

Ouzts, Peter J.; Lorenzo, Carl F.; Merrill, Walter C.

1993-01-01

The application of advanced control concepts to airbreathing engines may yield significant improvements in aircraft/engine performance and operability. Accordingly, the NASA Lewis Research Center has conducted screening studies of advanced control concepts for airbreathing engines to determine their potential impact on turbine engine performance and operability. The purpose of the studies was to identify concepts which offered high potential yet may incur high research and development risk. A target suite of proposed concepts was formulated by NASA and industry. These concepts were evaluated in a two phase study to quantify each concept's impact on desired engine characteristics. To aid in the evaluation, three target aircraft/engine combinations were considered: a military high performance fighter mission, a high speed civil transport mission, and a civil tiltrotor mission. Each of the advanced control concepts considered in the study were defined and described. The concept's potential impact on engine performance was determined. Relevant figures of merit on which to evaluate the concepts were also determined. Finally, the concepts were ranked with respect to the target aircraft/engine missions.

New approach to enhance and evaluate the performance of vehicle-infrastructure integration and its communication systems, final report.

DOT National Transportation Integrated Search

2010-09-01

Initial research studied the use of wireless local area networks (WLAN) protocols in Inter-Vehicle Communications : (IVC) environments. The protocols performance was evaluated in terms of measuring throughput, jitter time and : delay time. This re...

Effort provides its own reward: endeavors reinforce subjective expectation and evaluation of task performance.

PubMed

Wang, Lei; Zheng, Jiehui; Meng, Liang

2017-04-01

Although many studies have investigated the relationship between the amount of effort invested in a certain task and one's attitude towards the subsequent reward, whether exerted effort would impact one's expectation and evaluation of performance feedback itself still remains to be examined. In the present study, two types of calculation tasks that varied in the required effort were adopted, and we resorted to electroencephalography to probe the temporal dynamics of how exerted effort would affect one's anticipation and evaluation of performance feedback. In the high-effort condition, a more salient stimulus-preceding negativity was detected during the anticipation stage, which was accompanied with a more salient FRN/P300 complex (a more positive P300 and a less negative feedback-related negativity) in response to positive outcomes in the evaluation stage. These results suggested that when more effort was invested, an enhanced anticipatory attention would be paid toward one's task performance feedback and that positive outcomes would be subjectively valued to a greater extent.

Perception of premenstrual syndrome and attitude of evaluations of work performance among incoming university female students.

PubMed

Cheng, Shu Hui; Sun, Zih-Jie; Lee, I Hui; Shih, Chi-Chen; Chen, Kao Chin; Lin, Shih-Hsien; Lu, Feng-Hwa; Yang, Yi-Ching; Yang, Yen Kuang

2015-01-01

Premenstrual syndrome (PMS) is a common condition, and for 5% of women, the influence is so severe as to interfere with their mental health, interpersonal relationships, or studies. Severe PMS may result in decreased occupational productivity. The aim of this study was to investigate the influence of perception of PMS on evaluation of work performance. A total of 1971 incoming female university students were recruited in September 2009. A simulated clinical scenario was used, with a test battery including measurement of psychological symptoms and the Chinese Premenstrual Symptom Questionnaire. When evaluating employee performance in the simulated scenario, 1565 (79.4%) students neglected the impact of PMS, while 136 (6.9%) students considered it. Multivariate logistic regression showed that perception of daily function impairment due to PMS and frequency of measuring body weight were significantly associated with consideration of the influence of PMS on evaluation of work performance. It is important to increase the awareness of functional impairments related to severe PMS.

Impact of study design on development and evaluation of an activity-type classifier.

PubMed

van Hees, Vincent T; Golubic, Rajna; Ekelund, Ulf; Brage, Søren

2013-04-01

Methods to classify activity types are often evaluated with an experimental protocol involving prescribed physical activities under confined (laboratory) conditions, which may not reflect real-life conditions. The present study aims to evaluate how study design may impact on classifier performance in real life. Twenty-eight healthy participants (21-53 yr) were asked to wear nine triaxial accelerometers while performing 58 activity types selected to simulate activities in real life. For each sensor location, logistic classifiers were trained in subsets of up to 8 activities to distinguish between walking and nonwalking activities and were then evaluated in all 58 activities. Different weighting factors were used to convert the resulting confusion matrices into an estimation of the confusion matrix as would apply in the real-life setting by creating four different real-life scenarios, as well as one traditional laboratory scenario. The sensitivity of a classifier estimated with a traditional laboratory protocol is within the range of estimates derived from real-life scenarios for any body location. The specificity, however, was systematically overestimated by the traditional laboratory scenario. Walking time was systematically overestimated, except for lower back sensor data (range: 7-757%). In conclusion, classifier performance under confined conditions may not accurately reflect classifier performance in real life. Future studies that aim to evaluate activity classification methods are warranted to pay special attention to the representativeness of experimental conditions for real-life conditions.

Evaluation of Sub Query Performance in SQL Server

NASA Astrophysics Data System (ADS)

Oktavia, Tanty; Sujarwo, Surya

2014-03-01

The paper explores several sub query methods used in a query and their impact on the query performance. The study uses experimental approach to evaluate the performance of each sub query methods combined with indexing strategy. The sub query methods consist of in, exists, relational operator and relational operator combined with top operator. The experimental shows that using relational operator combined with indexing strategy in sub query has greater performance compared with using same method without indexing strategy and also other methods. In summary, for application that emphasized on the performance of retrieving data from database, it better to use relational operator combined with indexing strategy. This study is done on Microsoft SQL Server 2012.

Comparison of differences in performance evaluation of faculty by students with faculty's self-assessment.

PubMed

Azizi, Kourosh; Aghamolaei, Teamur; Parsa, Nader; Dabbaghmanesh, Tahereh

2014-07-01

The present study aimed to compare self-assessment forms of coursework taught in the school of public health at undergraduate, graduate, and postgraduate levels and students' evaluation of the performance of the faculty members at these levels. The subjects in this cross-sectional study were the faculty members and students of the School of Public Health and Nutrition, Shiraz University of Medical Sciences, Shiraz, Iran. The data were collected using a socio-demographic information form and evaluation forms of professors prepared by the Educational Development Center (EDC). The faculty members were assessed by the students in undergraduate and graduate classes. Among the study subjects, 23 faculty members filled out the self-assessment forms which were then evaluated by 23 students. Then, the data were analyzed using the SPSS statistical 14. Paired t-test was used to compare the students' evaluation of the faculty members' performance and the professors' self-assessment. The mean score of self-assessment of the faculty members who taught undergraduate courses was 289.7±8.3, while that of the students' evaluation was 281.3±16.1; the difference was statistically significant (t=3.56, p=0.001). Besides, the mean score of the self-assessment of the faculty members who taught graduate courses was 269.0±9.7, while that of the students' evaluation was 265.7±14.6 but the difference was not statistically significant (t=1.09, p=0.28). Teaching performance perceptions of the faculty were similar to those of the graduate students as compared to the undergraduate ones. This may reflect better understanding of coursework at this level compared to the undergraduate students. Faculty members may need to adjust teaching methods to improve students' performance and understanding especially in the undergraduate level.

An Aerodynamic Performance Evaluation of the NASA/Ames Research Center Advanced Concepts Flight Simulator. M.S. Thesis

NASA Technical Reports Server (NTRS)

Donohue, Paul F.

1987-01-01

The results of an aerodynamic performance evaluation of the National Aeronautics and Space Administration (NASA)/Ames Research Center Advanced Concepts Flight Simulator (ACFS), conducted in association with the Navy-NASA Joint Institute of Aeronautics, are presented. The ACFS is a full-mission flight simulator which provides an excellent platform for the critical evaluation of emerging flight systems and aircrew performance. The propulsion and flight dynamics models were evaluated using classical flight test techniques. The aerodynamic performance model of the ACFS was found to realistically represent that of current day, medium range transport aircraft. Recommendations are provided to enhance the capabilities of the ACFS to a level forecast for 1995 transport aircraft. The graphical and tabular results of this study will establish a performance section of the ACFS Operation's Manual.

Effects of Study Behavior on Objective-Style and Essay-Style Performance.

ERIC Educational Resources Information Center

Biggs, J. B.

In this study, the effects of motivational and behavioral dimensions of study behavior on objective and essay modes of evaluating course content were investigated. Several performance measures in two undergraduate Educational Psychology courses were factor analyzed, and three orthogonal performance factors were obtained: general achievement,…

Performance Evaluation of Community Health Workers: Case Study in the Amazon of Peru.

PubMed

Westgard, Christopher; Naraine, Renuka; Paucar Villacorta, Diego Mauricio

2018-03-26

A shortage in human resources for health is a growing crisis that has led to an inability to provide adequate health services to impoverished populations. By "task-shifting", health systems can delegate certain activities, such as health promotion and referral, to trained community members to help fill the human resource gap. An effective community health agent program can improve maternal and child health and overall effectiveness of rural health systems. Such a program is most effective when the community health agents receive supervision and evaluation of their performance. There is a shortage of literature that provides instruction and example on how to conduct a performance evaluation in the developing world to improve maternal and child health outcomes. The current study provides a case study of a performance evaluation in the Amazon region of Peru and how the findings can be used to make program adjustments. A set of instruments to measure the performance of CHWs was adapted from the literature and then implemented in the field. The instruments were used to measure the quality of home visits by the CHWs, their knowledge of the health topics, and structural activities. Three communities with an active CHW program in Loreto, Peru were chosen to receive the evaluation. All CHWs in the communities were evaluated. The scores from the evaluation were compared internally to identify strengths and weaknesses of the program and within the population of CHWs. The evaluation was completed on 52 home visits and 27 CHWs in three communities. The CHWs were found to be most effective at creating good relationships with caregivers and delivering health messages, and least effective at interacting with the child during the home visit and using material to deliver health messages. The evaluation instruments were well suited for the CHW program that utilizes home visits to teach about child health and development.

The Effects of Preexercise Caffeinated Coffee Ingestion on Endurance Performance: An Evidence-Based Review.

PubMed

Higgins, Simon; Straight, Chad R; Lewis, Richard D

2016-06-01

Endurance athletes commonly ingest caffeine as a means to enhance training intensity and competitive performance. A widely-used source of caffeine is coffee, however conflicting evidence exists regarding the efficacy of coffee in improving endurance performance. In this context, the aims of this evidence-based review were threefold: 1) to evaluate the effects of preexercise coffee on endurance performance, 2) to evaluate the effects of coffee on perceived exertion during endurance performance, and 3) to translate the research into usable information for athletes to make an informed decision regarding the intake of caffeine via coffee as a potential ergogenic aid. Searches of three major databases were performed using terms caffeine and coffee, or coffee-caffeine, and endurance, or aerobic. Included studies (n = 9) evaluated the effects of caffeinated coffee on human subjects, provided the caffeine dose administered, administered caffeine ≥ 45 min before testing, and included a measure of endurance performance (e.g., time trial). Significant improvements in endurance performance were observed in five of nine studies, which were on average 24.2% over controls for time to exhaustion trials, and 3.1% for time to completion trials. Three of six studies found that coffee reduced perceived exertion during performance measures significantly more than control conditions (p < .05). Based on the reviewed studies there is moderate evidence supporting the use of coffee as an ergogenic aid to improve performance in endurance cycling and running. Coffee providing 3-8.1 mg/kg (1.36-3.68 mg/lb) of caffeine may be used as a safe alternative to anhydrous caffeine to improve endurance performance.

Building-integrated photovoltaics: A case study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kiss, G.; Kinkead, J.; Raman, M.

1995-03-01

In 1992, Kiss Cathcart Anders Architects performed a study for NREL on Building-Integrated Photovoltaics (BIPV) issues as seen from the perspective of the building community. In general, the purpose of the study was to list major issues and potential applications; by it`s nature it asked more questions than it answered. This second phase study was to produce quantitative data on the performance of specific BIPV systems. Only roof systems are evaluated. The energy performance, construction cost and simple payback for five different BIPV roof options are evaluated in six different locations: Oakland, New York, Miami, Phoenix, Chicago, and Cincinnati. Themore » roof options evaluated include the following: single-glazed PV roof using glass-substrate PVs; double-glazed PV roof with insulating PV modules; ballasted roof-mounted system; sawtooth light monitor roof with indirect north daylighting; sawtooth roof with north light and active heat recovery.« less

Performance evaluation of a second-generation elastic loop mobility system

NASA Technical Reports Server (NTRS)

Melzer, K. J.; Swanson, G. D.

1974-01-01

Tests were conducted to evaluate the mobility performance of a second-generation Elastic Loop Mobility System (ELMS II). Performance on level test lanes and slopes of lunar soil simulant (LSS) and obstacle-surmounting and crevasse-crossing capabilities were investigated. In addition, internal losses and contact pressure distributions were evaluated. To evaluate the soft-soil performance, two basic soil conditions were tested: loose (LSS1) and dense (LSS5). These conditions embrace the spectrum of soil strengths tested during recent studies for NASA related to the mobility performance of the LRV. Data indicated that for the tested range of the various performance parameters, performance was independent of unit load (contact pressure) and ELMS II drum angular velocity, but was influenced by soil strength and ELMS pitch mode. Power requirements were smaller at a given system output for dense soil than for loose soil. The total system output in terms of pull developed or slope-climbing capability was larger for the ELMS II operating in restrained-pitch mode than in free-pitch mode.

Systematic content evaluation and review of measurement properties of questionnaires for measuring self-reported fatigue among older people.

PubMed

Egerton, Thorlene; Riphagen, Ingrid I; Nygård, Arnhild J; Thingstad, Pernille; Helbostad, Jorunn L

2015-09-01

The assessment of fatigue in older people requires simple and user-friendly questionnaires that capture the phenomenon, yet are free from items indistinguishable from other disorders and experiences. This study aimed to evaluate the content, and systematically review and rate the measurement properties of self-report questionnaires for measuring fatigue, in order to identify the most suitable questionnaires for older people. This study firstly involved identification of questionnaires that purport to measure self-reported fatigue, and evaluation of the content using a rating scale developed for the purpose from contemporary understanding of the construct. Secondly, for the questionnaires that had acceptable content, we identified studies reporting measurement properties and rated the methodological quality of those studies according to the COSMIN system. Finally, we extracted and synthesised the results of the studies to give an overall rating for each questionnaire for each measurement property. The protocol was registered with PROSPERO (CRD42013005589). Of the 77 identified questionnaires, twelve were selected for review after content evaluation. Methodological quality varied, and there was a lack of information on measurement error and responsiveness. The PROMIS-Fatigue item bank and short forms perform the best. The FACIT-Fatigue scale, Parkinsons Fatigue Scale, Perform Questionnaire, and Uni-dimensional Fatigue Impact Scale also perform well and can be recommended. Minor modifications to improve performance are suggested. Further evaluation of unresolved measurement properties, particularly with samples including older people, is needed for all the recommended questionnaires.

Reliability studies of Integrated Modular Engine system designs

NASA Technical Reports Server (NTRS)

Hardy, Terry L.; Rapp, Douglas C.

1993-01-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Reliability studies of integrated modular engine system designs

NASA Technical Reports Server (NTRS)

Hardy, Terry L.; Rapp, Douglas C.

1993-01-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Reliability studies of integrated modular engine system designs

NASA Astrophysics Data System (ADS)

Hardy, Terry L.; Rapp, Douglas C.

1993-06-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Reliability studies of Integrated Modular Engine system designs

NASA Astrophysics Data System (ADS)

Hardy, Terry L.; Rapp, Douglas C.

1993-06-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Increasing money-counting skills with a student with brain injury: skill and performance deficits.

PubMed

Fienup, Daniel M; Mudgal, Dipti; Pace, Gary

2013-01-01

Two studies examined the effectiveness of interventions designed to increase money-counting skills of a student with brain injury. Both skill and performance hypotheses were examined. Single subject designs were used to evaluate interventions, including a multiple-baseline across counting paper and coin money (study 1) and a changing criterion design (study 2). In study 1, it was hypothesized that the student had a skill deficit; thus, the participant was taught organizational strategies for counting money. In study 2, a performance deficit was hypothesized and the effects of contingent rewards were evaluated. In study 1, organizational strategies increased organized counting of money, but did not affect counting accuracy. In study 2, contingent rewards increased accurate money counting. When dealing with multi-step behaviours, different components of behaviour can be controlled by different variables, such as skill and performance deficits. Effective academic interventions may need to consider both types of deficits.

Evaluation of Generalized Performance across Materials When Using Video Technology by Students with Autism Spectrum Disorder and Moderate Intellectual Disability

ERIC Educational Resources Information Center

Mechling, Linda C.; Ayres, Kevin M.; Foster, Ashley L.; Bryant, Kathryn J.

2015-01-01

The purpose of this study was to evaluate the ability of four high school-aged students with a diagnosis of autism spectrum disorder and moderate intellectual disability to generalize performance of skills when using materials different from those presented through video models. An adapted alternating treatments design was used to evaluate student…

Influence of signal processing strategy in auditory abilities.

PubMed

Melo, Tatiana Mendes de; Bevilacqua, Maria Cecília; Costa, Orozimbo Alves; Moret, Adriane Lima Mortari

2013-01-01

The signal processing strategy is a parameter that may influence the auditory performance of cochlear implant and is important to optimize this parameter to provide better speech perception, especially in difficult listening situations. To evaluate the individual's auditory performance using two different signal processing strategy. Prospective study with 11 prelingually deafened children with open-set speech recognition. A within-subjects design was used to compare performance with standard HiRes and HiRes 120 in three different moments. During test sessions, subject's performance was evaluated by warble-tone sound-field thresholds, speech perception evaluation, in quiet and in noise. In the silence, children S1, S4, S5, S7 showed better performance with the HiRes 120 strategy and children S2, S9, S11 showed better performance with the HiRes strategy. In the noise was also observed that some children performed better using the HiRes 120 strategy and other with HiRes. Not all children presented the same pattern of response to the different strategies used in this study, which reinforces the need to look at optimizing cochlear implant clinical programming.

Forward-viewing endoscopic ultrasound-guided NOTES interventions: A study on peritoneoscopic potential

PubMed Central

Jeong, Seung Uk; Aizan, Hassanuddin; Song, Tae Jun; Seo, Dong Wan; Kim, Su-Hui; Park, Do Hyun; Lee, Sang Soo; Lee, Sung Koo; Kim, Myung-Hwan

2013-01-01

AIM: To evaluate the feasibility of diagnostic and therapeutic transgastric (TG) peritoneoscopic interventions with a forward-viewing endoscopic ultrasound (FV-EUS). METHODS: This prospective endoscopic experimental study used an animal model. Combined TG peritoneoscopic interventions and EUS examination of the intra-abdominal organs were performed using an FV-EUS on 10 animal models (1 porcine and 9 canine). The procedures carried out include EUS evaluation and endoscopic biopsy of intraperitoneal organs, EUS-guided fine needle aspiration (EUS-FNA), EUS-guided radiofrequency ablation (EUS-RFA), and argon plasma coagulation (APC) for hemostatic control. The animals were kept alive for 7 d, and then necropsy was performed to evaluate results and complications. RESULTS: In all 10 animals, TG peritoneoscopy, followed by endoscopic biopsy for the liver, spleen, abdominal wall, and omentum, was performed successfully. APC helped control minor bleeding. Visualization of intra-abdominal solid organs with real-time EUS was accomplished with ease. Intraperitoneal EUS-FNA was successfully performed on the liver, spleen, and kidney. Similarly, a successful outcome was achieved with EUS-RFA of the hepatic parenchyma. No adverse events were recorded during the study. CONCLUSION: Peritoneoscopic natural orifice transluminal endoscopic surgery (NOTES) interventions through FV-EUS were feasible in providing evaluation and performing endoscopic procedures. It promises potential as a platform for future EUS-based NOTES. PMID:24222961

Performance characteristics of ambient temperature secondary lithium cells

NASA Technical Reports Server (NTRS)

Deligiannis, F.; Shen, D.; Subbarao, S.; Whitcanack, L.; Halpert, G.

1988-01-01

State of art ambient temperature secondary lithium cells were evaluated to determine their performance capability and limitations and to assess the present status of the technology of these cells. Li-MoS2, Li-NbSe3 and Li-TiS2 cells were evaluated for their charge/discharge characteristics, rate capability, and cycle life performance. The cells evaluated have a cycle life of 100-250 cycles at moderate discharge rates (C/5). The specific energy of these cells is between 50 and 100 Wh/Kg, depending upon the system. This paper describes the details of the cell designs, the test procedures, and the results of the evaluation studies.

Evaluation of feedback interventions for improving the quality assurance of cancer screening in Japan: study design and report of the baseline survey.

PubMed

Machii, Ryoko; Saika, Kumiko; Higashi, Takahiro; Aoki, Ayako; Hamashima, Chisato; Saito, Hiroshi

2012-02-01

The importance of quality assurance in cancer screening has recently gained increasing attention in Japan. To evaluate and improve quality, checklists and process indicators have been developed. To explore effective methods of enhancing quality in cancer screening, we started a randomized control study of the methods of evaluation and feedback for cancer control from 2009 to 2014. We randomly assigned 1270 municipal governments, equivalent to 71% of all Japanese municipal governments that performed screening programs, into three groups. The high-intensity intervention groups (n = 425) were individually evaluated using both checklist performance and process indicator values, while the low-intensity intervention groups (n= 421) were individually evaluated on the basis of only checklist performance. The control group (n = 424) received only a basic report that included the national average of checklist performance scores. We repeated the survey for each municipality's quality assurance activity performance using checklists and process indicators. In this paper, we report our study design and the result of the baseline survey. The checklist adherence rates were especially low in the checklist elements related to invitation of individuals, detailed monitoring of process indicators such as cancer detection rates according to screening histories and appropriate selection of screening facilities. Screening rate and percentage of examinees who underwent detailed examination tended to be lower for large cities when compared with smaller cities for all cancer sites. The performance of the Japanese cancer screening program in 2009 was identified for the first time.

A Study of the Correlation of the Improvement of Teaching Evaluation Scores Based on Student Performance Grades

ERIC Educational Resources Information Center

Chen, Chi Yuan; Wang, Shu-Yin; Yang, Yi-Fang

2017-01-01

The purpose of the study is to explore the influence of teaching evaluations on teachers in that they might try to please their students by giving higher grades in order to get higher teaching evaluation scores. To achieve this purpose, the study analyzed the correlations between teaching evaluation scores, student's final grades and course fail…

Evaluation of emergency department performance - a systematic review on recommended performance and quality-in-care measures.

PubMed

Sørup, Christian Michel; Jacobsen, Peter; Forberg, Jakob Lundager

2013-08-09

Evaluation of emergency department (ED) performance remains a difficult task due to the lack of consensus on performance measures that reflects high quality, efficiency, and sustainability. To describe, map, and critically evaluate which performance measures that the published literature regard as being most relevant in assessing overall ED performance. Following the PRISMA guidelines, a systematic literature review of review articles reporting accentuated ED performance measures was conducted in the databases of PubMed, Cochrane Library, and Web of Science. Study eligibility criteria includes: 1) the main purpose was to discuss, analyse, or promote performance measures best reflecting ED performance, 2) the article was a review article, and 3) the article reported macro-level performance measures, thus reflecting an overall departmental performance level. A number of articles addresses this study's objective (n = 14 of 46 unique hits). Time intervals and patient-related measures were dominant in the identified performance measures in review articles from US, UK, Sweden and Canada. Length of stay (LOS), time between patient arrival to initial clinical assessment, and time between patient arrivals to admission were highlighted by the majority of articles. Concurrently, "patients left without being seen" (LWBS), unplanned re-attendance within a maximum of 72 hours, mortality/morbidity, and number of unintended incidents were the most highlighted performance measures that related directly to the patient. Performance measures related to employees were only stated in two of the 14 included articles. A total of 55 ED performance measures were identified. ED time intervals were the most recommended performance measures followed by patient centeredness and safety performance measures. ED employee related performance measures were rarely mentioned in the investigated literature. The study's results allow for advancement towards improved performance measurement and standardised assessment across EDs.

Perceptions on evaluative and formative functions of external supervision of Rwandan primary healthcare facilities: A qualitative study.

PubMed

Schriver, Michael; Cubaka, Vincent Kalumire; Itangishaka, Sylvere; Nyirazinyoye, Laetitia; Kallestrup, Per

2018-01-01

External supervision of primary healthcare facilities in low- and middle-income countries often has a managerial main purpose in which the role of support for professional development is unclear. To explore how Rwandan primary healthcare supervisors and providers (supervisees) perceive evaluative and formative functions of external supervision. Qualitative, exploratory study. Focus group discussions: three with supervisors, three with providers, and one mixed (n = 31). Findings were discussed with individual and groups of supervisors and providers. Evaluative activities occupied providers' understanding of supervision, including checking, correcting, marking and performance-based financing. These were presented as sources of motivation, that in self-determination theory indicate introjected regulation. Supervisors preferred to highlight their role in formative supervision, which may mask their own and providers' uncontested accounts that systematic performance evaluations predominated supervisors' work. Providers strongly requested larger focus on formative and supportive functions, voiced as well by most supervisors. Impact of performance evaluation on motivation and professional development is discussed. While external supervisors intended to support providers' professional development, our findings indicate serious problems with this in a context of frequent evaluations and performance marking. Separating the role of supporter and evaluator does not appear as the simple solution. If external supervision is to improve health care services, it is essential that supervisors and health centre managers are competent to support providers in a way that transparently accounts for various performance pressures. This includes delivery of proper formative supervision with useful feedback, maintaining an effective supervisory relationship, as well as ensuring providers are aware of the purpose and content of evaluative and formative supervision functions.

The Effect of Conductor Expressivity on Ensemble Performance Evaluation

ERIC Educational Resources Information Center

Morrison, Steven J.; Price, Harry E.; Geiger, Carla G.; Cornacchio, Rachel A.

2009-01-01

In this study, the authors examined whether a conductor's use of high-expressivity or low-expressivity techniques affected evaluations of ensemble performances that were identical across conducting conditions. Two conductors each conducted two 1-minute parallel excerpts from Percy Grainger's "Walking Tune." Each directed one excerpt…

The Role of Performance Quality in Adolescents' Self-Evaluation and Rumination after a Speech: Is it Contingent on Social Anxiety Level?

PubMed

Blöte, Anke W; Miers, Anne C; Van den Bos, Esther; Westenberg, P Michiel

2018-05-17

Cognitive behavioural therapy (CBT) has relatively poor outcomes for youth with social anxiety, possibly because broad-based CBT is not tailored to their specific needs. Treatment of social anxiety in youth may need to pay more attention to negative social cognitions that are considered a key factor in social anxiety development and maintenance. The aim of the present study was to learn more about the role of performance quality in adolescents' cognitions about their social performance and, in particular, the moderating role social anxiety plays in the relationship between performance quality and self-cognitions. A community sample of 229 participants, aged 11 to 18 years, gave a speech and filled in questionnaires addressing social anxiety, depression, expected and self-evaluated performance, and post-event rumination. Independent observers rated the quality of the speech. The data were analysed using moderated mediation analysis. Performance quality mediated the link between expected and self-evaluated performance in adolescents with low and medium levels of social anxiety. For adolescents with high levels of social anxiety, only a direct link between expected and self-evaluated performance was found. Their self-evaluation was not related to the quality of their performance. Performance quality also mediated the link between expected performance and rumination, but social anxiety did not moderate this mediation effect. Results suggest that a good performance does not help socially anxious adolescents to replace their negative self-evaluations with more realistic ones. Specific cognitive intervention strategies should be tailored to the needs of socially anxious adolescents who perform well.

Collaborative study using common samples to evaluate the performance of anti-drug antibody assays constructed by different companies.

PubMed

Niimi, Shingo; Nishimiya, Kazuhiro; Nishidate, Masanobu; Saito, Tetsu; Minoura, Kyoko; Kadotsuji, Kenta; Shimakura, Jin; Shigemizu, Hiroko; Hosogi, Jun; Adachi, Maiko; Hashimoto, Tsutomu; Mori, Tamiki; Harada, Hideki; Yamamoto, Ken-Ichi; Nakamura, Takahiro; Nomura, Tatsuki; Yamaguchi, Itadaki; Sonehara, Kazuhiko; Ishii-Watabe, Akiko; Kawasaki, Nana

2018-04-01

This study was undertaken to evaluate the performance of anti-drug antibody (ADA) assays constructed by each participating company using common samples including ADA, drug and human serum. The ADA assays constructed by each company showed good sensitivity and precision for evaluation of ADA. Cut points for screening and confirmatory assays and assay selectivity were determined by various calculation methods. In evaluations of blind ADA samples, nearly similar results were obtained by the study companies in determinations of whether samples were positive or negative except at the lowest sample concentration (5 ng/mL). In measurement of drug tolerance, for almost samples containing ADA and drugs, more positive results were obtained in assays using acid dissociation compared to those without acid dissociation. Overall, the performance of ADA assays constructed by the 10 companies participating in this study was acceptable in terms of sensitivity and reproducibility for detection and evaluation of immunogenicity in both patients and healthy subjects. On the other hand, based on results for samples containing ADA and drugs, validity of results for ADA assays conducted without acid dissociation was less meaningful and more difficult to evaluate. Thus, acid dissociation was confirmed to be useful for improving drug tolerance. Copyright © 2018 The Japanese Society for the Study of Xenobiotics. Published by Elsevier Ltd. All rights reserved.

Studies on the exercise physiology of draft horses performed in Japan during the 1950s and 1960s.

PubMed

Hiraga, Atsushi; Sugano, Shigeru

2017-01-01

Although the total number of horses raised in Japan dramatically decreased after World War II, because draft horses were still used for farm work in paddy fields and on farms during the period of the 1950s and 1960s, a performance test for selecting better draft horses was needed. In order to determine the most suitable size of draft horses for Japanese farm conditions, the working power of horses weighing from 185 to 622 kg was evaluated by performing an endurance test, several kinds of working power tests, and maximum pulling power tests. Oxygen consumption during draft exercise was measured by the Douglas bag method in order to evaluate effects of draft workload under the conditions of different types of work (14- and 18-cm plow depths, cultivator, and tillage), traction methods (shoulder traction, shoulder-trunk traction, and chest-trunk traction), walking speeds (40, 60, 80, 100, and 120 m/min), and depths of water (0, 18, 36, and 54 cm) on energy expenditure. The relationship between energy consumption and pulse rate during exercise was also evaluated. A study of a performance test for draft horses was conducted to establish a new approach for evaluating draft horse performance using heart rate as an index. For this study, a beat meter for measuring heart rate was developed, and experimental protocols were used to evaluate the relationship between heart rate and workload. Although the research results obtained from these studies do not have particular relevance in the current day, these studies are valuable for understanding the history of equine exercise physiology in Japan.

Studies on the exercise physiology of draft horses performed in Japan during the 1950s and 1960s

PubMed Central

HIRAGA, Atsushi; SUGANO, Shigeru

2017-01-01

ABSTRACT Although the total number of horses raised in Japan dramatically decreased after World War II, because draft horses were still used for farm work in paddy fields and on farms during the period of the 1950s and 1960s, a performance test for selecting better draft horses was needed. In order to determine the most suitable size of draft horses for Japanese farm conditions, the working power of horses weighing from 185 to 622 kg was evaluated by performing an endurance test, several kinds of working power tests, and maximum pulling power tests. Oxygen consumption during draft exercise was measured by the Douglas bag method in order to evaluate effects of draft workload under the conditions of different types of work (14- and 18-cm plow depths, cultivator, and tillage), traction methods (shoulder traction, shoulder-trunk traction, and chest-trunk traction), walking speeds (40, 60, 80, 100, and 120 m/min), and depths of water (0, 18, 36, and 54 cm) on energy expenditure. The relationship between energy consumption and pulse rate during exercise was also evaluated. A study of a performance test for draft horses was conducted to establish a new approach for evaluating draft horse performance using heart rate as an index. For this study, a beat meter for measuring heart rate was developed, and experimental protocols were used to evaluate the relationship between heart rate and workload. Although the research results obtained from these studies do not have particular relevance in the current day, these studies are valuable for understanding the history of equine exercise physiology in Japan. PMID:28400701

Engineered Barrier System performance requirements systems study report. Revision 02

DOE Office of Scientific and Technical Information (OSTI.GOV)

Balady, M.A.

This study evaluates the current design concept for the Engineered Barrier System (EBS), in concert with the current understanding of the geologic setting to assess whether enhancements to the required performance of the EBS are necessary. The performance assessment calculations are performed by coupling the EBS with the geologic setting based on the models (some of which were updated for this study) and assumptions used for the 1995 Total System Performance Assessment (TSPA). The need for enhancements is determined by comparing the performance assessment results against the EBS related performance requirements. Subsystem quantitative performance requirements related to the EBS includemore » the requirement to allow no more than 1% of the waste packages (WPs) to fail before 1,000 years after permanent closure of the repository, as well as a requirement to control the release rate of radionuclides from the EBS. The EBS performance enhancements considered included additional engineered components as well as evaluating additional performance available from existing design features but for which no performance credit is currently being taken.« less

Effect of the learning climate of residency programs on faculty's teaching performance as evaluated by residents.

PubMed

Lombarts, Kiki M J M H; Heineman, Maas Jan; Scherpbier, Albert J J A; Arah, Onyebuchi A

2014-01-01

To understand teaching performance of individual faculty, the climate in which residents' learning takes place, the learning climate, may be important. There is emerging evidence that specific climates do predict specific outcomes. Until now, the effect of learning climate on the performance of the individual faculty who actually do the teaching was unknown. THIS STUDY: (i) tested the hypothesis that a positive learning climate was associated with better teaching performance of individual faculty as evaluated by residents, and (ii) explored which dimensions of learning climate were associated with faculty's teaching performance. We conducted two cross-sectional questionnaire surveys amongst residents from 45 residency training programs and multiple specialties in 17 hospitals in the Netherlands. Residents evaluated the teaching performance of individual faculty using the robust System for Evaluating Teaching Qualities (SETQ) and evaluated the learning climate of residency programs using the Dutch Residency Educational Climate Test (D-RECT). The validated D-RECT questionnaire consisted of 11 subscales of learning climate. Main outcome measure was faculty's overall teaching (SETQ) score. We used multivariable adjusted linear mixed models to estimate the separate associations of overall learning climate and each of its subscales with faculty's teaching performance. In total 451 residents completed 3569 SETQ evaluations of 502 faculty. Residents also evaluated the learning climate of 45 residency programs in 17 hospitals in the Netherlands. Overall learning climate was positively associated with faculty's teaching performance (regression coefficient 0.54, 95% confidence interval: 0.37 to 0.71; P<0.001). Three out of 11 learning climate subscales were substantially associated with better teaching performance: 'coaching and assessment', 'work is adapted to residents' competence', and 'formal education'. Individual faculty's teaching performance evaluations are positively affected by better learning climate of residency programs.

Belgian guidelines for economic evaluations: second edition.

PubMed

Thiry, Nancy; Neyt, Mattias; Van De Sande, Stefaan; Cleemput, Irina

2014-12-01

The aim of this study was to present the updated methodological guidelines for economic evaluations of healthcare interventions (drugs, medical devices, and other interventions) in Belgium. The update of the guidelines was performed by three Belgian health economists following feedback from users of the former guidelines and personal experience. The updated guidelines were discussed with a multidisciplinary team consisting of other health economists, assessors of reimbursement request files, representatives of Belgian databases and representatives of the drugs and medical devices industry. The final document was validated by three external validators that were not involved in the previous discussions. The guidelines give methodological guidance for the following components of an economic evaluation: literature review, perspective of the evaluation, definition of the target population, choice of the comparator, analytic technique and study design, calculation of costs, valuation of outcomes, definition of the time horizon, modeling, handling uncertainty and discounting. We present a reference case that can be considered as the minimal requirement for Belgian economic evaluations of health interventions. These guidelines will improve the methodological quality, transparency and uniformity of the economic evaluations performed in Belgium. The guidelines will also provide support to the researchers and assessors performing or evaluating economic evaluations.

[Work as a source of pleasure: evaluating a Psychosocial Care Center team].

PubMed

Glanzner, Cecília Helena; Olschowsky, Agnes; Kantorski, Luciane Prado

2011-06-01

The objective of this study was to evaluate the pleasure at work felt by the members of a Psychosocial Care Center team. This qualitative case study used Forth Generation Evaluation. This study was performed in Foz do Iguaçu, Parana, Brazil, in November and December 2006. Participants were 10 tem members. Data collection was performed through observation and individual interviews. The analysis was initiated at the same time as the data collection, and the final analysis was performed as per the following steps: data ordering, classification and final analysis. The following analysis themes were developed: work characteristics at the psychological care center, suffering and coping with suffering at work. During the evaluation, the participants showed pleasure and fulfillment with their work by expressing pride, fulfillment and appreciation of what they deliver. Pleasure occurs during the development of psychosocial care, because they always have the freedom to rearrange their manner of working, making possible to develop activities and attitudes capable of giving them pleasure.

Study of the Correlation between the Performances of Lunar Vehicle Wheels Predicted by the Nepean Wheeled Vehicle Performance Model and Test Data

NASA Technical Reports Server (NTRS)

Wong, J. Y.; Asnani, V. M.

2008-01-01

This paper describes the results of a study of the correlation between the performances of wheels for lunar vehicles predicted using the Nepean wheeled vehicle performance model (NWVPM), developed under the auspices of Vehicle Systems Development Corporation, Ottawa, Canada, and the corresponding test data presented in Performance evaluation of wheels for lunar vehicles , Technical Report M-70-2, prepared for George C. Marshall Space Flight Center, National Aeronautics and Space Administration (NASA), USA, by the US Army Engineer Waterways Experiment Station (WES). The NWVPM was originally developed for design and performance evaluation of terrestrial off-road wheeled vehicles. The purpose of this study is to assess the potential of the NWVPM for evaluating wheel candidates for the new generation of extra-terrestrial vehicles. Two versions of a wire-mesh wheel and a hoop-spring wheel, which were considered as candidates for lunar roving vehicles for the NASA Apollo program in the late 1960s, together with a pneumatic wheel were examined in this study. The tractive performances of these wheels and of a 464 test vehicle with the pneumatic wheels on air-dry sand were predicted using the NWVPM and compared with the corresponding test data obtained under Earth s gravity and previously documented in the above-named report. While test data on wheel or vehicle performances obtained under Earth s gravity may not necessarily be representative of those on extra-terrestrial bodies, because of the differences in gravity and in environmental conditions, such as atmospheric pressure, it is still a valid approach to use test data obtained under Earth s gravity to evaluate the predictive capability of the NWVPM and its potential applications to predicting wheel or wheeled rover performances on extra-terrestrial bodies. Results of this study show that, using the ratio (P20/W) of the drawbar pull to normal load at 20 per cent slip as a performance indicator, there is a reasonable correlation between the predictions and experimental data. This indicates that the NWVPM has the potential as an engineering tool for evaluating wheel candidates for a future generation of extra-terrestrial vehicles, provided that appropriate input data are available.

Anesthesiology resident personality type correlates with faculty assessment of resident performance.

PubMed

Schell, Randall M; Dilorenzo, Amy N; Li, Hsin-Fang; Fragneto, Regina Y; Bowe, Edwin A; Hessel, Eugene A

2012-11-01

To study the association between anesthesiology residents' personality preference types, faculty evaluations of residents' performance, and knowledge. Convenience sample and prospective study. Academic department of anesthesiology. Consenting anesthesiology residents (n = 36). All participants completed the Myers Briggs Type Indicator® (MBTI®). All residents' 6-month summation of daily focal evaluations completed by faculty [daily performance score (DPS); 1 = unsatisfactory, 2 = needs improvement, 3 = meets expectations, 4 = exceeds expectations], as well as a global assessment of performance (GAP) score based on placement of each resident into perceived quartile compared with their peers (ie,1 = first, or top, quartile) by senior faculty (n = 7) who also completed the MBTI, were obtained. The resident MBTI personality preferences were compared with the DPS and GAP scores, the United States Medical Licensing Examination (USMLE) I and II scores, and faculty MBTI personality type. There was no association between personality preference type and performance on standardized examinations (USMLE I, II). The mean GAP score was better (higher quartile score) for Extraverts than Introverts (median 2.0 vs 2.6, P = 0.0047) and for Sensing versus Intuition (median 2.0 vs 2.6, P = 0.0206) preference. Faculty evaluator MBTI preference type did not influence the GAP scores they assigned residents. Like GAP, the DPS was better for residents with Sensing versus Intuition preference (median 3.5 vs 3.3, P = 0.0111). No difference in DPS was noted between Extraverts and Introverts. Personality preference type was not associated with resident performance on standardized examinations, but it was associated with faculty evaluations of resident performance. Residents with Sensing personality preference were evaluated more favorably on global and focal faculty evaluations than those residents who chose the Intuition preference. Extraverted residents were evaluated more favorably on global but not focal assessment of performance. Copyright © 2012 Elsevier Inc. All rights reserved.

Multispectral scanner data applications evaluation. Volume 1: User applications study

NASA Technical Reports Server (NTRS)

Thomson, F. J.; Erickson, J. D.; Nalepka, R. F.; Weber, J. D.

1974-01-01

A six-month systems study of earth resource surveys from satellites was conducted and is reported. SKYLAB S-192 multispectral scanner (MSS) data were used as a baseline to aid in evaluating the characteristics of future systems using satellite MSS sensors. The study took the viewpoint that overall system (sensor and processing) characteristics and parameter values should be determined largely by user requirements for automatic information extraction performance in quasi-operational earth resources surveys, the other major factor being hardware limitations imposed by state-of-the-art technology and cost. The objective was to use actual aircraft and spacecraft MSS data to outline parametrically the trade-offs between user performance requirements and hardware performance and limitations so as to allow subsequent evaluation of compromises which must be made in deciding what system(s) to build.

Effects of Caffeine Supplementation on Performance in Ball Games.

PubMed

Chia, Jingyi Shannon; Barrett, Laura Ann; Chow, Jia Yi; Burns, Stephen Francis

2017-12-01

Although a large body of evidence exists documenting the ergogenic properties of caffeine, most studies have focused on endurance performance. However, findings from endurance sports cannot be generalized to performance in ball games where, apart from having a high level of endurance, successful athletic performances require a combination of physiological, technical and cognitive capabilities. The purpose of this review was to critically evaluate studies that have examined the effect of a single dose of caffeine in isolation on one or more of the following performance measures: total distance, sprint performance, agility, vertical jump performance and accuracy in ball games. Searches of three major databases resulted in 19 studies (invasion games: 13; net-barrier games: 6) that evaluated the acute effects of caffeine on human participants, provided the caffeine dose administered, and included a ball games specific task or simulated match. Improvements in sprint performance were observed in 8 of 10 studies (80%), and vertical jump in 7 of 8 studies (88%). Equivocal results were reported for distance covered, agility and accuracy. Minor side effects were reported in 4 of 19 studies reviewed. Pre-exercise caffeine ingestion between 3.0 and 6.0 mg/kg of body mass appears to be a safe ergogenic aid for athletes in ball games. However, the efficacy of caffeine varies depending on various factors, including, but not limited to, the nature of the game, physical status and caffeine habituation. More research is warranted to clarify the effects of caffeine on performance measures unique to ball games, such as agility and accuracy. It is essential that athletes, coaches and practitioners evaluate the risk-benefit ratio of caffeine ingestion strategies on an individual case-by-case basis.

WWC Review of the Report "Incentives, Selection, and Teacher Performance: Evidence from IMPACT." What Works Clearinghouse Single Study Review

ERIC Educational Resources Information Center

What Works Clearinghouse, 2014

2014-01-01

The 2013 study, "Incentives, Selection, and Teacher Performance: Evidence from IMPACT" examined the effects of "IMPACT," a teacher evaluation system used in the District of Columbia Public Schools, on teacher retention and performance. "IMPACT" assigns each teacher a single performance score based on classroom…

Relationship between touch sensation of the affected hand and performance of valued activities in individuals with chronic stroke.

PubMed

Hill, Valerie A; Fisher, Thomas; Schmid, Arlene A; Crabtree, Jeffrey; Page, Stephen J

2014-01-01

To investigate the association between touch sensation of the affected hand and performance and satisfaction with performance of valued activities in individuals with chronic stroke. Using a cross-sectional study design, this study correlated factors related to hand sensation and activity performance in individuals with chronic stroke. The Touch Test Evaluators and Canadian Occupational Performance Measure (COPM) were used. Correlations were used to determine the relationships between touch sensation of the affected hand and individuals' performance and satisfaction with performance of valued activities. There was a good to excellent relationship between sensation and performance and satisfaction with performance of valued activities for individuals with intact touch sensation of the affected hand who scored higher on the COPM. There was little to no relationship between touch sensation of the affected hand and performance of valued activities for individuals with impaired sensation. This is the first study to relate touch sensation of the affected hand and performance and satisfaction with performance of valued activities in individuals with stroke. The findings suggest that rehabilitation therapists need to continue to address sensory function in evaluation and intervention as it relates to performance in valued activities. This study serves as a foundation for future research in sensation and performance of valued activities in individuals with chronic stroke.

The use of individualized contract plans as a method of performance evaluation for allied health faculty.

PubMed

Mitcham, M D; Vericella, B J

1985-11-01

Results from a two-year study of the individualized contract plan (ICP) approach to faculty evaluation indicate this is a workable method of performance evaluation for allied health faculty. The ICP was found to be individualized, systematic, flexible, and objective. Faculty members and department chairpersons differed in their perception of the effectiveness of the ICP, but both groups supported its continued use. Five major recommendations were made regarding the continued use of the ICP as a method of faculty performance evaluation: (1) separate evaluation and professional development aspects, (2) link results to the institutional reward structure, (3) administer the ICP uniformly among departments, (4) develop a monitoring mechanism, and (5) foster open communication among all participants in the system.

Feasibility study of solar energy utilization in modular integrated utility systems

NASA Technical Reports Server (NTRS)

1975-01-01

The feasibility and benefits were evaluated of solar thermal energy systems on Integrated Utility Systems. The effort included the identification of potential system concepts, evaluation of hardware status, and performance of weighted system evaluations to select promising system concepts deserving of further study.

Liberal Grading Improves Evaluations but Not Performance.

ERIC Educational Resources Information Center

Vasta, Ross; Sarmiento, Robert F.

1979-01-01

The effects of examination grades on undergraduates' study behaviors, attendance, and evaluations of instruction were examined. Liberal grading was found to result in higher evaluations of course and instructor but had no demonstrable effect on studying or attendance. The implications of these findings and alternative interpretations are…

A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as "CRM simulator study IB").

PubMed

Kim, John; Neilipovitz, David; Cardinal, Pierre; Chiu, Michelle

2009-01-01

Crisis resource management (CRM) skills are a set of nonmedical skills required to manage medical emergencies. There is currently no gold standard for evaluation of CRM performance. A prior study examined the use of a global rating scale (GRS) to evaluate CRM performance. This current study compared the use of a GRS and a checklist as formal rating instruments to evaluate CRM performance during simulated emergencies. First-year and third-year residents participated in two simulator scenarios each. Three raters then evaluated resident performance in CRM using edited video recordings using both a GRS and a checklist. The Ottawa GRS provides a seven-point anchored ordinal scale for performance in five categories of CRM, and an overall performance score. The Ottawa CRM checklist provides 12 items in the five categories of CRM, with a maximum cumulative score of 30 points. Construct validity was measured on the basis of content validity, response process, internal structure, and response to other variables. T-test analysis of Ottawa GRS scores was conducted to examine response to the variable of level of training. Intraclass correlation coefficient (ICC) scores were used to measure inter-rater reliability for both scenarios. Thirty-two first-year and 28 third-year residents participated in the study. Third-year residents produced higher mean scores for overall CRM performance than first-year residents (P < 0.05), and in all individual categories within the Ottawa GRS (P < 0.05) and the Ottawa CRM checklist (P < 0.05). This difference was noted for both scenarios and for each individual rater (P < 0.05). No statistically significant difference in resident scores was observed between scenarios for both instruments. ICC scores of 0.59 and 0.61 were obtained for Scenarios 1 and 2 with the Ottawa GRS, whereas ICC scores of 0.63 and 0.55 were obtained with the Ottawa CRM checklist. Users indicated a strong preference for the Ottawa GRS given ease of scoring, presence of an overall score, and the potential for formative evaluation. Construct validity seems to be present when using both the Ottawa GRS and CRM checklist to evaluate CRM performance during simulated emergencies. Data also indicate the presence of moderate inter-rater reliability when using both the Ottawa GRS and CRM checklist.

Engineering evaluation of SSME dynamic data from engine tests and SSV flights

NASA Technical Reports Server (NTRS)

1986-01-01

An engineering evaluation of dynamic data from SSME hot firing tests and SSV flights is summarized. The basic objective of the study is to provide analyses of vibration, strain and dynamic pressure measurements in support of MSFC performance and reliability improvement programs. A brief description of the SSME test program is given and a typical test evaluation cycle reviewed. Data banks generated to characterize SSME component dynamic characteristics are described and statistical analyses performed on these data base measurements are discussed. Analytical models applied to define the dynamic behavior of SSME components (such as turbopump bearing elements and the flight accelerometer safety cut-off system) are also summarized. Appendices are included to illustrate some typical tasks performed under this study.

Turbine generator evaluation for the Eesti-Energia Estonia and Baltic power plants. Export trade information

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

1995-12-01

The report evaluates the feasibility of 200 MW turbines and generators modernization in two Estonian power plants in order to improve performance and/or availability. This is Volume 1 and it includes the following: (1) scope; (2) evaluation approach; (3) summary of major recommendations; (4) performance tests descriptions; (5) current technology -- component description; (6) recommended studies; (7) recommendations; (8) district heating; (9) description of turbine K-200-130; (10) turbine evaluation results; (11) generator; (12) estimation of modernization costs.

Occupational safety of different industrial sectors in Khartoum State, Sudan. Part 1: Safety performance evaluation.

PubMed

Zaki, Gehan R; El-Marakby, Fadia A; H Deign El-Nor, Yasser; Nofal, Faten H; Zakaria, Adel M

2012-12-01

Safety performance evaluation enables decision makers improve safety acts. In Sudan, accident records, statistics, and safety performance were not evaluated before maintenance of accident records became mandatory in 2005. This study aimed at evaluating and comparing safety performance by accident records among different cities and industrial sectors in Khartoum state, Sudan, during the period from 2005 to 2007. This was a retrospective study, the sample in which represented all industrial enterprises in Khartoum state employing 50 workers or more. All industrial accident records of the Ministry of Manpower and Health and those of different enterprises during the period from 2005 to 2007 were reviewed. The safety performance indicators used within this study were the frequency-severity index (FSI) and fatal and disabling accident frequency rates (DAFR). In Khartoum city, the FSI [0.10 (0.17)] was lower than that in Bahari [0.11 (0.21)] and Omdurman [0.84 (0.34)]. It was the maximum in the chemical sector [0.33 (0.64)] and minimum in the metallurgic sector [0.09 (0.19)]. The highest DAFR was observed in Omdurman [5.6 (3.5)] and in the chemical sector [2.5 (4.0)]. The fatal accident frequency rate in the mechanical and electrical engineering industry was the highest [0.0 (0.69)]. Male workers who were older, divorced, and had lower levels of education had the lowest safety performance indicators. The safety performance of the industrial enterprises in Khartoum city was the best. The safety performance in the chemical sector was the worst with regard to FSI and DAFR. The age, sex, and educational level of injured workers greatly affect safety performance.

Objective Fidelity Evaluation in Multisensory Virtual Environments: Auditory Cue Fidelity in Flight Simulation

PubMed Central

Meyer, Georg F.; Wong, Li Ting; Timson, Emma; Perfect, Philip; White, Mark D.

2012-01-01

We argue that objective fidelity evaluation of virtual environments, such as flight simulation, should be human-performance-centred and task-specific rather than measure the match between simulation and physical reality. We show how principled experimental paradigms and behavioural models to quantify human performance in simulated environments that have emerged from research in multisensory perception provide a framework for the objective evaluation of the contribution of individual cues to human performance measures of fidelity. We present three examples in a flight simulation environment as a case study: Experiment 1: Detection and categorisation of auditory and kinematic motion cues; Experiment 2: Performance evaluation in a target-tracking task; Experiment 3: Transferrable learning of auditory motion cues. We show how the contribution of individual cues to human performance can be robustly evaluated for each task and that the contribution is highly task dependent. The same auditory cues that can be discriminated and are optimally integrated in experiment 1, do not contribute to target-tracking performance in an in-flight refuelling simulation without training, experiment 2. In experiment 3, however, we demonstrate that the auditory cue leads to significant, transferrable, performance improvements with training. We conclude that objective fidelity evaluation requires a task-specific analysis of the contribution of individual cues. PMID:22957068

Postmatch recovery of physical performance and biochemical markers in team ball sports: a systematic review

PubMed Central

Brink, Michel S; Kosse, Silke J; Lemmink, Koen A P M

2018-01-01

Background Insufficient postmatch recovery in elite players may cause an increased risk of injuries, illnesses and non-functional over-reaching. Objective To evaluate postmatch recovery time courses of physical performance and biochemical markers in team ball sport players. Study design Systematic review. Data sources PubMed and Web of Science. Eligibility criteria for selecting studies This systematic review was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The Critical Review Form for Quantitative Studies was used to evaluate quality. Studies were included if they met the following criteria: (1) original research evaluated players’ physical recovery postmatch; (2) team/intermittent sports; and (3) at least two postmeasurements were compared with baseline values. Results Twenty-eight studies were eligible. Mean methodological quality was 11.2±1.11. Most used performance tests and biochemical markers were the countermovement jump test, sprint tests and creatine kinase (CK), cortisol (C) and testosterone (T), respectively. Summary/conclusions The current evidence demonstrates that underlying mechanisms of muscle recovery are still in progress while performance recovery is already reached. CK recovery time courses are up to ≥72 hours. Soccer and rugby players need more time to recover for sprint performance, CK and C in comparison to other team ball sports. There are more high-quality studies needed regarding recovery in various team sports and recovery strategies on an individual level should be evaluated. Clinical relevance Ongoing insufficient recovery can be prevented by the use of the presented recovery time courses as specific practical recovery guidelines. PMID:29527320

Evaluating Preclinical Medical Students by Using Computer-Based Problem-Solving Examinations.

ERIC Educational Resources Information Center

Stevens, Ronald H.; And Others

1989-01-01

A study to determine the feasibility of creating and administering computer-based problem-solving examinations for evaluating second-year medical students in immunology and to determine how students would perform on these tests relative to their performances on concurrently administered objective and essay examinations is described. (Author/MLW)

Professor Age and Gender Affect Student Perceptions and Grades

ERIC Educational Resources Information Center

Joye, Shauna W.; Wilson, Janie H.

2015-01-01

Student evaluations provide rich information about teaching performance, but a number of factors beyond teacher effectiveness influence student evaluations. In this study we examined the effects of professor gender and perceived age on ratings of effectiveness and rapport as well as academic performance. We also asked students to rate professor…

Development of a Rubric for Collegiate Jazz Improvisation Performance Assessment

ERIC Educational Resources Information Center

Moore, Kendall Ryan

2016-01-01

The purpose of this study was to develop a jazz improvisation rubric for the evaluation of collegiate jazz improvisation. To create this measure, research objectives were devised to investigate the aurally-observed performer-controlled components of improvisation, which aurally-observed components should be evaluated in an improvisatory…

Performance Evaluation of Extension Education Centers in Universities Based on the Balanced Scorecard

ERIC Educational Resources Information Center

Wu, Hung-Yi; Lin, Yi-Kuei; Chang, Chi-Hsiang

2011-01-01

This study aims at developing a set of appropriate performance evaluation indices mainly based on balanced scorecard (BSC) for extension education centers in universities by utilizing multiple criteria decision making (MCDM). Through literature reviews and experts who have real practical experiences in extension education, adequate performance…

Performance Evaluation of Automated Passive Capillary Sampler for Estimating Water Drainage in the Vadose Zone

USDA-ARS?s Scientific Manuscript database

Passive capillary samplers (PCAPs) are widely used to monitor, measure and sample drainage water under saturated and unsaturated soil conditions in the vadose zone. The objective of this study was to evaluate the performance and accuracy of automated passive capillary sampler for estimating drainage...

Measures of Searcher Performance: A Psychometric Evaluation.

ERIC Educational Resources Information Center

Wildemuth, Barbara M.; And Others

1993-01-01

Describes a study of medical students that was conducted to evaluate measures of performance on factual searches of INQUIRER, a full-text database in microbiology. Measures relating to recall, precision, search term overlap, and efficiency are discussed; reliability and construct validity are considered; and implications for future research are…

Use of Fiber Bragg Grating (FBG) sensors for performing automated bridge pier structural damage detection and scour monitoring.

DOT National Transportation Integrated Search

2012-04-01

The goal of this study was to evaluate the performance of Fiber Bragg Grating (FBG) sensors able to detect impacts with : different frequencies on a bridge pier. The FBG technology was evaluated under controlled conditions in a laboratory : flume set...

76 FR 6795 - Statement of Organization, Functions, and Delegations of Authority; Office of the National...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-02-08

... Coordinator; (2) applies research methodologies to perform evaluation studies of health information technology grant programs; and, (3) applies advanced mathematical or quantitative modeling to the U.S. health care... remaining items in the paragraph accordingly: ``(1) Applying research methodologies to perform evaluation...

Performance evaluation of the Puritan-Bennett Crew-member portable protective breathing device as prescribed by portions of FAA Action Notice A-8150.2.

DOT National Transportation Integrated Search

1989-05-01

This study was undertaken, on request, to evaluate the performance of the Puritan-Bennett portable crew protective breathing device for contaminant leaks. O2, CO2 levels, inhalation/exhalation pressure, and inhalation temperature. Tests were conducte...

MnROAD cells 16-23 (phase II) : forensic investigation into recycled unbound base and asphalt surface materials.

DOT National Transportation Integrated Search

2017-06-01

This report presents the findings from an eight-year performance evaluation of eight cells (Cells 16-23) built at the Minnesota Road Research Facility (MnROAD) in 2008. The constructed cells were used for two performance evaluation studies of: 1) unb...

The Rasch Model for Evaluating Italian Student Performance

ERIC Educational Resources Information Center

Camminatiello, Ida; Gallo, Michele; Menini, Tullio

2010-01-01

In 1997 the Organisation for Economic Co-operation and Development (OECD) launched the OECD Programme for International Student Assessment (PISA) for collecting information about 15-year-old students in participating countries. Our study analyses the PISA 2006 cognitive test for evaluating the Italian student performance in mathematics, reading…

VERIFICATION OF THE HYDROLOGIC EVALUATION OF LANDFILL PERFORMANCE (HELP) MODEL USING FIELD DATA

EPA Science Inventory

The report describes a study conducted to verify the Hydrologic Evaluation of Landfill Performance (HELP) computer model using existing field data from a total of 20 landfill cells at 7 sites in the United States. Simulations using the HELP model were run to compare the predicted...

Developing low-input, high-biomass, perennial cropping systems for advanced biofuels in the Intermountain West

USDA-ARS?s Scientific Manuscript database

Lignocellulosic biomass studies are being conducted to evaluate perennial herbaceous feedstocks and to determine their field performance and adaptation potential for biomass production in the Intermountain West. Field performance of four biomass entries and four inputs are being evaluated over a lo...

Performance Outcomes of an Online First Aid and CPR Course for Laypersons

ERIC Educational Resources Information Center

Cason, Carolyn L.; Stiller, Janeth

2011-01-01

Objective: The study evaluated the effectiveness of an online first aid course by comparing it with the traditional instructor-led course. An effective online course increases course accessibility and mitigates the major deterrent to widespread layperson training. Design: A comparison group design evaluated performances among 25 laypersons…

Effects of Physical Attractiveness on Evaluation of Vocal Performance.

ERIC Educational Resources Information Center

Wapnick, Joel; Darrow, Alice Ann; Kovacs, Jolan; Dalrymple, Lucinda

1997-01-01

Studies whether physical attractiveness of singers affects judges' ratings of their vocal performances. Reveals that physical attractiveness does impact evaluation, that male raters were more severe than female raters, and that the rating of undergraduate majors versus graduate students and professors combined were not differently affected by…

The Relationship between Neuropsychological and Ecological Measurements of Executive Functioning in Childhood and the Prediction of Mathematics Performance. A Pilot Study

ERIC Educational Resources Information Center

Zorrilla-Silvestre, Lorena; Presentación-Herrero, María Jesús; Gil-Gómez, Jesús

2016-01-01

Introduction: This study explored the variables of executive functioning (EF) that permitted the evaluation of EF both at home and at school. The objective was to compare the results of the evaluations of these functions in children aged 5 to 6 years, and see to what extent these variables predicted mathematics performance best. Method: Sixty-six…

Wavelet-based compression of pathological images for telemedicine applications

NASA Astrophysics Data System (ADS)

Chen, Chang W.; Jiang, Jianfei; Zheng, Zhiyong; Wu, Xue G.; Yu, Lun

2000-05-01

In this paper, we present the performance evaluation of wavelet-based coding techniques as applied to the compression of pathological images for application in an Internet-based telemedicine system. We first study how well suited the wavelet-based coding is as it applies to the compression of pathological images, since these images often contain fine textures that are often critical to the diagnosis of potential diseases. We compare the wavelet-based compression with the DCT-based JPEG compression in the DICOM standard for medical imaging applications. Both objective and subjective measures have been studied in the evaluation of compression performance. These studies are performed in close collaboration with expert pathologists who have conducted the evaluation of the compressed pathological images and communication engineers and information scientists who designed the proposed telemedicine system. These performance evaluations have shown that the wavelet-based coding is suitable for the compression of various pathological images and can be integrated well with the Internet-based telemedicine systems. A prototype of the proposed telemedicine system has been developed in which the wavelet-based coding is adopted for the compression to achieve bandwidth efficient transmission and therefore speed up the communications between the remote terminal and the central server of the telemedicine system.

Predictive validity of driving-simulator assessments following traumatic brain injury: a preliminary study.

PubMed

Lew, Henry L; Poole, John H; Lee, Eun Ha; Jaffe, David L; Huang, Hsiu-Chen; Brodd, Edward

2005-03-01

To evaluate whether driving simulator and road test evaluations can predict long-term driving performance, we conducted a prospective study on 11 patients with moderate to severe traumatic brain injury. Sixteen healthy subjects were also tested to provide normative values on the simulator at baseline. At their initial evaluation (time-1), subjects' driving skills were measured during a 30-minute simulator trial using an automated 12-measure Simulator Performance Index (SPI), while a trained observer also rated their performance using a Driving Performance Inventory (DPI). In addition, patients were evaluated on the road by a certified driving evaluator. Ten months later (time-2), family members observed patients driving for at least 3 hours over 4 weeks and rated their driving performance using the DPI. At time-1, patients were significantly impaired on automated SPI measures of driving skill, including: speed and steering control, accidents, and vigilance to a divided-attention task. These simulator indices significantly predicted the following aspects of observed driving performance at time-2: handling of automobile controls, regulation of vehicle speed and direction, higher-order judgment and self-control, as well as a trend-level association with car accidents. Automated measures of simulator skill (SPI) were more sensitive and accurate than observational measures of simulator skill (DPI) in predicting actual driving performance. To our surprise, the road test results at time-1 showed no significant relation to driving performance at time-2. Simulator-based assessment of patients with brain injuries can provide ecologically valid measures that, in some cases, may be more sensitive than a traditional road test as predictors of long-term driving performance in the community.

HDL-cholesterol and physical performance: results from the ageing and longevity study in the sirente geographic area (ilSIRENTE Study).

PubMed

Landi, Francesco; Russo, Andrea; Cesari, Matteo; Pahor, Marco; Bernabei, Roberto; Onder, Graziano

2007-09-01

High-density lipoprotein (HDL) cholesterol has been hypothesised to be a reliable marker of frailty and poor prognosis among the oldest elderly. We evaluate the relationship of HDL-cholesterol with measures of physical performance, muscle strength, and functional status in older persons aged 80years or older. Data are from baseline evaluation of the ageing and longevity study in the Sirente geographic area (ilSIRENTE study) (n = 364). Physical performance was assessed using the physical performance battery score [short physical performance battery (SPPB)], which is based on three-timed tests: 4-m walking-speed, balance, and chair-stand tests. Muscle strength was measured by hand-grip strength. Analyses of covariance were performed to evaluate the relationship of different HDL-cholesterol levels with physical function. In the unadjusted analyses, physical function (as measured by the 4-m walking-speed, theSPPB score, the basic and instrumental activities of daily living scales scores), but not hand-grip strength, improved significantly as HDL-cholesterol tertiles increased. After adjustment for potential confounders, which included age, gender, living alone, alcohol abuse, physical activity, congestive heart failure, diabetes, cerebrovascular diseases, osteoarthritis, albumin, urea, C-reactive protein and LDL cholesterol, the association of HDL-cholesterol tertiles with the 4-m walking-speed and the SPPB score was still consistent. The present study suggests that among very old subjects living in the community the higher levels of HDL-cholesterol are associated with better functional performance.

Management systems research study

NASA Technical Reports Server (NTRS)

Bruno, A. V.

1975-01-01

The development of a Monte Carlo simulation of procurement activities at the NASA Ames Research Center is described. Data cover: simulation of the procurement cycle, construction of a performance evaluation model, examination of employee development, procedures and review of evaluation criteria for divisional and individual performance evaluation. Determination of the influences and apparent impact of contract type and structure and development of a management control system for planning and controlling manpower requirements.

Case Studies of Teacher Satisfaction with Three Plans for Evaluation and Supervision

ERIC Educational Resources Information Center

Arp, Jeb-Stuart Bennett

2013-01-01

The purpose of this study was to identify which plans for evaluation and supervision are most satisfactory to teachers. The study's participants come from three school systems in northwest Georgia. Each school district uses a different plan for evaluation and supervision; each claiming that the end goal is to improve teacher performance. Prior…

Overall Performance Evaluation of Tubular Scraper Conveyors Using a TOPSIS-Based Multiattribute Decision-Making Method

PubMed Central

Yao, Yanping; Kou, Ziming; Meng, Wenjun; Han, Gang

2014-01-01

Properly evaluating the overall performance of tubular scraper conveyors (TSCs) can increase their overall efficiency and reduce economic investments, but such methods have rarely been studied. This study evaluated the overall performance of TSCs based on the technique for order of preference by similarity to ideal solution (TOPSIS). Three conveyors of the same type produced in the same factory were investigated. Their scraper space, material filling coefficient, and vibration coefficient of the traction components were evaluated. A mathematical model of the multiattribute decision matrix was constructed; a weighted judgment matrix was obtained using the DELPHI method. The linguistic positive-ideal solution (LPIS), the linguistic negative-ideal solution (LNIS), and the distance from each solution to the LPIS and the LNIS, that is, the approximation degrees, were calculated. The optimal solution was determined by ordering the approximation degrees for each solution. The TOPSIS-based results were compared with the measurement results provided by the manufacturer. The ordering result based on the three evaluated parameters was highly consistent with the result provided by the manufacturer. The TOPSIS-based method serves as a suitable evaluation tool for the overall performance of TSCs. It facilitates the optimal deployment of TSCs for industrial purposes. PMID:24991646

Effects of structured written feedback by cards on medical students' performance at Mini Clinical Evaluation Exercise (Mini-CEX) in an outpatient clinic.

PubMed

Haghani, Fariba; Hatef Khorami, Mohammad; Fakhari, Mohammad

2016-07-01

Feedback cards are recommended as a feasible tool for structured written feedback delivery in clinical education while effectiveness of this tool on the medical students' performance is still questionable.  The purpose of this study was to compare the effects of structured written feedback by cards as well as verbal feedback versus verbal feedback alone on the clinical performance of medical students at the Mini Clinical Evaluation Exercise (Mini-CEX) test in an outpatient clinic. This is a quasi-experimental study with pre- and post-test comprising four groups in two terms of medical students' externship. The students' performance was assessed through the Mini-Clinical Evaluation Exercise (Mini-CEX) as a clinical performance evaluation tool. Structured written feedbacks were given to two experimental groups by designed feedback cards as well as verbal feedback, while in the two control groups feedback was delivered verbally as a routine approach in clinical education. By consecutive sampling method, 62 externship students were enrolled in this study and seven students were excluded from the final analysis due to their absence for three days. According to the ANOVA analysis and Post Hoc Tukey test,  no statistically significant difference was observed among the four groups at the pre-test, whereas a statistically significant difference was observed between the experimental and control groups at the post-test  (F = 4.023, p =0.012). The effect size of the structured written feedbacks on clinical performance was 0.19. Structured written feedback by cards could improve the performance of medical students in a statistical sense. Further studies must be conducted in other clinical courses with longer durations.

"It's Always the Judge's Fault": Attention, Emotion Recognition, and Expertise in Rhythmic Gymnastics Assessment.

PubMed

van Bokhorst, Lindsey G; Knapová, Lenka; Majoranc, Kim; Szebeni, Zea K; Táborský, Adam; Tomić, Dragana; Cañadas, Elena

2016-01-01

In many sports, such as figure skating or gymnastics, the outcome of a performance does not rely exclusively on objective measurements, but on more subjective cues. Judges need high attentional capacities to process visual information and overcome fatigue. Also their emotion recognition abilities might have an effect in detecting errors and making a more accurate assessment. Moreover, the scoring given by judges could be also influenced by their level of expertise. This study aims to assess how rhythmic gymnastics judges' emotion recognition and attentional abilities influence accuracy of performance assessment. Data will be collected from rhythmic gymnastics judges and coaches at different international levels. This study will employ an online questionnaire consisting on an emotion recognition test and attentional test. Participants' task is to watch a set of videotaped rhythmic gymnastics performances and evaluate them on the artistic and execution components of performance. Their scoring will be compared with the official scores given at the competition the video was taken from to measure the accuracy of the participants' evaluations. The proposed research represents an interdisciplinary approach that integrates cognitive and sport psychology within experimental and applied contexts. The current study advances the theoretical understanding of how emotional and attentional aspects affect the evaluation of sport performance. The results will provide valuable evidence on the direction and strength of the relationship between the above-mentioned factors and the accuracy of sport performance evaluation. Importantly, practical implications might be drawn from this study. Intervention programs directed at improving the accuracy of judges could be created based on the understanding of how emotion recognition and attentional abilities are related to the accuracy of performance assessment.

“It’s Always the Judge’s Fault”: Attention, Emotion Recognition, and Expertise in Rhythmic Gymnastics Assessment

PubMed Central

van Bokhorst, Lindsey G.; Knapová, Lenka; Majoranc, Kim; Szebeni, Zea K.; Táborský, Adam; Tomić, Dragana; Cañadas, Elena

2016-01-01

In many sports, such as figure skating or gymnastics, the outcome of a performance does not rely exclusively on objective measurements, but on more subjective cues. Judges need high attentional capacities to process visual information and overcome fatigue. Also their emotion recognition abilities might have an effect in detecting errors and making a more accurate assessment. Moreover, the scoring given by judges could be also influenced by their level of expertise. This study aims to assess how rhythmic gymnastics judges’ emotion recognition and attentional abilities influence accuracy of performance assessment. Data will be collected from rhythmic gymnastics judges and coaches at different international levels. This study will employ an online questionnaire consisting on an emotion recognition test and attentional test. Participants’ task is to watch a set of videotaped rhythmic gymnastics performances and evaluate them on the artistic and execution components of performance. Their scoring will be compared with the official scores given at the competition the video was taken from to measure the accuracy of the participants’ evaluations. The proposed research represents an interdisciplinary approach that integrates cognitive and sport psychology within experimental and applied contexts. The current study advances the theoretical understanding of how emotional and attentional aspects affect the evaluation of sport performance. The results will provide valuable evidence on the direction and strength of the relationship between the above-mentioned factors and the accuracy of sport performance evaluation. Importantly, practical implications might be drawn from this study. Intervention programs directed at improving the accuracy of judges could be created based on the understanding of how emotion recognition and attentional abilities are related to the accuracy of performance assessment. PMID:27458406

Veterinary and human vaccine evaluation methods

PubMed Central

Knight-Jones, T. J. D.; Edmond, K.; Gubbins, S.; Paton, D. J.

2014-01-01

Despite the universal importance of vaccines, approaches to human and veterinary vaccine evaluation differ markedly. For human vaccines, vaccine efficacy is the proportion of vaccinated individuals protected by the vaccine against a defined outcome under ideal conditions, whereas for veterinary vaccines the term is used for a range of measures of vaccine protection. The evaluation of vaccine effectiveness, vaccine protection assessed under routine programme conditions, is largely limited to human vaccines. Challenge studies under controlled conditions and sero-conversion studies are widely used when evaluating veterinary vaccines, whereas human vaccines are generally evaluated in terms of protection against natural challenge assessed in trials or post-marketing observational studies. Although challenge studies provide a standardized platform on which to compare different vaccines, they do not capture the variation that occurs under field conditions. Field studies of vaccine effectiveness are needed to assess the performance of a vaccination programme. However, if vaccination is performed without central co-ordination, as is often the case for veterinary vaccines, evaluation will be limited. This paper reviews approaches to veterinary vaccine evaluation in comparison to evaluation methods used for human vaccines. Foot-and-mouth disease has been used to illustrate the veterinary approach. Recommendations are made for standardization of terminology and for rigorous evaluation of veterinary vaccines. PMID:24741009

Stereotype validation: the effects of activating negative stereotypes after intellectual performance.

PubMed

Clark, Jason K; Thiem, Kelsey C; Barden, Jamie; Stuart, Jillian O'Rourke; Evans, Abigail T

2015-04-01

With regard to intellectual performance, a large body of research has shown that stigmatized group members may perform more poorly when negative, self-relevant stereotypes become activated prior to a task. However, no research to date has identified the potential ramifications of stereotype activation that happens after-rather than before-a person has finished performing. Six studies examined how postperformance stereotype salience may increase the certainty individuals have in evaluations of their own performance. In the current research, the accessibility of gender or racial stereotypes was manipulated after participants completed either a difficult math test (Studies 1-5) or a test of child-care knowledge (Study 6). Consistent with predictions, stereotype activation was found to increase the certainty that women (Studies 1, 2, 4, and 5), African Americans (Study 3), and men (Study 6) had toward negative evaluations of their own test performance. These effects emerged when performance-related perceptions were stereotype consistent rather than inconsistent (Studies 1-6) and were found to be most pronounced among those who were highly identified with the stereotyped group (Study 5). Furthermore, greater certainty-triggered by negative stereotypes-predicted lowered domain-relevant beliefs (Studies 1, 2, 3, and 6) and differential exposure to domain-relevant stimuli (Studies 4 and 5). (c) 2015 APA, all rights reserved).

Simulation Performance and National Council Licensure Examination for Registered Nurses Outcomes: Field Research Perspectives.

PubMed

Brackney, Dana E; Lane, Susan Hayes; Dawson, Tyia; Koontz, Angie

2017-11-01

This descriptive field study examines processes used to evaluate simulation for senior-level Bachelor of Science in Nursing (BSN) students in a capstone course, discusses challenges related to simulation evaluation, and reports the relationship between faculty evaluation of student performance and National Council Licensure Examination for Registered Nurses (NCLEX-RN) first-time passing rates. Researchers applied seven terms used to rank BSN student performance (n = 41, female, ages 22-24 years) in a senior-level capstone simulation. Faculty evaluation was correlated with students' NCLEX-RN outcomes. Students evaluated as "lacking confidence" and "flawed" were less likely to pass the NCLEX-RN on the first attempt. Faculty evaluation of capstone simulation performance provided additional evidence of student preparedness for practice in the RN role, as evidenced by the relationship between the faculty assessment and NCLEX-RN success. Simulation has been broadly accepted as a powerful educational tool that may also contribute to verification of student achievement of program outcomes and readiness for the RN role.

Evaluation of EIT system performance.

PubMed

Yasin, Mamatjan; Böhm, Stephan; Gaggero, Pascal O; Adler, Andy

2011-07-01

An electrical impedance tomography (EIT) system images internal conductivity from surface electrical stimulation and measurement. Such systems necessarily comprise multiple design choices from cables and hardware design to calibration and image reconstruction. In order to compare EIT systems and study the consequences of changes in system performance, this paper describes a systematic approach to evaluate the performance of the EIT systems. The system to be tested is connected to a saline phantom in which calibrated contrasting test objects are systematically positioned using a position controller. A set of evaluation parameters are proposed which characterize (i) data and image noise, (ii) data accuracy, (iii) detectability of single contrasts and distinguishability of multiple contrasts, and (iv) accuracy of reconstructed image (amplitude, resolution, position and ringing). Using this approach, we evaluate three different EIT systems and illustrate the use of these tools to evaluate and compare performance. In order to facilitate the use of this approach, all details of the phantom, test objects and position controller design are made publicly available including the source code of the evaluation and reporting software.

Reference standards, judges, and comparison subjects: roles for experts in evaluating system performance.

PubMed

Hripcsak, George; Wilcox, Adam

2002-01-01

Medical informatics systems are often designed to perform at the level of human experts. Evaluation of the performance of these systems is often constrained by lack of reference standards, either because the appropriate response is not known or because no simple appropriate response exists. Even when performance can be assessed, it is not always clear whether the performance is sufficient or reasonable. These challenges can be addressed if an evaluator enlists the help of clinical domain experts. 1) The experts can carry out the same tasks as the system, and then their responses can be combined to generate a reference standard. 2)The experts can judge the appropriateness of system output directly. 3) The experts can serve as comparison subjects with which the system can be compared. These are separate roles that have different implications for study design, metrics, and issues of reliability and validity. Diagrams help delineate the roles of experts in complex study designs.

Performance Evaluation of Wearable Sensor Systems: A Case Study in Moderate-Scale Deployment in Hospital Environment.

PubMed

Sun, Wen; Ge, Yu; Zhang, Zhiqiang; Wong, Wai-Choong

2015-09-25

A wearable sensor system enables continuous and remote health monitoring and is widely considered as the next generation of healthcare technology. The performance, the packet error rate (PER) in particular, of a wearable sensor system may deteriorate due to a number of factors, particularly the interference from the other wearable sensor systems in the vicinity. We systematically evaluate the performance of the wearable sensor system in terms of PER in the presence of such interference in this paper. The factors that affect the performance of the wearable sensor system, such as density, traffic load, and transmission power in a realistic moderate-scale deployment case in hospital are all considered. Simulation results show that with 20% duty cycle, only 68.5% of data transmission can achieve the targeted reliability requirement (PER is less than 0.05) even in the off-peak period in hospital. We then suggest some interference mitigation schemes based on the performance evaluation results in the case study.

Centaur operations at the space station: Cost and transportation analysis

NASA Technical Reports Server (NTRS)

1988-01-01

A study was conducted to expand on the results of an initial study entitled Centaur Operations at the Space Station. The previous study developed technology demonstration missions (TDMs) that utilized the Centaur G-prime upper stage to advance OTV technologies required for accomodations and operations at the Space Station. An initial evaluation was performed of the cost to NASA for TDM implementation. Due to the potential for commercial communication satellite operation utilizing the TDM hardware, an evaluation of the Centaur's transportation potential was also performed.

Connecting Theory to Practice: Evaluating a Brain-Based Writing Curriculum

ERIC Educational Resources Information Center

Griffee, Dale T.

2007-01-01

This 10 week longitudinal evaluation study evaluated a brain-based learning curriculum proposed by Smilkstein (2003) by comparing student performance in a traditional basic writing curriculum with NHLP-oriented basic writing curriculum. The study included two classes each of experimental and traditional methods. Results of the data, gathered by…

Bench-Scale Evaluation Of Chemically Bonded Phosphate Ceramic Technology To Stabilize Mercury Waste Mixtures

EPA Science Inventory

This bench-scale study was conducted to evaluate the stabilization of mercury (Hg) and mercuric chloride-containing surrogate test materials by the chemically bonded phosphate ceramics technology. This study was performed as part of a U.S. EPA program to evaluate treatment and d...

Systematic review of the methodological quality of controlled trials evaluating Chinese herbal medicine in patients with rheumatoid arthritis

PubMed Central

Pan, Xin; Lopez-Olivo, Maria A; Song, Juhee; Pratt, Gregory; Suarez-Almazor, Maria E

2017-01-01

Objectives We appraised the methodological and reporting quality of randomised controlled clinical trials (RCTs) evaluating the efficacy and safety of Chinese herbal medicine (CHM) in patients with rheumatoid arthritis (RA). Design For this systematic review, electronic databases were searched from inception until June 2015. The search was limited to humans and non-case report studies, but was not limited by language, year of publication or type of publication. Two independent reviewers selected RCTs, evaluating CHM in RA (herbals and decoctions). Descriptive statistics were used to report on risk of bias and their adherence to reporting standards. Multivariable logistic regression analysis was performed to determine study characteristics associated with high or unclear risk of bias. Results Out of 2342 unique citations, we selected 119 RCTs including 18 919 patients: 10 108 patients received CHM alone and 6550 received one of 11 treatment combinations. A high risk of bias was observed across all domains: 21% had a high risk for selection bias (11% from sequence generation and 30% from allocation concealment), 85% for performance bias, 89% for detection bias, 4% for attrition bias and 40% for reporting bias. In multivariable analysis, fewer authors were associated with selection bias (allocation concealment), performance bias and attrition bias, and earlier year of publication and funding source not reported or disclosed were associated with selection bias (sequence generation). Studies published in non-English language were associated with reporting bias. Poor adherence to recommended reporting standards (<60% of the studies not providing sufficient information) was observed in 11 of the 23 sections evaluated. Limitations Study quality and data extraction were performed by one reviewer and cross-checked by a second reviewer. Translation to English was performed by one reviewer in 85% of the included studies. Conclusions Studies evaluating CHM often fail to meet expected methodological criteria, and high-quality evidence is lacking. PMID:28249848

Tethered Swimming for the Evaluation and Prescription of Resistance Training in Young Swimmers.

PubMed

Papoti, Marcelo; da Silva, Adelino S R; Kalva-Filho, Carlos Augusto; Araujo, Gustavo Gomes; Santiago, Vanessa; Martins, LuizEduardo Barreto; Cunha, Sérgio Augusto; Gobatto, Claudio Alexandre

2017-02-01

The aims of the present study were 1) to evaluate the effects of 11 weeks of a typical free-swimming training program on aerobic and stroke parameters determined in tethered swimming (Study 1; n=13) and 2) to investigate the responses of tethered swimming efforts, in addition to free-swimming sessions, through 7 weeks of training (Study 2; n=21). In both studies, subjects performed a graded exercise test in tethered swimming (GET) to determine anaerobic threshold (AnT), stroke rate at AnT (SR AnT ), peak force at GET (PF GET ) and peak blood lactate ([La-] GET ). Participants also swam 100-, 200- and 400-m lengths to evaluate performance. In Study 2, swimmers were divided into control (i. e., only free-swimming; GC [n=11]) and tethered swimming group (i. e., 50% of the main session; G TS [n=10]). The results of Study 1 demonstrate that AnT, PF GET , [La - ] GET and 200-m performance were improved with free-swimming training. The SR AnT decreased with training. In Study 2, free-swimming performance and most of the graded exercise test parameters were not altered in either group. However, [La-] GET improved only for G TS . These results demonstrate that aerobic parameters obtained in tethered swimming can be used to evaluate free-swimming training responses, and the addition of tethered efforts during training routine improves the lactate production capacity of swimmers. © Georg Thieme Verlag KG Stuttgart · New York.

Effects of Newly Designed Hospital Buildings on Staff Perceptions: A Pre-Post Study to Validate Design Decisions.

PubMed

Schreuder, Eliane; van Heel, Liesbeth; Goedhart, Rien; Dusseldorp, Elise; Schraagen, Jan Maarten; Burdorf, Alex

2015-01-01

This study investigates effects of the newly built nonpatient-related buildings of a large university medical center on staff perceptions and whether the design objectives were achieved. The medical center is gradually renewing its hospital building area of 200,000 m.(2) This redevelopment is carefully planned and because lessons learned can guide design decisions of the next phase, the medical center is keen to evaluate the performance of the new buildings. A pre- and post-study with a control group was conducted. Prior to the move to the new buildings an occupancy evaluation was carried out in the old setting (n = 729) (pre-study). Post occupation of the new buildings another occupancy evaluation (post-study) was carried out in the new setting (intervention group) and again in some old settings (control group) (n = 664). The occupancy evaluation consisted of an online survey that measured the perceived performance of different aspects of the building. Longitudinal multilevel analysis was used to compare the performance of the old buildings with the new buildings. Significant improvements were found in indoor climate, perceived safety, working environment, well-being, facilities, sustainability, and overall satisfaction. Commitment to the employer, working atmosphere, orientation, work performance, and knowledge sharing did not improve. The results were interpreted by relating them to specific design choices. We showed that it is possible to measure the performance improvements of a complex intervention being a new building design and validate design decisions. A focused design process aiming for a safe, pleasant and sustainable building resulted in actual improvements in some of the related performance measures. © The Author(s) 2015.

A mixed integer bi-level DEA model for bank branch performance evaluation by Stackelberg approach

NASA Astrophysics Data System (ADS)

Shafiee, Morteza; Lotfi, Farhad Hosseinzadeh; Saleh, Hilda; Ghaderi, Mehdi

2016-03-01

One of the most complicated decision making problems for managers is the evaluation of bank performance, which involves various criteria. There are many studies about bank efficiency evaluation by network DEA in the literature review. These studies do not focus on multi-level network. Wu (Eur J Oper Res 207:856-864, 2010) proposed a bi-level structure for cost efficiency at the first time. In this model, multi-level programming and cost efficiency were used. He used a nonlinear programming to solve the model. In this paper, we have focused on multi-level structure and proposed a bi-level DEA model. We then used a liner programming to solve our model. In other hand, we significantly improved the way to achieve the optimum solution in comparison with the work by Wu (2010) by converting the NP-hard nonlinear programing into a mixed integer linear programming. This study uses a bi-level programming data envelopment analysis model that embodies internal structure with Stackelberg-game relationships to evaluate the performance of banking chain. The perspective of decentralized decisions is taken in this paper to cope with complex interactions in banking chain. The results derived from bi-level programming DEA can provide valuable insights and detailed information for managers to help them evaluate the performance of the banking chain as a whole using Stackelberg-game relationships. Finally, this model was applied in the Iranian bank to evaluate cost efficiency.

Methods for comparative evaluation of propulsion system designs for supersonic aircraft

NASA Technical Reports Server (NTRS)

Tyson, R. M.; Mairs, R. Y.; Halferty, F. D., Jr.; Moore, B. E.; Chaloff, D.; Knudsen, A. W.

1976-01-01

The propulsion system comparative evaluation study was conducted to define a rapid, approximate method for evaluating the effects of propulsion system changes for an advanced supersonic cruise airplane, and to verify the approximate method by comparing its mission performance results with those from a more detailed analysis. A table look up computer program was developed to determine nacelle drag increments for a range of parametric nacelle shapes and sizes. Aircraft sensitivities to propulsion parameters were defined. Nacelle shapes, installed weights, and installed performance was determined for four study engines selected from the NASA supersonic cruise aircraft research (SCAR) engine studies program. Both rapid evaluation method (using sensitivities) and traditional preliminary design methods were then used to assess the four engines. The method was found to compare well with the more detailed analyses.

NASA Animal Enclosure Module Mouse Odor Containment Study for STS-107 September 15, 1999;SJSU Odor Panel Data

NASA Technical Reports Server (NTRS)

Holley, Daniel C.; Mele, Gary D.; Poffenroth, Mary; Young, Cliff

2000-01-01

Experiment #153 by Scott Brady is manifested for shuttle flight STS-107. This evaluation of space flight induced stress and its effects on neuronal plasticity will use 18 six month old C57Bl/6 male mice. A 21 day evaluation study was proposed to determine the length of time groups of 6, 9, or 12 mice could be housed in the Animal Enclosure Module (AEM) without odor breakthrough. This study was performed at NASA-Ames Research Center beginning on September 15, 1999. NASA personnel, were responsible for animal care, maintenance, facilities, hardware, etc. San Jose State personnel performed the odor panel evaluations and data reduction. We used similar procedures and methods for earlier tests evaluating female mice.

Fish Research Project Oregon; Umatilla Hatchery Monitoring and Evaluation, 1992 Annual Report.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Keefe, MaryLouise; Carmichael, Richard W.; French, Rod A.

1993-03-01

This report covers the first year of comprehensive monitoring and evaluation of the Umatilla Hatchery. As both the hatchery and the evaluation study are in the early stages of implementation, much of the information contained in this report is preliminary. The most crucial data for evaluating the success of the hatchery program, the data on post-release performance and survival, is yet unavailable. In addition, several years of data are necessary to make conclusions about rearing performance at Umatilla Hatchery. The conclusions drawn in this report should be viewed as preliminary and should be used in conjunction with additional information asmore » it becomes available. A comprehensive fish health monitoring regimen was incorporated into the monitoring and evaluation study for Umatilla Hatchery. This is a unique feature of the Umatilla Hatchery evaluation project.« less

Performance evaluation of automated segmentation software on optical coherence tomography volume data

PubMed Central

Tian, Jing; Varga, Boglarka; Tatrai, Erika; Fanni, Palya; Somfai, Gabor Mark; Smiddy, William E.

2016-01-01

Over the past two decades a significant number of OCT segmentation approaches have been proposed in the literature. Each methodology has been conceived for and/or evaluated using specific datasets that do not reflect the complexities of the majority of widely available retinal features observed in clinical settings. In addition, there does not exist an appropriate OCT dataset with ground truth that reflects the realities of everyday retinal features observed in clinical settings. While the need for unbiased performance evaluation of automated segmentation algorithms is obvious, the validation process of segmentation algorithms have been usually performed by comparing with manual labelings from each study and there has been a lack of common ground truth. Therefore, a performance comparison of different algorithms using the same ground truth has never been performed. This paper reviews research-oriented tools for automated segmentation of the retinal tissue on OCT images. It also evaluates and compares the performance of these software tools with a common ground truth. PMID:27159849

Towards a balanced performance measurement system in a public health care organization.

PubMed

Yuen, Peter P; Ng, Artie W

2012-01-01

This article attempts to devise an integrated performance measurement framework to assess the Hong Kong Hospital Authority (HA) management system by harnessing previous performance measurement systems. An integrated evaluative framework based on the balanced score card (BSC) was developed and applied using the case study method and longitudinal data to evaluate the HA's performance management system. The authors unveil evolving HA performance indicators (P1). Despite the HA staffs explicit quality emphasis, cost control remains the primary focus in their performance measurements. RESEARCH LHNITATIONS/IMPLICATIONS: Data used in this study are from secondary sources, disclosed mostly by HA staff. This study shows public sector staff often attach too much importance to cost control and easily measurable activities at the expense of quality and other less easily measurable attributes'. A balanced performance measurement system, linked to health targets, with a complementary budgeting process that supports pertinent resource allocation is yet to be implemented in Hong Kong's public hospitals.

Fuzzy logic based sensor performance evaluation of vehicle mounted metal detector systems

NASA Astrophysics Data System (ADS)

Abeynayake, Canicious; Tran, Minh D.

2015-05-01

Vehicle Mounted Metal Detector (VMMD) systems are widely used for detection of threat objects in humanitarian demining and military route clearance scenarios. Due to the diverse nature of such operational conditions, operational use of VMMD without a proper understanding of its capability boundaries may lead to heavy causalities. Multi-criteria fitness evaluations are crucial for determining capability boundaries of any sensor-based demining equipment. Evaluation of sensor based military equipment is a multi-disciplinary topic combining the efforts of researchers, operators, managers and commanders having different professional backgrounds and knowledge profiles. Information acquired through field tests usually involves uncertainty, vagueness and imprecision due to variations in test and evaluation conditions during a single test or series of tests. This report presents a fuzzy logic based methodology for experimental data analysis and performance evaluation of VMMD. This data evaluation methodology has been developed to evaluate sensor performance by consolidating expert knowledge with experimental data. A case study is presented by implementing the proposed data analysis framework in a VMMD evaluation scenario. The results of this analysis confirm accuracy, practicability and reliability of the fuzzy logic based sensor performance evaluation framework.

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017. Published by Elsevier B.V.

Evaluation of Oral and Maxillofacial Surgery Residents' Operative Skills: Feasibility and Engagement Study Using SIMPL Software for a Mobile Phone.

PubMed

Kaban, Leonard B; Cappetta, Alyssa; George, Brian C; Lahey, Edward T; Bohnen, Jordan D; Troulis, Maria J

2017-10-01

There are no universally accepted tools to evaluate operative skills of surgical residents in a timely fashion. The purpose of this study was to determine the feasibility of using a smartphone application, SIMPL (System for Improving and Measuring Procedural Learning), developed by a multi-institutional research collaborative, to achieve a high rate of timely operative evaluations and resident communication and to collect performance data. The authors hypothesized that these goals would be achieved because the process is convenient and efficient. This was a prospective feasibility and engagement study using SIMPL to evaluate residents' operative skills. SIMPL requires the attending surgeon to answer 3 multiple-choice questions: 1) What level of help (Zwisch Scale) was required by the trainee? 2) What was the level of performance? 3) How complex was the case? The evaluator also can dictate a narrative. The sample was composed of 3 faculty members and 3 volunteer senior residents. Predictor variables were the surgeons, trainees, and procedures performed. Outcome variables included number and percentage of procedures performed by faculty-and-resident pairs assessed, time required to complete assessments, time lapsed to submission, percentage of assessments with narratives, and residents' response rates. From March through June 2016, 151 procedures were performed in the operating room by the faculty-and-resident teams. There were 107 assessments submitted (71%). Resident response (self-assessment) to faculty evaluations was 81%. Recorded time to complete assessments (n = 75 of 107) was shorter than 2 minutes. The time lapsed to submission was shorter than 72 hours (100%). Dictations were submitted for 35 evaluations (33%). Data for the type of help, performance, and complexity of cases were collected for each resident. SIMPL facilitates timely intraoperative evaluations of surgical skills, engagement by faculty and residents, and collection of detailed procedural data. Additional prospective trials to assess this tool further are planned. Copyright © 2017 American Association of Oral and Maxillofacial Surgeons. Published by Elsevier Inc. All rights reserved.

Criteria of Police Officer Performance.

ERIC Educational Resources Information Center

Baehr, Melany E.

The indifferent success in achieving the goal of reliable and valid police officer work performance measures has been attributed to the complexity of the job. This study explored reasons for unsatisfactory police performance evaluation, reviewing and integrating previous studies and new recently collected but not yet published data. Performance…

Evaluation of adding item-response theory analysis for evaluation of the European Board of Ophthalmology Diploma examination.

PubMed

Mathysen, Danny G P; Aclimandos, Wagih; Roelant, Ella; Wouters, Kristien; Creuzot-Garcher, Catherine; Ringens, Peter J; Hawlina, Marko; Tassignon, Marie-José

2013-11-01

To investigate whether introduction of item-response theory (IRT) analysis, in parallel to the 'traditional' statistical analysis methods available for performance evaluation of multiple T/F items as used in the European Board of Ophthalmology Diploma (EBOD) examination, has proved beneficial, and secondly, to study whether the overall assessment performance of the current written part of EBOD is sufficiently high (KR-20≥ 0.90) to be kept as examination format in future EBOD editions. 'Traditional' analysis methods for individual MCQ item performance comprise P-statistics, Rit-statistics and item discrimination, while overall reliability is evaluated through KR-20 for multiple T/F items. The additional set of statistical analysis methods for the evaluation of EBOD comprises mainly IRT analysis. These analysis techniques are used to monitor whether the introduction of negative marking for incorrect answers (since EBOD 2010) has a positive influence on the statistical performance of EBOD as a whole and its individual test items in particular. Item-response theory analysis demonstrated that item performance parameters should not be evaluated individually, but should be related to one another. Before the introduction of negative marking, the overall EBOD reliability (KR-20) was good though with room for improvement (EBOD 2008: 0.81; EBOD 2009: 0.78). After the introduction of negative marking, the overall reliability of EBOD improved significantly (EBOD 2010: 0.92; EBOD 2011:0.91; EBOD 2012: 0.91). Although many statistical performance parameters are available to evaluate individual items, our study demonstrates that the overall reliability assessment remains the only crucial parameter to be evaluated allowing comparison. While individual item performance analysis is worthwhile to undertake as secondary analysis, drawing final conclusions seems to be more difficult. Performance parameters need to be related, as shown by IRT analysis. Therefore, IRT analysis has proved beneficial for the statistical analysis of EBOD. Introduction of negative marking has led to a significant increase in the reliability (KR-20 > 0.90), indicating that the current examination format can be kept for future EBOD examinations. © 2013 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Design and implementation of a controlled clinical trial to evaluate the effectiveness and efficiency of routine opt-out rapid human immunodeficiency virus screening in the emergency department.

PubMed

Haukoos, Jason S; Hopkins, Emily; Byyny, Richard L; Conroy, Amy A; Silverman, Morgan; Eisert, Sheri; Thrun, Mark; Wilson, Michael; Boyett, Brian; Heffelfinger, James D

2009-08-01

In 2006, the Centers for Disease Control and Prevention (CDC) released revised recommendations for performing human immunodeficiency virus (HIV) testing in health care settings, including implementing routine rapid HIV screening, the use of an integrated opt-out consent, and limited prevention counseling. Emergency departments (EDs) have been a primary focus of these efforts. These revised CDC recommendations were primarily based on feasibility studies and have not been evaluated through the application of rigorous research methods. This article describes the design and implementation of a large prospective controlled clinical trial to evaluate the CDC's recommendations in an ED setting. From April 15, 2007, through April 15, 2009, a prospective quasi-experimental equivalent time-samples clinical trial was performed to compare the clinical effectiveness and efficiency of routine (nontargeted) opt-out rapid HIV screening (intervention) to physician-directed diagnostic rapid HIV testing (control) in a high-volume urban ED. In addition, three nested observational studies were performed to evaluate the cost-effectiveness and patient and staff acceptance of the two rapid HIV testing methods. This article describes the rationale, methodologies, and study design features of this program evaluation clinical trial. It also provides details regarding the integration of the principal clinical trial and its nested observational studies. Such ED-based trials are rare, but serve to provide valid comparisons between testing approaches. Investigators should consider similar methodology when performing future ED-based health services research.

Systematic review of coaching to enhance surgeons' operative performance.

PubMed

Min, Hyeyoun; Morales, Dianali Rivera; Orgill, Dennis; Smink, Douglas S; Yule, Steven

2015-11-01

There is increasing attention on the coaching of surgeons and trainees to improve performance but no comprehensive review on this topic. The purpose of this review is to summarize the quantity and the quality of studies involving surgical coaching methods and their effectiveness. We performed a systematic literature search through PubMed and PsychINFO by using predefined inclusion criteria. Evidence for main outcome categories was evaluated with the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system and the Medical Education Research Study Quality Instrument (MERSQI). Of a total 3,063 articles, 23 met our inclusion criteria; 4 randomized controlled trials and 19 observational studies. We categorized the articles into 4 groups on the basis of the outcome studied: perception, attitude and opinion; technical skills; nontechnical skills; and performance measures. Overall strength of evidence for each outcome groups was as follows: Perception, attitude, and opinion (Grading of Recommendations Assessment, Development, and Evaluation: Very Low, Medical Education Research Study Quality Instrument [MERSQI]: 10); technical skills (randomized controlled trials: High, 13.1; Observation studies: Very Low, 11.5); nontechnical skills (Very Low, 12.4) and performance measures (Very Low, 13.6). Simulation was the most used setting for coaching; more than half of the studies deployed an experienced surgeon as a coach and showed that coaching was effective. Surgical coaching interventions have a positive impact on learners' perception and attitudes, their technical and nontechnical skills, and performance measures. Evidence of impact on patient outcomes was limited, and the quality of research studies was variable. Despite this, our systematic review of different coaching interventions will benefit future coaching strategies and implementation to enhance operative performance. Copyright © 2015 Elsevier Inc. All rights reserved.

IR DirectFET Extreme Environments Evaluation Final Report

NASA Technical Reports Server (NTRS)

Burmeister, Martin; Mottiwala, Amin

2008-01-01

In 2007, International Rectifier (IR) introduced a new version of its DirectFET metal oxide semiconductor field effect transistor (MOSFET) packaging. The new version (referred to as 'Version 2') enhances device moisture resistance, makes surface mount (SMT) assembly of these devices to printed wiring boards (PWBs) more repeatable, and subsequent assembly inspection simpler. In the present study, the National Aeronautics Space Administration (NASA) Jet Propulsion Laboratory (JPL), in collaboration with Stellar Microelectronics (Stellar), continued an evaluation of the DirectFET that they started together in 2006. The present study focused on comparing the two versions of the DirectFET and examining the suitability of the DirectFET devices for space applications. This study evaluated both versions of two DirectFET packaged devices that had both been shown in the 2006 study to have the best electrical and thermal properties: the IRF6635 and IRF6644. The present study evaluated (1) the relative electrical and thermal performance of both versions of each device, (2) the performance through high reliability testing, and (3) the performance of these devices in combination with a range of alternate solder alloys in the extreme thermal environments of deep space....

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Evaluation of HMA overlays in Illinois.

DOT National Transportation Integrated Search

2008-09-01

The Illinois Department of Transportation (IDOT) has evaluated the performance of the pavements in Illinois in a : variety of studies over the years. Since those studies were conducted, several changes in IDOT practices, policies, and : procedures ha...

An Evaluation of the Impact of E-Learning Media Formats on Student Perception and Performance

NASA Astrophysics Data System (ADS)

Kurbel, Karl; Stankov, Ivo; Datsenka, Rastsislau

Factors influencing student evaluation of web-based courses are analyzed, based on student feedback from an online distance-learning graduate program. The impact of different media formats on the perception of the courses by the students as well as on their performance in these courses are examined. In particular, we studied conventional hypertext-based courses, video-based courses and audio-based courses, and tried to find out whether the media format has an effect on how students assess courses and how good or bad their grades are. Statistical analyses were performed to answer several research questions related to the topic and to properly evaluate the factors influencing student evaluation.

Using Emotional Intelligence and Social Support to Predict Job Performance of Health Educators

ERIC Educational Resources Information Center

Branscum, Paul; Haider, Taj; Brown, David; Sharma, Manoj

2016-01-01

Background: The theory of emotional intelligence (EI) has been developed to evaluate and highlight the importance of emotional health, especially on job performance. Purpose: No study has examined EI's role on the performance of public health educators; therefore, this study examined the role of EI and social support on the performance of health…

The performance of select universities of medical sciences based on the components affecting medical education

PubMed Central

Tayebi Arasteh, Mehdi; Pouragha, Behrooz; Bagheri Kahkesh, Masume

2018-01-01

Background: Every educational institution requires an evaluation system in order to find out about the quality and desirability of its activities, especially if it is a complex and dynamic environment. The present study was conducted to evaluate the educational performance of schools affiliated to Alborz University of Medical Sciences to help improve their performance. Methods: This descriptive analytical study was conducted in six schools affiliated to Alborz University of Medical Sciences in April 2016-October 2016 and October 2016-April 2017. The evaluation was carried out in two stages: self-assessment by service executives across schools, and external assessment in person by the university’s expert staff. The study tools included the components, criteria and desirable standards of educational performance in ten categories. Data were analyzed in SPSS. Results: The results obtained showed that, in April-October 2016, the highest performance evaluation scores pertained to the "secure testing" and "rules and regulations" components and the lowest to the "packages for reform and innovation in education" and "the school action plan" components. In October 2016-April 2017, the highest scores pertained to "workforce empowerment" and "secure testing" and the lowest to "faculty affairs" and "electronic education management system". Conclusions: Offering a balanced portrayal of the actual performance of schools using the right performance indicators in two consecutive periods can help further motivate the superior schools and encourage the weaker schools to strive harder. Competition among schools to get a higher score in the components affecting medical education helps mobilize them to move toward reform and improvement. PMID:29770211

Evaluation of Aeroservoelastic Effects on Flutter

NASA Technical Reports Server (NTRS)

Nagaraja, K. S.; Felt, Larry R.; Kraft, Raymond

1998-01-01

This report presents work performed by The Boeing Company to satisfy the deliverable "Evaluation of aeroservoelastic Effects on Symmetric Flutter" for Subtask 7 of Reference 1. The objective of this report is to incorporate the improved methods for studying the effects of a closed-loop control system on the aeroservoelastic behavior of the airplane planned under NASA HSR technical Integration Task 20 work. Also, a preliminary evaluation of the existing pitch control laws on symmetric flutter of the TCA configuration was addressed."The goal is to develop an improved modeling methodology and perform design studies that account for the aero-structures-systems interaction effects.

Hybrid propulsion technology program: Phase 1. Volume 3: Thiokol Corporation Space Operations

NASA Technical Reports Server (NTRS)

Schuler, A. L.; Wiley, D. R.

1989-01-01

Three candidate hybrid propulsion (HP) concepts were identified, optimized, evaluated, and refined through an iterative process that continually forced improvement to the systems with respect to safety, reliability, cost, and performance criteria. A full scale booster meeting Advanced Solid Rocket Motor (ASRM) thrust-time constraints and a booster application for 1/4 ASRM thrust were evaluated. Trade studies and analyses were performed for each of the motor elements related to SRM technology. Based on trade study results, the optimum HP concept for both full and quarter sized systems was defined. The three candidate hybrid concepts evaluated are illustrated.

Performance of the first structure built with high performance concrete in Virginia.

DOT National Transportation Integrated Search

2001-08-01

This study evaluated the preparation and placement operations, concrete properties, cost-effectiveness, and performance over 5 years of the first bridge containing high performance concrete built by the Virginia Department of Transportation. High per...

Perceptions on evaluative and formative functions of external supervision of Rwandan primary healthcare facilities: A qualitative study

PubMed Central

Schriver, Michael; Cubaka, Vincent Kalumire; Itangishaka, Sylvere; Nyirazinyoye, Laetitia; Kallestrup, Per

2018-01-01

Background External supervision of primary healthcare facilities in low- and middle-income countries often has a managerial main purpose in which the role of support for professional development is unclear. Aim To explore how Rwandan primary healthcare supervisors and providers (supervisees) perceive evaluative and formative functions of external supervision. Design Qualitative, exploratory study. Data Focus group discussions: three with supervisors, three with providers, and one mixed (n = 31). Findings were discussed with individual and groups of supervisors and providers. Results Evaluative activities occupied providers’ understanding of supervision, including checking, correcting, marking and performance-based financing. These were presented as sources of motivation, that in self-determination theory indicate introjected regulation. Supervisors preferred to highlight their role in formative supervision, which may mask their own and providers’ uncontested accounts that systematic performance evaluations predominated supervisors’ work. Providers strongly requested larger focus on formative and supportive functions, voiced as well by most supervisors. Impact of performance evaluation on motivation and professional development is discussed. Conclusion While external supervisors intended to support providers’ professional development, our findings indicate serious problems with this in a context of frequent evaluations and performance marking. Separating the role of supporter and evaluator does not appear as the simple solution. If external supervision is to improve health care services, it is essential that supervisors and health centre managers are competent to support providers in a way that transparently accounts for various performance pressures. This includes delivery of proper formative supervision with useful feedback, maintaining an effective supervisory relationship, as well as ensuring providers are aware of the purpose and content of evaluative and formative supervision functions. PMID:29462144

Effect of prior performance on subsequent performance evaluation by field independent-dependent raters.

PubMed

Sisco, Howard; Leventhal, Gloria

2007-12-01

The importance of accurate performance appraisals is central to many aspects of personnel activities in organizations. This study examined threats due to past performance to accuracy of evaluation of subsequent performance by raters differing in scores on field dependence. 162 college students were classified as Field-dependent (n = 81) or Field-independent (n = 81), using a median split on the Group Embedded Figures Test. Past performance (a lecture) was good or poor, presented directly via a videotape or indirectly via a written evaluation to the Field-independent or Field-dependent groups. Analysis indicated the hypothesized contrast effect (ratings in the opposite direction from that of prior ratings) in the Direct condition and an unexpected, albeit smaller, contrast effect in the Indirect condition. There were also differential effects of performance, presentation, and field dependency on rating of lecturer's style and ability.

Effectiveness of the Teacher Performance Evaluation Methods Practiced by Managers of Public Schools in the Directorate of Education in Southern Jordan Valley/Jordan from the Point of View of Teachers

ERIC Educational Resources Information Center

Al-Tarawneh, Sabri; Al-Oshaibat, Hussein; Ismail, Hairul Al-Nizam

2016-01-01

This study identifies the efficiency of the teacher performance evaluation methods used by government school principals in South Ghour or the hollows educational department from the perspective of teachers. This study dealt with the approaches used by government school principals in the domains of planning assessment, working with the teacher,…

[Municipalities Stratification for Health Performance Evaluation].

PubMed

Calvo, Maria Cristina Marino; Lacerda, Josimari Telino de; Colussi, Claudia Flemming; Schneider, Ione Jayce Ceola; Rocha, Thiago Augusto Hernandes

2016-01-01

to propose and present a stratification of Brazilian municipalities into homogeneous groups for evaluation studies of health management performance. this was a methodological study, with selected indicators which classify municipalities according to conditions that influence the health management and population size; data for the year 2010 were collected from demographic and health databases; correlation tests and factor analysis were used. seven strata were identified - Large-sized; Medium-sized with favorable, regular or unfavorable influences; and Small-sized with favorable, regular or unfavorable influences -; there was a concentration of municipalities with favorable influences in strata with better purchasing power and funding, as well as a concentration of municipalities with unfavorable influences in the North and Northeast regions. the proposed classification grouped similar municipalities regarding influential factors in health management, which allowed the identification of comparable groups of municipalities, setting up a consistent alternative to performance evaluation studies.

78 FR 8150 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-02-05

... three components: the ``Design and Implementation Study,'' the ``Performance Analysis Study,'' and the...- Component Evaluation--Data Collection Related to the Performance Analysis Study and the Impact and the In-depth Implementation Study. OMB No.: 0970-0398 Description: The Office of Data Analysis, Research, and...

Performance evaluation of nonhomogeneous hospitals: the case of Hong Kong hospitals.

PubMed

Li, Yongjun; Lei, Xiyang; Morton, Alec

2018-02-14

Throughout the world, hospitals are under increasing pressure to become more efficient. Efficiency analysis tools can play a role in giving policymakers insight into which units are less efficient and why. Many researchers have studied efficiencies of hospitals using data envelopment analysis (DEA) as an efficiency analysis tool. However, in the existing literature on DEA-based performance evaluation, a standard assumption of the constant returns to scale (CRS) or the variable returns to scale (VRS) DEA models is that decision-making units (DMUs) use a similar mix of inputs to produce a similar set of outputs. In fact, hospitals with different primary goals supply different services and provide different outputs. That is, hospitals are nonhomogeneous and the standard assumption of the DEA model is not applicable to the performance evaluation of nonhomogeneous hospitals. This paper considers the nonhomogeneity among hospitals in the performance evaluation and takes hospitals in Hong Kong as a case study. An extension of Cook et al. (2013) [1] based on the VRS assumption is developed to evaluated nonhomogeneous hospitals' efficiencies since inputs of hospitals vary greatly. Following the philosophy of Cook et al. (2013) [1], hospitals are divided into homogeneous groups and the product process of each hospital is divided into subunits. The performance of hospitals is measured on the basis of subunits. The proposed approach can be applied to measure the performance of other nonhomogeneous entities that exhibit variable return to scale.

Protective clothing for pesticide operators: part II--data analysis of fabric characteristics.

PubMed

Shaw, Anugrah; Schiffelbein, Paul

2016-01-01

Development of objective measurements is an important requirement for establishing performance-based standards for protective clothing used while handling pesticide. This study, the second in a two-part series, reports on the work completed to evaluate the performance of approximately 100 fabrics that are either used or have the potential to be used for garments worn by operators while applying pesticides. Part I, published separately, provides an overview of these issues and describes research undertaken to select a test chemical for use in subsequent studies. The goals of this study were first to develop a comprehensive approach to evaluate the performance of garments currently being used by pesticide operators, and second, to use the laboratory and field data in the development of performance specifications.

Use of Portable Digital Devices to Analyze Autonomic Stress Response in Psychology Objective Structured Clinical Examination.

PubMed

Beltrán-Velasco, Ana Isabel; Bellido-Esteban, Alberto; Ruisoto-Palomera, Pablo; Clemente-Suárez, Vicente Javier

2018-01-12

The aim of the present study was to explore changes in the autonomic stress response of Psychology students in a Psychology Objective Structured Clinical Examination (OSCE) and their relationship with OSCE performance. Variables of autonomic modulation by the analysis of heart rate variability in temporal, frequency and non-linear domains, subjective perception of distress strait and academic performance were measured before and after the two different evaluations that composed the OSCE. A psychology objective structured clinical examination composed by two different evaluation scenarios produced a large anxiety anticipatory response, a habituation response in the first of the evaluation scenarios and a in the entire evaluation, and a no habituation response in the second evaluation scenario. Autonomic modulation parameters do not correlate with academic performance of students.

Preferences of Training Performance Measurement: A Comparative Study of Training Professionals and Non-Training Managers

ERIC Educational Resources Information Center

Chapman, Diane D.

2004-01-01

This survey-based study addressed a perceived gap between training performance evaluation practice and decision-making criteria required in business. Training professionals and non-training managers in North Carolina were surveyed. The study found that the groups differ in the performance measures that motivate them to act on training issues.…

Evaluating School Facilities in Brazil

ERIC Educational Resources Information Center

Ornstein, Sheila Walbe; Moreira, Nanci Saraiva

2008-01-01

Brazil's Sao Paulo Metropolitan Region is conducting a performance evaluation pilot study at three schools serving disadvantaged populations. The objective is first to test methods which can facilitate Post Occupancy Evaluations (POEs) and then to carry out the evaluations. The preliminary results are provided below.

A Descriptive-Comparative Study of Teacher Performance Evaluation on Student Achievement in a Public School District

ERIC Educational Resources Information Center

Christensen, William Howard

2013-01-01

In 2010, the federal government increased accountability expectations by placing more emphasis on monitoring teacher performance. Using a model that focuses on the New York State teacher evaluation system, that is comprised of a rubric for observation, local student assessment scores, and student state assessment scores, this…

Evaluating Math Recovery: Implications for Policy and Practice

ERIC Educational Resources Information Center

Smith, Thomas

2010-01-01

This presentation focuses on an initial evaluation study of Math Recovery (MR), a pullout, one-to-one tutoring program that has been designed to increase mathematics achievement among low-performing first graders, thereby closing the school-entry achievement gap and enabling participants to achieve at the level of their higher-performing peers in…

Evaluating Math Recovery: Investigating Tutor Learning

ERIC Educational Resources Information Center

Green, Sarah Elizabeth; Smith, Thomas

2010-01-01

The goal of the overall study was to evaluate the potential of Math Recovery (MR), a pullout, one-to-one tutoring program, to increase mathematics achievement among low-performing first graders, thereby closing the school-entry achievement gap by enabling them to achieve at the level of their higher-performing peers in the regular mathematics…

Personality and Student Performance on Evaluation Methods Used in Business Administration Courses

ERIC Educational Resources Information Center

Lakhal, Sawsen; Sévigny, Serge; Frenette, Éric

2015-01-01

The objective of this study was to verify whether personality (Big Five model) influences performance on the evaluation methods used in business administration courses. A sample of 169 students enrolled in two compulsory undergraduate business courses responded to an online questionnaire. As it is difficult within the same course to assess…

Conceptual Paradigms and Empirical Investigations for Evaluating INTELSAT's Past Performance and Future Prospects.

ERIC Educational Resources Information Center

Snow, Marcellus S.

This paper summarizes the results of a recent study of the past performance and future prospects of the International Telecommunications Satellite (INTELSAT) Organization. First, an overview of INTELSAT's history is provided and major policy issues are detailed. Five alternative paradigms are then presented through which to evaluate INTELSAT's…

Differences between Employees' and Supervisors' Evaluations of Work Performance and Support Needs

ERIC Educational Resources Information Center

Bennett, Kyle; Frain, Michael; Brady, Michael P.; Rosenberg, Howard; Surinak, Tricia

2009-01-01

Assessment systems are needed that are sensitive to employees' work performance as well as their need for support, while incorporating the input from both employees and their supervisors. This study examined the correspondence of one such evaluation system, the Job Observation and Behavior Scale (JOBS) and the JOBS: Opportunity for…

Approaches for Combining Multiple Measures of Teacher Performance: Reliability, Validity, and Implications for Evaluation Policy

ERIC Educational Resources Information Center

Martínez, José Felipe; Schweig, Jonathan; Goldschmidt, Pete

2016-01-01

A key question facing teacher evaluation systems is how to combine multiple measures of complex constructs into composite indicators of performance. We use data from the Measures of Effective Teaching (MET) study to investigate the measurement properties of composite indicators obtained under various conjunctive, disjunctive (or complementary),…

Calibration of automatic performance measures - speed and volume data: volume 2, evaluation of the accuracy of approach volume counts and speeds collected by microwave sensors.

DOT National Transportation Integrated Search

2016-05-01

This study evaluated the accuracy of approach volumes and free flow approach speeds collected by the Wavetronix : SmartSensor Advance sensor for the Signal Performance Metrics system of the Utah Department of Transportation (UDOT), : using the field ...

Training and Performance Improvement Professionals' Perspectives on Ethical Challenges during Evaluation

ERIC Educational Resources Information Center

Chyung, Seung Youn; Winiecki, Donald J.; Downing, Jessica L.

2010-01-01

Ethical concerns are rising in the business world. With this in mind, training and performance improvement practitioners, especially during evaluation projects, should be aware of principles and codes of ethics, and their behaviors and decisions should reflect the standards recognized by members of the professional society. A study was conducted…

DETERMINING COARSE PARTICULATE MATTER CONCENTRATIONS: A PERFORMANCE EVALUATION OF CANDIDATE METHODOLOGIES UNDER WINTERTIME CONDITIONS

EPA Science Inventory

The main objective of this study is to evaluate the performance of sampling methods for potential use as a Federal Reference Method (FRM) capable of providing an estimate of coarse particle (PMc: particulate matter with an aerodynamic diameter between 2.5 um and 10 um) mass con...

Evaluating the Impact of Electronic Training on Organizational Performance in an SME Food Manufacturing Environment

ERIC Educational Resources Information Center

Fry, Richard C.

2011-01-01

Many small to medium sized manufacturing organizations do not have adequate resources to conduct formalized workplace training or properly evaluate its results. The purpose of this study was to examine the effectiveness of electronic training on workplace behavior and small business organizational performance in the manufacturing environment using…

Convergent Validity Evidence regarding the Validity of the Chilean Standards-Based Teacher Evaluation System

ERIC Educational Resources Information Center

Santelices, Maria Veronica; Taut, Sandy

2011-01-01

This paper describes convergent validity evidence regarding the mandatory, standards-based Chilean national teacher evaluation system (NTES). The study examined whether NTES identifies--and thereby rewards or punishes--the "right" teachers as high- or low-performing. We collected in-depth teaching performance data on a sample of 58…

Administrators' Views on Teacher Evaluation: Examining Ontario's Teacher Performance Appraisal

ERIC Educational Resources Information Center

Maharaj, Sachin

2014-01-01

This study examines the views of administrators (i.e., principals and vice-principals) in Ontario, Canada, with regard to the province's Teacher Performance Appraisal process. A total of 178 responses were collected from a survey that examined five areas: 1) preparation and training; 2) classroom observations; 3) preparing the formal evaluation;…

The Viewpoints of Students and Evaluation Experts About Performance Processes of Faculty Member Evaluation at Mazandaran University of Medical Sciences, 2014

PubMed Central

Ghahrani, Nassim; Balaghafari, Azita; Aligolbandi, Kobra; Vahedi, Mohammad; Siamian, Hasan

2015-01-01

Background and purpose: One of the most common ways used in most of the countries and Iran to determine the status of teacher training is the evaluation by students. The most common method of evaluation is the survey questionnaire, the content of a number of questions about educational activities provided to the students. The researchers plan to evaluate the students’ and experts’ performances at Mazandaran University of Medical Sciences on the process of evaluating the performance of teachers, they examined in 2014. Materials and methods: This study surveys the students and experts in the evaluation of faculty members’ performance process. The study subjects were 3904 students and 37 evaluation expert of Mazandaran University of Medical Sciences. Using Cochran sampling formula of 350 students through proportional stratified random sampling were selected. The experts’ viewpoint, method was used. Data collection tools consisted of 14 questions with answers Yes, or, I don’t know. Descriptive Statistical analysis of the data and chi-square test was performed. Results: From total of 350 students, 346 and the entire 37 evaluations expert participated in this study. Most of the students, 80 (23.12%) and the largest number of experts, 8 (21.62%) were from Sari Allied Medical Sciences Faculty. Most of the demographic information about gender were, 255 female students (74.56%) and 29 female experts (78.37%). In most age groups of students, 188 (55.62 percent) were in the category of 18 to 20 years, and the experts, 19 (51.35%) were in the category of 22 and 31 years. Most students, 232 of them (70.95%) were in semester 2 and 4. Most experts, 20 (54.05 percent) were under 10 years of work experience. The comparison between the views of students and experts in the evaluation process between the schools of Mazandaran University of Medical Sciences, Sari School of Nursing and Midwifery, there was difference between the opinions of experts and students (p-value=0.01. It showed 86.7% student and 33.3% of experts is satisfied with the evaluation process. Conclusion: on comparison of students and experts viewpoints on the implementation of the evaluation process, it is noteworthy that among students of different opinions on how the evaluation process. It worth to mention that there is insignificant difference between their viewpoints and majority of students and evaluation experts with the evaluation the process. In addition, the experts evaluated at different schools, most of them are satisfied the process. PMID:26236169

The Viewpoints of Students and Evaluation Experts About Performance Processes of Faculty Member Evaluation at Mazandaran University of Medical Sciences, 2014.

PubMed

Ghahrani, Nassim; Balaghafari, Azita; Aligolbandi, Kobra; Vahedi, Mohammad; Siamian, Hasan

2015-06-01

One of the most common ways used in most of the countries and Iran to determine the status of teacher training is the evaluation by students. The most common method of evaluation is the survey questionnaire, the content of a number of questions about educational activities provided to the students. The researchers plan to evaluate the students' and experts' performances at Mazandaran University of Medical Sciences on the process of evaluating the performance of teachers, they examined in 2014. This study surveys the students and experts in the evaluation of faculty members' performance process. The study subjects were 3904 students and 37 evaluation expert of Mazandaran University of Medical Sciences. Using Cochran sampling formula of 350 students through proportional stratified random sampling were selected. The experts' viewpoint, method was used. Data collection tools consisted of 14 questions with answers Yes, or, I don't know. Descriptive Statistical analysis of the data and chi-square test was performed. From total of 350 students, 346 and the entire 37 evaluations expert participated in this study. Most of the students, 80 (23.12%) and the largest number of experts, 8 (21.62%) were from Sari Allied Medical Sciences Faculty. Most of the demographic information about gender were, 255 female students (74.56%) and 29 female experts (78.37%). In most age groups of students, 188 (55.62 percent) were in the category of 18 to 20 years, and the experts, 19 (51.35%) were in the category of 22 and 31 years. Most students, 232 of them (70.95%) were in semester 2 and 4. Most experts, 20 (54.05 percent) were under 10 years of work experience. The comparison between the views of students and experts in the evaluation process between the schools of Mazandaran University of Medical Sciences, Sari School of Nursing and Midwifery, there was difference between the opinions of experts and students (p-value=0.01. It showed 86.7% student and 33.3% of experts is satisfied with the evaluation process. on comparison of students and experts viewpoints on the implementation of the evaluation process, it is noteworthy that among students of different opinions on how the evaluation process. It worth to mention that there is insignificant difference between their viewpoints and majority of students and evaluation experts with the evaluation the process. In addition, the experts evaluated at different schools, most of them are satisfied the process.

Physical evaluation of color and monochrome medical displays using an imaging colorimeter

NASA Astrophysics Data System (ADS)

Roehrig, Hans; Gu, Xiliang; Fan, Jiahua

2013-03-01

This paper presents an approach to physical evaluation of color and monochrome medical grade displays using an imaging colorimeter. The purpose of this study was to examine the influence of medical display types, monochrome or color at the same maximum luminance settings, on diagnostic performance. The focus was on the measurements of physical characteristics including spatial resolution and noise performance, which we believed could affect the clinical performance. Specifically, Modulation Transfer Function (MTF) and Noise Power Spectrum (NPS) were evaluated and compared at different digital driving levels (DDL) between two EIZO displays.

Evaluation of a new computerized psychometric test battery: Effects of zolpidem and caffeine.

PubMed

Pilli, Raveendranadh; Naidu, Mur; Pingali, Usharani; Shobha, Jc

2013-10-01

To evaluate the effects of centrally active drugs using a new indigenously developed automated psychometric test system and compare the results with that obtained using pencil- and paper-based techniques. The tests were standardized in 24 healthy participants. Reproducibility of the test procedure was evaluated by performing the tests by a single experimenter on two occasions (interday reproducibility). To evaluate the sensitivity of the tests, the effects of zolpidem (5 mg) and caffeine (500 mg) versus placebo were studied in 24 healthy participants in a randomized, double-blind three-way crossover design. Psychometric tests were performed at baseline and at 1, 2, and 3 h after administration of study medication. The effects of zolpidem and caffeine on the psychomotor performance were most pronounced 1 h after administration. At this time, a significant impairment of performance in the simple reaction test (SRT), choice discrimination test (CDT), digit symbol substitution test (DSST), digit vigilance test (DVT), and card sorting test (CST) was observed with zolpidem. In contrast, caffeine showed a significant improvement in performance in CDT and DVT only. The results suggest that the tests of the computerized system are more sensitive and reliable then the pencil and paper tests in detecting the effects of central acting agents and are suitable for use in clinical areas to conduct studies with patients.

Performance study of SKIROC2/A ASIC for ILD Si-W ECAL

NASA Astrophysics Data System (ADS)

Suehara, T.; Sekiya, I.; Callier, S.; Balagura, V.; Boudry, V.; Brient, J.-C.; de la Taille, C.; Kawagoe, K.; Irles, A.; Magniette, F.; Nanni, J.; Pöschl, R.; Yoshioka, T.

2018-03-01

The ILD Si-W ECAL is a sampling calorimeter with tungsten absorber and highly segmented silicon layers for the International Large Detector (ILD), one of the two detector concepts for the International Linear Collider. SKIROC2 is an ASIC for the ILD Si-W ECAL. To investigate the issues found in prototype detectors, we prepared dedicated ASIC evaluation boards with either BGA sockets or directly soldered SKIROC2. We report a performance study with the evaluation boards, including signal-to-noise ratio and TDC performance with comparing SKIROC2 and an updated version, SKIROC2A.

Pavement design and performance studies : progress report no. 4 on phase A, performance study of typical Virginia pavements.

DOT National Transportation Integrated Search

1970-01-01

The performance of in-service typical Virginia flexible and rigid pavements in all areas of the state is under evaluation. The objectives are to provide a ready reference for designers and field engineers and to provide background information for des...

USE OF FAST GC/TOFMS AS REFERENCE STANDARD FOR FIELD COMPARISON STUDIES WITH ON-SITE INSTRUMENTS

EPA Science Inventory

A faster reference standard for field comparison studies of portable gas chromatographs (PGC) is needed. A performance evaluation of a high-speed GCMS (FGC/MS) system conducted during 1998 demonstrated generally satisfactory performance, but it was evident that performance of b...

Estimation for aerial detection effectiveness with cooperation efficiency factors of early-warning aircraft in early-warning detection SoS under BSC framework

NASA Astrophysics Data System (ADS)

Zhu, Feng; Hu, Xiaofeng; He, Xiaoyuan; Guo, Rui; Li, Kaiming; Yang, Lu

2017-11-01

In the military field, the performance evaluation of early-warning aircraft deployment or construction is always an important problem needing to be explored. As an effective approach of enterprise management and performance evaluation, Balanced Score Card (BSC) attracts more and more attentions and is studied more and more widely all over the world. It can also bring feasible ideas and technical approaches for studying the issue of the performance evaluation of the deployment or construction of early-warning aircraft which is the important component in early-warning detection system of systems (SoS). Therefore, the deep explored researches are carried out based on the previously research works. On the basis of the characteristics of space exploration and aerial detection effectiveness of early-warning detection SoS and the cardinal principle of BSC are analyzed simply, and the performance evaluation framework of the deployment or construction of early-warning aircraft is given, under this framework, aimed at the evaluation issue of aerial detection effectiveness of early-warning detection SoS with the cooperation efficiency factors of the early-warning aircraft and other land based radars, the evaluation indexes are further designed and the relative evaluation model is further established, especially the evaluation radar chart being also drawn to obtain the evaluation results from a direct sight angle. Finally, some practical computer simulations are launched to prove the validity and feasibility of the research thinking and technologic approaches which are proposed in the paper.

Leveraging simulation to evaluate system performance in presence of fixed pattern noise

NASA Astrophysics Data System (ADS)

Teaney, Brian P.

2017-05-01

The development of image simulation techniques which map the effects of a notional, modeled sensor system onto an existing image can be used to evaluate the image quality of camera systems prior to the development of prototype systems. In addition, image simulation or `virtual prototyping' can be utilized to reduce the time and expense associated with conducting extensive field trials. In this paper we examine the development of a perception study designed to assess the performance of the NVESD imager performance metrics as a function of fixed pattern noise. This paper discusses the development of the model theory and the implementation and execution of the perception study. In addition, other applications of the image simulation component including the evaluation of limiting resolution and other test targets is provided.

NREL Evaluates Performance of Fast-Charge Electric Buses

DOE Office of Scientific and Technical Information (OSTI.GOV)

2016-09-16

This real-world performance evaluation is designed to enhance understanding of the overall usage and effectiveness of electric buses in transit operation and to provide unbiased technical information to other agencies interested in adding such vehicles to their fleets. Initial results indicate that the electric buses under study offer significant fuel and emissions savings. The final results will help Foothill Transit optimize the energy-saving potential of its transit fleet. NREL's performance evaluations help vehicle manufacturers fine-tune their designs and help fleet managers select fuel-efficient, low-emission vehicles that meet their bottom line and operational goals. help Foothill Transit optimize the energy-saving potentialmore » of its transit fleet. NREL's performance evaluations help vehicle manufacturers fine-tune their designs and help fleet managers select fuel-efficient, low-emission vehicles that meet their bottom line and operational goals.« less

Effects of spatially displaced feedback on remote manipulation tasks

NASA Technical Reports Server (NTRS)

Manahan, Meera K.; Stuart, Mark A.; Bierschwale, John M.; Hwang, Ellen Y.; Legendre, A. J.

1992-01-01

Several studies have been performed to determine the effects on computer and direct manipulation task performance when viewing conditions are spatially displaced. Whether results from these studies can be directly applied to remote manipulation tasks is quenstionable. The objective of this evaluation was to determine the effects of reversed, inverted, and inverted/reversed views on remote manipulation task performance using two 3-Degree of Freedom (DOF) hand controllers and a replica position hand controller. Results showed that trials using the inverted viewing condition showed the worst performance, followed by the inverted/reversed view and the reversed view when using the 2x3 DOF. However, these differences were not significant. The inverted and inverted/reversed viewing conditions were significantly worse than the normal and reversed viewing conditions when using the Kraft Replica. A second evaluation was conducted in which additional trials were performed with each viewing condition to determine the long term effects of spatially displaced views on task performance for the hand controllers. Results of the second evaluation indicated that there was more of a difference in performance between the perturbed viewing conditions and the normal viewing condition with the Kraft Replica than with the 2x3 DOF.

Performance Assessment for Pump-and-Treat Closure or Transition

DOE Office of Scientific and Technical Information (OSTI.GOV)

Truex, Michael J.; Johnson, Christian D.; Becker, Dave J.

2015-09-29

A structured performance assessment approach is useful to evaluate pump-and-treat (P&T) groundwater remediation, which has been applied at numerous sites. Consistent with the U.S. Environmental Protection Agency’s Groundwater Road Map, performance assessment during remedy implementation may be needed, and should consider remedy optimization, transition to alternative remedies, or remedy closure. In addition, a recent National Research Council study examined groundwater remediation at complex contaminated sites and concluded that it may be beneficial to evaluate remedy performance and the potential need for transition to alternative approaches at these sites. The intent of this document is to provide a structured approach formore » assessing P&T performance to support a decision to optimize, transition, or close a P&T remedy. The process presented in this document for gathering information and performing evaluations to support P&T remedy decisions includes use of decision elements to distinguish between potential outcomes of a remedy decision. Case studies are used to augment descriptions of decision elements and to illustrate each type of outcome identified in the performance assessment approach. The document provides references to resources for tools and other guidance relevant to conducting the P&T assessment.« less

DuPont qualicon BAX system real-time PCR assay for Escherichia coli O157:H7.

PubMed

Burns, Frank; Fleck, Lois; Andaloro, Bridget; Davis, Eugene; Rohrbeck, Jeff; Tice, George; Wallace, Morgan

2011-01-01

Evaluations were conducted to test the performance of the BAX System Real-Time PCR assay, which was certified as Performance Tested Method 031002 for screening E. coli O157:H7 in ground beef, beef trim, spinach, and lettuce. Method comparison studies performed on samples with low-level inoculates showed that the BAX System demonstrates a sensitivity equivalent or superior to the FDA-BAM and the USDA-FSIS culture methods, but with a significantly shorter time to result. Tests to evaluate inclusivity and exclusivity returned no false-negative and no false-positive results on a diverse panel of isolates, and tests for lot-to-lot variability and tablet stability demonstrated consistent performance. Ruggedness studies determined that none of the factors examined affect the performance of the assay. An accelerated shelf life study determined an initial 36 month shelf life for the test kit.

Cognitive performance in childhood and early adult illness: a prospective cohort study

PubMed Central

Martin, L.; Fitzmaurice, G.; Kindlon, D.; Buka, S.

2004-01-01

Study objective: To evaluate whether cognitive performance in childhood is an early determinant of adult illness. Design: Prospective cohort study covering over 30 years. Setting: Providence, Rhode Island, USA. Participants: 633 people ages 30–39 followed up since birth as part of the Providence cohort of the national collaborative perinatal project. Main results: Higher cognitive performance at age 7 was related to a significantly reduced risk of serious illness in adulthood, OR = 0.65 (95%CI: 0.47 to 0.89) for a one standard deviation (15 point) increase in IQ score. This association was independent of both parental socioeconomic status and participant's attained level of education. Conclusions: General cognitive performance may be an important and informative early determinant of adult health. Further evaluation of this association and mechanisms linking cognitive performance and health may provide new and innovative strategies to improve disease management and reduce morbidity. PMID:15252070

Evaluation Of The Diagnostic Performance Of A Multimedia Medical Communications System.

NASA Astrophysics Data System (ADS)

Robertson, John G.; Coristine, Marjorie; Goldberg, Morris; Beeton, Carolyn; Belanger, Garry; Tombaugh, Jo W.; Hickey, Nancy M.; Millward, Steven F.; Davis, Michael; Whittingham, David

1989-05-01

The central concern of radiologists when evaluating Picture Archiving Communication System (PACS) is the diagnostic performance of digital images compared to the original analog versions of the same images. Considerable work has been done comparing the ROC curves of various types of digital systems to the corresponding analog systems for the detection of specific phantoms or diseases. Although the studies may notify the radiologists that for a specific lesion a digital system may perform as well as the analog system, it tells the radiologists very little about the impact on diagnostic performance of a digital system in the general practice of radiology. We describe in this paper an alternative method for evaluating the diagnostic performance of a digital system and a preliminary experiment we conducted to test the methodology.

[New trends in the evaluation of mathematics learning disabilities. The role of metacognition].

PubMed

Miranda-Casas, A; Acosta-Escareño, G; Tarraga-Minguez, R; Fernández, M I; Rosel-Remírez, J

2005-01-15

The current trends in the evaluation of mathematics learning disabilities (MLD), based on cognitive and empirical models, are oriented towards combining procedures involving the criteria and the evaluation of cognitive and metacognitive processes, associated to performance in mathematical tasks. The objective of this study is to analyse the metacognitive skills of prediction and evaluation in performing maths tasks and to compare metacognitive performance among pupils with MLD and younger pupils without MLD, who have the same level of mathematical performance. Likewise, we analyse these pupils' desire to learn. Subjects and methods. We compare a total of 44 pupils from the second cycle of primary education (8-10 years old) with and without mathematics learning disabilities. Significant differences are observed between pupils with and without mathematics learning disabilities in their capacity to predict and assess all of the tasks evaluated. As regards their 'desire to learn', no significant differences were found between pupils with and without MLD, which indicated that those with MLD assess their chances of successfully performing maths tasks in the same way as those without MLD. Finally, the findings reveal a similar metacognitive profile in pupils with MLD and the younger pupils with no mathematics learning disabilities. In future studies we consider it important to analyse the influence of the socio-affective belief system in the use of metacognitive skills.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Neuhauser, K.

Through discussion of five case studies (test homes), this project evaluates strategies to elevate the performance of existing homes to a level commensurate with best-in-class implementation of high-performance new construction homes. The test homes featured in this research activity participated in Deep Energy Retrofit (DER) Pilot Program sponsored by the electric and gas utility National Grid in Massachusetts and Rhode Island. Building enclosure retrofit strategies are evaluated for impact on durability and indoor air quality in addition to energy performance.

Entropy of Linkography: Evaluating the Creativity of Short Animation

ERIC Educational Resources Information Center

Chou, Shyan-Bin; Chou, Huey-Wen; Chen, Yui-Liang

2013-01-01

There are important research issues surrounding the best methods for evaluating creativity of animation. This study proposed an approach to evaluate the creativity of short animation by adopting Linkography. This article reported the results of two experiments performed to test this approach. In study 1, participants identified as impressive a set…

Properties of the Multiple Measures in Arizona's Teacher Evaluation Model. REL 2015-050

ERIC Educational Resources Information Center

Lazarev, Valeriy; Newman, Denis; Sharp, Alyssa

2014-01-01

This study explored the relationships among the components of the Arizona Department of Education's new teacher evaluation model, with a particular focus on the extent to which ratings from the state model's teacher observation instrument differentiated higher and lower performance. The study used teacher-level evaluation data collected by the…

The Effect of Student Evaluations on Faculty Performance

ERIC Educational Resources Information Center

Hartford, Kenneth M.

2017-01-01

The purpose of this study was to understand the behavior of professors as a consequence of receiving student evaluations. To address this purpose, a single research question directed this study: In what ways and to what extent might faculty compromise good pedagogical practices for positive student evaluations of teaching? A qualitative research…

Performance measurement for supply chain management and evaluation criteria determination for reverse supply chain management

NASA Astrophysics Data System (ADS)

Kongar, N. Elif

2004-12-01

Today, since customers are able to obtain similar-quality products for similar prices, the lead time has become the only preference criterion for most of the consumers. Therefore, it is crucial that the lead time, i.e., the time spent from the raw material phase till the manufactured good reaches the customer, is minimized. This issue can be investigated under the title of Supply Chain Management (SCM). An efficiently managed supply chain can lead to reduced response time for customers. To achieve this, continuous observation of supply chain efficiency, i.e., a constant performance evaluation of the current SCM is required. Widely used conventional performance measurement methods lack the ability to evaluate a SCM since the supply chain is a dynamic system that requires a more thorough and flexible performance measurement technique. Balanced Scorecard (BS) is an efficient tool for measuring the performance of dynamic systems and has a proven capability of providing the decision makers with the appropriate feedback data. In addition to SCM, a relatively new management field, namely reverse supply chain management (RSCM), also necessitates an appropriate evaluation approach. RSCM differs from SCM in many aspects, i.e., the criteria used for evaluation, the high level of uncertainty involved etc., not allowing the usage of identical evaluation techniques used for SCM. This study proposes a generic Balanced Scorecard to measure the performance of supply chain management while defining the appropriate performance measures for SCM. A scorecard prototype, ESCAPE, is presented to demonstrate the evaluation process.

Green and sustainable remediation (GSR) evaluation: framework, standards, and tool. A case study in Taiwan.

PubMed

Huang, Wen-Yen; Hung, Weiteng; Vu, Chi Thanh; Chen, Wei-Ting; Lai, Jhih-Wei; Lin, Chitsan

2016-11-01

Taiwan has a large number of poorly managed contaminated sites in need of remediation. This study proposes a framework, a set of standards, and a spreadsheet-based evaluation tool for implementing green and sustainable principles into remediation projects and evaluating the projects from this perspective. We performed a case study to understand how the framework would be applied. For the case study, we used a spreadsheet-based evaluation tool (SEFA) and performed field scale cultivation tests on a site contaminated with total petroleum hydrocarbons (TPHs). The site was divided into two lots: one treated by chemical oxidation and the other by bioremediation. We evaluated five core elements of green and sustainable remediation (GSR): energy, air, water resources, materials and wastes, and land and ecosystem. The proposed evaluation tool and field scale cultivation test were found to efficiently assess the effectiveness of the two remediation alternatives. The framework and related tools proposed herein can potentially be used to support decisions about the remediation of contaminated sites taking into account engineering management, cost effectiveness, and social reconciliation.

Evaluation of a wireless audio streaming accessory to improve mobile telephone performance of cochlear implant users.

PubMed

Wolfe, Jace; Morais Duke, Mila; Schafer, Erin; Cire, George; Menapace, Christine; O'Neill, Lori

2016-01-01

The objective of this study was to evaluate the potential improvement in word recognition in quiet and in noise obtained with use of a Bluetooth-compatible wireless hearing assistance technology (HAT) relative to the acoustic mobile telephone condition (e.g. the mobile telephone receiver held to the microphone of the sound processor). A two-way repeated measures design was used to evaluate differences in telephone word recognition obtained in quiet and in competing noise in the acoustic mobile telephone condition compared to performance obtained with use of the CI sound processor and a telephone HAT. Sixteen adult users of Nucleus cochlear implants and the Nucleus 6 sound processor were included in this study. Word recognition over the mobile telephone in quiet and in noise was significantly better with use of the wireless HAT compared to performance in the acoustic mobile telephone condition. Word recognition over the mobile telephone was better in quiet when compared to performance in noise. The results of this study indicate that use of a wireless HAT improves word recognition over the mobile telephone in quiet and in noise relative to performance in the acoustic mobile telephone condition for a group of adult cochlear implant recipients.

Performance Evaluation and Quantitative Accuracy of Multipinhole NanoSPECT/CT Scanner for Theranostic Lu-177 Imaging

NASA Astrophysics Data System (ADS)

Gupta, Arun; Kim, Kyeong Yun; Hwang, Donghwi; Lee, Min Sun; Lee, Dong Soo; Lee, Jae Sung

2018-06-01

SPECT plays important role in peptide receptor targeted radionuclide therapy using theranostic radionuclides such as Lu-177 for the treatment of various cancers. However, SPECT studies must be quantitatively accurate because the reliable assessment of tumor uptake and tumor-to-normal tissue ratios can only be performed using quantitatively accurate images. Hence, it is important to evaluate performance parameters and quantitative accuracy of preclinical SPECT systems for therapeutic radioisotopes before conducting pre- and post-therapy SPECT imaging or dosimetry studies. In this study, we evaluated system performance and quantitative accuracy of NanoSPECT/CT scanner for Lu-177 imaging using point source and uniform phantom studies. We measured recovery coefficient, uniformity, spatial resolution, system sensitivity and calibration factor for mouse whole body standard aperture. We also performed the experiments using Tc-99m to compare the results with that of Lu-177. We found that the recovery coefficient of more than 70% for Lu-177 at the optimum noise level when nine iterations were used. The spatial resolutions of Lu-177 with and without adding uniform background was comparable to that of Tc-99m in axial, radial and tangential directions. System sensitivity measured for Lu-177 was almost three times less than that of Tc-99m.

Individual and population pharmacokinetic compartment analysis: a graphic procedure for quantification of predictive performance.

PubMed

Eksborg, Staffan

2013-01-01

Pharmacokinetic studies are important for optimizing of drug dosing, but requires proper validation of the used pharmacokinetic procedures. However, simple and reliable statistical methods suitable for evaluation of the predictive performance of pharmacokinetic analysis are essentially lacking. The aim of the present study was to construct and evaluate a graphic procedure for quantification of predictive performance of individual and population pharmacokinetic compartment analysis. Original data from previously published pharmacokinetic compartment analyses after intravenous, oral, and epidural administration, and digitized data, obtained from published scatter plots of observed vs predicted drug concentrations from population pharmacokinetic studies using the NPEM algorithm and NONMEM computer program and Bayesian forecasting procedures, were used for estimating the predictive performance according to the proposed graphical method and by the method of Sheiner and Beal. The graphical plot proposed in the present paper proved to be a useful tool for evaluation of predictive performance of both individual and population compartment pharmacokinetic analysis. The proposed method is simple to use and gives valuable information concerning time- and concentration-dependent inaccuracies that might occur in individual and population pharmacokinetic compartment analysis. Predictive performance can be quantified by the fraction of concentration ratios within arbitrarily specified ranges, e.g. within the range 0.8-1.2.

Performance evaluation of Arizona's LTPP SPS-6 project : strategic study of rehabilitation techniques.

DOT National Transportation Integrated Search

2013-10-01

As part of the Long Term Pavement Performance (LTPP) Program, the Arizona Department of Transportation (ADOT) : constructed 19 Specific Pavement Studies 6 (SPS6) test sections on Interstate 40 near Flagstaff. The SPS6 project : studied the effe...

The Effects of Coping Interventions on Ability to Perform Under Pressure

PubMed Central

Kent, Sofie; Devonport, Tracey J.; Lane, Andrew M.; Nicholls, Wendy; Friesen, Andrew P.

2018-01-01

The ability to perform under pressure is necessary to achieve goals in various domains of life. We conducted a systematic review to synthesise findings from applied studies that focus on interventions developed to enhance an individual’s ability to cope under performance pressure. Following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines, a comprehensive search of five electronic databases was conducted. This yielded 66,618 records, of which 23 peer review papers met inclusion criteria of containing an intervention that targeted coping skills for performing under pressure. Using the Standard Quality Assessment for evaluation of primary research papers (Kmet et al., 2004) to assess quality, included studies performed well on reporting research objectives, research design, and statistical procedures. Sixteen studies showed poor quality in controlling for potentially confounding factors and small sample sizes. A narrative aggregate synthesis identified intervention studies that provided an educational focus (n = 9), consultancy sessions (n = 6), simulation training (n = 5) and emotion regulation strategies (n = 3). Findings highlight a need to; 1) establish a contextualized pressure task which will generate high levels of ecological validity for participants. Having established a suitable pressure task, 2) research should assess the effects of pressure by evaluating conscious and nonconscious effects and associated coping mechanisms, which should inform the subsequent development of interventions, and 3) assess interventions to enhance understanding of the ways in which they improve coping with pressure, or may fail, and the mechanisms which may explain these outcomes. Key points Simulation studies that exposed individuals to ‘pressure’ settings produced the most consistent improvements to performance, in comparison to a control group. This systematic review highlights limitations with the design, execution, and evaluation of pressure interventions. Future research should attempt to better consider the approach used to generate meaningful performance pressures and assess the consequences of pressure by evaluating conscious and non-conscious effects and coping mechanisms through which coping with pressure might be improved. PMID:29535577

Effects of message, source, and context on evaluations of employee voice behavior.

PubMed

Whiting, Steven W; Maynes, Timothy D; Podsakoff, Nathan P; Podsakoff, Philip M

2012-01-01

The article contained a production-related error. In Table 5, the four values in the rows for Study 1 Prosocial motives and Study 1 Constructive voice should have been shifted one column to the right, to the Direct and Total Performance evaluations columns. All versions of this article have been corrected.] Although employee voice behavior is expected to have important organizational benefits, research indicates that employees voicing their recommendations for organizational change may be evaluated either positively or negatively by observers. A review of the literature suggests that the perceived efficacy of voice behaviors may be a function of characteristics associated with the (a) source, (b) message, and (c) context of the voice event. In this study, we manipulated variables from each of these categories based on a model designed to predict when voice will positively or negatively impact raters' evaluations of an employee's performance. To test our model, we conducted 3 laboratory studies in which we manipulated 2 source factors (voicer expertise and trustworthiness), 2 message factors (recommending a solution and positively vs. negatively framing the message), and 2 context factors (timing of the voice event and organizational norms for speaking up vs. keeping quiet). We also examined the mediating effects of liking, prosocial motives, and perceptions that the voice behavior was constructive on the relationships between the source, message, and context factors and performance evaluations. Generally speaking, we found that at least one of the variables from each category had an effect on performance evaluations for the voicer and that most of these effects were indirect, operating through one or more of the mediators. Implications for theory and future research are discussed.

Performance of polymer modified hot mix asphalt pavements : an extended evaluation.

DOT National Transportation Integrated Search

2004-03-01

In the summer of 1996, the Mississippi Department of Transportation (MDOT) initiated a field trial (MDOT : State Study No. 111) and a laboratory study (MDOT State Study No. 123) to evaluate the use of polymer : modified asphalts in hot mix asphalt pa...

Performance Evaluation of 14 Neural Network Architectures Used for Predicting Heat Transfer Characteristics of Engine Oils

NASA Astrophysics Data System (ADS)

Al-Ajmi, R. M.; Abou-Ziyan, H. Z.; Mahmoud, M. A.

2012-01-01

This paper reports the results of a comprehensive study that aimed at identifying best neural network architecture and parameters to predict subcooled boiling characteristics of engine oils. A total of 57 different neural networks (NNs) that were derived from 14 different NN architectures were evaluated for four different prediction cases. The NNs were trained on experimental datasets performed on five engine oils of different chemical compositions. The performance of each NN was evaluated using a rigorous statistical analysis as well as careful examination of smoothness of predicted boiling curves. One NN, out of the 57 evaluated, correctly predicted the boiling curves for all cases considered either for individual oils or for all oils taken together. It was found that the pattern selection and weight update techniques strongly affect the performance of the NNs. It was also revealed that the use of descriptive statistical analysis such as R2, mean error, standard deviation, and T and slope tests, is a necessary but not sufficient condition for evaluating NN performance. The performance criteria should also include inspection of the smoothness of the predicted curves either visually or by plotting the slopes of these curves.

Performance of Bipolar Disorder Patients in Attention Testing: Comparison with Normal Controls and Among Manic, Depressive, and Euthymic Phases.

PubMed

Camelo, Evelyn V M; Mograbi, Daniel; de Assis da Silva, Rafael; Bifano, Jaqueline; Wainstok, Mayra; Silveira, Luciana Angélica Silva; Netto, Tânia; Santana, Cristina M T; Cheniaux, Elie

2017-03-01

Several studies on cognition in bipolar disorder (BD) have been developed on the last decade. Neuropsychological evaluation of attention in BD patients is fundamental since alterations in attention affect other cognitive functions. Evaluate if performance of BD patients in attention tests varies according to each phase of the disease and verify if there are differences in attention when comparing BD patients with normal controls. The study included 101 BD patients, with ages between 18 and 65 years, being 52 euthymic, 22 manic and 27 depressive, besides 30 normal controls. All subjects were evaluated though Hamilton Depression Scale, Young Mania Rating Scale and Global Assessment of Functioning, bipolar version (CGI-BP). Attention was evaluated through a neuropsychological battery. Normal controls had a better performance in selective attention tests than BD patients. No differences were found among manic, depressive and euthymic phases. Attention is markedly impaired in BD. Nevertheless, the results of this study do not imply that the severity of the attention deficit in BD patients varies according to decease phase.

Performance Evaluation of a Mobile Touchscreen Interface for Assistive Robotic Manipulators: A Pilot Study.

PubMed

Chung, Cheng-Shiu; Ka, Hyun W; Wang, Hongu; Ding, Dan; Kelleher, Annmarie; Cooper, Rory A

2017-01-01

Background: Assistive robotic manipulators (ARMs) have been developed to provide enhanced assistance and independence in performance of daily activities among people with spinal cord injury when a caregiver is not on site. However, the current commercial ARM user interfaces (UIs) may be difficult to learn and control. A touchscreen mobile UI was developed to overcome these challenges. Objective: The object of this study was to evaluate the performance between 2 ARM UIs, touchscreen and the original joystick, using an ARM evaluation tool (ARMET). Methods: This is a pilot study of people with upper extremity impairments ( N = 8). Participants were trained on 2 UIs, and then they chose one to use when performing 3 tasks on the ARMET: flipping a toggle switch, pushing down a door handle, and turning a knob. Task completion time, mean velocity, and open interviews were the main outcome measurements. Results: Among 8 novice participants, 7 chose the touchscreen UI and 1 chose the joystick UI. All participants could complete the ARMET tasks independently. Use of the touchscreen UI resulted in enhanced ARMET performance (higher mean moving speed and faster task completion). Conclusions: Mobile ARM UIs demonstrated easier learning experience, less physical effort, and better ARMET performance. The improved performance, the accessibility, and lower physical effort suggested that the touchscreen UI might be an efficient tool for the ARM users.

Education and cognitive change over 15 years: the atherosclerosis risk in communities study.

PubMed

Schneider, Andrea L C; Sharrett, A Richey; Patel, Mehul D; Alonso, Alvaro; Coresh, Josef; Mosley, Thomas; Selnes, Ola; Selvin, Elizabeth; Gottesman, Rebecca F

2012-10-01

To evaluate whether education level is associated with change in cognitive performance. Prospective cohort study. The Atherosclerosis Risk in Communities (ARIC) Study, a community-based cohort. Nine thousand two hundred sixty-eight ARIC participants who underwent cognitive evaluation at least twice over a 15-year period. Education was evaluated as a predictor of change in word recall, the Digit Symbol Substitution Test (DSST), and word fluency. A random-effects linear regression model, and a time by educational level interaction was used. Educational level was highly associated with cognitive performance. The effect on performance of a less than high school education (vs more than high school) was equivalent to the effect of as much as 22 years of cognitive aging, but educational level was not associated with change in cognitive performance in whites or blacks, with the exception of the DSST for whites, in whom those with lower levels of education had less decline in scores. Educational level was not associated with change in cognitive performance, although the higher baseline cognitive performance of individuals with more education might explain lower rates of dementia in more-educated individuals, because more decline would have to take place between baseline higher performance and time at which dementia was diagnosed in more-educated individuals. © 2012, Copyright the Authors Journal compilation © 2012, The American Geriatrics Society.

Life cycle cost assessment and performance evaluation of sediment control technologies.

DOT National Transportation Integrated Search

2015-10-01

This study was performed for the Georgia Department of Transportation (GDOT) : to better understand the environmental impacts associated with sediment control : technology currently employed on transportation projects. In this study, a review of : cu...

Evaluation of Pavement Safety Performance

DOT National Transportation Integrated Search

2015-02-01

The intent of this study was to isolate the effects of various low-cost pavement treatments on roadway safety. This was a retrospective study of pavement safety performance, looking back at crash data before and after treatments were installed. Both ...

Investigation of warm-mix asphalt for Iowa roadways.

DOT National Transportation Integrated Search

2013-09-01

Phase II of this study further evaluated the performance of plant-produced warm-mix asphalt (WMA) mixes by conducting : additional mixture performance tests at a broader range of temperatures, adding additional pavements to the study, comparing : vir...

The effects of performance appraisal in the Norwegian municipal health services: a case study

PubMed Central

2011-01-01

Introduction Previous research in performance appraisal (PA) indicates that variation exists in learning and job motivation from performance appraisal between occupational groups. This research evaluates the potential effect of job motivation, learning and self-assessment through performance appraisals for health personnel. Case description This article focuses on goal-setting, feedback, participation and training in performance appraisals in municipal health services in Norway; and job motivation, learning and self-assessment of performance are the dependent factors. Questionnaires were distributed to a representative sample of 600 health personnel from the Norwegian municipal health service, with a response rate of 62%. Factor analysis and regression analysis were run in SPSS 12. Discussion and evaluation The study suggests that respondents learn from performance appraisal. Nurses experienced some higher job motivation from performance appraisal than auxiliary nurses. All subordinates perceived higher job motivation after performance appraisal than managers. Conclusion Useful feedback, active participation and higher education are fundamental elements of discussion in performance appraisal, as well as the role of increasing employees' job motivation. In this study, nurses' job motivation seems to be more effected by PA, than for auxiliary nurses. Both nurses and auxiliary nurses indicate that there is a learning effect from PA. This study may be of interest to health researchers and managers in municipal health services. PMID:21974831

Performance measures for multi-vehicle allowance shuttle transit (MAST) system.

DOT National Transportation Integrated Search

2014-09-01

This study investigates the performance measures for multi-vehicle mobility allowance shuttle : transit (MAST) system. Particularly, researchers were primarily concerned with two measures, : waiting time and ride time, to evaluate the performance and...

Conceptual Knowledge Influences Decision Making Differently in Individuals with High or Low Cognitive Flexibility: An ERP Study.

PubMed

Dong, Xiaofei; Du, Xiumin; Qi, Bing

2016-01-01

Studies using the Iowa Gambling Task (IGT) have distinguished between good and bad decision makers and have provided an explanation for deficits in decision making. Previous studies have demonstrated a link between Wisconsin Card Sorting Test (WCST) performance and IGT performance, but the results were not consistent and failed to explain why WCST performance can predict IGT performance. The present study aimed to demonstrate that WCST performance can predict IGT performance and to identify the cognitive component of the WCST that affects IGT performance using event-related potentials (ERPs). In this study, 39 healthy subjects (5 subjects were excluded) were divided into a high group and a low group based on their global score on the WCST. A single-choice version of the IGT was used to eliminate the impact of retrieval strategies on the choice evaluation process and interference due to uncorrelated decks. Differences in the underlying neural mechanisms and explicit knowledge between the two groups during the three stages of the decision-making process were described. Based on the information processing perspective, we divided the decision-making process into three stages: choice evaluation, response selection, and feedback processing. The behavioral results showed that the highly cognitively flexible participants performed better on the IGT and acquired more knowledge of the task. The ERP results showed that during the choice evaluation stage, the P300 recorded from central and parietal regions when a bad deck appeared was larger in the high group participants than in the low group participants. During the response selection stage, the effect of choice type was significant only in the frontal region in the high group, with a larger effect for passing. During the feedback evaluation stage, a larger FRN was evoked for a loss than for a win in the high group, whereas the FRN effect was absent in the low group. Compared with the participants with low cognitive flexibility, the participants with high cognitive flexibility performed better on the IGT, acquired more knowledge of the task, and displayed more obvious somatic markers. The low group participants showed reduced working memory abilities during the choice evaluation stage. The appropriate somatic markers reflected by the DPN is formed only when conceptual knowledge is gained in the response selection stage. The absence of an FRN effect in the subjects who performed poorly on the WCST suggests a significant deficit in feedback learning and reward prediction.

Conceptual Knowledge Influences Decision Making Differently in Individuals with High or Low Cognitive Flexibility: An ERP Study

PubMed Central

Dong, Xiaofei; Du, Xiumin; Qi, Bing

2016-01-01

Objective Studies using the Iowa Gambling Task (IGT) have distinguished between good and bad decision makers and have provided an explanation for deficits in decision making. Previous studies have demonstrated a link between Wisconsin Card Sorting Test (WCST) performance and IGT performance, but the results were not consistent and failed to explain why WCST performance can predict IGT performance. The present study aimed to demonstrate that WCST performance can predict IGT performance and to identify the cognitive component of the WCST that affects IGT performance using event-related potentials (ERPs). Methods In this study, 39 healthy subjects (5 subjects were excluded) were divided into a high group and a low group based on their global score on the WCST. A single-choice version of the IGT was used to eliminate the impact of retrieval strategies on the choice evaluation process and interference due to uncorrelated decks. Differences in the underlying neural mechanisms and explicit knowledge between the two groups during the three stages of the decision-making process were described. Results Based on the information processing perspective, we divided the decision-making process into three stages: choice evaluation, response selection, and feedback processing. The behavioral results showed that the highly cognitively flexible participants performed better on the IGT and acquired more knowledge of the task. The ERP results showed that during the choice evaluation stage, the P300 recorded from central and parietal regions when a bad deck appeared was larger in the high group participants than in the low group participants. During the response selection stage, the effect of choice type was significant only in the frontal region in the high group, with a larger effect for passing. During the feedback evaluation stage, a larger FRN was evoked for a loss than for a win in the high group, whereas the FRN effect was absent in the low group. Conclusion Compared with the participants with low cognitive flexibility, the participants with high cognitive flexibility performed better on the IGT, acquired more knowledge of the task, and displayed more obvious somatic markers. The low group participants showed reduced working memory abilities during the choice evaluation stage. The appropriate somatic markers reflected by the DPN is formed only when conceptual knowledge is gained in the response selection stage. The absence of an FRN effect in the subjects who performed poorly on the WCST suggests a significant deficit in feedback learning and reward prediction. PMID:27479484

Does performance management affect nurses' well-being?

PubMed

Decramer, Adelien; Audenaert, Mieke; Van Waeyenberg, Thomas; Claeys, Tine; Claes, Claudia; Vandevelde, Stijn; van Loon, Jos; Crucke, Saskia

2015-04-01

This article focuses on employee performance-management practices in the healthcare sector. We specifically aim to contribute to a better understanding of the impact of employee performance-management practices on affective well-being of nurses in hospitals. Theory suggests that the features of employee-performance management (planning and evaluation of individual performances) predict affective well-being (in this study: job satisfaction and affective commitment). Performance-management planning and evaluation and affective well-being were drawn from a survey of nurses at a Flemish hospital. Separate estimations were performed for different aspects of affective well-being. Performance planning has a negative effect on job satisfaction of nurses. Both vertical alignment and satisfaction with the employee performance-management system increase the affective well-being of nurses; however, the impact of vertical alignment differs for different aspects of affective well-being (i.e. job satisfaction and affective commitment). Performance-management planning and evaluation of nurses are associated with attitudinal outcomes. The results indicate that employee performance-management features have different impacts on different aspects of well-being. Copyright © 2014 Elsevier Ltd. All rights reserved.

FLUORESCENT TRACER EVALUATION OF PROTECTIVE CLOTHING PERFORMANCE

EPA Science Inventory

Field studies evaluating chemical protective clothing (CPC), which is often employed as a primary control option to reduce occupational exposures during pesticide applications, are limited. This study, supported by the U.S. Environmental Protection Agency (EPA), was designed to...

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

Code of Federal Regulations, 2013 CFR

2013-07-01

... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Performance Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control Devices As required in § 63.5850 you must conduct performance tests, performance evaluations, and...

40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

Code of Federal Regulations, 2014 CFR

2014-07-01

... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Performance Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control Devices As required in § 63.5850 you must conduct performance tests, performance evaluations, and...

40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

Code of Federal Regulations, 2012 CFR

2012-07-01

... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Performance Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control Devices As required in § 63.5850 you must conduct performance tests, performance evaluations, and...

Neuropsychological performance of a patient suspected of dementia taking lorazepam and retested 1 year later following titration.

PubMed

Scott, Bonnie M; Schmitt, Andrew L; Livingston, Ronald B

2016-01-01

The effects of medication on neuropsychological performance have yet to be fully investigated, particularly in older patients. As such, the present case study was undertaken to examine the specific impact of benzodiazepine use on neuropsychological performance by providing a comparison of the test-retest data of an 81-year-old patient taking lorazepam. A comprehensive neuropsychological evaluation was conducted: (a) during the initial referral, while the patient had been taking high doses of lorazepam for approximately 3 years; and (b) 6 months after complete titration, which was 1 year after the initial evaluation. Normative scores derived from the 2 trials were compared via calculation of Reliable Change Indexes. Neuropsychological performance during both evaluations was indicative of dementia, including similar degrees of impairment in delayed memory, verbal fluency, and olfaction. However, scores obtained during the second evaluation were somewhat higher, with significant improvements observed in immediate memory, visuospatial/construction abilities, language function, abstract concept formation, and set shifting. Results of the current case study suggest that several neuropsychological domains may be particularly sensitive to chronic benzodiazepine use. Although the overall diagnostic picture in the present study remained unaltered, clinicians should be cognizant of such medication effects and the potential for these neuropsychological alterations to obscure differential diagnosis.

Performance of an Automated-Mixed-Traffic-Vehicle /AMTV/ System. [urban people mover

NASA Technical Reports Server (NTRS)

Peng, T. K. C.; Chon, K.

1978-01-01

This study analyzes the operation and evaluates the expected performance of a proposed automatic guideway transit system which uses low-speed Automated Mixed Traffic Vehicles (AMTV's). Vehicle scheduling and headway control policies are evaluated with a transit system simulation model. The effect of mixed-traffic interference on the average vehicle speed is examined with a vehicle-pedestrian interface model. Control parameters regulating vehicle speed are evaluated for safe stopping and passenger comfort.

Probiotic supplementation in sports and physical exercise: Does it present any ergogenic effect?

PubMed

Coqueiro, Audrey Yule; de Oliveira Garcia, Amanda Beatriz; Rogero, Marcelo Macedo; Tirapegui, Julio

2017-12-01

Probiotics are live microorganisms that promote health benefits to the host. Evidence indicates that some probiotic strains play an immunomodulatory role and reduce the incidence of respiratory and gastrointestinal infections in athletes and in physical activity practitioners. For this reason, probiotic supplementation could indirectly improve exercise performance. However, recent studies have observed direct ergogenic effects of probiotics, but the mechanisms of action are poorly elucidated. In this study, we aim to synthesize available knowledge on the effect of probiotics on physical exercise, identify the mechanisms of action by which probiotics could improve performance directly and indirectly, and verify whether probiotics have any ergogenic effect. The study was performed in the PubMed database in February 2017, without limitation as to the publication period. The keyword combinations used were: 'Probiotics' and 'Sports' ( n = 17 articles), 'Probiotics' and 'Exercise' ( n = 26 articles) and 'Probiotics' and 'Athletes' ( n = 11 articles). Of the 16 studies evaluated, only six applied performance tests, of which only two demonstrated that probiotic supplementation increases performance, but one of them was performed with mice. According to the studies evaluated, probiotic supplementation does not present ergogenic effect, however, considering the small number of studies, this subject should be better investigated.

A Multi-center Milestone Study of Clinical Vertebral CT Segmentation

PubMed Central

Yao, Jianhua; Burns, Joseph E.; Forsberg, Daniel; Seitel, Alexander; Rasoulian, Abtin; Abolmaesumi, Purang; Hammernik, Kerstin; Urschler, Martin; Ibragimov, Bulat; Korez, Robert; Vrtovec, Tomaž; Castro-Mateos, Isaac; Pozo, Jose M.; Frangi, Alejandro F.; Summers, Ronald M.; Li, Shuo

2017-01-01

A multiple center milestone study of clinical vertebra segmentation is presented in this paper. Vertebra segmentation is a fundamental step for spinal image analysis and intervention. The first half of the study was conducted in the spine segmentation challenge in 2014 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) Workshop on Computational Spine Imaging (CSI 2014). The objective was to evaluate the performance of several state-of-the-art vertebra segmentation algorithms on computed tomography (CT) scans using ten training and five testing dataset, all healthy cases; the second half of the study was conducted after the challenge, where additional 5 abnormal cases are used for testing to evaluate the performance under abnormal cases. Dice coefficients and absolute surface distances were used as evaluation metrics. Segmentation of each vertebra as a single geometric unit, as well as separate segmentation of vertebra substructures, was evaluated. Five teams participated in the comparative study. The top performers in the study achieved Dice coefficient of 0.93 in the upper thoracic, 0.95 in the lower thoracic and 0.96 in the lumbar spine for healthy cases, and 0.88 in the upper thoracic, 0.89 in the lower thoracic and 0.92 in the lumbar spine for osteoporotic and fractured cases. The strengths and weaknesses of each method as well as future suggestion for improvement are discussed. This is the first multi-center comparative study for vertebra segmentation methods, which will provide an up-to-date performance milestone for the fast growing spinal image analysis and intervention. PMID:26878138

Using Performance on the Job to Inform Teacher Tenure Decisions. Brief 10

ERIC Educational Resources Information Center

Goldhaber, Dan; Hansen, Michael

2010-01-01

In recent months a number of states, such as Tennessee, have considered tying teacher evaluations and tenure to student achievement as part of their Race to the Top plans. This research brief evaluates how well early-career performance signals teacher effectiveness after tenure. The brief presents selected findings from a larger study using North…

Evaluation of formulated feed for juvenile lake sturgeon (Acipenser fulvescens) based on growth performance and nutrient retention

USDA-ARS?s Scientific Manuscript database

This study evaluated the potential of giving formulated feed to juvenile lake sturgeon (Acipenser fulvescens) and determined the optimal feeding rate of a soft-moist feed on the growth performance and whole-body composition of this fish. Six feeding rates (% body weight per day: % BW/d) of a soft-mo...

ARSENIC REMOVAL FROM DRINKING WATER BY ADSORPTIVE MEDIA U.S. EPA DEMONSTRATION PROJECT AT RICHMOND ELEMENTARY SCHOOL IN SUSANVILLE, CA SIX-MONTH EVALUATION REPORT

EPA Science Inventory

This report documents the activities performed during and the results obtained from the first six months of the performance evaluation study of the Aquatic Treatment Systems, Inc. (ATS) adsorptive media arsenic removal system at Richmond Elementary School in Susanville, Californi...

Impacts of Performance Pay under the Teacher Incentive Fund: Study Design Report

ERIC Educational Resources Information Center

Glazerman, Steven; Chiang, Hanley; Wellington, Alison; Constantine, Jill; Player, Dan

2011-01-01

The body of research on the design, implementation, and effects of performance-based compensation systems has influenced the design and evaluation of the 2010 Teacher Incentive Fund (TIF) grants. In the sections presented here, the authors describe the key components of 2010 TIF grants and the conceptual framework for the evaluation. The remainder…

Self-Efficacy, Self-Evaluation, and Music Performance of Secondary-Level Band Students

ERIC Educational Resources Information Center

Hewitt, Michael P.

2015-01-01

In the present study, relationships between two components of self-regulation (self-efficacy and self-evaluation) and gender, school level, instrument family, and music performance were examined. Participants were 340 middle and high school band students who participated in one of two summer music camps or who were members of a private middle…

A Conceptual Framework to Help Evaluate the Quality of Institutional Performance

ERIC Educational Resources Information Center

Kettunen, Juha

2008-01-01

Purpose: This study aims to present a general conceptual framework which can be used to evaluate quality and institutional performance in higher education. Design/methodology/approach: The quality of higher education is at the heart of the setting up of the European Higher Education Area. Strategic management is widely used in higher education…

Internal Consistency of Performance Evaluations as a Function of Music Expertise and Excerpt Familiarity

ERIC Educational Resources Information Center

Kinney, Daryl W.

2009-01-01

The purpose of this study was to examine the effects of music experience and excerpt familiarity on the internal consistency of performance evaluations. Participants included nonmusic majors who had not participated in high school music ensembles, nonmusic majors who had participated in high school music ensembles, music majors, and experts…

Investing in Development: Six High-Performing, High-Poverty Schools Implement the Massachusetts Teacher Evaluation Policy

ERIC Educational Resources Information Center

Reinhorn, Stefanie K.; Johnson, Susan Moore; Simon, Nicole S.

2017-01-01

We studied how six high-performing, high-poverty schools in one large Massachusetts city implemented the state's new teacher evaluation policy. The sample includes traditional, turnaround, restart, and charter schools, each of which had received the state's highest accountability rating. We sought to learn how these successful schools approached…

Advanced Life Support Equivalent System Mass Guidelines Document

NASA Technical Reports Server (NTRS)

Levri, Julie; Fisher, John W.; Jones, Harry W.; Drysdale, Alan E.; Ewert, Michael K.; Hanford, Anthony J.; Hogan, John A.; Joshi, Jitendri, A.; Vaccari, David A.

2003-01-01

This document is a viewgraph presentation which provides guidelines for performing an Equivalent System Mass (ESM) evaluation for trade study purposes. The document: 1) Defines ESM; 2) Explains how to calculate ESM; 3) Discusses interpretation of ESM results. The document is designed to provide detailed instructive material for researchers who are performing ESM evaluations for the first time.

PRELIMINARY RESULTS OF EPA'S PERFORMANCE EVALUATION OF FEDERAL REFERENCE METHODS AND FEDERAL EQUIVALENT METHODS FOR COARSE PARTICULATE MATTER

EPA Science Inventory

The main objective of this study is to evaluate the performance of sampling methods for potential use as a Federal Reference Method (FRM) capable of providing an estimate of coarse particle (PMc: particulate matter with an aerodynamic diameter between 2.5 µm and 10 µm) ...

Improving Fifth Grade Students' Mathematics Self-Efficacy Calibration and Performance through Self-Regulation Training

ERIC Educational Resources Information Center

Ramdass, Darshanand H.

2009-01-01

This primary goal of this study was to investigate the effects of strategy training and self-reflection, two subprocesses of Zimmerman's cyclical model of self-regulation, on fifth grade students' mathematics performance, self-efficacy, self-evaluation, and calibration measures of self-efficacy bias, self-efficacy accuracy, self-evaluation bias,…

Arsenic Removal from Drinking Water by Adsorptive Media, U.S. EPA Demonstration Project at LEADS Head Start Building in Buckeye Lake, OH - Final Performance Evaluation Report

EPA Science Inventory

This report documents the activities performed and the results obtained for the arsenic removal treatment technology demonstration project at Licking Economic Action Development Study (LEADS) Head Start School in Buckeye Lake, Ohio. The objectives of the project were to evaluate...

Developing and evaluating a target-background similarity metric for camouflage detection.

PubMed

Lin, Chiuhsiang Joe; Chang, Chi-Chan; Liu, Bor-Shong

2014-01-01

Measurement of camouflage performance is of fundamental importance for military stealth applications. The goal of camouflage assessment algorithms is to automatically assess the effect of camouflage in agreement with human detection responses. In a previous study, we found that the Universal Image Quality Index (UIQI) correlated well with the psychophysical measures, and it could be a potentially camouflage assessment tool. In this study, we want to quantify the camouflage similarity index and psychophysical results. We compare several image quality indexes for computational evaluation of camouflage effectiveness, and present the results of an extensive human visual experiment conducted to evaluate the performance of several camouflage assessment algorithms and analyze the strengths and weaknesses of these algorithms. The experimental data demonstrates the effectiveness of the approach, and the correlation coefficient result of the UIQI was higher than those of other methods. This approach was highly correlated with the human target-searching results. It also showed that this method is an objective and effective camouflage performance evaluation method because it considers the human visual system and image structure, which makes it consistent with the subjective evaluation results.

Nursing students' self-evaluation using a video recording of foley catheterization: effects on students' competence, communication skills, and learning motivation.

PubMed

Yoo, Moon Sook; Yoo, Il Young; Lee, Hyejung

2010-07-01

An opportunity for a student to evaluate his or her own performance enhances self-awareness and promotes self-directed learning. Using three outcome measures of competency of procedure, communication skills, and learning motivation, the effects of self-evaluation using a video recording of the student's Foley catheterization was investigated in this study. The students in the experimental group (n = 20) evaluated their Foley catheterization performance by reviewing the video recordings of their own performance, whereas students in the control group (n = 20) received written evaluation guidelines only. The results showed that the students in the experimental group had better scores on competency (p < 0.001), communication skills (p < 0.001), and learning motivation (p = 0.018) than the control group at the post-test, which was conducted 8 weeks after the pretest. Self-awareness of one's own performance developed by reviewing a videotape appears to increase the competency of clinical skills in nursing students. Copyright 2010, SLACK Incorporated.

Study of the Performance and Characteristics of U.S. Academic Research Institution Technology Commercialization (ARITC)

ERIC Educational Resources Information Center

Kim, Jisun

2012-01-01

This dissertation aims to provide a better understanding of the technology licensing practices of academic research institutions. The study identifies time durations in licensing and incorporates these into a model to evaluate licensing performance. Performance is measured by the efficiency of an institution's technology licensing process and…

The Influence of Body Mapping on Student Musicians' Performance Experiences

ERIC Educational Resources Information Center

Buchanan, Heather J.; Hays, Terrence

2014-01-01

This qualitative study examines student musicians' perceptions of their performance and development resulting from Body Mapping (BMG) technique. BMG is a somatic (mind-body) education technique designed to teach musicians skills in self-evaluation and change for performing with sensory-motor integrity. A qualitative study guided by an…

The Relationship between Emotional Intelligence and Student Teacher Performance

ERIC Educational Resources Information Center

Drew, Todd L.

2006-01-01

The purpose of this mixed methods study (N = 40) was to determine whether Student Teacher Performance (STP), as measured by a behavior-based performance evaluation process, is associated with Emotional Intelligence (EI), as measured by a personality assessment instrument. The study is an important contribution to the literature in that it appears…

Doppler lidar power, aperture diameter, and FFT size trade-off study

NASA Astrophysics Data System (ADS)

Chester, David B.; Budge, Scott E.

2017-05-01

In the design or selection of a Doppler lidar instrument for a spacecraft landing system, it is important to evaluate the balance between performance requirements and cost, weight, and power consumption. Leveraging the capability of LadarSIM, a trade-off study was performed to evaluate the interaction between the laser transmission power, aperture diameter, and FFT size in a Doppler lidar system. For this study the probabilities of detection and false alarm were calculated using LadarSIM to simulate FMCW lidar systems with varying power, aperture diameter, and FFT size. This paper reports the results of this trade-off study.

Evaluating the effect of work-family conflict and emotional intelligence in workplace: review to increase employees’ performance

NASA Astrophysics Data System (ADS)

Siahaan, E.

2018-03-01

Work-family conflict appeared as a form of women emancipation that made them commit two roles simultaneously, as a house wife and as a worker. This kind of situation created an issue about the impact of the role conflict experienced by women employees towards the level of their emotional control and performance. The aim of this study was to analyze and evaluate the impact of work-family conflict and emotional intelligence towards married women employees’ job performance. This study also proposed a mediating effect of emotional intelligence. This study used a structured questionnaires to gather the required data. There were 54 married women employees in PT Telkom Regional I participated in this study. The result of this study showed that the model could explain 14,6% variance in employees’ performance. Role conflict experienced by a woman burdened her mind and affected her emotional intelligence negatively. There was no effect of work-family conflict on employees’ performance; however, the conflict significantly affected employees performance in an indirect path. The performance would lower through the decrease of employees’ emotional intelligence as the result of the conflict happened. The most important aspect increasing employees’ performance was improving their emotional intelligence while maintaining their work-family conflict.

Impact of low vision care on reading performance in children with multiple disabilities and visual impairment

PubMed Central

Ramani, Krishna Kumar; Police, Shailaja Reddy; Jacob, Namita

2014-01-01

Background: Lack of evidence in literature to show low vision care enhances the reading performance in children with Multiple Disabilities and Visual Impairment (MDVI). Aim: To evaluate the effectiveness of Low Vision Care intervention on the reading performance of children with MDVI. Materials and Methods: Three subjects who were diagnosed to have cerebral palsy and visual impairment, studying in a special school were recruited for the study. All of them underwent detailed eye examination and low vision care evaluation at a tertiary eye care hospital. A single subject multiple baseline (study) design was adopted and the study period was 16 weeks. The reading performance (reading speed, reading accuracy, reading fluency) was evaluated during the baseline phase and the intervention phase. The median of all the reading parameters for each week was noted. The trend of the reading performance was graphically represented in both the phases. Results: Reading speed increased by 37 Word per minute, 37 Letters per minute and 5 letters per minute for the subject 1, 2 and 3 respectively after the intervention. Reading accuracy was 84%, 91% and 86.4% at the end of the baseline period and 98.7%, 98.4% and 99% at the end of 16 weeks for subject 1, 2 and 3 respectively. Average reading fluency score was 8.3, 7.1 and 5.5 in the baseline period and 10.2, 10.2 and 8.7 in the intervention period. Conclusion: This study shows evidence of noticeable improvement in reading performance of children with MDVI using a novel study design. PMID:23619499

Impact of low vision care on reading performance in children with multiple disabilities and visual impairment.

PubMed

Ramani, Krishna Kumar; Police, Shailaja Reddy; Jacob, Namita

2014-02-01

Lack of evidence in literature to show low vision care enhances the reading performance in children with Multiple Disabilities and Visual Impairment (MDVI). To evaluate the effectiveness of Low Vision Care intervention on the reading performance of children with MDVI. Three subjects who were diagnosed to have cerebral palsy and visual impairment, studying in a special school were recruited for the study. All of them underwent detailed eye examination and low vision care evaluation at a tertiary eye care hospital. A single subject multiple baseline (study) design was adopted and the study period was 16 weeks. The reading performance (reading speed, reading accuracy, reading fluency) was evaluated during the baseline phase and the intervention phase. The median of all the reading parameters for each week was noted. The trend of the reading performance was graphically represented in both the phases. Reading speed increased by 37 Word per minute, 37 Letters per minute and 5 letters per minute for the subject 1, 2 and 3 respectively after the intervention. Reading accuracy was 84%, 91% and 86.4% at the end of the baseline period and 98.7%, 98.4% and 99% at the end of 16 weeks for subject 1, 2 and 3 respectively. Average reading fluency score was 8.3, 7.1 and 5.5 in the baseline period and 10.2, 10.2 and 8.7 in the intervention period. This study shows evidence of noticeable improvement in reading performance of children with MDVI using a novel study design.

Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction.

PubMed

Park, Seong Ho; Han, Kyunghwa

2018-03-01

The use of artificial intelligence in medicine is currently an issue of great interest, especially with regard to the diagnostic or predictive analysis of medical images. Adoption of an artificial intelligence tool in clinical practice requires careful confirmation of its clinical utility. Herein, the authors explain key methodology points involved in a clinical evaluation of artificial intelligence technology for use in medicine, especially high-dimensional or overparameterized diagnostic or predictive models in which artificial deep neural networks are used, mainly from the standpoints of clinical epidemiology and biostatistics. First, statistical methods for assessing the discrimination and calibration performances of a diagnostic or predictive model are summarized. Next, the effects of disease manifestation spectrum and disease prevalence on the performance results are explained, followed by a discussion of the difference between evaluating the performance with use of internal and external datasets, the importance of using an adequate external dataset obtained from a well-defined clinical cohort to avoid overestimating the clinical performance as a result of overfitting in high-dimensional or overparameterized classification model and spectrum bias, and the essentials for achieving a more robust clinical evaluation. Finally, the authors review the role of clinical trials and observational outcome studies for ultimate clinical verification of diagnostic or predictive artificial intelligence tools through patient outcomes, beyond performance metrics, and how to design such studies. © RSNA, 2018.

Evaluation of betahistine for the prevention of seasickness: effect on vestibular function, psychomotor performance and efficacy at sea.

PubMed

Gordon, Carlos R; Doweck, Ilana; Nachum, Zohar; Gonen, Adi; Spitzer, Orna; Shupak, Avi

2003-01-01

Betahistine was evaluated for the prevention of seasickness in a laboratory and sea study. The effect of 48 mg betahistine on the vestibulo-ocular reflex (VOR) and on psychomotor performance was evaluated in twelve young healthy subjects in a double-blind, placebo controlled, randomized, crossover design. The vestibulo-ocular reflex was evaluated by the Sinusoidal Harmonic Acceleration (SHA) test at frequencies of 0.01, 0.02, 0.04, 0.08 and 0.16 Hz. Psychomotor performance was assessed by both computerized and paper and pencil test batteries. No significant differences in VOR gain or phase were found between betahistine and placebo treatment for any of the frequencies tested. No significant differences were found between treatments for any of the psychomotor performance tests or other possible side effects. The effect of 48 mg betahistine on seasickness severity was evaluated in 83 subjects during a voyage in rough seas. Betahistine had a borderline non-statistically significant effect on the prevention of seasickness in comparison with placebo (p = 0.053), with no notable side effects. Although our results are insufficient to recommend betahistine as an anti-seasickness drug, further studies are required to determine its possible effectiveness in less provocative motion sickness situations.

Principals' Perceptions Regarding Their Supervision and Evaluation

ERIC Educational Resources Information Center

Hvidston, David J.; Range, Bret G.; McKim, Courtney Ann

2015-01-01

This study examined the perceptions of principals concerning principal evaluation and supervisory feedback. Principals were asked two open-ended questions. Respondents included 82 principals in the Rocky Mountain region. The emerging themes were "Superintendent Performance," "Principal Evaluation Components," "Specific…

Evaluation of special surface treatment aged using UV, phase I.

DOT National Transportation Integrated Search

2011-08-01

Research was undertaken to evaluate the effectiveness of Tensars specialty polymer cement slurry : (coating) in reducing aging of asphalt binders and mixtures. The study was also aimed at evaluating the effect of this : material on performance cha...

Evaluation of Multiclass Model Observers in PET LROC Studies

NASA Astrophysics Data System (ADS)

Gifford, H. C.; Kinahan, P. E.; Lartizien, C.; King, M. A.

2007-02-01

A localization ROC (LROC) study was conducted to evaluate nonprewhitening matched-filter (NPW) and channelized NPW (CNPW) versions of a multiclass model observer as predictors of human tumor-detection performance with PET images. Target localization is explicitly performed by these model observers. Tumors were placed in the liver, lungs, and background soft tissue of a mathematical phantom, and the data simulation modeled a full-3D acquisition mode. Reconstructions were performed with the FORE+AWOSEM algorithm. The LROC study measured observer performance with 2D images consisting of either coronal, sagittal, or transverse views of the same set of cases. Versions of the CNPW observer based on two previously published difference-of-Gaussian channel models demonstrated good quantitative agreement with human observers. One interpretation of these results treats the CNPW observer as a channelized Hotelling observer with implicit internal noise

What goes up must . . . Keep going up? Cultural differences in cognitive styles influence evaluations of dynamic performance.

PubMed

Ferris, D Lance; Reb, Jochen; Lian, Huiwen; Sim, Samantha; Ang, Dionysius

2018-03-01

Past research on dynamic workplace performance evaluation has taken as axiomatic that temporal performance trends produce naïve extrapolation effects on performance ratings. That is, we naïvely assume that an individual whose performance has trended upward over time will continue to improve, and rate that individual more positively than an individual whose performance has trended downward over time-even if, on average, the 2 individuals have performed at an equivalent level. However, we argue that such naïve extrapolation effects are more pronounced in Western countries than Eastern countries, owing to Eastern countries having a more holistic cognitive style. To test our hypotheses, we examined the effect of performance trend on expectations of future performance and ratings of past performance across 2 studies: Study 1 compares the magnitude of naïve extrapolation effects among Singaporeans primed with either a more or less holistic cognitive style, and Study 2 examines holistic cognitive style as a mediating mechanism accounting for differences in the magnitude of naïve extrapolation effects between American and Chinese raters. Across both studies, we found support for our predictions that dynamic performance trends have less impact on the ratings of more holistic thinkers. Implications for the dynamic performance and naïve extrapolation literatures are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The Influence of Social Style in Evaluating Academic Presentations of Engineering Projects

ERIC Educational Resources Information Center

Ortiz València, Héctor; García Carrillo, Águeda; González Benítez, Margarita

2012-01-01

An individual's social style is determined by behavioral patterns in the interactions with their peers. Some studies suggest that social style may influence the way in which an individual's performance is evaluated. We studied the effects that speakers' and evaluators' social styles have on the marks given for end-of-term presentations in a…

Technology Evaluation Tools and Teacher Performance in Public Schools

ERIC Educational Resources Information Center

Stonehouse, Pauline; Keengwe, Jared

2013-01-01

The purpose of this study was, (a) to describe the introduction of mVAL software and Charlotte Danielson Rubrics (CDR) as teacher evaluation tools; (b) to compare the process and outcomes of the new initiative with traditional systems; and (c) to evaluate the software from the perspective of participants in the system. This study highlights the…

Optical versus Virtual: Teaching Assistant Perceptions of the Use of Virtual Microscopy in an Undergraduate Human Anatomy Course

ERIC Educational Resources Information Center

Collier, Larissa; Dunham, Stacey; Braun, Mark W.; O'Loughlin, Valerie Dean

2012-01-01

Many studies that evaluate the introduction of technology in the classroom focus on student performance and student evaluations. This study focuses on instructor evaluation of the introduction of virtual microscopy into an undergraduate anatomy class. Semi-structured interviews were conducted with graduate teaching assistants (TA) and analyzed…

Performance Evaluation of Bucket based Excavating, Loading and Transport (BELT) Equipment - An OEE Approach

NASA Astrophysics Data System (ADS)

Mohammadi, Mousa; Rai, Piyush; Gupta, Suprakash

2017-03-01

Overall Equipment Effectiveness (OEE) has been used since last over two decades as a measure of performance in manufacturing industries. Unfortunately, enough, application of OEE in mining and excavation industry has not been duly adopted. In this paper an effort has been made to identify the OEE for performance evaluation of Bucket based Excavating, Loading and Transport (BELT) equipment. The conceptual model of OEE, as used in the manufacturing industries, has been revised to adapt to the BELT equipment. The revised and adapted model considered the operational time, speed and bucket capacity utilization losses as the key OEE components for evaluating the performance of BELT equipment. To illustrate the efficacy of the devised model on real-time basis, a case study was undertaken on the biggest single bucket excavating equipment - the dragline, in a large surface coal mine. One-year data was collected in order to evaluate the proposed OEE model.

Results from an audit feedback strategy for chronic obstructive pulmonary disease in-hospital care: a joint analysis from the AUDIPOC and European COPD audit studies.

PubMed

Lopez-Campos, Jose Luis; Asensio-Cruz, M Isabel; Castro-Acosta, Ady; Calero, Carmen; Pozo-Rodriguez, Francisco

2014-01-01

Clinical audits have emerged as a potential tool to summarize the clinical performance of healthcare over a specified period of time. However, the effectiveness of audit and feedback has shown inconsistent results and the impact of audit and feedback on clinical performance has not been evaluated for COPD exacerbations. In the present study, we analyzed the results of two consecutive nationwide clinical audits performed in Spain to evaluate both the in-hospital clinical care provided and the feedback strategy. The present study is an analysis of two clinical audits performed in Spain that evaluated the clinical care provided to COPD patients who were admitted to the hospital for a COPD exacerbation. The first audit was performed from November-December 2008. The feedback strategy consisted of personalized reports for each participant center, the presentation and discussion of the results at regional, national and international meetings and the creation of health-care quality standards for COPD. The second audit was part of a European study during January and February 2011. The impact of the feedback strategy was evaluated in term of clinical care provided and in-hospital survival. A total of 94 centers participated in the two audits, recruiting 8,143 admissions (audit 1∶3,493 and audit 2∶4,650). The initially provided clinical care was reasonably acceptable even though there was considerable variability. Several diagnostic and therapeutic procedures improved in the second audit. Although the differences were significant, the degree of improvement was small to moderate. We found no impact on in-hospital mortality. The present study describes COPD hospital care in Spanish hospitals and evaluates the impact of peer-benchmarked, individually written and group-oral feedback strategy on the clinical outcomes for treating COPD exacerbations. It describes small to moderate improvements in the clinical care provided to COPD patients with no impact on in-hospital mortality.

Metrology Standards for Quantitative Imaging Biomarkers

PubMed Central

Obuchowski, Nancy A.; Kessler, Larry G.; Raunig, David L.; Gatsonis, Constantine; Huang, Erich P.; Kondratovich, Marina; McShane, Lisa M.; Reeves, Anthony P.; Barboriak, Daniel P.; Guimaraes, Alexander R.; Wahl, Richard L.

2015-01-01

Although investigators in the imaging community have been active in developing and evaluating quantitative imaging biomarkers (QIBs), the development and implementation of QIBs have been hampered by the inconsistent or incorrect use of terminology or methods for technical performance and statistical concepts. Technical performance is an assessment of how a test performs in reference objects or subjects under controlled conditions. In this article, some of the relevant statistical concepts are reviewed, methods that can be used for evaluating and comparing QIBs are described, and some of the technical performance issues related to imaging biomarkers are discussed. More consistent and correct use of terminology and study design principles will improve clinical research, advance regulatory science, and foster better care for patients who undergo imaging studies. © RSNA, 2015 PMID:26267831

Performance evaluation of Bragg coherent diffraction imaging

NASA Astrophysics Data System (ADS)

Öztürk, H.; Huang, X.; Yan, H.; Robinson, I. K.; Noyan, I. C.; Chu, Y. S.

2017-10-01

In this study, we present a numerical framework for modeling three-dimensional (3D) diffraction data in Bragg coherent diffraction imaging (Bragg CDI) experiments and evaluating the quality of obtained 3D complex-valued real-space images recovered by reconstruction algorithms under controlled conditions. The approach is used to systematically explore the performance and the detection limit of this phase-retrieval-based microscopy tool. The numerical investigation suggests that the superb performance of Bragg CDI is achieved with an oversampling ratio above 30 and a detection dynamic range above 6 orders. The observed performance degradation subject to the data binning processes is also studied. This numerical tool can be used to optimize experimental parameters and has the potential to significantly improve the throughput of Bragg CDI method.

Integrating Soft Set Theory and Fuzzy Linguistic Model to Evaluate the Performance of Training Simulation Systems

PubMed Central

Chang, Kuei-Hu; Chang, Yung-Chia; Chain, Kai; Chung, Hsiang-Yu

2016-01-01

The advancement of high technologies and the arrival of the information age have caused changes to the modern warfare. The military forces of many countries have replaced partially real training drills with training simulation systems to achieve combat readiness. However, considerable types of training simulation systems are used in military settings. In addition, differences in system set up time, functions, the environment, and the competency of system operators, as well as incomplete information have made it difficult to evaluate the performance of training simulation systems. To address the aforementioned problems, this study integrated analytic hierarchy process, soft set theory, and the fuzzy linguistic representation model to evaluate the performance of various training simulation systems. Furthermore, importance–performance analysis was adopted to examine the influence of saving costs and training safety of training simulation systems. The findings of this study are expected to facilitate applying military training simulation systems, avoiding wasting of resources (e.g., low utility and idle time), and providing data for subsequent applications and analysis. To verify the method proposed in this study, the numerical examples of the performance evaluation of training simulation systems were adopted and compared with the numerical results of an AHP and a novel AHP-based ranking technique. The results verified that not only could expert-provided questionnaire information be fully considered to lower the repetition rate of performance ranking, but a two-dimensional graph could also be used to help administrators allocate limited resources, thereby enhancing the investment benefits and training effectiveness of a training simulation system. PMID:27598390

Integrating Soft Set Theory and Fuzzy Linguistic Model to Evaluate the Performance of Training Simulation Systems.

PubMed

Chang, Kuei-Hu; Chang, Yung-Chia; Chain, Kai; Chung, Hsiang-Yu

2016-01-01

The advancement of high technologies and the arrival of the information age have caused changes to the modern warfare. The military forces of many countries have replaced partially real training drills with training simulation systems to achieve combat readiness. However, considerable types of training simulation systems are used in military settings. In addition, differences in system set up time, functions, the environment, and the competency of system operators, as well as incomplete information have made it difficult to evaluate the performance of training simulation systems. To address the aforementioned problems, this study integrated analytic hierarchy process, soft set theory, and the fuzzy linguistic representation model to evaluate the performance of various training simulation systems. Furthermore, importance-performance analysis was adopted to examine the influence of saving costs and training safety of training simulation systems. The findings of this study are expected to facilitate applying military training simulation systems, avoiding wasting of resources (e.g., low utility and idle time), and providing data for subsequent applications and analysis. To verify the method proposed in this study, the numerical examples of the performance evaluation of training simulation systems were adopted and compared with the numerical results of an AHP and a novel AHP-based ranking technique. The results verified that not only could expert-provided questionnaire information be fully considered to lower the repetition rate of performance ranking, but a two-dimensional graph could also be used to help administrators allocate limited resources, thereby enhancing the investment benefits and training effectiveness of a training simulation system.

The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets.

PubMed

Saito, Takaya; Rehmsmeier, Marc

2015-01-01

Binary classifiers are routinely evaluated with performance measures such as sensitivity and specificity, and performance is frequently illustrated with Receiver Operating Characteristics (ROC) plots. Alternative measures such as positive predictive value (PPV) and the associated Precision/Recall (PRC) plots are used less frequently. Many bioinformatics studies develop and evaluate classifiers that are to be applied to strongly imbalanced datasets in which the number of negatives outweighs the number of positives significantly. While ROC plots are visually appealing and provide an overview of a classifier's performance across a wide range of specificities, one can ask whether ROC plots could be misleading when applied in imbalanced classification scenarios. We show here that the visual interpretability of ROC plots in the context of imbalanced datasets can be deceptive with respect to conclusions about the reliability of classification performance, owing to an intuitive but wrong interpretation of specificity. PRC plots, on the other hand, can provide the viewer with an accurate prediction of future classification performance due to the fact that they evaluate the fraction of true positives among positive predictions. Our findings have potential implications for the interpretation of a large number of studies that use ROC plots on imbalanced datasets.

Travtek Evaluation Modeling Study

DOT National Transportation Integrated Search

1996-03-01

THE FOLLOWING REPORT DESCRIBES A MODELING STUDY THAT WAS PERFORMED TO EXTRAPOLATE, FROM THE TRAVTEK OPERATIONAL TEST DATA, A SET OF SYSTEM WIDE BENEFITS AND PERFORMANCE VALUES FOR A WIDER-SCALE DEPLOYMENT OF A TRAVTEK-LIKE SYSTEM. IN THE FIRST PART O...

Child-Report Measures of Occupational Performance: A Systematic Review

PubMed Central

Totino, Rebekah; Doma, Kenji; Leicht, Anthony; Brown, Nicole; Cuomo, Belinda

2016-01-01

Introduction Improving occupational performance is a key service of occupational therapists and client-centred approach to care is central to clinical practice. As such it is important to comprehensively evaluate the quality of psychometric properties reported across measures of occupational performance; in order to guide assessment and treatment planning. Objective To systematically review the literature on the psychometric properties of child-report measures of occupational performance for children ages 2–18 years. Methods A systematic search of the following six electronic databases was conducted: CINAHL; PsycINFO; EMBASE; PubMed; the Health and Psychosocial Instruments (HAPI) database; and Google Scholar. The quality of the studies was evaluated against the COSMIN taxonomy of measurement properties and the overall quality of psychometric properties was evaluated using pre-set psychometric criteria. Results Fifteen articles and one manual were reviewed to assess the psychometric properties of the six measures–the PEGS, MMD, CAPE, PAC, COSA, and OSA- which met the inclusion criteria. Most of the measures had conducted good quality studies to evaluate the psychometric properties of measures (PEGS, CAPE, PAC, OSA); however, the quality of the studies for two of these measures was relatively weak (MMD, COSA). When integrating the quality of the psychometric properties of the measures with the quality of the studies, the PAC stood out as having superior psychometric qualities. Conclusions The overall quality of the psychometric properties of most measures was limited. There is a need for continuing research into the psychometric properties of child-report measures of occupational performance, and to revise and improve the psychometric properties of existing measures. PMID:26808674

Continuous Evaluation Of In-Service Highway Safety Feature Performance

DOT National Transportation Integrated Search

2002-09-01

This report documents the research effort, findings, conclusions, and recommendations of a study to develop a program for the continuous in-service evaluation of highway safety features. The study consisted of two phases and eight tasks. An in-servic...

A SIMPLE METHOD FOR EVALUATING DATA FROM AN INTERLABORATORY STUDY

EPA Science Inventory

Large-scale laboratory-and method-performance studies involving more than about 30 laboratories may be evaluated by calculating the HORRAT ratio for each test sample (HORRAT=[experimentally found among-laboratories relative standard deviation] divided by [relative standard deviat...

Contractor assistance in highway maintenance : state-of-the-art evaluation.

DOT National Transportation Integrated Search

1980-01-01

The purpose of this study was to perform a state-of-the art evaluation of contractor assistance in Virginia's highway maintenance. The study revealed that expenditures for contractor assistance accounted for 2.79% of the total expenditure on ordinary...

Effects of a Velocity-Vector Based Command Augmentation System and Synthetic Vision System Terrain Portrayal and Guidance Symbology Concepts on Single-Pilot Performance

NASA Technical Reports Server (NTRS)

Liu, Dahai; Goodrich, Kenneth H.; Peak, Bob

2010-01-01

This study investigated the effects of synthetic vision system (SVS) concepts and advanced flight controls on the performance of pilots flying a light, single-engine general aviation airplane. We evaluated the effects and interactions of two levels of terrain portrayal, guidance symbology, and flight control response type on pilot performance during the conduct of a relatively complex instrument approach procedure. The terrain and guidance presentations were evaluated as elements of an integrated primary flight display system. The approach procedure used in the study included a steeply descending, curved segment as might be encountered in emerging, required navigation performance (RNP) based procedures. Pilot performance measures consisted of flight technical performance, perceived workload, perceived situational awareness and subjective preference. The results revealed that an elevation based generic terrain portrayal significantly improved perceived situation awareness without adversely affecting flight technical performance or workload. Other factors (pilot instrument rating, control response type, and guidance symbology) were not found to significantly affect the performance measures.

Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

PubMed

Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

2018-02-01

Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

The Interaction of Motor Performance and Psycho-Physiological Effects During Acceleration to Hypergravity

NASA Astrophysics Data System (ADS)

Guardiera, Simon; Schneider, Stefan

2008-06-01

Several studies reported that human motor performance is impaired during acceleration to hypergravity. While physiological explanations (e.g. vestibular activity) are widely discussed, psycho-physiological reasons (e.g. stress) are less considered. The present study therefore evaluates the interaction between psycho-physiological effects and motor performance in hypergravity. Eleven subjects performed a manual tracking task. Additionally, stress hormone concentration, EEG and subjective mood were evaluated. All measurements were performed in normal (+1Gz), and in (or directly after) three times gravitational acceleration (+3Gz). Motor performance decreased, while all determined stress hormone concentrations increased in +3Gz. EEG analysis revealed an increase of brain cortical activity in right frontal lobe in +3Gz. Subjective mood decreased due to +3Gz. Our data confirm, that motor performance is decreased in hypergravity, whereas an increase in psychophysiological stress markers could be obtained. We conclude that psycho-physiological changes have to be regarded as a possible explanation for deficits in motor performance in hypergravity.

Effect of patient positions on measurement errors of the knee-joint space on radiographs

NASA Astrophysics Data System (ADS)

Gilewska, Grazyna

2001-08-01

Osteoarthritis (OA) is one of the most important health problems these days. It is one of the most frequent causes of pain and disability of middle-aged and old people. Nowadays the radiograph is the most economic and available tool to evaluate changes in OA. Error of performance of radiographs of knee joint is the basic problem of their evaluation for clinical research. The purpose of evaluation of such radiographs in my study was measuring the knee-joint space on several radiographs performed at defined intervals. Attempt at evaluating errors caused by a radiologist of a patient was presented in this study. These errors resulted mainly from either incorrect conditions of performance or from a patient's fault. Once we have information about size of the errors, we will be able to assess which of these elements have the greatest influence on accuracy and repeatability of measurements of knee-joint space. And consequently we will be able to minimize their sources.

The incidence of oropharyngeal dysphagia in infants with GERD-like symptoms.

PubMed

Fishbein, Mark; Branham, Christina; Fraker, Cheryl; Walbert, Laura; Cox, Sibyl; Scarborough, Donna

2013-09-01

Symptoms of infantile gastroesophageal reflux disease (GERD) may overlap with oropharyngeal dysphagia, but the evaluation and treatment of these conditions vary greatly. In this investigation, the incidence of oropharyngeal dysphagia in infants with GERD-like symptoms is determined. A retrospective chart review was performed on infants referred to a pediatric gastroenterology clinic for GERD-like symptoms. A feeding screen was performed in all infants. Standardized bedside swallow evaluation and modified barium swallow (MBS) studies were then performed when clinically indicated. A similarly aged cohort of normal participants also underwent a standard bedside swallow evaluation for group comparison. Study population included 67 infants. A swallow evaluation was recommended in 39 of 67 infants with abnormalities noted in all. Swallowing abnormalities were more frequent and clustered in infants with GERD-like symptoms vs controls. MBS was abnormal in 16 of 17 qualifying infants. Characteristics of at-risk infants included extreme prematurity, developmental delay, or symptoms refractory to antireflux medications. Oropharyngeal dysphagia is prominent in infants with GERD-like symptoms.

Evaluation method of the performance of kinetic inhibitor for clathrate hydrate

NASA Astrophysics Data System (ADS)

Muraoka, M.; Susuki, N.; Yamamoto, Y.

2016-12-01

As a part of a Japanese National hydrate research program (MH21, funded by METI), we study the formation of tetrahydrofuran (THF) clathrate hydrate from polyvinylpyrrolidone (PVP) aqueous solution as a function of growth rate V and adsorbed PVP concentration c using the unidirectional growth technique. This study aims to propose a simple method for evaluating the performance of kinetic hydrate inhibitors (KHIs) for the clathrate hydrate-aqueous solution system. The degree of super cooling ΔT calculated from the growth-induced interface shift under steady-state conditions was used for evaluating the KHIs performance. Using this method, a single experimental run can be completed within 3.5 h of the compulsory nucleation by setting V = 5 μm s-1. We believe this method is useful for screening various KHIs and clarifying the inhibition mechanism of KHIs.

Systematic review and meta-analysis of the performance of clinical risk assessment instruments for screening for osteoporosis or low bone density

PubMed Central

Edwards, D. L.; Saleh, A. A.; Greenspan, S. L.

2015-01-01

Summary We performed a systematic review and meta-analysis of the performance of clinical risk assessment instruments for screening for DXA-determined osteoporosis or low bone density. Commonly evaluated risk instruments showed high sensitivity approaching or exceeding 90 % at particular thresholds within various populations but low specificity at thresholds required for high sensitivity. Simpler instruments, such as OST, generally performed as well as or better than more complex instruments. Introduction The purpose of the study is to systematically review the performance of clinical risk assessment instruments for screening for dual-energy X-ray absorptiometry (DXA)-determined osteoporosis or low bone density. Methods Systematic review and meta-analysis were performed. Multiple literature sources were searched, and data extracted and analyzed from included references. Results One hundred eight references met inclusion criteria. Studies assessed many instruments in 34 countries, most commonly the Osteoporosis Self-Assessment Tool (OST), the Simple Calculated Osteoporosis Risk Estimation (SCORE) instrument, the Osteoporosis Self-Assessment Tool for Asians (OSTA), the Osteoporosis Risk Assessment Instrument (ORAI), and body weight criteria. Meta-analyses of studies evaluating OST using a cutoff threshold of <1 to identify US postmenopausal women with osteoporosis at the femoral neck provided summary sensitivity and specificity estimates of 89 % (95%CI 82–96 %) and 41 % (95%CI 23–59 %), respectively. Meta-analyses of studies evaluating OST using a cutoff threshold of 3 to identify US men with osteoporosis at the femoral neck, total hip, or lumbar spine provided summary sensitivity and specificity estimates of 88 % (95%CI 79–97 %) and 55 % (95%CI 42–68 %), respectively. Frequently evaluated instruments each had thresholds and populations for which sensitivity for osteoporosis or low bone mass detection approached or exceeded 90 % but always with a trade-off of relatively low specificity. Conclusions Commonly evaluated clinical risk assessment instruments each showed high sensitivity approaching or exceeding 90 % for identifying individuals with DXA-determined osteoporosis or low BMD at certain thresholds in different populations but low specificity at thresholds required for high sensitivity. Simpler instruments, such as OST, generally performed as well as or better than more complex instruments. PMID:25644147

A Study on Project Priority Evaluation Method on Road Slope Disaster Prevention Management

NASA Astrophysics Data System (ADS)

Sekiguchi, Nobuyasu; Ohtsu, Hiroyasu; Izu, Ryuutarou

To improve the safety and security of driving while coping with today's stagnant economy and frequent natural disasters, road slopes should be appropriately managed. To achieve the goals, road managers should establish project priority evaluation methods for each stage of road slope management by clarifying social losses that would result by drops in service levels. It is important that road managers evaluate a project priority properly to manage the road slope effectively. From this viewpoint, this study proposed "project priority evaluation methods" in road slope disaster prevention, which use available slope information at each stage of road slope management under limited funds. In addition, this study investigated the effect of managing it from the high slope of the priority by evaluating a risk of slope failure. In terms of the amount of available information, staged information provision is needed ranging from macroscopic studies, which involves evaluation of the entire route at each stage of decision making, to semi- and microscopic investigations for evaluating slopes, and microscopic investigations for evaluating individual slopes. With limited funds, additional detailed surveys are difficult to perform. It is effective to use the slope risk assessment system, which was constructed to complement detailed data, to extract sites to perform precise investigations.

Reduction of bias and variance for evaluation of computer-aided diagnostic schemes.

PubMed

Li, Qiang; Doi, Kunio

2006-04-01

Computer-aided diagnostic (CAD) schemes have been developed to assist radiologists in detecting various lesions in medical images. In addition to the development, an equally important problem is the reliable evaluation of the performance levels of various CAD schemes. It is good to see that more and more investigators are employing more reliable evaluation methods such as leave-one-out and cross validation, instead of less reliable methods such as resubstitution, for assessing their CAD schemes. However, the common applications of leave-one-out and cross-validation evaluation methods do not necessarily imply that the estimated performance levels are accurate and precise. Pitfalls often occur in the use of leave-one-out and cross-validation evaluation methods, and they lead to unreliable estimation of performance levels. In this study, we first identified a number of typical pitfalls for the evaluation of CAD schemes, and conducted a Monte Carlo simulation experiment for each of the pitfalls to demonstrate quantitatively the extent of bias and/or variance caused by the pitfall. Our experimental results indicate that considerable bias and variance may exist in the estimated performance levels of CAD schemes if one employs various flawed leave-one-out and cross-validation evaluation methods. In addition, for promoting and utilizing a high standard for reliable evaluation of CAD schemes, we attempt to make recommendations, whenever possible, for overcoming these pitfalls. We believe that, with the recommended evaluation methods, we can considerably reduce the bias and variance in the estimated performance levels of CAD schemes.

Effects of Learning Strategy Training on the Writing Performance of College Students with Asperger's Syndrome.

PubMed

Jackson, Lynn G; Duffy, Mary Lou; Brady, Michael P; McCormick, Jazarae

2018-03-01

Individuals with autism spectrum disorders (ASD) are increasingly entering institutions of higher education. However, many are not prepared for the academic and social demands of postsecondary environments. Although studies have evaluated academic and social interventions for children and adolescents with ASD, little research exists on the college population. The current study utilized a multiple baseline across participants design to evaluate the effectiveness of a writing learning strategy on the writing performance of three college students with ASD. Results indicated that the quality of writing performance improved following strategy instruction. In addition, participants were able to generalize strategy use to content specific writing tasks.

Avoidance temperament and social-evaluative threat in college students' math performance: a mediation model of math and test anxiety.

PubMed

Liew, Jeffrey; Lench, Heather C; Kao, Grace; Yeh, Yu-Chen; Kwok, Oi-man

2014-01-01

Standardized testing has become a common form of student evaluation with high stakes, and limited research exists on understanding the roles of students' personality traits and social-evaluative threat on their academic performance. This study examined the roles of avoidance temperament (i.e., fear and behavioral inhibition) and evaluative threat (i.e., fear of failure and being viewed as unintelligent) in standardized math test and course grades in college students. Undergraduate students (N=184) from a large public university were assessed on temperamental fear and behavioral inhibition. They were then given 15 minutes to complete a standardized math test. After the test, students provided data on evaluative threat and their math performance (scores on standardized college entrance exam and average grades in college math courses). Results indicate that avoidance temperament was linked to social-evaluative threat and low standardized math test scores. Furthermore, evaluative threat mediated the influence of avoidance temperament on both types of math performance. Results have educational and clinical implications, particularly for students at risk for test anxiety and underperformance. Interventions targeting emotion regulation and stress management skills may help individuals reduce their math and test anxieties.

Performance evaluation of Arizona's LTPP SPS-5 project : strategic study of rehabilitation of asphalt concrete pavements.

DOT National Transportation Integrated Search

2015-06-01

As part of the Long Term Pavement Performance (LTPP) Program, the Arizona Department of Transportation : (ADOT) constructed 11 Specific Pavement Study5 (SPS5) test sections on Interstate 8 near Casa Grande. The : SPS5 project studied a varie...

Performance evaluation of Arizona's LTPP SPS-2 project : strategic study of structural factors for rigid pavements.

DOT National Transportation Integrated Search

2015-10-01

As part of the Long Term Pavement Performance (LTPP) Program, Arizona Department of Transportation : (ADOT) constructed 21 Specific Pavement Studies 2 (SPS-2) test sections on Interstate 10 near Buckeye, : Arizona, to study a variety of structural se...

Treatability studies performed in support of an engineering evaluation/cost analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Myers, J.M.; Mueller, J.P.; Sundquist, J.A.

1995-12-31

The Southern Shipbuilding Corporation (SSC) site is located on 54 acres of wooded land adjacent to Bayou Bonfouca, approximately 1.8 miles downstream of the Bayou Bonfouca National Priorities List (NPL) Superfund site in Slidell, St. Tammany Parish, Louisiana. Two one-acre, impoundments on the SSC site were used to store wastes generated from vessel cleaning. Wastes stored in the impoundments are migrating into Bayou Bonfouca, which empties into Lake Pontchartrain. In addition, the impoundments are frequently invaded by flood waters. The US EPA Emergency Response Branch (EPA-ERB) performed a site investigation which indicated that the majority of the contamination is petroleum-relatedmore » and that the compounds of concern are polycyclic aromatic hydrocarbons (PARs). The wastes are generally contained with the two impoundments and surrounding soils. As part of an Engineering Evaluation/Cost Basis (EE/CA) of potential response action alternatives, four treatability studies were performed. A thermal treatment (incineration) study was performed at the EPA`s Incineration Research Facility (IRF). Biodegradation remedy selection feasibility assessment was conducted on-site. A remedy screening soil washing study was also performed by TAT. A solidification/stabilization (S/S) study was conducted through EPA`s Risk Reduction Engineering Laboratory (RREL) to ascertain if the PAHs could be immobilized within a solid matrix. Experimental objectives, dead methodology and conclusions for these studies are presented as they relate to potential response actions being evaluated at the SSC site.« less

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

An Empirical Study of Kirkpatrick's Evaluation Model in the Hospitality Industry

ERIC Educational Resources Information Center

Chang, Ya-Hui Elegance

2010-01-01

This study examined Kirkpatrick's training evaluation model (Kirkpatrick & Kirkpatrick, 2006) by assessing a sales training program conducted at an organization in the hospitality industry. The study assessed the employees' training outcomes of knowledge and skills, job performance, and the impact of the training upon the organization. By…

Academic Library Development Program: A Self Study.

ERIC Educational Resources Information Center

Carnegie-Mellon Univ., Pittsburgh, PA. University Libraries.

Results of a 4-month library self-evaluation program conducted by staff members at Carnegie-Mellon University Libraries are reported in this document. The study was conducted using the Academic Library Development Program (ALDP), a self-improvement strategy for libraries to evaluate and develop their performance. The study team consisting of four…

Evaluation of the Teaching Performance of University Lecturers: Comparison between Mexico and Spain

ERIC Educational Resources Information Center

Diaz, Matilde; Borges, Africa; Valadez, Dolores; Zambrano, Rogelio

2015-01-01

Comparative educational studies allow the study of the differences and similarities between different educational systems. This research, which consists on an educational evaluation, has studied the teaching behavior of ten university lecturers from a Spanish university--the University of La Laguna--, and seven from a Mexican…

(PRESENTED NAQC SAN FRANCISCO, CA) COARSE PM METHODS STUDY: STUDY DESIGN AND RESULTS

EPA Science Inventory

Comprehensive field studies were conducted to evaluate the performance of sampling methods for measuring the coarse fraction of PM10 in ambient air. Five separate sampling approaches were evaluated at each of three sampling sites. As the primary basis of comparison, a discrete ...

Reporter-Interpreter-Manager-Educator (RIME) descriptive ratings as an evaluation tool in an emergency medicine clerkship.

PubMed

Ander, Douglas S; Wallenstein, Joshua; Abramson, Jerome L; Click, Lorie; Shayne, Philip

2012-10-01

Emergency Medicine (EM) clerkships traditionally assess students using numerical ratings of clinical performance. The descriptive ratings of the Reporter, Interpreter, Manager, and Educator (RIME) method have been shown to be valuable in other specialties. We hypothesized that the RIME descriptive ratings would correlate with clinical performance and examination scores in an EM clerkship, indicating that the RIME ratings are a valid measure of performance. This was a prospective cohort study of an evaluation instrument for 4(th)-year medical students completing an EM rotation. This study received exempt Institutional Review Board status. EM faculty and residents completed shift evaluation forms including both numerical and RIME ratings. Students completed a final examination. Mean scores for RIME and clinical evaluations were calculated. Linear regression models were used to determine whether RIME ratings predicted clinical evaluation scores or final examination scores. Four hundred thirty-nine students who completed the EM clerkship were enrolled in the study. After excluding items with missing data, there were 2086 evaluation forms (based on 289 students) available for analysis. There was a clear positive relationship between RIME category and clinical evaluation score (r(2)=0.40, p<0.01). RIME ratings correlated most strongly with patient management skills and least strongly with humanistic qualities. A very weak correlation was seen with RIME and final examination. We found a positive association between RIME and clinical evaluation scores, suggesting that RIME is a valid clinical evaluation instrument. RIME descriptive ratings can be incorporated into EM evaluation instruments and provides useful data related to patient management skills. Copyright © 2012 Elsevier Inc. All rights reserved.

PRACA Enhancement Pilot Study Report: Engineering for Complex Systems Program (formerly Design for Safety), DFS-IC-0006

NASA Technical Reports Server (NTRS)

Korsmeyer, David; Schreiner, John

2002-01-01

This technology evaluation report documents the findings and recommendations of the Engineering for Complex Systems Program (formerly Design for Safety) PRACA Enhancement Pilot Study of the Space Shuttle Program's (SSP's) Problem Reporting and Corrective Action (PRACA) System. A team at NASA Ames Research Center (ARC) performed this Study. This Study was initiated as a follow-on to the NASA chartered Shuttle Independent Assessment Team (SIAT) review (performed in the Fall of 1999) which identified deficiencies in the current PRACA implementation. The Pilot Study was launched with an initial qualitative assessment and technical review performed during January 2000 with the quantitative formal Study (the subject of this report) started in March 2000. The goal of the PRACA Enhancement Pilot Study is to evaluate and quantify the technical aspects of the SSP PRACA systems and recommend enhancements to address deficiencies and in preparation for future system upgrades.

Normative Functional Performance Values in High School Athletes: The Functional Pre-Participation Evaluation Project.

PubMed

Onate, James A; Starkel, Cambrie; Clifton, Daniel R; Best, Thomas M; Borchers, James; Chaudhari, Ajit; Comstock, R Dawn; Cortes, Nelson; Grooms, Dustin R; Hertel, Jay; Hewett, Timothy E; Miller, Meghan Maume; Pan, Xueliang; Schussler, Eric; Van Lunen, Bonnie L

2018-01-01

  The fourth edition of the Preparticipation Physical Evaluation recommends functional testing for the musculoskeletal portion of the examination; however, normative data across sex and grade level are limited. Establishing normative data can provide clinicians reference points with which to compare their patients, potentially aiding in the development of future injury-risk assessments and injury-mitigation programs.   To establish normative functional performance and limb-symmetry data for high school-aged male and female athletes in the United States.   Cross-sectional study.   Athletic training facilities and gymnasiums across the United States.   A total of 3951 male and female athletes who participated on high school-sponsored basketball, football, lacrosse, or soccer teams enrolled in this nationwide study.   Functional performance testing consisted of 3 evaluations. Ankle-joint range of motion, balance, and lower extremity muscular power and landing control were assessed via the weight-bearing ankle-dorsiflexion-lunge, single-legged anterior-reach, and anterior single-legged hop-for-distance (SLHOP) tests, respectively. We used 2-way analyses of variance and χ 2 analyses to examine the effects of sex and grade level on ankle-dorsiflexion-lunge, single-legged anterior-reach, and SLHOP test performance and symmetry.   The SLHOP performance differed between sexes (males = 187.8% ± 33.1% of limb length, females = 157.5% ± 27.8% of limb length; t = 30.3, P < .001). A Cohen d value of 0.97 indicated a large effect of sex on SLHOP performance. We observed differences for SLHOP and ankle-dorsiflexion-lunge performance among grade levels, but these differences were not clinically meaningful.   We demonstrated differences in normative data for lower extremity functional performance during preparticipation physical evaluations across sex and grade levels. The results of this study will allow clinicians to compare sex- and grade-specific functional performances and implement approaches for preventing musculoskeletal injuries in high school-aged athletes.

40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

Code of Federal Regulations, 2010 CFR

2010-07-01

... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control Devices As required in § 63.5850 you must conduct performance tests, performance evaluations, and design...

40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

Code of Federal Regulations, 2011 CFR

2011-07-01

... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control Devices As required in § 63.5850 you must conduct performance tests, performance evaluations, and design...

Evaluation of medical command and control using performance indicators in a full-scale, major aircraft accident exercise.

PubMed

Gryth, Dan; Rådestad, Monica; Nilsson, Heléne; Nerf, Ola; Svensson, Leif; Castrén, Maaret; Rüter, Anders

2010-01-01

Large, functional, disaster exercises are expensive to plan and execute, and often are difficult to evaluate objectively. Command and control in disaster medicine organizations can benefit from objective results from disaster exercises to identify areas that must be improved. The objective of this pilot study was to examine if it is possible to use performance indicators for documentation and evaluation of medical command and control in a full-scale major incident exercise at two levels: (1) local level (scene of the incident and hospital); and (2) strategic level of command and control. Staff procedure skills also were evaluated. Trained observers were placed in each of the three command and control locations. These observers recorded and scored the performance of command and control using templates of performance indicators. The observers scored the level of performance by awarding 2, 1, or 0 points according to the template and evaluated content and timing of decisions. Results from 11 performance indicators were recorded at each template and scores greater than 11 were considered as acceptable. Prehospital command and control had the lowest score. This also was expressed by problems at the scene of the incident. The scores in management and staff skills were at the strategic level 15 and 17, respectively; and at the hospital level, 17 and 21, respectively. It is possible to use performance indicators in a full-scale, major incident exercise for evaluation of medical command and control. The results could be used to compare similar exercises and evaluate real incidents in the future.

The relationship between the managerial skills and results of "performance evaluation "tool among nursing managers in teaching hospitals of Iran University of Medical Science.

PubMed

Isfahani, Haleh Mousavi; Aryankhesal, Aidin; Haghani, Hamid

2014-09-25

Performance of different organizations, such as hospitals is mainly influenced by their managers' performance. Nursing managers have an important role in hospital performance and their managerial skills can improve the quality of the services. Hence, the present study was conducted in order to assess the relationship between the managerial skills and the results of their performance evaluation in Teaching Hospitals of Iran University of Medical Science in 2013. The research used the cross sectional method in 2013. It was done by distributing a managerial skills assessment questionnaire, with close-ended questions in 5 choice Likert scale, among 181 managers and head nurses of hospitals of Iran university of Medical Sciences; among which 131 answered the questions. Another data collection tools was a forms to record evaluation marks from the personnel records. We used Pearson and Spearman correlation tests and SPSS for analysis and description (frequency, mean and standard deviation). Results showed that the managerial skills of the nursing mangers were fair (2.57 out of 5) and the results of the performance evaluation were in a good condition (98.44). The mangers' evaluation results and the managerial skills scores were not in a meaningful correlation (r=0.047 np=0.856). The research showed no correlation between different domains of managerial skills and the performance evaluation marks: decision making skills (r=0.074 and p=0.399), leadership (correlation coefficient 0.028 and p=0.654), motivation (correlation coefficient 0.118 and p=0.163), communication  (correlation coefficient 0.116 and p=0.122), systematic thinking  (correlation coefficient 0.028 and p=0.828), time management (correlation coefficient 0.077 and p=0.401) and strategic thinking  (correlation coefficient 0.041 and p=0.756). Lack of any correlation and relation between managers' managerial skills and their performance evaluation results shows need to a fundamental revision at managers' performance evaluation form.

CAIRSENSE Study: Real-world evaluation of low cost sensors ...

EPA Pesticide Factsheets

Low-cost air pollution sensors are a rapidly developing field in air monitoring. In recent years, numerous sensors have been developed that can provide real-time concentration data for different air pollutants at costs accessible to individuals and non-regulatory groups. Additionally, these sensors have the potential to improve the spatial resolution of monitoring networks and provide a better understanding of neighborhood- and local-scale air quality and sources. However, many new sensors have not been evaluated to determine their long-term performance and capabilities. In this study, nine different low-cost sensor models, including O3, NO2 and particle sensors, were deployed in Denver, CO from September 2015 to February 2016. Three sensors of each type were deployed to evaluate instrument precision and consistency over the time period. Sensors were co-located with reference monitors at the Denver NCore site in order to evaluate sensor accuracy and precision. Denver was chosen as the location for this study to evaluate sensor performance in dry, high altitude, and low winter temperatures. Sensors were evaluated for data completeness, performance over time, and comparison with regulatory monitors. This presentation will also address challenges and approaches to data logging and processing. Preliminary analysis revealed that most sensors had high data completeness when data loggers were operational (e.g., the Aeroqual O3 sensor ranged from 94-100%), and exhibited

Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

[Evaluation of the performance of the logistics management system of malaria control resources in the Littoral Department, Benin, in 2017].

PubMed

Ouro-Koura, Abdou-Rahim; Sopoh, Emmanuel Ghislain; Sossa, Jerôme Charles; Glèlè-Ahanhanzo, Yolaine; Agueh, Victoire; Ouendo, Edgard-Marius; Ouedraogo, Laurent

2018-01-01

This study aimed to evaluate the performance of the logistics management system (LMS) of malaria control (MC) resources in the Littoral Department, Benin, in 2017. In June 2017, we conducted a cross-sectional evaluative study focusing on the structures for the storage and the disposal of MC resources as well as on staff involved in their management. The performance of the the logistics management system was evaluated on the basis of the observed compliance of the components and sub-components of the "Structure", the "Process" and the "Results" with the norms and standards defined by the Ministry of Health. A total of 36 structures were investigated and secondary target was surveyed. It followed that 52,78% of the structures for the storage and the disposal of MC resources met the requirements for resources storage while only 33.33% of MC resources management staff were trained in logistics management. The performance of the logistics management system of MC resources was inadequate (compliance 59,13 % compared to the expected score). The structure, as well as the process were non-compliant with the standards ( 60,20% and 73.22% compared to the expected score respectively), leading to negative results (41.53% compared to the expected score). The most inadequate sub-component was the logistics management information system (LMIS). This study highlights the role of LMS for better performance of MC resources management. Particular attention should be given to this component.

SENTRE and TREND attenuating systems

DOT National Transportation Integrated Search

1991-07-01

The objective of this study was to construct SENTRE and TREND attenuator systems and evaluate their in-service performance as set forth in NCHRP-230 for a period of two years. The evaluation was conducted as part of ADOTs New Product Evaluation Progr...

Economic Evaluation of Dual-Level-Residence Solar-Energy System

NASA Technical Reports Server (NTRS)

1982-01-01

105-page report is one in a series of economic evaluations of different solar-energy installations. Using study results, an optimal collector area is chosen that minimizes life-cycle costs. From this optimal size thermal and economic performance is evaluated.

NASA Exercise Physiology and Countermeasures Project Overview

NASA Technical Reports Server (NTRS)

Loerch, Linda; Ploutz-Snyder, Lori

2009-01-01

Efficient exercise countermeasures are necessary to offset or minimize spaceflight-induced deconditioning and to maximize crew performance of mission tasks. These countermeasure protocols should use the fewest crew and vehicle resources. NASA s Exercise Physiology and Countermeasures (ExPC) Project works to identify, collect, interpret, and summarize evidence that results in effective exercise countermeasure protocols which protect crew health and performance during International Space Station (ISS) and future exploration-class missions. The ExPC and NASA s Human Research Program are sponsoring multiple studies to evaluate and improve the efficacy of spaceflight exercise countermeasures. First, the Project will measure maximal aerobic capacity (VO2max) during cycle ergometry before, during, and after ISS missions. Second, the Project is sponsoring an evaluation of a new prototype harness that offers improved comfort and increased loading during treadmill operations. Third, the Functional Tasks Test protocol will map performance of anticipated lunar mission tasks with physiologic systems before and after short and long-duration spaceflight, to target system contributions and the tailoring of exercise protocols to maximize performance. In addition to these studies that are actively enrolling crewmember participants, the ExPC is planning new studies that include an evaluation of a higher-intensity/lower-volume exercise countermeasure protocol aboard the ISS using the Advanced Resistive Exercise Device and second-generation treadmill, studies that evaluate bone loading during spaceflight exercise, and ground-based studies that focus on fitness for duty standards required to complete lunar mission tasks and for which exercise protocols need to protect. Summaries of these current and future studies and strategies will be provided to international colleagues for knowledge sharing and possible collaboration.

Performance Assessment as a Diagnostic Tool for Science Teachers

NASA Astrophysics Data System (ADS)

Kruit, Patricia; Oostdam, Ron; van den Berg, Ed; Schuitema, Jaap

2018-04-01

Information on students' development of science skills is essential for teachers to evaluate and improve their own education, as well as to provide adequate support and feedback to the learning process of individual students. The present study explores and discusses the use of performance assessments as a diagnostic tool for formative assessment to inform teachers and guide instruction of science skills in primary education. Three performance assessments were administered to more than 400 students in grades 5 and 6 of primary education. Students performed small experiments using real materials while following the different steps of the empirical cycle. The mutual relationship between the three performance assessments is examined to provide evidence for the value of performance assessments as useful tools for formative evaluation. Differences in response patterns are discussed, and the diagnostic value of performance assessments is illustrated with examples of individual student performances. Findings show that the performance assessments were difficult for grades 5 and 6 students but that much individual variation exists regarding the different steps of the empirical cycle. Evaluation of scores as well as a more substantive analysis of students' responses provided insight into typical errors that students make. It is concluded that performance assessments can be used as a diagnostic tool for monitoring students' skill performance as well as to support teachers in evaluating and improving their science lessons.

Study of Synthetic Vision Systems (SVS) and Velocity-vector Based Command Augmentation System (V-CAS) on Pilot Performance

NASA Technical Reports Server (NTRS)

Liu, Dahai; Goodrich, Ken; Peak, Bob

2006-01-01

This study investigated the effects of synthetic vision system (SVS) concepts and advanced flight controls on single pilot performance (SPP). Specifically, we evaluated the benefits and interactions of two levels of terrain portrayal, guidance symbology, and control-system response type on SPP in the context of lower-landing minima (LLM) approaches. Performance measures consisted of flight technical error (FTE) and pilot perceived workload. In this study, pilot rating, control type, and guidance symbology were not found to significantly affect FTE or workload. It is likely that transfer from prior experience, limited scope of the evaluation task, specific implementation limitations, and limited sample size were major factors in obtaining these results.

Analytical and Clinical Performance of Blood Glucose Monitors

PubMed Central

Boren, Suzanne Austin; Clarke, William L.

2010-01-01

Background The objective of this study was to understand the level of performance of blood glucose monitors as assessed in the published literature. Methods Medline from January 2000 to October 2009 and reference lists of included articles were searched to identify eligible studies. Key information was abstracted from eligible studies: blood glucose meters tested, blood sample, meter operators, setting, sample of people (number, diabetes type, age, sex, and race), duration of diabetes, years using a glucose meter, insulin use, recommendations followed, performance evaluation measures, and specific factors affecting the accuracy evaluation of blood glucose monitors. Results Thirty-one articles were included in this review. Articles were categorized as review articles of blood glucose accuracy (6 articles), original studies that reported the performance of blood glucose meters in laboratory settings (14 articles) or clinical settings (9 articles), and simulation studies (2 articles). A variety of performance evaluation measures were used in the studies. The authors did not identify any studies that demonstrated a difference in clinical outcomes. Examples of analytical tools used in the description of accuracy (e.g., correlation coefficient, linear regression equations, and International Organization for Standardization standards) and how these traditional measures can complicate the achievement of target blood glucose levels for the patient were presented. The benefits of using error grid analysis to quantify the clinical accuracy of patient-determined blood glucose values were discussed. Conclusions When examining blood glucose monitor performance in the real world, it is important to consider if an improvement in analytical accuracy would lead to improved clinical outcomes for patients. There are several examples of how analytical tools used in the description of self-monitoring of blood glucose accuracy could be irrelevant to treatment decisions. PMID:20167171

Infrared scan of concrete admixtures and structural steel paints.

DOT National Transportation Integrated Search

2011-06-01

This study evaluates correlation coefficients for concrete admixtures and structural steel paints by : performing IR scans using ASTM C494-05a specifications. The intent of this study is to perform a : sufficient number of IR scans from different bat...

Risk management in technovigilance: construction and validation of a medical-hospital product evaluation instrument.

PubMed

Kuwabara, Cleuza Catsue Takeda; Evora, Yolanda Dora Martinez; de Oliveira, Márcio Mattos Borges

2010-01-01

With the continuous incorporation of health technologies, hospital risk management should be implemented to systemize the monitoring of adverse effects, performing actions to control and eliminate their damage. As part of these actions, Technovigilance is active in the procedures of acquisition, use and quality control of health products and equipment. This study aimed to construct and validate an instrument to evaluate medical-hospital products. This is a quantitative, exploratory, longitudinal and methodological development study, based on the Six Sigma quality management model, which has as its principle basis the component stages of the DMAIC Cycle. For data collection and content validation, the Delphi technique was used with professionals from the Brazilian Sentinel Hospital Network. It was concluded that the instrument developed permitted the evaluation of the product, differentiating between the results of the tested brands, in line with the initial study goal of qualifying the evaluations performed.

Motivational Implications of Faculty Performance Standards

ERIC Educational Resources Information Center

Hardre, Patricia L.; Kollmann, Sherry L.

2012-01-01

Expectations and how they are communicated influence employees' motivation, effort, goals, efficacy and performance. This study examined faculty performance evaluation standards and processes of 60 academic departments in research universities for motivationally relevant elements. Characteristics were systematically analysed to understand their…

Tack Coat Performance and Materials Study

DOT National Transportation Integrated Search

2017-06-01

A good bond provided by a tack coat can improve performance of asphalt overlays. The objectives of this research were: (1) develop a method for testing the bond between pavement layers; (2) evaluate the bond performance and predict long-term performa...

Acoustic Telemetry Evaluation of Juvenile Salmonid Passage and Survival at John Day Dam with Emphasis on the Prototype Surface Flow Outlet, 2008

DOE Office of Scientific and Technical Information (OSTI.GOV)

Weiland, Mark A.; Ploskey, Gene R.; Hughes, James S.

The main purpose of the study was to evaluate the performance of Top Spill Weirs installed at two spillbays at John Day Dam and evaluate the effectiveness of these surface flow outlets at attracting juvenile salmon away from the powerhouse and reducing turbine passage. The Juvenile Salmonid Acoustic Telemetry System (JSATS) was used to estimate survival of juvenile salmonids passing the dam and also for calculating performance metrics used to evaluate the efficiency and effectiveness of the dam at passing juvenile salmonids.

Does evaluative pressure make you less or more distractible? Role of top-down attentional control over response selection.

PubMed

Normand, Alice; Bouquet, Cédric A; Croizet, Jean-Claude

2014-06-01

People's ability to resist cognitive distraction is crucial in many situations. The present research examines individuals' resistance to attentional distraction under conditions of evaluative pressure. In a series of 4 studies, participants had to complete various attentional tasks while believing their intelligence was or was not under the scrutiny of an experimenter. Using a spatial cuing paradigm, Studies 1 through 3 demonstrated that feeling evaluated led participants to implement stronger feature-based attentional control, which resulted in more (or less) distraction when irrelevant information matched (did not match) the searched-for target. Study 4 ruled out the possibility that the above effects were due to voluntary shifts of attention and demonstrated that the control settings implemented under evaluative pressure resulted in stronger goal-contingent response priming. Thus, the way individuals relate to the task-the performance context in which they are-induces strong attentional selection biases. Altogether, the present findings highlight an overlooked form of top-down modulation of attention based on performance self-relevance. Implications for both the current models of attentional control and the current hypotheses on the impact of evaluative pressure on cognition, as well as the consequences for more complex performances, are discussed. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Feedback-giving behaviour in performance evaluations during clinical clerkships.

PubMed

Bok, Harold G J; Jaarsma, Debbie A D C; Spruijt, Annemarie; Van Beukelen, Peter; Van Der Vleuten, Cees P M; Teunissen, Pim W

2016-01-01

Narrative feedback documented in performance evaluations by the teacher, i.e. the clinical supervisor, is generally accepted to be essential for workplace learning. Many studies have examined factors of influence on the usage of mini-clinical evaluation exercise (mini-CEX) instruments and provision of feedback, but little is known about how these factors influence teachers' feedback-giving behaviour. In this study, we investigated teachers' use of mini-CEX in performance evaluations to provide narrative feedback in undergraduate clinical training. We designed an exploratory qualitative study using an interpretive approach. Focusing on the usage of mini-CEX instruments in clinical training, we conducted semi-structured interviews to explore teachers' perceptions. Between February and June 2013, we conducted interviews with 14 clinicians participated as teachers during undergraduate clinical clerkships. Informed by concepts from the literature, we coded interview transcripts and iteratively reduced and displayed data using template analysis. We identified three main themes of interrelated factors that influenced teachers' practice with regard to mini-CEX instruments: teacher-related factors; teacher-student interaction-related factors, and teacher-context interaction-related factors. Four issues (direct observation, relationship between teacher and student, verbal versus written feedback, formative versus summative purposes) that are pertinent to workplace-based performance evaluations were presented to clarify how different factors interact with each other and influence teachers' feedback-giving behaviour. Embedding performance observation in clinical practice and establishing trustworthy teacher-student relationships in more longitudinal clinical clerkships were considered important in creating a learning environment that supports and facilitates the feedback exchange. Teachers' feedback-giving behaviour within the clinical context results from the interaction between personal, interpersonal and contextual factors. Increasing insight into how teachers use mini-CEX instruments in daily practice may offer strategies for creating a professional learning culture in which feedback giving and seeking would be enhanced.

The Evaluation of Reading Performance with Minnesota Low Vision Reading Charts in Patients with Age-related Macular Degeneration.

PubMed

Altinbay, Deniz; Adibelli, Fatih Mehmet; Taskin, Ibrahim; Tekin, Adil

2016-01-01

To evaluate the reading performance using the Minnesota low vision reading (MNREAD) charts, of patients with age-related macular degeneration (AMD) who use low vision aid (LVA) devices. This prospective study enrolled 27 patients with AMD. Distance visual acuity (VA) was evaluated with a distance chart designed for patients with low vision. Near vision and reading performance were evaluated with the Turkish version of the MNREAD charts. Unaided vision and vision with LVA devices and high spherical add near glasses was measured. P <0.05 was considered statistically significant. The mean unaided near VA was 1.05 ± 0.27 log of the minimum angle of resolution (LogMAR). The mean VA with the LVA devices was 0.71 ± 0.41 LogMAR. Reading acuity ranged between 1.15 and 0.21 LogMAR, critical print size was between - 1.2 and 0.2 LogMAR. Maximum reading speeds were between 0 and 103 words/min. The cases are divided into groups in terms of reading speed according to age, gender, diagnosis, and education. Reading speed was negatively correlated to increasing age. MNREAD reading charts can be used to evaluate reading performance in patients with AMD with low vision. The outcomes of the present study indicate that optical correction is adequate for near VA requirements in this patient population. However, optical correction was inadequate for improving reading performance. Appropriate rehabilitation programs can be used to increase reading speed.

Performance and non-destructive evaluation methods of airborne radome and stealth structures

NASA Astrophysics Data System (ADS)

Panwar, Ravi; Ryul Lee, Jung

2018-06-01

In the past few years, great effort has been devoted to the fabrication of highly efficient, broadband radome and stealth (R&S) structures for distinct control, guidance, surveillance and communication applications for airborne platforms. The evaluation of non-planar aircraft R&S structures in terms of their electromagnetic performance and structural damage is still a very challenging task. In this article, distinct measurement techniques are discussed for the electromagnetic performance and non-destructive evaluation (NDE) of R&S structures. This paper deals with an overview of the transmission line method and free space measurement based microwave measurement techniques for the electromagnetic performance evaluation of R&S structures. In addition, various conventional as well as advanced methods, such as millimetre and terahertz wave based imaging techniques with great potential for NDE of load bearing R&S structures, are also discussed in detail. A glimpse of in situ NDE techniques with corresponding experimental setup for R&S structures is also presented. The basic concepts, measurement ranges and their instrumentation, measurement method of different R&S structures and some miscellaneous topics are discussed in detail. Some of the challenges and issues pertaining to the measurement of curved R&S structures are also presented. This study also lists various mathematical models and analytical techniques for the electromagnetic performance evaluation and NDE of R&S structures. The research directions described in this study may be of interest to the scientific community in the aerospace sectors.

FINE PORE DIFFUSER FOULING: THE LOS ANGELES STUDIES

EPA Science Inventory

This report describes five fine pore diffuser evaluations conducted at three different wastewater treatment plants located in the greater Los Angeles area. The overall goal of the study was to evaluate the performance of fine pore diffusers using selected cleaning methods for ex...

Protective Coatings for Metals

NASA Technical Reports Server (NTRS)

Ruggieri, D. J.; Rowe, A. P.

1986-01-01

Report evaluates protective coatings for metal structures in seashore and acid-cloud environments. Evaluation result of study of coating application characteristics, repair techniques, and field performance. Products from variety of manufacturers included in study. Also factory-coated panels and industrial galvanized panels with and without topcoats.

ACCP: economic evaluations of clinical pharmacy services: 2001-2005.

PubMed

Perez, Alexandra; Doloresco, Fred; Hoffman, James M; Meek, Patrick D; Touchette, Daniel R; Vermeulen, Lee C; Schumock, Glen T

2009-01-01

The objectives of this review were to summarize and evaluate studies that measured the economic impact of clinical pharmacy services published between 2001 and 2005 (inclusive) and to provide guidance on methodologic considerations to individuals performing such research in the future. A systematic literature search using the MEDLINE and International Pharmaceutical Abstracts databases was conducted to identify published economic evaluations of clinical pharmacy services. Studies were screened and then randomly assigned to reviewers, who reassessed inclusion and exclusion criteria and abstracted prespecified data from each study. Among the many characteristics examined in each study were study design and type of economic evaluation, setting and type of clinical pharmacy service, study quality, and results. Ninety-three articles were included in the final analysis. These studies were published in 43 different journals, most of which (68 [73.1%]) were pharmacy-based. Most studies were performed in hospitals (40 [43.0%]), ambulatory care clinics or physician's offices (20 [21.5%]), or community pharmacies (16 [17.2%]). The most common types of clinical pharmacy services evaluated were general pharmacotherapeutic monitoring services (32 [34.4%]), target drug programs (27 [29%]), and disease state-management services (21 [22.6%]). Full economic evaluations were performed in just less than half (45 [48.4%]) of the studies, and a positive economic benefit associated with clinical pharmacy services was noted in 31 (69%) of the 45 studies. Among 15 studies reporting data necessary to determine a benefit:cost ratio, the pooled median value was 4.81:1-meaning that for every $1 invested in clinical pharmacy services, $4.81 was achieved in reduced costs or other economic benefits. The quality of studies varied widely, with less than one half considered to be good to fair (40 [43.0%]); however, the proportion of studies using appropriate study designs increased compared with previous reviews. Based on the evidence examined in this review, clinical pharmacy services continue to provide a significant return on investment, but improvements are still needed in the methods used to evaluate the economic impact of these services.

Systematic review of the methodological quality of controlled trials evaluating Chinese herbal medicine in patients with rheumatoid arthritis.

PubMed

Pan, Xin; Lopez-Olivo, Maria A; Song, Juhee; Pratt, Gregory; Suarez-Almazor, Maria E

2017-03-01

We appraised the methodological and reporting quality of randomised controlled clinical trials (RCTs) evaluating the efficacy and safety of Chinese herbal medicine (CHM) in patients with rheumatoid arthritis (RA). For this systematic review, electronic databases were searched from inception until June 2015. The search was limited to humans and non-case report studies, but was not limited by language, year of publication or type of publication. Two independent reviewers selected RCTs, evaluating CHM in RA (herbals and decoctions). Descriptive statistics were used to report on risk of bias and their adherence to reporting standards. Multivariable logistic regression analysis was performed to determine study characteristics associated with high or unclear risk of bias. Out of 2342 unique citations, we selected 119 RCTs including 18 919 patients: 10 108 patients received CHM alone and 6550 received one of 11 treatment combinations. A high risk of bias was observed across all domains: 21% had a high risk for selection bias (11% from sequence generation and 30% from allocation concealment), 85% for performance bias, 89% for detection bias, 4% for attrition bias and 40% for reporting bias. In multivariable analysis, fewer authors were associated with selection bias (allocation concealment), performance bias and attrition bias, and earlier year of publication and funding source not reported or disclosed were associated with selection bias (sequence generation). Studies published in non-English language were associated with reporting bias. Poor adherence to recommended reporting standards (<60% of the studies not providing sufficient information) was observed in 11 of the 23 sections evaluated. Study quality and data extraction were performed by one reviewer and cross-checked by a second reviewer. Translation to English was performed by one reviewer in 85% of the included studies. Studies evaluating CHM often fail to meet expected methodological criteria, and high-quality evidence is lacking. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Pre-Service Identification of Talented Teachers through Non-Traditional Measures: A Study of the Role of Affective Variables as Predictors of Success in Student Teaching.

ERIC Educational Resources Information Center

Basom, Margaret; And Others

1994-01-01

Researchers examined relationships between the SRI Gallup Pre-Professional Teacher Interview and performance-based student teaching evaluations and between SRI Interview and California Student Achievement Test (CAT) scores. A relationship between SRI Interview scores and performance-based student teaching evaluations surfaces. CAT scores did not…

Impact of Motivation on Cognitive Control in the Context of Vigilance Lowering: An ERP Study

ERIC Educational Resources Information Center

Bonnefond, Anne; Doignon-Camus, Nadege; Hoeft, Alain; Dufour, Andre

2011-01-01

We assessed the effects of time-on-task on cognitive control expressed by the CRN/Nc and the extent to which motivation modulates this relationship. We utilized two groups of participants, who were told that their performance would (evaluation condition) or would not (control condition) be evaluated online. Both groups performed a version of the…

Enhancing Students' Self-Regulation and Mathematics Performance: The Influence of Feedback and Self-Evaluative Standards

ERIC Educational Resources Information Center

Labuhn, Andju Sara; Zimmerman, Barry J.; Hasselhorn, Marcus

2010-01-01

The purpose of this study was to examine the effects of self-evaluative standards and graphed feedback on calibration accuracy and performance in mathematics. Specifically, we explored the influence of mastery learning standards as opposed to social comparison standards as well as of individual feedback as opposed to social comparison feedback. 90…

Teacher Evaluation, Pay for Performance, and Learning around Instruction: Between Dissonant Incentives and Resonant Procedures

ERIC Educational Resources Information Center

Mintrop, Rick; Ordenes, Miguel; Coghlan, Erin; Pryor, Laura; Madero, Cristobal

2018-01-01

Purpose: The study examines why the logic of a performance management system, supported by the federal Teacher Incentive Fund, might be faulty. It does this by exploring the nuances of the interplay between teaching evaluations as formative and summative, the use of procedures, tools, and artifacts obligated by the local Teacher Incentive Fund…

The effect of NovaSil dietary supplementation on the growth and health performance of Nile tilapia (Oreochromis niloticus) fed aflatoxin-B1 contaminated feed

USDA-ARS?s Scientific Manuscript database

The objective of this study was to evaluate the ability of NovaSil (NS) clay to sorb and mitigate the toxic effects of aflatoxin B1 (AFB1) in Nile tilapia (Oreochromis niloticus). Growth performance, specific innate immunological function, intestinal microbial community, and histology were evaluate...

Teachers as Strategic Classroom Leaders: The Relationship of Their Cognitive and Behavioral Agility to Student Outcomes and Performance Evaluations

ERIC Educational Resources Information Center

Warkentien, Michael

2016-01-01

The purpose of this non-experimental study was to determine whether teacher cognitive and behavioral agility relates to student achievement as measured by their value-added model (VAM) score and their performance evaluation measured through the Marzano instructional practice (IP) framework, and whether that relationship is moderated by contextual…