Science.gov

Sample records for performance evaluation agreement

  1. The FY 1998 Battelle performance evaluation and incentive fee agreement

    SciTech Connect

    Davis, T.L.

    1998-01-07

    Fiscal Year 1998 represents the second full year utilizing a results-oriented, performance-based contract. This document describes the critical outcomes, objectives, performance indicators, expected levels of performance, and the basis for the evaluation of the Contractors performance for the period October 1, 1997 through September 30, 1998, as required by Articles entitled Use of Objective Standards of Performance, Self Assessment and Performance Evaluation and Critical Outcomes Review of the Contract DE-AC06-76RL01830. In partnership with the Contractor and other key customers, the Department of Energy (DOE) Richland Operations Office has defined six critical outcomes that serve as the core for the Contractors performance evaluation. The Contractor also utilizes these outcomes as a basis for overall management of the Laboratory. The Critical Outcome system focuses all of the customer desires into specific objectives and performance indicators, with supporting measures to track and foster continued improvement in meeting the needs (outcomes) of the Laboratory`s customers. Section 1 provides information on how the overall performance rating for the Contractor will be determined. Section 2 provides the detailed information concerning critical outcomes, objectives, performance indicators and expectations of performance. Section 3 describes the commitments for documenting and reporting the Laboratory`s self-evaluation.

  2. Fiscal year 1999 Battelle performance evaluation and fee agreement

    SciTech Connect

    DAVIS, T.L.

    1998-10-22

    Fiscal Year 1999 represents the third fill year utilizing a results-oriented, performance-based evaluation for the Contractor's operations and management of the DOE Pacific Northwest National Laboratory (here after referred to as the Laboratory). However, this is the first year that the Contractor's fee is totally performance-based utilizing the same Critical Outcomes. This document describes the critical outcomes, objectives, performance indicators, expected levels of performance, and the basis for the evaluation of the Contractor's performance for the period October 1, 1998 through September 30, 1999, as required by Clauses entitled ''Use of Objective Standards of Performance, Self Assessment and Performance Evaluation'' and ''Performance Measures Review'' of the Contract DE-ACO6-76RL01830. Furthermore, it documents the distribution of the total available performance-based fee and the methodology set for determining the amount of fee earned by the Contractor as stipulated within the causes entitled ''Estimated Cost and Annual Fee,'' ''Total Available Fee'' and ''Allowable Costs and Fee.'' In partnership with the Contractor and other key customers, the Department of Energy (DOE) Headquarters (HQ) and Richland Operations Office (RL) has defined four critical outcomes that serve as the core for the Contractor's performance-based evaluation and fee determination. The Contractor also utilizes these outcomes as a basis for overall management of the Laboratory.

  3. FY 1997 performance evaluation and incentive fee agreement. Annual report

    SciTech Connect

    1997-04-01

    FY 1997 represents the second full year utilizing a results-oriented, performance-based contract. This document describes the critical outcomes, objectives, performance indicators, expected levels of performance, and the basis for the evaluation of PNNL performance for Oct. 1, 1996-Sept. 30, 1997, as required by Articles H-24 and H-25 of the contract. Section I provides the information regarding the determination of the overall performance rating for PNNL. In Section II, six critical outcomes were defined that serve as basis for overall management of PNNL: environmental molecular sciences laboratory, environmental technology, scientific excellence, environment/safety & health operations, leadership/management, and economic development (create new businesses). Section III describes the commitments for documenting and reporting PNNL self-evaluation. In Section IV, it is stated that discussions regarding FY97 fee are still ongoing.

  4. Fiscal year 1998 Battelle performance evaluation agreement revision 1

    SciTech Connect

    DAVIS, T.L.

    1998-10-22

    Fiscal Year 1998 represents the second full year utilizing a results-oriented, performance-based contract. This document describes the critical outcomes, objectives, performance indicators, expected levels of performance, and the basis for the evaluation of the Contractors performance for the period October 1, 1997 through September 30, 1998, as required by Articles entitled Use of Objective Standards of Performance, Self Assessment and Performance Evaluation and Critical Outcomes Review of the Contract DE-AC08-76RLO1830. In partnership with the Contractor and other key customers, the Department of Energy (DOE) Richland Operations Office has defined six critical outcomes that same as the core for the Contractors performance evaluation. The Contractor also utilizes these outcomes as a basis for overall management of the Laboratory. As stated above six critical outcomes have been established for FY 1998. These outcomes are based on the following needs identified by DOE-HQ, RL and other customers of the Laboratory. Our Energy Research customer desires relevant, quality and cost effective science. Our Environmental Management customer wants technology developed, demonstrated, and deployed to solve environmental cleanup issues. To ensure the diversification and viability of the Laboratory as a National asset, RL and HQ alike want to increase the Science and Technical contributions of PNNL related to its core capabilities. RL wants improved leadership/management, cost-effective operations, and maintenance of a work environment, which fosters innovative thinking and high morale. RL and HQ alike desire compliance with environment, safety and health (ES and H) standards and disciplined conduct of operations for protection of the worker, environment, and the public, As with all of Hanford, DOE expects contribution of the Laboratory to the economic development of the Tri-Cities community, and the region, to build a new local economy that is less reliant on the Hanford mission

  5. FY 1996 performance evaluation and incentive fee agreement for the Pacific Northwest National Laboratory

    SciTech Connect

    1996-01-08

    The document describes the critical outcomes, objectives, performance indicators, expected levels of performance, specific detail on incentive fee, and agreements concerning the evaluation of the Pacific Northwest National Laboratory`s FY 1996 Self-Assessment. This information will be the basis for the evaluation of the Laboratory`s performance as required by Articles H-24 and H-25 of the Contract. For the period October 1, 1995 through September 30, 1996, the Parties have agreed to measure and evaluate the individual areas of Laboratory activities identified herein. This reflects the fact that the Contractor will be evaluated on two dimensions, namely (1) accomplishment of critical outcomes and (2) the effectiveness of the Contractor`s self-assessment program. Each area will receive its own evaluation rating and they will be combined to determined an overall rating with the first area weighted at 75% and the second area weighted at 25%.

  6. Evaluating the performance of the NPL femtosecond frequency combs: agreement at the 10-21 level

    NASA Astrophysics Data System (ADS)

    Johnson, L. A. M.; Gill, P.; Margolis, H. S.

    2015-02-01

    Results are presented from a series of comparisons between two independent femtosecond frequency comb systems at NPL, which were carried out in order to assess their systematic uncertainty. Simultaneous measurements with the two systems demonstrate agreement at the level of 5 × 10-18 when measuring an optical frequency against a common microwave reference. When simultaneously measuring the ratio of two optical frequencies, agreement at the 3 × 10-21 level is observed. The results represent the highest reported level of agreement to date between Ti:Sapphire and Er-doped femtosecond combs. The limitations of the combs when operating in these two different manners are discussed, including traceability to the SI second, which can be achieved with an uncertainty below 1 × 10-16. The technical details presented underpin recent absolute frequency measurements of the 88Sr+ and 171Yb+ optical clock transitions at NPL, as well as a frequency ratio measurement between the two optical clock transitions in 171Yb+.

  7. Block Transfer Agreement Evaluation Project

    ERIC Educational Resources Information Center

    Bastedo, Helena

    2010-01-01

    The objective of this project is to evaluate for the British Columbia Council on Admissions and Transfer (BCCAT) the effectiveness of block transfer agreements (BTAs) in the BC Transfer System and recommend steps to be taken to improve their effectiveness. Findings of this study revealed that institutions want to expand block credit transfer;…

  8. 7 CFR 2201.25 - Performance Agreement.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Performance Agreement. 2201.25 Section 2201.25... LOCAL TELEVISION LOAN GUARANTEE PROGRAM-PROGRAM REGULATIONS Loan Guarantees § 2201.25 Performance Agreement. (a) The Borrower of a Loan guaranteed under the Program shall enter into a Performance...

  9. Evaluation of hospital service level agreements.

    PubMed

    Berbée, Rieneke G; Gemmel, Paul; Droesbeke, Brenda; Casteleyn, Hugo; Vandaele, Darline

    2009-01-01

    The purpose of the paper is to evaluate the development and use of service level agreements (SLAs) in a Belgian hospital from a client's point of view. The paper is based on a theoretical framework indicating the variables that influence the relationship between the use of a specific governance mechanisms and performance, a new instrument was developed and applied on a convenience sample of 107 SLA clients from a Belgian hospital. SLAs are useful for hospitals, as they improve people's insight into processes, stimulate people to think about performance measurement and, in some cases, also lead to improved services. The main advantages of SLAs do not really lie in improved relationships and better fits with clients' needs, but in improved process mapping and improved performance measurement. The questionnaire from this research study proves to be a useful and reliable instrument for evaluating internal SLAs from a client's point of view. The results of this study are limited, as they are only based on one Belgian institution. Other limitations include the posttest-only research design and the unequal distribution of the respondents over the different SLAs. Recommendations for future research include applying the questionnaire in other Belgian hospitals and in settings where both a pretest and posttest can be conducted. As far as known, no other studies have yet evaluated the effectiveness of SLAs in the healthcare sector. While a fairly-substantial amount of scientific literature deals with SLAs in the world of ICT, this literature is often very specific and cannot always be applied to other service sectors.

  10. 7 CFR 2201.25 - Performance Agreement.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... Agriculture Regulations of the Department of Agriculture (Continued) LOCAL TELEVISION LOAN GUARANTEE BOARD LOCAL TELEVISION LOAN GUARANTEE PROGRAM-PROGRAM REGULATIONS Loan Guarantees § 2201.25 Performance... with the Administrator with respect to the Local Television Broadcast Signals to be provided through...

  11. 7 CFR 2201.25 - Performance Agreement.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... Agriculture Regulations of the Department of Agriculture (Continued) LOCAL TELEVISION LOAN GUARANTEE BOARD LOCAL TELEVISION LOAN GUARANTEE PROGRAM-PROGRAM REGULATIONS Loan Guarantees § 2201.25 Performance... with the Administrator with respect to the Local Television Broadcast Signals to be provided through...

  12. 7 CFR 2201.25 - Performance Agreement.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... Agriculture Regulations of the Department of Agriculture (Continued) LOCAL TELEVISION LOAN GUARANTEE BOARD LOCAL TELEVISION LOAN GUARANTEE PROGRAM-PROGRAM REGULATIONS Loan Guarantees § 2201.25 Performance... with the Administrator with respect to the Local Television Broadcast Signals to be provided through...

  13. Interrater Agreement Evaluation: A Latent Variable Modeling Approach

    ERIC Educational Resources Information Center

    Raykov, Tenko; Dimitrov, Dimiter M.; von Eye, Alexander; Marcoulides, George A.

    2013-01-01

    A latent variable modeling method for evaluation of interrater agreement is outlined. The procedure is useful for point and interval estimation of the degree of agreement among a given set of judges evaluating a group of targets. In addition, the approach allows one to test for identity in underlying thresholds across raters as well as to identify…

  14. Evaluation of Spatial Agreement of Distinct Landslide Prediction Models

    NASA Astrophysics Data System (ADS)

    Sterlacchini, Simone; Bordogna, Gloria; Frigerio, Ivan

    2013-04-01

    The aim of the study was to assess the degree of spatial agreement of different predicted patterns in a majority of coherent landslide prediction maps with almost similar success and prediction rate curves. If two or more models have a similar performance, the choice of the best one is not a trivial operation and cannot be based on success and prediction rate curves only. In fact, it may happen that two or more prediction maps with similar accuracy and predictive power do not have the same degree of agreement in terms of spatial predicted patterns. The selected study area is the high Valtellina valley, in North of Italy, covering a surface of about 450 km2 where mapping of historical landslides is available. In order to assess landslide susceptibility, we applied the Weights of Evidence (WofE) modeling technique implemented by USGS by means of ARC-SDM tool. WofE efficiently investigate the spatial relationships among past events and multiple predisposing factors, providing useful information to identify the most probable location of future landslide occurrences. We have carried out 13 distinct experiments by changing the number of morphometric and geo-environmental explanatory variables in each experiment with the same training set and thus generating distinct models of landslide prediction, computing probability degrees of occurrence of landslides in each pixel. Expert knowledge and previous results from indirect statistically-based methods suggested slope, land use, and geology the best "driving controlling factors". The Success Rate Curve (SRC) was used to estimate how much the results of each model fit the occurrence of landslides used for the training of the models. The Prediction Rate Curve (PRC) was used to estimate how much the model predict the occurrence of landslides in the validation set. We found that the performances were very similar for different models. Also the dendrogram of the Cohen's kappa statistic and Principal Component Analysis (PCA) were

  15. An Independent Inter- and Intraobserver Agreement Evaluation of the AOSpine Subaxial Cervical Spine Injury Classification System.

    PubMed

    Urrutia, Julio; Zamora, Tomas; Yurac, Ratko; Campos, Mauricio; Palma, Joaquin; Mobarec, Sebastian; Prada, Carlos

    2017-03-01

    An agreement study. The aim of this study was to perform an independent interobserver and intraobserver agreement assessment of the AOSpine subaxial cervical spine injury classification system. The AOSpine subaxial cervical spine injury classification system was recently described. It showed substantial inter- and intraobserver agreement in the study describing it; however, an independent evaluation has not been performed. Anteroposterior and lateral radiographs, computed tomography scans, and magnetic resonance imaging of 65 patients with acute traumatic subaxial cervical spine injuries were selected and classified using the morphologic grading of the subaxial cervical spine injury classification system by 6 evaluators (3 spine surgeons and 3 orthopedic surgery residents). After a 6-week interval, the 65 cases were presented to the same evaluators in a random sequence for repeat evaluation. The kappa coefficient (κ) was used to determine the inter- and intraobserver agreement. The interobserver agreement was substantial when considering the fracture main types (A, B, C, or F), with κ = 0.61 (0.57-0.64), but moderate when considering the subtypes: κ = 0.57 (0.54-0.60). The intraobserver agreement was substantial considering the fracture types, with κ = 0.68 (0.62-0.74) and considering subtypes, κ = 0.62 (0.57-0.66). No significant differences were observed between spine surgeons and orthopedic residents in the overall inter- and intraobserver agreement, or in the inter- and intraobserver agreement of specific A, B, C, or F type of injuries. This classification allows adequate agreement among different observers and by the same observer on separate occasions. Future prospective studies should determine whether this classification allows surgeons to decide the best treatment for patients with subaxial cervical spine injuries. 3.

  16. MAP Markers: Research and Evaluation of the Mutual Agreement Program. Resource Document No. 5.

    ERIC Educational Resources Information Center

    Robison, James O.

    This report is an evaluation, using randomized experimental/control design, of a program involving negotiated contractual agreements (MAP) between prisoners and parole boards for specific parole dates contingent on performance in work, training and treatment activities. Contracts were generally for less than six months. Both feasibility and…

  17. Apprentice Performance Evaluation.

    ERIC Educational Resources Information Center

    Gast, Clyde W.

    The Granite City (Illinois) Steel apprentices are under a performance evaluation from entry to graduation. Federally approved, the program is guided by joint apprenticeship committees whose monthly meetings include performance evaluation from three information sources: journeymen, supervisors, and instructors. Journeymen's evaluations are made…

  18. Diagnostic agreement when comparing still and video imaging for the medical evaluation of child sexual abuse.

    PubMed

    Killough, Emily; Spector, Lisa; Moffatt, Mary; Wiebe, Jan; Nielsen-Parker, Monica; Anderst, Jim

    2016-02-01

    Still photo imaging is often used in medical evaluations of child sexual abuse (CSA) but video imaging may be superior. We aimed to compare still images to videos with respect to diagnostic agreement regarding hymenal deep notches and transections in post-pubertal females. Additionally, we evaluated the role of experience and expertise on agreement. We hypothesized that videos would result in improved diagnostic agreement of multiple evaluators as compared to still photos. This was a prospective quasi-experimental study using imaging modality as the quasi-independent variable. The dependent variable was diagnostic agreement of participants regarding presence/absence of findings indicating penetrative trauma on non-acute post-pubertal genital exams. Participants were medical personnel who regularly perform CSA exams. Diagnostic agreement was evaluated utilizing a retrospective selection of videos and still photos obtained directly from the videos. Videos and still photos were embedded into an on-line survey as sixteen cases. One-hundred sixteen participants completed the study. Participant diagnosis was more likely to agree with study center diagnosis when using video (p<0.01). Use of video resulted in statistically significant changes in diagnosis in four of eight cases. In two cases, the diagnosis of the majority of participants changed from no hymenal transection to transection present. No difference in agreement was found based on experience or expertise. Use of video vs. still images resulted in increased agreement with original examiner and changes in diagnostic impressions in review of CSA exams. Further study is warranted, as video imaging may have significant impacts on diagnosis. Copyright © 2015 Elsevier Ltd. All rights reserved.

  19. Echocardiographic agreement in the diagnostic evaluation for infective endocarditis.

    PubMed

    Lauridsen, Trine Kiilerich; Selton-Suty, Christine; Tong, Steven; Afonso, Luis; Cecchi, Enrico; Park, Lawrence; Yow, Eric; Barnhart, Huiman X; Paré, Carlos; Samad, Zainab; Levine, Donald; Peterson, Gail; Stancoven, Amy Butler; Johansson, Magnus Carl; Dickerman, Stuart; Tamin, Syahidah; Habib, Gilbert; Douglas, Pamela S; Bruun, Niels Eske; Crowley, Anna Lisa

    2016-07-01

    Echocardiography is essential for the diagnosis and management of infective endocarditis (IE). However, the reproducibility for the echocardiographic assessment of variables relevant to IE is unknown. Objectives of this study were: (1) To define the reproducibility for IE echocardiographic variables and (2) to describe a methodology for assessing quality in an observational cohort containing site-interpreted data. IE reproducibility was assessed on a subset of echocardiograms from subjects enrolled in the International Collaboration on Endocarditis registry. Specific echocardiographic case report forms were used. Intra-observer agreement was assessed from six site readers on ten randomly selected echocardiograms. Inter-observer agreement between sites and an echocardiography core laboratory was assessed on a separate random sample of 110 echocardiograms. Agreement was determined using intraclass correlation (ICC), coverage probability (CP), and limits of agreement for continuous variables and kappa statistics (κweighted) and CP for categorical variables. Intra-observer agreement for LVEF was excellent [ICC = 0.93 ± 0.1 and all pairwise differences for LVEF (CP) were within 10 %]. For IE categorical echocardiographic variables, intra-observer agreement was best for aortic abscess (κweighted = 1.0, CP = 1.0 for all readers). Highest inter-observer agreement for IE categorical echocardiographic variables was obtained for vegetation location (κweighted = 0.95; 95 % CI 0.92-0.99) and lowest agreement was found for vegetation mobility (κweighted = 0.69; 95 % CI 0.62-0.86). Moderate to excellent intra- and inter-observer agreement is observed for echocardiographic variables in the diagnostic assessment of IE. A pragmatic approach for determining echocardiographic data reproducibility in a large, multicentre, site interpreted observational cohort is feasible.

  20. Evaluation of Agreement between Measurement Methods from Data with Matched Repeated Measurements via the Coefficient of Individual Agreement

    PubMed Central

    Haber, Michael; Gao, Jingjing; Barnhart, Huiman X

    2009-01-01

    Summary We propose a simple method for evaluating agreement between methods of measurement when the measured variable is continuous and the data consists of matched repeated observations made with the same method under different conditions. The conditions may represent different time points, raters, laboratories, treatments, etc. Our approach allows the values of the measured variable and the magnitude of disagreement to vary across the conditions. The coefficient of individual agreement (CIA), which is based on the comparison of the between and within-methods mean squared deviation (MSD) is used to quantify the magnitude of agreement between measurement methods. The new approach is illustrated via two examples from studies designed to compare (a) methods of evaluating carotid stenosis and (b) methods of measuring percent body fat. PMID:20664753

  1. Evaluation of Jackknife and Bootstrap for Defining Confidence Intervals for Pairwise Agreement Measures

    PubMed Central

    Severiano, Ana; Carriço, João A.; Robinson, D. Ashley; Ramirez, Mário; Pinto, Francisco R.

    2011-01-01

    Several research fields frequently deal with the analysis of diverse classification results of the same entities. This should imply an objective detection of overlaps and divergences between the formed clusters. The congruence between classifications can be quantified by clustering agreement measures, including pairwise agreement measures. Several measures have been proposed and the importance of obtaining confidence intervals for the point estimate in the comparison of these measures has been highlighted. A broad range of methods can be used for the estimation of confidence intervals. However, evidence is lacking about what are the appropriate methods for the calculation of confidence intervals for most clustering agreement measures. Here we evaluate the resampling techniques of bootstrap and jackknife for the calculation of the confidence intervals for clustering agreement measures. Contrary to what has been shown for some statistics, simulations showed that the jackknife performs better than the bootstrap at accurately estimating confidence intervals for pairwise agreement measures, especially when the agreement between partitions is low. The coverage of the jackknife confidence interval is robust to changes in cluster number and cluster size distribution. PMID:21611165

  2. An Empirical Study into Annotator Agreement, Ground Truth Estimation, and Algorithm Evaluation.

    PubMed

    Lampert, Thomas A; Stumpf, Andre; Gancarski, Pierre

    2016-03-21

    Although agreement between annotators who mark feature locations within images has been studied in the past from a statistical viewpoint, little work has attempted to quantify the extent to which this phenomenon affects the evaluation of foreground-background segmentation algorithms. Many researchers utilise ground truth in experimentation and more often than not this ground truth is derived from one annotator's opinion. How does the difference in opinion affect an algorithm's evaluation? A methodology is applied to four image processing problems to quantify the inter-annotator variance and to offer insight into the mechanisms behind agreement and the use of ground truth. It is found that when detecting linear structures annotator agreement is very low. The agreement in a structure's position can be partially explained through basic image properties. Automatic segmentation algorithms are compared to annotator agreement and it is found that there is a clear relation between the two. Several ground truth estimation methods are used to infer a number of algorithm performances. It is found that: the rank of a detector is highly dependent upon the method used to form the ground truth; and that although STAPLE and LSML appear to represent the mean of the performance measured using individual annotations, when there are few annotations, or there is a large variance in them, these estimates tend to degrade. Furthermore, one of the most commonly adopted combination methods-consensus voting- accentuates more obvious features, resulting in an overestimation of performance. It is concluded that in some datasets it is not possible to confidently infer an algorithm ranking when evaluating upon one ground truth.

  3. Agreement in interpersonal perception as a predictor of group performance.

    PubMed

    Sierra, Vicenta; Andrés, Amara; Solanas, Antonio; Leiva, David

    2010-11-01

    The present work deals with quantifying group characteristics. Specifically, dyadic measures of interpersonal perceptions were used to forecast group performance. Forty-six groups of students, 24 of four and 22 of five people, were studied in a real educational assignment context and marks were gathered as an indicator of group performance. Our results show that dyadic measures of interpersonal perceptions account for final marks. By means of linear regression analysis, 85% and 85.6% of group performance, respectively, was explained for group sizes equal to four and five. Results found in the scientific literature based on the individualistic approach are no larger than 18%. The results of the present study support the utility of dyadic approaches for predicting group performance in social contexts.

  4. Supervisor-Subordinate Agreement on Performance Feedback: A Field Study.

    DTIC Science & Technology

    1986-12-01

    about the job, and whether the superior has had an adequate opportunity to observe their behavior on the job (Landy, Barnes & Murphy, 1978; Tuckman ...Thornton, G.C. (1980). Psychometric properties of self-appraisals of job performance. Personnel Psychology, 33, 263-271. Tuckman , B.W., & Oliver, W.F. (1968

  5. Comparing the agreement among alternative models in evaluating HMO efficiency.

    PubMed Central

    Bryce, C L; Engberg, J B; Wholey, D R

    2000-01-01

    OBJECTIVE: To describe the efficiency of HMOs and to test the robustness of these findings across alternative models of efficiency. This study examines whether these models, when constructed in parallel to use the same information, provide researchers with the same insights and identify the same trends. DATA SOURCES: A data set containing 585 HMOs operating from 1985 through 1994. Variables include enrollment, utilization, and financial information compiled primarily from Health Care Investment Analysts, InterStudy HMO Census, and Group Health Association of America. STUDY DESIGN: We compute three estimates of efficiency for each HMO and compare the results in terms of individual performance and industry-wide trends. The estimates are then regressed against measures of case mix, quality, and other factors that may be related to the model estimates. PRINCIPAL FINDINGS: The three models identify similar trends for the HMO industry as a whole; however, they assess the relative technical efficiency of individual firms differently. Thus, these techniques are limited for either benchmarking or setting rates because the firms identified as efficient may be a consequence of model selection rather than actual performance. CONCLUSIONS: The estimation technique to evaluate efficient firms can affect the findings themselves. The implications are relevant not only for HMOs, but for efficiency analyses in general. Concurrence among techniques is no guarantee of accuracy, but it is reassuring; conversely, radically distinct inferences across models can be a warning to temper research conclusions. PMID:10857474

  6. 48 CFR 53.301-273 - Reinsurance Agreement for a Miller Act Performance Bond.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 48 Federal Acquisition Regulations System 2 2010-10-01 2010-10-01 false Reinsurance Agreement for a Miller Act Performance Bond. 53.301-273 Section 53.301-273 Federal Acquisition Regulations System... Reinsurance Agreement for a Miller Act Performance Bond. ER30OC98.020 ER30OC98.021...

  7. 29 CFR 553.23 - Agreement or understanding prior to performance of work.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 29 Labor 3 2010-07-01 2010-07-01 false Agreement or understanding prior to performance of work... understanding prior to performance of work. (a) General. (1) As a condition for use of compensatory time in lieu of overtime payment in cash, section 7(o)(2)(A) of the Act requires an agreement or understanding...

  8. Agreement between cytotechnologists and cytopathologists as a new measure of cytopathologist performance in gynecologic cytology.

    PubMed

    Quinn, Andrew M; Minhajuddin, Abu T; Hynan, Linda S; Reisch, Joan S; Cibas, Edmund S

    2017-07-01

    Although objective measures of cytotechnologist (CT) and cytopathologist (CP) performance exist, challenges remain. Two assumptions deserve examination: CPs' interpretations are correct, and CTs and CPs render interpretations independently of each other. This study presents a CT-CP interpretation comparison and provides insight into these assumptions. Every gynecologic cytology specimen examined by both a CT and a CP from December 2004 to March 2015 was extracted from the laboratory information system; glandular interpretations were excluded. Excel and SAS were used for CT-CP pair analysis. CT-CP pairs with fewer than 32 specimens (the lowest quartile) were excluded. For the remaining CT-CP pairs, 30 specimens or 10% of the specimens (whichever was higher) were randomly selected for comparison by a weighted κ statistic. κ values greater than 0.6 represented good agreement within CT-CP pairs. This study evaluated 7116 of 53,241 gynecologic cytology specimens (13.4%) that received CT and CP interpretations. This resulted in 155 pair-specific κ values from 15 CTs and 16 CPs. In aggregate, the κ values had a mean of 0.64, a standard deviation of 0.14, a median of 0.65, and a range of 0.27 to 0.91. Nine CTs exhibited good agreement in the majority of their pair-specific κ values with CPs (high-concordance CTs; 88 pair-specific κ values). This allowed us to identify outlier CPs who did not demonstrate good agreement with high-concordance CTs (16 of 88 pair-specific κ values [18.2%]). Laboratories can use this κ to determine when CP levels of agreement with CTs depart from those of their peers. Adding this to established metrics can give a more nuanced impression of CP performance. Cancer Cytopathol 2017;125:576-80. © 2017 American Cancer Society. © 2017 American Cancer Society.

  9. Evaluating steam trap performance

    SciTech Connect

    Fuller, N.Y.

    1985-08-08

    This paper presents a method for evaluating the performance level of steam traps by preparing an economic analysis of several types to determine the equivalent uniform annual cost. A series of tests on steam traps supplied by six manufacturers provided data for determining the relative efficiencies of each unit. The comparison was made using a program developed for the Texas Instruments T1-59 programmable calculator to evaluate overall steam trap economics.

  10. Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

    PubMed Central

    Díaz-Cabrera, Dolores; Hernández-Fernaud, Estefanía; Rosales-Sánchez, Christian

    2015-01-01

    Work performance is one of the most important dependent variables in Work and Organizational Psychology. The main objective of this paper was to explore the relationships between citizenship performance and task performance measures obtained from different appraisers and their consistency through a seldom-used methodology, intraclass correlation coefficients. Participants were 135 public employees, the total staff in a local government department. Jobs were clustered into job families through a work analysis based on standard questionnaires. A task description technique was used to develop a performance appraisal questionnaire for each job family, with three versions: self-, supervisor-, and peer-evaluation, in addition to a measure of citizenship performance. Only when the self-appraisal bias is controlled, significant correlations appeared between task performance rates. However, intraclass correlations analyses show that only self- (contextual and task) performance measures are consistent, while interrater agreement disappears. These results provide some interesting clues about the procedure of appraisal instrument development, the role of appraisers, and the importance of choosing adequate consistency analysis methods. PMID:26473956

  11. Evaluating Performance of Components

    NASA Technical Reports Server (NTRS)

    Katz, Daniel; Tisdale, Edwin; Norton, Charles

    2004-01-01

    Parallel Component Performance Benchmarks is a computer program developed to aid the evaluation of the Common Component Architecture (CCA) - a software architecture, based on a component model, that was conceived to foster high-performance computing, including parallel computing. More specifically, this program compares the performances (principally by measuring computing times) of componentized versus conventional versions of the Parallel Pyramid 2D Adaptive Mesh Refinement library - a software library that is used to generate computational meshes for solving physical problems and that is typical of software libraries in use at NASA s Jet Propulsion Laboratory.

  12. Performance Evaluation Process.

    ERIC Educational Resources Information Center

    1998

    This document contains four papers from a symposium on the performance evaluation process and human resource development (HRD). "Assessing the Effectiveness of OJT (On the Job Training): A Case Study Approach" (Julie Furst-Bowe, Debra Gates) is a case study of the effectiveness of OJT in one of a high-tech manufacturing company's product…

  13. Evacuation performance evaluation tool.

    PubMed

    Farra, Sharon; Miller, Elaine T; Gneuhs, Matthew; Timm, Nathan; Li, Gengxin; Simon, Ashley; Brady, Whittney

    2016-01-01

    Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation. Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed. Large pediatric hospital and medical center in the Midwest. The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU). The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952). The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

  14. Should a lower discount rate be used for evaluating a tolling agreement than used for a renewable energy contract?

    SciTech Connect

    Woo, C.K.; Horii, Brian; Chait, Michele; Horowitz, Ira

    2008-11-15

    Should a lower discount rate be used for evaluating a tolling agreement than used for a renewable energy contract? The California Energy Commission seems to think so. An analysis suggests that a risk-adjusted discount rate is inappropriate. A correct approach should quantify the effect of risk on a contract's financial performance, thereby providing useful information for decision-making. (author)

  15. Functional Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Greenisen, Michael C.; Hayes, Judith C.; Siconolfi, Steven F.; Moore, Alan D.

    1999-01-01

    The Extended Duration Orbiter Medical Project (EDOMP) was established to address specific issues associated with optimizing the ability of crews to complete mission tasks deemed essential to entry, landing, and egress for spaceflights lasting up to 16 days. The main objectives of this functional performance evaluation were to investigate the physiological effects of long-duration spaceflight on skeletal muscle strength and endurance, as well as aerobic capacity and orthostatic function. Long-duration exposure to a microgravity environment may produce physiological alterations that affect crew ability to complete critical tasks such as extravehicular activity (EVA), intravehicular activity (IVA), and nominal or emergency egress. Ultimately, this information will be used to develop and verify countermeasures. The answers to three specific functional performance questions were sought: (1) What are the performance decrements resulting from missions of varying durations? (2) What are the physical requirements for successful entry, landing, and emergency egress from the Shuttle? and (3) What combination of preflight fitness training and in-flight countermeasures will minimize in-flight muscle performance decrements? To answer these questions, the Exercise Countermeasures Project looked at physiological changes associated with muscle degradation as well as orthostatic intolerance. A means of ensuring motor coordination was necessary to maintain proficiency in piloting skills, EVA, and IVA tasks. In addition, it was necessary to maintain musculoskeletal strength and function to meet the rigors associated with moderate altitude bailout and with nominal or emergency egress from the landed Orbiter. Eight investigations, referred to as Detailed Supplementary Objectives (DSOs) 475, 476, 477, 606, 608, 617, 618, and 624, were conducted to study muscle degradation and the effects of exercise on exercise capacity and orthostatic function (Table 3-1). This chapter is divided into

  16. Mother-Daughter Agreement on Adolescent Adopted Chinese Girls' Academic Performance and Internalizing Symptoms

    ERIC Educational Resources Information Center

    Tan, Tony Xing; Marn, Travis

    2014-01-01

    This study reported mother-daughter agreement on adolescent adopted Chinese girls' adjustment. Data on the girls' academic performance and internalizing syndromes were collected from the adopted Chinese girls and their adoptive mothers separately. The adoptive mothers also provided data on mother-daughter relationship quality. There were 219 girls…

  17. 29 CFR 553.23 - Agreement or understanding prior to performance of work.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 29 Labor 3 2013-07-01 2013-07-01 false Agreement or understanding prior to performance of work... understanding is required with respect to employees hired prior to April 15, 1986, who do not have a representative, if the employer had a regular practice in effect on April 15, 1986, of granting compensatory...

  18. 48 CFR 53.301-273 - Reinsurance Agreement for a Miller Act Performance Bond.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 48 Federal Acquisition Regulations System 2 2013-10-01 2013-10-01 false Reinsurance Agreement for a Miller Act Performance Bond. 53.301-273 Section 53.301-273 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION (CONTINUED) CLAUSES AND FORMS FORMS Illustrations of Forms...

  19. 48 CFR 53.301-273 - Reinsurance Agreement for a Miller Act Performance Bond.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 48 Federal Acquisition Regulations System 2 2011-10-01 2011-10-01 false Reinsurance Agreement for a Miller Act Performance Bond. 53.301-273 Section 53.301-273 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION (CONTINUED) CLAUSES AND FORMS FORMS Illustrations of Forms...

  20. 48 CFR 53.301-273 - Reinsurance Agreement for a Miller Act Performance Bond.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 48 Federal Acquisition Regulations System 2 2012-10-01 2012-10-01 false Reinsurance Agreement for a Miller Act Performance Bond. 53.301-273 Section 53.301-273 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION (CONTINUED) CLAUSES AND FORMS FORMS Illustrations of Forms...

  1. 48 CFR 53.301-273 - Reinsurance Agreement for a Bonds Statute Performance Bond.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 48 Federal Acquisition Regulations System 2 2014-10-01 2014-10-01 false Reinsurance Agreement for a Bonds Statute Performance Bond. 53.301-273 Section 53.301-273 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION (CONTINUED) CLAUSES AND FORMS FORMS Illustrations of Forms...

  2. Analysis of Time-Sharing Contract Agreements with Related Suggested Systems Evaluation Criteria.

    ERIC Educational Resources Information Center

    Chanoux, Jo Ann J.

    While avoiding evaluation or specification of individual companies, computer time-sharing commercial contract agreements are analyzed. Price and non-price contract elements are analyzed according to 22 evaluation criteria: confidentiality measures assumed by the vendor; consultation services available; package programs and user routines; languages…

  3. SPSS Macros for Assessing the Reliability and Agreement of Student Evaluations of Teaching

    ERIC Educational Resources Information Center

    Morley, Donald D.

    2009-01-01

    This article reports and demonstrates two SPSS macros for calculating Krippendorff's alpha and intraclass reliability coefficients in repetitive situations where numerous coefficients are needed. Specifically, the reported SPSS macros were used to evaluate the interrater agreement and reliability of student evaluations of teaching in thousands of…

  4. SPSS Macros for Assessing the Reliability and Agreement of Student Evaluations of Teaching

    ERIC Educational Resources Information Center

    Morley, Donald D.

    2009-01-01

    This article reports and demonstrates two SPSS macros for calculating Krippendorff's alpha and intraclass reliability coefficients in repetitive situations where numerous coefficients are needed. Specifically, the reported SPSS macros were used to evaluate the interrater agreement and reliability of student evaluations of teaching in thousands of…

  5. Algorithm performance evaluation

    NASA Astrophysics Data System (ADS)

    Smith, Richard N.; Greci, Anthony M.; Bradley, Philip A.

    1995-03-01

    Traditionally, the performance of adaptive antenna systems is measured using automated antenna array pattern measuring equipment. This measurement equipment produces a plot of the receive gain of the antenna array as a function of angle. However, communications system users more readily accept and understand bit error rate (BER) as a performance measure. The work reported on here was conducted to characterize adaptive antenna receiver performance in terms of overall communications system performance using BER as a performance measure. The adaptive antenna system selected for this work featured a linear array, least mean square (LMS) adaptive algorithm and a high speed phase shift keyed (PSK) communications modem.

  6. Evaluation of Mother-Child Agreement and Factorial Structures of the SCARED Questionnaire in an Italian Clinical Sample

    PubMed Central

    Scaini, Simona; Ogliari, Anna; De Carolis, Ludovica; Bellodi, Laura; Di Serio, Clelia; Brombin, Chiara

    2017-01-01

    Background: A great part of the literature has confirmed the importance of both child and parents reports as source of factual information, especially for childhood emotional syndromes. In our study we aimed at: (i) calculating mother-child agreement and (ii) evaluating factorial structure of the Screen for Child Anxiety Related Emotional Disorders (SCARED) questionnaire in an Italian clinical sample. The novelty of this contribution is two-fold: first, from a clinical point of view, we investigated the parent-child agreement level and examined separately the factorial structures of both parent and child versions of the SCARED for the first time in an Italian clinical sample. Second, unlike previous studies, we used statistical approaches specifically suited to account for the ordinal nature of the collected variables. Method: In a clinical sample of 171 children and adolescents aged 8–18 and their mothers we evaluated inter-rater agreement using weighted kappa indices to assess agreement for each item belonging to a certain SCARED subscale. Exploratory factor analysis for ordinal data was then performed on the polychoric correlation matrix calculated on SCARED items. Differences in the numbers of symptoms reported by children and parents were evaluated as well. Results and Conclusions: Our results reveal moderate to strong mother-child agreement. A significant age effect is present. Two different factorial solutions emerged for parent and child SCARED versions (a 5 factor structure for parents and a 6 factor solution in the child version, including a new factor “Worry about Parents”). This study confirmed the importance of evaluating both child and parent reports in assessment protocols for anxiety disorders. Our findings could help clinicians to determine which information, and from which rater, must be accounted for in evaluating treatment decisions. Moreover, we find that patients characteristics, such as gender and age, should be taken into account when

  7. Vender Performance Evaluation.

    ERIC Educational Resources Information Center

    Grant, Joan; Perelmuter, Susan

    1978-01-01

    Vendor selection can mean success or failure of an approval plan; this study evaluates three book vendors by comparing their plans on the bases of speed, bibliographic accuracy, and discounts. (Author/CWM)

  8. Evaluating School Administrators: The Scope and Nature of Administrative Performance.

    ERIC Educational Resources Information Center

    Abbott, Max G.

    Evaluation of administrative performance should be situationally specific and should be based on a reasonable three-way agreement regarding expectations for that performance, beginning with the administrator being evaluated and including both superordinates and subordinates, according to the author. He states that criteria for evaluation should be…

  9. Alberta stroke program early computed tomographic scoring performance in a series of patients undergoing computed tomography and MRI: reader agreement, modality agreement, and outcome prediction.

    PubMed

    McTaggart, Ryan A; Jovin, Tudor G; Lansberg, Maarten G; Mlynash, Michael; Jayaraman, Mahesh V; Choudhri, Omar A; Inoue, Manabu; Marks, Michael P; Albers, Gregory W

    2015-02-01

    In this study, we compare the performance of pretreatment Alberta Stroke Program Early Computed Tomographic scoring (ASPECTS) using noncontrast CT (NCCT) and MRI in a large endovascular therapy cohort. Prospectively enrolled patients underwent baseline NCCT and MRI and started endovascular therapy within 12 hours of stroke onset. Inclusion criteria for this analysis were evaluable pretreatment NCCT, diffusion-weighted MRI (DWI), and 90-day modified Rankin Scale scores. Two expert readers graded ischemic change on NCCT and DWI using the ASPECTS. ASPECTS scores were analyzed with the full scale or were trichotomized (0-4 versus 5-7 versus 8-10) or dichotomized (0-7 versus 8-10). Good functional outcome was defined as a 90-day modified Rankin Scale score of 0 to 2. Seventy-four patients fulfilled our study criteria. The full-scale inter-rater agreement for CT-ASPECTS and DWI-ASPECTS was 0.579 and 0.867, respectively. DWI-ASPECTS correlated with functional outcome (P=0.004), whereas CT-ASPECTS did not (P=0.534). Both DWI-ASPECTS and CT-ASPECTS correlated with DWI volume. The receiver operating characteristic analysis revealed that DWI-ASPECTS outperformed both CT-ASPECTS and the time interval between symptom onset and start of the procedure for predicting good functional outcome (modified Rankin Scale score, ≤2) and DWI volume ≥70 mL. Inter-rater agreement for DWI-ASPECTS was superior to that for CT-ASPECTS. DWI-ASPECTS outperformed NCCT ASPECTS for predicting functional outcome at 90 days. © 2014 American Heart Association, Inc.

  10. Instrument performance evaluation

    SciTech Connect

    Swinth, K.L.

    1993-03-01

    Deficiencies exist in both the performance and the quality of health physics instruments. Recognizing the implications of such deficiencies for the protection of workers and the public, in the early 1980s the DOE and the NRC encouraged the development of a performance standard and established a program to test a series of instruments against criteria in the standard. The purpose of the testing was to establish the practicality of the criteria in the standard, to determine the performance of a cross section of available instruments, and to establish a testing capability. Over 100 instruments were tested, resulting in a practical standard and an understanding of the deficiencies in available instruments. In parallel with the instrument testing, a value-impact study clearly established the benefits of implementing a formal testing program. An ad hoc committee also met several times to establish recommendations for the voluntary implementation of a testing program based on the studies and the performance standard. For several reasons, a formal program did not materialize. Ongoing tests and studies have supported the development of specific instruments and have helped specific clients understand the performance of their instruments. The purpose of this presentation is to trace the history of instrument testing to date and suggest the benefits of a centralized formal program.

  11. Evaluation of the agreement between modeled and monitored ambient hazardous air pollutants in California.

    PubMed

    Garcia, Erika; Hurley, Susan; Nelson, David O; Gunier, Robert B; Hertz, Andrew; Reynolds, Peggy

    2014-08-01

    Elevated breast cancer incidence rates in urban areas have led to speculation regarding the potential role of air pollution. In order to inform the exposure assessment for a subsequent breast cancer study, we evaluated agreement between modeled and monitored hazardous air pollutants (HAPs). Modeled annual ambient concentrations of HAPs in California came from the US Environmental Protection Agency's National Air Toxics Assessment database for 1996, 1999, 2002, and 2005 and corresponding monitored data from the California Air Resources Board's air quality monitoring program. We selected 12 compounds of interest for our study and focused on evaluating agreement between modeled and monitored data, and of temporal trends. Modeled data generally underestimated the monitored data, especially in 1996. For most compounds agreement between modeled and monitored concentrations improved over time. We concluded that 2002 and 2005 modeled data agree best with monitored data and are the most appropriate years for direct use in our subsequent epidemiologic analysis.

  12. Forming a reference standard from LIDC data: impact of reader agreement on reported CAD performance

    NASA Astrophysics Data System (ADS)

    Ochs, Robert; Kim, Hyun J.; Angel, Erin; Panknin, Christoph; McNitt-Gray, Michael; Brown, Matthew

    2007-03-01

    The Lung Image Database Consortium (LIDC) has provided a publicly available collection of CT images with nodule markings from four radiologists. The LIDC protocol does not require radiologists to reach a consensus during the reading process, and as a result, there are varying levels of reader agreement for each potential nodule with no explicit reference standard for nodules. The purpose of this work was to investigate the effects of the level of reader agreement on the development of a reference standard and the subsequent impact on CAD performance. Ninety series were downloaded from the LIDC database. Four different reference standards were created based on the markings of the LIDC radiologists, reflecting four different levels of reader agreement. All series were analyzed with a research CAD system and its performance was measured against each of the four standards. Between the standards with the lowest (any 1 of 4 readers) and highest (all 4 readers) required level of reader agreement, the number of nodules >= 3 mm decreased 48% (from 174 to 90) and CAD sensitivity for nodules >= 3 mm increased from 0.70 +/- 0.34 to 0.79 +/- 0.35. Between the same reference standards, the number of nodules < 3 mm decreased 84% (from 483 to 75) and CAD sensitivity for nodules < 3 mm increased from 0.30 +/- 0.29 to 0.51 +/- 0.45. This research illustrates the importance of indicating the method used to form the reference standard, since the method influences both the number of nodules and reported CAD performance.

  13. Admissions; Evaluation of Credentials; Financial Aids; Marketing and Recruitment; Articulation Agreements and Practices.

    ERIC Educational Resources Information Center

    College and University, 1980

    1980-01-01

    Proceedings of the 66th Annual Meeting of the American Association of Collegiate Registrars and Admissions Officers that relate to admissions, evaluation of credentials, financial aid, marketing and recruitment, and articulation agreements and practices are summarized. Names and institutions of conference participants are included. (MSE)

  14. Admissions; Evaluation of Credentials; Financial Aids; Marketing and Recruitment; Articulation Agreements and Practices.

    ERIC Educational Resources Information Center

    College and University, 1981

    1981-01-01

    Proceedings of the 67th Annual Meeting of the American Association of Collegiate Registrars and Admissions Officers which relate to admissions, evaluation of credentials, student financial aid, marketing and recruitment, and articulation agreements and practices are summarized. Names and institutions of conference participants are included. (MSE)

  15. A mixed-methods evaluation of the Educational Supervision Agreement for Wales.

    PubMed

    Webb, Katie Louise; Bullock, Alison; Groves, Caroline; Saayman, Anton Gerhard

    2017-06-08

    In a bid to promote high-quality postgraduate education and training and support the General Medical Council's (GMC) implementation plan for trainer recognition, the Wales Deanery developed the Educational Supervision Agreement (EdSA). This is a three-way agreement between Educational Supervisors, Local Education Providers and the Wales Deanery which clarifies roles, responsibilities and expectations for all. This paper reports on the formative evaluation of the EdSA after 1 year. Evaluation of pan-Wales EdSA roll-out (2013-2015) employed a mixed-methods approach: questionnaires (n=191), interviews (n=11) with educational supervisors and discussion with key stakeholders (GMC, All-Wales Trainer Recognition Group, Clinical Directors). Numerical data were analysed in SPSS V.20; open comments underwent thematic content analysis. The study involved Educational Supervisors working in different specialties across Wales, UK. At the point of data collection, survey respondents represented 14% of signed agreements. Respondents believed the Agreement professionalises the Educational Supervisor role (85%, n=159 agreed), increases the accountability of Educational Supervisors (87%; n=160) and health boards (72%, n=131), provides leverage to negotiate supporting professional activities' (SPA) time (76%, n=142) and continuing professional development (CPD) activities (71%, n=131). Factor analysis identified three principal factors: professionalisation of the educational supervisor role, supporting practice through training and feedback and implementation of the Agreement. Our evidence suggests that respondents believed the Agreement would professionalise and support their Educational Supervisor role. Respondents showed enthusiasm for the Agreement and its role in maintaining high standards of training. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise

  16. Glaucoma progression detection: agreement, sensitivity, and specificity of expert visual field evaluation, event analysis, and trend analysis.

    PubMed

    Antón, Alfonso; Pazos, Marta; Martín, Belén; Navero, José Manuel; Ayala, Miriam Eleonora; Castany, Marta; Martínez, Patricia; Bardavío, Javier

    2013-01-01

    To assess sensitivity, specificity, and agreement among automated event analysis, automated trend analysis, and expert evaluation to detect glaucoma progression. This was a prospective study that included 37 eyes with a follow-up of 36 months. All had glaucomatous disks and fields and performed reliable visual fields every 6 months. Each series of fields was assessed with 3 different methods: subjective assessment by 2 independent teams of glaucoma experts, glaucoma/guided progression analysis (GPA) event analysis, and GPA (visual field index-based) trend analysis. Kappa agreement coefficient between methods and sensitivity and specificity for each method using expert opinion as gold standard were calculated. The incidence of glaucoma progression was 16% to 18% in 3 years but only 3 cases showed progression with all 3 methods. Kappa agreement coefficient was high (k=0.82) between subjective expert assessment and GPA event analysis, and only moderate between these two and GPA trend analysis (k=0.57). Sensitivity and specificity for GPA event and GPA trend analysis were 71% and 96%, and 57% and 93%, respectively. The 3 methods detected similar numbers of progressing cases. The GPA event analysis and expert subjective assessment showed high agreement between them and moderate agreement with GPA trend analysis. In a period of 3 years, both methods of GPA analysis offered high specificity, event analysis showed 83% sensitivity, and trend analysis had a 66% sensitivity.

  17. Evaluation of Performance Based Logistics

    DTIC Science & Technology

    2006-08-01

    logistics warehouse provider (see Figure 11 below). NAVICP-P 3PL Warehouse Provider Lockheed Martin Michelin Government Prime Contractor Subcontractor...Evaluation of Performance Based Logistics by Jacques S. Gansler and William Lucyshyn August...REPORT DATE AUG 2006 2. REPORT TYPE 3. DATES COVERED 00-00-2006 to 00-00-2006 4. TITLE AND SUBTITLE Evaluation of Performance Based Logistics

  18. Evaluating and Improving Teacher Performance.

    ERIC Educational Resources Information Center

    Manatt, Richard P.

    This workbook, coordinated with Manatt Teacher Performance Evaluation (TPE) workshops, summarizes large group presentation in sequence with the transparancies used. The first four modules of the workbook deal with the state of the art of evaluating and improving teacher performance; the development of the TPE system, including selection of…

  19. Agreement in the diagnosis of dental fluorosis in central incisors performed by a standardized photographic method and clinical examination.

    PubMed

    Martins, Carolina Castro; Chalub, Loliza; Lima-Arsati, Ynara Bosco; Pordeus, Isabela Almeida; Paiva, Saul Martins

    2009-05-01

    The aim of this study was to assess agreement in the diagnosis of dental fluorosis performed by a standardized digital photographic method and a clinical examination (gold standard). 49 children (aged 7-9 years) were clinically evaluated by a trained examiner for the assessment of dental fluorosis. Central incisors were evaluated for the presence or absence of dental fluorosis and were photographed with a digital camera. Photographs were presented to three pediatric dentists, who examined the images. Data were analyzed using Cohen's kappa and validity values. Agreement in the diagnosis performed by the photographic method and clinical examination was good (0.67) and accuracy was 83.7%. The prevalence of dental fluorosis was reported to be higher in the clinical examination (49%) compared with the photographic method (36.7%). The photographic method presented higher specificity (96%) than sensitivity (70.8%), a positive predictive value (PPV) of 94.4% and a negative predictive value (NPV) of 77.4%. The diagnosis of dental fluorosis performed using the photographic method presented high specificity and PPV, which indicates that the method is reproducible and reliable for recording dental fluorosis.

  20. Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies

    PubMed Central

    Barth, Jürgen; de Boer, Wout E L; Busse, Jason W; Hoving, Jan L; Kedzia, Sarah; Couban, Rachel; Fischer, Katrin; von Allmen, David Y; Spanjer, Jerry

    2017-01-01

    Objectives To explore agreement among healthcare professionals assessing eligibility for work disability benefits. Design Systematic review and narrative synthesis of reproducibility studies. Data sources Medline, Embase, and PsycINFO searched up to 16 March 2016, without language restrictions, and review of bibliographies of included studies. Eligibility criteria Observational studies investigating reproducibility among healthcare professionals performing disability evaluations using a global rating of working capacity and reporting inter-rater reliability by a statistical measure or descriptively. Studies could be conducted in insurance settings, where decisions on ability to work include normative judgments based on legal considerations, or in research settings, where decisions on ability to work disregard normative considerations.Teams of paired reviewers identified eligible studies, appraised their methodological quality and generalisability, and abstracted results with pretested forms. As heterogeneity of research designs and findings impeded a quantitative analysis, a descriptive synthesis stratified by setting (insurance or research) was performed. Results From 4562 references, 101 full text articles were reviewed. Of these, 16 studies conducted in an insurance setting and seven in a research setting, performed in 12 countries, met the inclusion criteria. Studies in the insurance setting were conducted with medical experts assessing claimants who were actual disability claimants or played by actors, hypothetical cases, or short written scenarios. Conditions were mental (n=6, 38%), musculoskeletal (n=4, 25%), or mixed (n=6, 38%). Applicability of findings from studies conducted in an insurance setting to real life evaluations ranged from generalisable (n=7, 44%) and probably generalisable (n=3, 19%) to probably not generalisable (n=6, 37%). Median inter-rater reliability among experts was 0.45 (range intraclass correlation coefficient 0.86 to κ−0

  1. [Evaluation of comprehensiveness: ascribing meaning to agreements on goals for local health systems].

    PubMed

    Conill, Eleonor Minho

    2004-01-01

    As a policy guideline, ideal, or objective, comprehensiveness is a relevant attribute in the evaluation of quality of care and health systems. The article discusses the meaning of the concept of comprehensiveness in practice in some health services and systems, analyzing various methodologies to implement the concept. In Brazil, what prevails is an expanded perception emphasizing the complete, continuous, and coordinated nature of health care and management. The article highlights the importance of combining the evaluation of comprehensiveness with measures of access, suggesting the selection of indicators pertaining to agreements on goals for local health systems and their monitoring. This initiative could enhance the validity of existing evaluation instruments, from a communications perspective.

  2. Interobserver agreement and performance score comparison in quality control using a breast phantom: screen-film mammography vs computed radiography.

    PubMed

    Shimamoto, Kazuhiro; Ikeda, Mitsuru; Satake, Hiroko; Ishigaki, Satoko; Sawaki, Akiko; Ishigaki, Takeo

    2002-09-01

    Our objective was to evaluate interobserver agreement and to compare the performance score in quality control of screen-film mammography and computed radiography (CR) using a breast phantom. Eleven radiologists interpreted a breast phantom image (CIRS model X) by four viewing methods: (a) original screen-film; (b) soft-copy reading of the digitized film image; (c) hard-copy reading of CR using an imaging plate; and (d) soft-copy reading of CR. For the soft-copy reading, a 17-in. CRT monitor (1024x1536x8 bits) was used. The phantom image was evaluated using a scoring system outlined in the instruction manual, and observers judged each object using a three-point rating scale: (a) clearly seen; (b) barely seen; and (c) not seen. For statistical analysis, the kappa statistic was employed. For "mass" depiction, interobserver agreement using CR was significantly lower than when using screen-film ( p<0.05). There was no significant difference in the kappa value for detecting "microcalcification"; however, the performance score of "microcalcification" on CR hard-copy was significantly lower than on the other three viewing methods ( p<0.05). Viewing methods (film or CR, soft-copy or hard-copy) could affect how the phantom image is judged. Paying special attention to viewing conditions is recommended for quality control of CR mammograms.

  3. Evaluation of Service Level Agreement Approaches for Portfolio Management in the Financial Industry

    NASA Astrophysics Data System (ADS)

    Pontz, Tobias; Grauer, Manfred; Kuebert, Roland; Tenschert, Axel; Koller, Bastian

    The idea of service-oriented Grid computing seems to have the potential for fundamental paradigm change and a new architectural alignment concerning the design of IT infrastructures. There is a wide range of technical approaches from scientific communities which describe basic infrastructures and middlewares for integrating Grid resources in order that by now Grid applications are technically realizable. Hence, Grid computing needs viable business models and enhanced infrastructures to move from academic application right up to commercial application. For a commercial usage of these evolutions service level agreements are needed. The developed approaches are primary of academic interest and mostly have not been put into practice. Based on a business use case of the financial industry, five service level agreement approaches have been evaluated in this paper. Based on the evaluation, a management architecture has been designed and implemented as a prototype.

  4. Adopting a practical statistical approach for evaluating assay agreement in drug discovery.

    PubMed

    Sun, Dongyu; Whitty, Adrian; Papadatos, James; Newman, Miki; Donnelly, Jason; Bowes, Scott; Josiah, Serene

    2005-08-01

    The authors assess the equivalence of 2 assays and put forward a general approach for assay agreement analysis that can be applied during drug discovery. Data sets generated by different assays are routinely compared to each other during the process of drug discovery. For a given target, the assays used for high-throughput screening and structure-activity relationship studies will most likely differ in their assay reagents, assay conditions, and/or detection technology, which makes the interpretation of data between assays difficult, particularly as most assays are used to measure quantitative changes in compound potency against the target. To better quantify the relationship of data sets from different assays for the same target, the authors evaluated the agreement between results generated by 2 different assays that measure the activity of compounds against the same protein, ALK5. The authors show that the agreement between data sets can be quantified using correlation and Bland-Altman plots, and the precision of the assays can be used to define the expectations of agreement between 2 assays. They propose a scheme for addressing issues of assay data equivalence, which can be applied to address questions of how data sets compare during the lead identification and lead optimization processes in which assays are frequently added and changed.

  5. Room for Improvement: Performance Evaluations.

    ERIC Educational Resources Information Center

    Webb, Gisela

    1989-01-01

    Describes a performance management approach to library personnel management that stresses communication, clarification of goals, and reinforcement of new practices and behaviors. Each phase of the evaluation process (preparation, rating, administrative review, appraisal interview, and follow-up) and special evaluations to be used in cases of…

  6. Agreement between Computerized and Human Assessment of Performance on the Ruff Figural Fluency Test

    PubMed Central

    Elderson, Martin F.; Pham, Sander; van Eersel, Marlise E. A.; Wolffenbuttel, Bruce H. R.; Kok, Johan; Gansevoort, Ron T.; Tucha, Oliver; van der Klauw, Melanie M.; Slaets, Joris P. J.

    2016-01-01

    The Ruff Figural Fluency Test (RFFT) is a sensitive test for nonverbal fluency suitable for all age groups. However, assessment of performance on the RFFT is time-consuming and may be affected by interrater differences. Therefore, we developed computer software specifically designed to analyze performance on the RFFT by automated pattern recognition. The aim of this study was to compare assessment by the new software with conventional assessment by human raters. The software was developed using data from the Lifelines Cohort Study and validated in an independent cohort of the Prevention of Renal and Vascular End Stage Disease (PREVEND) study. The total study population included 1,761 persons: 54% men; mean age (SD), 58 (10) years. All RFFT protocols were assessed by the new software and two independent human raters (criterion standard). The mean number of unique designs (SD) was 81 (29) and the median number of perseverative errors (interquartile range) was 9 (4 to 16). The intraclass correlation coefficient (ICC) between the computerized and human assessment was 0.994 (95%CI, 0.988 to 0.996; p<0.001) and 0.991 (95%CI, 0.990 to 0.991; p<0.001) for the number of unique designs and perseverative errors, respectively. The mean difference (SD) between the computerized and human assessment was -1.42 (2.78) and +0.02 (1.94) points for the number of unique designs and perseverative errors, respectively. This was comparable to the agreement between two independent human assessments: ICC, 0.995 (0.994 to 0.995; p<0.001) and 0.985 (0.982 to 0.988; p<0.001), and mean difference (SD), -0.44 (2.98) and +0.56 (2.36) points for the number of unique designs and perseverative errors, respectively. We conclude that the agreement between the computerized and human assessment was very high and comparable to the agreement between two independent human assessments. Therefore, the software is an accurate tool for the assessment of performance on the RFFT. PMID:27661083

  7. The supervisor's performance appraisal: evaluating the evaluator.

    PubMed

    McConnell, C R

    1993-04-01

    The focus of much performance appraisal in the coming decade or so will likely be on the level of customer satisfaction achieved through performance. Ultimately, evaluating the evaluator--that is, appraising the supervisor--will likely become a matter of assessing how well the supervisor's department meets the needs of its customers. Since meeting the needs of one's customers can well become the strongest determinant of organizational success or failure, it follows that relative success in ensuring these needs are met can become the primary indicator of one's relative success as a supervisor. This has the effect of placing the emphasis on supervisory performance exactly at the point it belongs, right on the bottom-line results of the supervisor's efforts.

  8. Agreement between cone-beam computed tomography and nasoendoscopy evaluations of adenoid hypertrophy.

    PubMed

    Major, Michael P; Witmans, Manisha; El-Hakim, Hamdy; Major, Paul W; Flores-Mir, Carlos

    2014-10-01

    The goals of this study were to evaluate (1) the reliability and accuracy of cone-beam computed tomography (CBCT) for assessing adenoid size compared with nasoendoscopy and (2) the influence of clinical experience on CBCT diagnosis. Adenoid size was graded on a 4-point scale for CBCT and nasoendoscopy by a pediatric otolaryngologist. Reliability was assessed with intraobserver and interobserver agreement. Accuracy was assessed with agreement between CBCT and nasoendoscopy, plus sensitivity and specificity analyses. The CBCT assessments were completed by a team of 4 evaluators: an oral and maxillofacial radiologist, an airway orthodontist who participates in the multidisciplinary team, an academic orthodontist whose primary research is in 3-dimensional imaging, and a highly experienced private practice orthodontist comfortable with CBCT imaging. Each evaluator was specifically chosen to represent a unique set of clinical and radiographic experiences. All evaluators were blinded to the subject's identity and clinical history, and they evaluated the images in a unique random order and evaluated each image 3 times separated by a minimum of 7 days. The same computer hardware and software were used. Thirty-nine consecutively assessed, nonsyndromic subjects (ages, 11.5 ± 2.8 years) were evaluated. The CBCT demonstrated excellent sensitivity (88%) and specificity (93%), strong accuracy (ICC, 0.80; 95% CI, ± 0.15), and good reliability, both within observers (ICC, 0.85; 95% CI, ± 0.08) and between observers (ICC, 0.84; 95% CI, ± 0.08). The clinical experience of the CBCT evaluator did not have a statistically significant effect. CBCT is a reliable and accurate tool for identifying adenoid hypertrophy. Copyright © 2014 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

  9. Interobserver agreement among cytopathologists in the evaluation of pancreatic endoscopic ultrasound-guided fine needle aspiration cytology specimens.

    PubMed

    Mounzer, Rawad; Yen, Roy; Marshall, Carrie; Sams, Sharon; Mehrotra, Sanjana; Said, Mohamed Sherif; Obuch, Joshua C; Brauer, Brian; Attwell, Augustin; Fukami, Norio; Shah, Raj; Amateau, Stuart; Hall, Matthew; Hosford, Lindsay; Wilson, Robert; Rastogi, Amit; Wani, Sachin

    2016-07-01

    Endoscopic ultrasound with fine needle aspiration (EUS-FNA) has become the standard of care in the evaluation of solid pancreatic lesions. Limited data exist on interobserver agreement (IOA) among cytopathologists in assessing solid pancreatic EUS-FNA specimens. This study aimed to evaluate IOA among cytopathologists in assessing EUS-FNA cytology specimens of solid pancreatic lesions using a novel standardized scoring system and to assess individual clinical and cytologic predictors of IOA. Consecutive patients who underwent EUS-FNA of solid pancreatic lesions at a tertiary care referral center were included. EUS-FNA slides were evaluated by four blinded cytopathologists using a standardized scoring system that assessed final cytologic diagnosis and quantitative (number of nucleated/diagnostic cells) and qualitative (bloodiness, inflammation/necrosis, contamination, artifact) cytologic parameters. Final clinical diagnosis was based on final cytology, surgical pathology, or 1-year clinical follow-up. IOA was calculated using multi-rater kappa (κ) statistics. Bivariate analyses were performed comparing cases with and without uniform agreement among the cytopathologists followed by logistic regression with backward elimination to model likelihood of uniform agreement. Ninety-nine patients were included (49 % males, mean age 64 years, mean lesion size 26 mm). IOA for final diagnosis was moderate (κ = 0.45, 95 % confidence interval (CI) 0.4 - 0.49) with minimal improvement when combining suspicious and malignant diagnoses (κ = 0.54, 95 %CI 0.49 - 0.6). The weighted kappa value for overall diagnosis was 0.65 (95 %CI 0.54 - 0.76). IOA was slight to fair (κ = 0.04 - 0.32) for individual cytologic parameters. A final clinical diagnosis of malignancy was the most significant predictor of agreement [OR 3.99 (CI 1.52 - 10.49)]. Interobserver agreement among cytopathologists for pancreatic EUS-FNA specimens is moderate

  10. Agreement between medical record and parent report for evaluation of childhood febrile seizures.

    PubMed

    Ackerson, Bradley K; Sy, Lina S; Yao, Janis F; Craig Cheetham, T; Espinosa-Rydman, Ana M; Jones, Tonia L; Jacobsen, Steven J

    2013-06-12

    The monitoring of vaccine safety is critical to maintaining the public acceptance of vaccines required to ensure their continued success. Methods used to assess adverse events following immunization (AEFI) must accurately reflect their occurrence. Assessment of AEFI is often done via medical record review (MR) or via patient report (PR). However, these sources of data have not previously been compared for the analysis of AEFI. The objective of this study was to evaluate the concordance between MR and PR for young children identified as having had a febrile seizure (FS), an important AEFI, in an integrated health care system. The variables chosen for analysis were those recommended by the Brighton Collaboration Seizure Working Group for the evaluation of generalized seizure as an AEFI [1]. Parent report from phone interviews and mailed questionnaires was compared to abstracted medical records of 110 children with FS between ages 3 and 60 months. Concordance between PR and MR for characteristics and predisposing factors of FS was assessed by percent total agreement and kappa statistic. Percent total agreement between PR and MR was between 43.6 and 100% for variables studied, with 62.5% of items having >70% agreement. However, kappa was poor to fair for all measures (-0.04 to 0.33). While some variables, such as history of seizures in a sibling or parent and several seizure characteristics, were reported more often by PR, other items, such as maximum fever and several concurrent conditions, were reported more often by MR. These findings demonstrate the limitations of using MR or PR alone to assess febrile seizures in children. This analysis supports the practice of collecting data from both MR and PR to most accurately portray the spectrum of predisposing factors and seizure characteristics when evaluating FS in children whenever feasible. Copyright © 2013 Elsevier Ltd. All rights reserved.

  11. Evaluation of the agreement by examiners according to classifications of third molars.

    PubMed

    Lima, C-J; Silva, L-C-F; Melo, M-R-S; Santos, J-A-S-S; Santos, T-S

    2012-03-01

    This study recorded and evaluated the intra- and inter-group agreement degree by different examiners for the classification of lower third molars according to both the Winter's and Pell & Gregory's systems. An observational and cross-sectional study was realized with forty lower third molars analyzed from twenty digital panoramic radiographs. Four examiner groups (undergraduates, maxillofacial surgeons, oral radiologists and clinical dentists) from Aracaju, Sergipe, Brazil, classified them in relation to angulation, class and position. The variance test (ANOVA) was applied in the examiner findings with significance level of p<0.05 and confidence intervals of 95%. Intra- and inter-group agreement was observed in Winter's classification system among all examiners. Pell & Gregory's classification system showed an average intra-group agreement and a statistical significant difference to position variable in inter-group analysis with greater disagreement to the clinical dentists group (p<0.05). High reproducibility was associated to Winter's classification, whereas the system proposed by Pell & Gregory did not demonstrate appropriate levels of reliability.

  12. Evaluation of Agreement between Participant and Expert on Jump-landing Characteristics During a 4-week Intervention.

    PubMed

    Ericksen, Hayley M; Pietrosimone, Brian; Gribble, Phillip A; Thomas, Abbey C

    2017-09-27

    Feedback is an important factor of interventions designed to reduce anterior cruciate ligament injury risk. Self-analysis feedback requires participants to self-critique their jump landing mechanics; however it is unknown if individuals are able to effectively self-analyze their own biomechanics and if this self-analysis agrees with observed biomechanical changes by an expert. Determine agreement between an expert and participants on biomechanical errors committed during 3 of 12 sessions which were part of an intervention to change jump-landing biomechanics in healthy females. Descriptive analysis. Research laboratory. Healthy, recreationally active females with no history of lower extremity fracture or surgery. Participants completed a 4 week, 12 session feedback intervention. Each intervention session lasted approximately 15 minutes and included asking participants to perform 6 sets of 6 jumps off a 30 cm high box placed 50% of their height away from the target landing area. Participants performed self-analysis feedback and received expert feedback on 7 different jump-landing criteria following each set of jumps. Data were coded and agreement between the expert and the participant was assessed using Cohen's unweighted kappa for sessions 1, 6 and 12. There was agreement between the expert and participants for 0/7 criterion for session 1; 3/7 criterion for session 6; and 4/7 criterion for session 12. Participants demonstrated some agreement with the expert when evaluating their jump-landing biomechanics. Self-analysis feedback may not replace what an expert can provide; both types of feedback may be better used in conjunction to produce significant biomechanical changes. Changes made by the participant, may not translate into biomechanical changes during a real-life game or practice situation. Future research should continue to investigate effective interventions to reduce injury risk.

  13. Skylab experiment performance evaluation manual

    NASA Technical Reports Server (NTRS)

    Meyers, J. E.

    1972-01-01

    A series of preparation analyses used for evaluating the performance of the Skylab corollary experiments under preflight, in-flight, and postflight conditions is given. Experiment continegency plan work-around procedure and malfunction analyses are presented in order to assist in making the experiment operationally succesful.

  14. Quantitative assessment of target delineation variability for thymic cancers: Agreement evaluation of a prospective segmentation challenge

    PubMed Central

    Holliday, Emma; Fuller, Clifton D.; Kalpathy-Cramer, Jayashree; Gomez, Daniel; Rimner, Andreas; Li, Ying; Senan, Suresh; Wilson, Lynn D.; Choi, Jehee; Komaki, Ritsuko; Thomas, Charles R.

    2016-01-01

    Objectives We sought to quantitatively determine the inter-observer variability of expert radiotherapy target-volume delineation for thymic cancers, as part of a larger effort to develop an expert-consensus contouring atlas. Methods A pilot dataset was created consisting of a standardized case presentation with pre- and post-operative DICOM CT image sets from a single patient with Masaoka-Koga Stage III thymoma. Expert thoracic radiation oncologists delineated tumor targets on the pre- and post-operative scans as they would for a definitive and adjuvant case, respectively. Respondents completed a survey including recommended dose prescription and target volume margins for definitive and post-operative scenarios. Inter-observer variability was analyzed quantitatively with Warfield's simultaneous truth, performance level estimation (STAPLE) algorithm and Dice similarity coefficient (DSC). Results Seven users completed contouring for definitive and adjuvant cases; of these, 5 completed online surveys. Segmentation performance was assessed, with high mean±SD STAPLE-estimated segmentation sensitivity for definitive case GTV and CTV at 0.77 and 0.80, respectively, and post-operative CTV sensitivity of 0.55; all volumes had specificity of ≥0.99. Inter-observer agreement was markedly higher for the definitive target volumes, with mean±SD DSC of 0.88±0.03 and 0.89±0.04 for GTV and CTV respectively, compared to post-op CTV DSC of 0.69±0.06 (Kruskal-Wallis p<0.01. Conclusion Expert agreement for definitive case volumes was exceptionally high, though significantly lower agreement was noted post-operatively. Technique and dose prescription between experts was substantively consistent, and these preliminary results will be utilized to create an expert-consensus contouring atlas to aid the non-expert radiation oncologist in the planning of these challenging, rare tumors. PMID:27570583

  15. 43 CFR 3192.12 - What activities may Tribes or States perform under cooperative agreements?

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... (3000) DELEGATION OF AUTHORITY, COOPERATIVE AGREEMENTS AND CONTRACTS FOR OIL AND GAS INSPECTION... appropriate BLM State or field office and as specified in the agreement, and may include— (a) Inspecting Tribal or allotted oil and gas leases for compliance with BLM regulations; (b) Issuing initial Notices of...

  16. Looking for Agreement among Criteria Used to Determine Teacher Effectiveness in Two Different Evaluation Models

    ERIC Educational Resources Information Center

    McGair, Charles D.

    2012-01-01

    Many theories, methods, and practices are utilized to evaluate teachers with the intention of determining teacher effectiveness to better inform decisions about retention, tenure, certification and performance-based pay. In the 21st century there has been a renewed emphasis on teacher evaluation in public schools, largely due to federal "Race…

  17. Inter-Rater Agreement Measures and the Refinement of Metrics in the PLATO MT Evaluation Paradigm

    DTIC Science & Technology

    2005-07-01

    automated downstream processes are able to perform on MT output. 7 Acknowledgements We acknowledge and thank Lacey Sculley , who spent many long hours...Validation of MT Evaluation Metrics Across Languages. Proceedings of Language Resources and Evaluation Conference, Spain. White, John S. and K...Taylor. (1998). Task- Oriented Metric for MT Evaluation Proceedings of AMTA 1998, Langhorne, PA. White, John S., Jennifer B. Doyon, and Susan W. Talbott

  18. An evaluation of agreement between pectoral spines and otoliths for estimating ages of catfishes

    USGS Publications Warehouse

    Olive, J.A.; Schramm, Harold; Gerard, Patrick D.; Irwin, E.

    2011-01-01

    Otoliths have been shown to provide more accurate ages than pectoral spine sections for several catfish populations; but sampling otoliths requires euthanizing the specimen, whereas spines can be sampled non-lethally. To evaluate whether, and under what conditions, spines provide the same or similar age estimates as otoliths, we examined data sets of individual fish aged from pectoral spines and otoliths for six blue catfish Ictalurus furcatus populations (n=420), 14 channel catfish Ictalurus punctatus populations (n=997), and 10 flathead catfish Pylodictus olivaris populations (n=947) from lotic and lentic waters throughout the central and eastern U.S. Logistic regression determined that agreement between ages estimated from otoliths and spines was consistently related to age, but inconsistently related to growth rate. When modeled at mean growth rate, we found at least 80% probability of no difference in spine- and otolith-assigned ages up to ages 4 and 5 for blue and channel catfish, respectively. For flathead catfish, an 80% probability of agreement between spine- and otolith-assigned ages did not occur at any age due to high incidence of differences in assigned ages even for age-1 fish. Logistic regression models predicted at least 80% probability that spine and otolith ages differed by ≤1 year up to ages 13, 16, and 9 for blue, channel, and flathead catfish, respectively. Age-bias assessment found mean spine-assigned age differed by less than 1 year from otolith-assigned age up to ages 19, 9, and 17 for blue catfish, channel catfish, and flathead catfish, respectively. These results can be used to help guide decisions about which structure is most appropriate for estimating catfish ages for particular populations and management objectives.

  19. Agreement and Diagnostic Performance of FITNESSGRAM®, International Obesity Task Force, and Hungarian National BMI Standards

    ERIC Educational Resources Information Center

    Laurson, Kelly R.; Welk, Gregory J.; Marton, Orsolya; Kaj, Mónika; Csányi, Tamás

    2015-01-01

    Purpose: This study examined agreement between all 3 standards (as well as relative diagnostic associations with metabolic syndrome) using a representative sample of youth from the Hungarian National Youth Fitness Study. Method: Body mass index (BMI) was assessed in a field sample of 2,352 adolescents (ages 10-18.5 years) and metabolic syndrome…

  20. Agreement and Diagnostic Performance of FITNESSGRAM®, International Obesity Task Force, and Hungarian National BMI Standards

    ERIC Educational Resources Information Center

    Laurson, Kelly R.; Welk, Gregory J.; Marton, Orsolya; Kaj, Mónika; Csányi, Tamás

    2015-01-01

    Purpose: This study examined agreement between all 3 standards (as well as relative diagnostic associations with metabolic syndrome) using a representative sample of youth from the Hungarian National Youth Fitness Study. Method: Body mass index (BMI) was assessed in a field sample of 2,352 adolescents (ages 10-18.5 years) and metabolic syndrome…

  1. 50 CFR 260.72 - Fees for inspection service performed under cooperative agreement.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... under cooperative agreement. 260.72 Section 260.72 Wildlife and Fisheries NATIONAL MARINE FISHERIES... PRODUCTS, PROCESSED PRODUCTS THEREOF, AND CERTAIN OTHER PROCESSED FOOD PRODUCTS INSPECTION AND CERTIFICATION Inspection and Certification of Establishments and Fishery Products for Human Consumption Fees and...

  2. Agreement between therapists, parents, patients, and independent evaluators on clinical improvement in pediatric obsessive compulsive disorder

    PubMed Central

    Lewin, Adam B.; Peris, Tara S.; De Nadai, Alessandro S.; McCracken, James T.; Piacentini, John

    2012-01-01

    Objective Independent evaluators (IE) are employed widely in clinical trials to make unbiased determinations of treatment response. By virtue of being kept blind to treatment condition, however, IEs are also kept unaware of many pertinent clinical details that are relevant for decisions about clinical improvement. In this study, agreement among raters (children, parents, therapists, and IEs) about treatment response over the course of a 14-week clinical trial for pediatric obsessive compulsive disorder (OCD) was examined in order to determine the utility of non-blind clinician and patient ratings of treatment response. Method Participants were 71 youth (mean age= 12.2 years; 63.4% female) with a primary diagnosis of OCD and their parents participating in a psychotherapy trial. Independent evaluators provided response ratings (Clinician's Global Impressions-Improvement Scale; CGI-I) at weeks 4, week 8 and 14 and therapists, children and parents completed independent CGI-I ratings at weeks 2, 4, 8 and 14. Results Nonlinear mixed models revealed differences in rating parties, with therapists and IEs slower to rate treatment improvement compared to children and parents and growth curve models suggested that therapists and IEs produced generally consistent ratings. In addition, no evidence was found for an evaluator-by-treatment interaction, indicating that raters displayed these differences consistently across both active and placebo conditions. Conclusions Youth and parents may be able to provide accurate ratings of global improvement; non-blinded treating clinicians (with training in research-oriented assessment) can offer global improvement ratings commensurate with blinded IEs. Findings suggest that alternatives (or additions) to the blinded-IE model may be appropriate for assessing global improvement, especially with the growing emphasis on dissemination and effectiveness trials. PMID:22963592

  3. Using Magnetic Resonance Myelography to Improve Interobserver Agreement in the Evaluation of Lumbar Spinal Canal Stenosis and Root Compression

    PubMed Central

    Al-Essawi, Sattar; Shukri, Mahmud; Naji, Farah Kasim

    2017-01-01

    Study Design Cross-sectional retrospective study designed to assess interobserver agreement. Purpose To investigate if interobserver agreement using magnetic resonance imaging (MRI) in the evaluation of lumbar spinal canal stenosis and root compression can be improved upon combination with magnetic resonance myelography (MRM). Overview of Literature The interpretation of lumbar spinal MRI, which is the imaging modality of choice, often has a significant influence on the diagnosis and treatment of low back pain. However, using MRI alone, substantial interobserver variability has been reported in the evaluation of lumbar spinal canal stenosis and nerve root compression. Methods Hardcopies of 30 lumbar spinal MRI (containing a total of 150 disk levels) as well as MRM films were separately reviewed by two radiologists and a neurosurgeon. At each intervertebral disk, the observers were asked to evaluate the thecal sac for the presence and degree of spinal stenoses (mild, moderate, or severe) and presence of root canal compression. Interobserver agreement was measured using weighted kappa statistics. Results Regarding lumbar spinal canal stenosis, interobserver agreement between the two radiologists was moderate (kappa, 0.4) for MRI and good (kappa, 0.6) for combination with MRM. However, the agreement between the radiologist and neurosurgeon remained fair for MRI alone or in combination with MRM (kappa, 0.38 and 033, respectively). In the evaluation of nerve root compression, interobserver agreement between the radiologists improved from moderate (kappa, 0.57) for MRI to good (kappa, 0.73) after combination with MRM; moderate agreement between the radiologist and neurosurgeon was noted for both MRI alone and after combination with MRM (kappa, 0.58 and 0.56, respectively). Conclusions Interobserver agreement in the evaluation of lumbar spinal canal stenosis and root compression between the radiologists improved when MRM was combined with MRI, relative to MRI alone. PMID

  4. Using Magnetic Resonance Myelography to Improve Interobserver Agreement in the Evaluation of Lumbar Spinal Canal Stenosis and Root Compression.

    PubMed

    Al-Tameemi, Haider Najim; Al-Essawi, Sattar; Shukri, Mahmud; Naji, Farah Kasim

    2017-04-01

    Cross-sectional retrospective study designed to assess interobserver agreement. To investigate if interobserver agreement using magnetic resonance imaging (MRI) in the evaluation of lumbar spinal canal stenosis and root compression can be improved upon combination with magnetic resonance myelography (MRM). The interpretation of lumbar spinal MRI, which is the imaging modality of choice, often has a significant influence on the diagnosis and treatment of low back pain. However, using MRI alone, substantial interobserver variability has been reported in the evaluation of lumbar spinal canal stenosis and nerve root compression. Hardcopies of 30 lumbar spinal MRI (containing a total of 150 disk levels) as well as MRM films were separately reviewed by two radiologists and a neurosurgeon. At each intervertebral disk, the observers were asked to evaluate the thecal sac for the presence and degree of spinal stenoses (mild, moderate, or severe) and presence of root canal compression. Interobserver agreement was measured using weighted kappa statistics. Regarding lumbar spinal canal stenosis, interobserver agreement between the two radiologists was moderate (kappa, 0.4) for MRI and good (kappa, 0.6) for combination with MRM. However, the agreement between the radiologist and neurosurgeon remained fair for MRI alone or in combination with MRM (kappa, 0.38 and 033, respectively). In the evaluation of nerve root compression, interobserver agreement between the radiologists improved from moderate (kappa, 0.57) for MRI to good (kappa, 0.73) after combination with MRM; moderate agreement between the radiologist and neurosurgeon was noted for both MRI alone and after combination with MRM (kappa, 0.58 and 0.56, respectively). Interobserver agreement in the evaluation of lumbar spinal canal stenosis and root compression between the radiologists improved when MRM was combined with MRI, relative to MRI alone.

  5. 20 CFR 411.321 - Under what conditions will SSA terminate an agreement with an EN due to inadequate performance?

    Code of Federal Regulations, 2010 CFR

    2010-04-01

    ... 20 Employees' Benefits 2 2010-04-01 2010-04-01 false Under what conditions will SSA terminate an agreement with an EN due to inadequate performance? 411.321 Section 411.321 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.321...

  6. 20 CFR 411.321 - Under what conditions will SSA terminate an agreement with an EN due to inadequate performance?

    Code of Federal Regulations, 2013 CFR

    2013-04-01

    ... 20 Employees' Benefits 2 2013-04-01 2013-04-01 false Under what conditions will SSA terminate an agreement with an EN due to inadequate performance? 411.321 Section 411.321 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.321 Under...

  7. 25 CFR 170.621 - What if a tribe fails to substantially perform work under a contract or agreement?

    Code of Federal Regulations, 2010 CFR

    2010-04-01

    ... 25 Indians 1 2010-04-01 2010-04-01 false What if a tribe fails to substantially perform work under a contract or agreement? 170.621 Section 170.621 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR LAND AND WATER INDIAN RESERVATION ROADS PROGRAM Service Delivery for Indian Reservation...

  8. Accountability under Constraint: The Relationship between Collective Bargaining Agreements and California Schools' and Districts' Performance under No Child Left Behind

    ERIC Educational Resources Information Center

    Strunk, Katharine O.; McEachin, Andrew

    2011-01-01

    The authors examine how the collective bargaining agreement (CBA) negotiated between teachers' unions and districts is associated with schools' and districts' performance under accountability pressures in California. They find that CBA restrictiveness is associated with the increased likelihood that districts will be in Program Improvement (PI)…

  9. 20 CFR 411.321 - Under what conditions will SSA terminate an agreement with an EN due to inadequate performance?

    Code of Federal Regulations, 2014 CFR

    2014-04-01

    ... 20 Employees' Benefits 2 2014-04-01 2014-04-01 false Under what conditions will SSA terminate an agreement with an EN due to inadequate performance? 411.321 Section 411.321 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.321 Under...

  10. 20 CFR 411.321 - Under what conditions will SSA terminate an agreement with an EN due to inadequate performance?

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... 20 Employees' Benefits 2 2012-04-01 2012-04-01 false Under what conditions will SSA terminate an agreement with an EN due to inadequate performance? 411.321 Section 411.321 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.321 Under...

  11. Accountability under Constraint: The Relationship between Collective Bargaining Agreements and California Schools' and Districts' Performance under No Child Left Behind

    ERIC Educational Resources Information Center

    Strunk, Katharine O.; McEachin, Andrew

    2011-01-01

    The authors examine how the collective bargaining agreement (CBA) negotiated between teachers' unions and districts is associated with schools' and districts' performance under accountability pressures in California. They find that CBA restrictiveness is associated with the increased likelihood that districts will be in Program Improvement (PI)…

  12. 20 CFR 411.321 - Under what conditions will SSA terminate an agreement with an EN due to inadequate performance?

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... 20 Employees' Benefits 2 2011-04-01 2011-04-01 false Under what conditions will SSA terminate an agreement with an EN due to inadequate performance? 411.321 Section 411.321 Employees' Benefits SOCIAL SECURITY ADMINISTRATION THE TICKET TO WORK AND SELF-SUFFICIENCY PROGRAM Employment Networks § 411.321...

  13. SEASAT SAR performance evaluation study

    NASA Technical Reports Server (NTRS)

    1982-01-01

    The performance of the SEASAT synthetic aperture radar (SAR) sensor was evaluated using data processed by the MDA digital processor. Two particular aspects are considered the location accuracy of image data, and the calibration of the measured backscatter amplitude of a set of corner reflectors. The image location accuracy was assessed by selecting identifiable targets in several scenes, converting their image location to UTM coordinates, and comparing the results to map sheets. The error standard deviation is measured to be approximately 30 meters. The amplitude was calibrated by measuring the responses of the Goldstone corner reflector array and comparing the results to theoretical values. A linear regression of the measured against theoretical values results in a slope of 0.954 with a correlation coefficient of 0.970.

  14. Agreement of clinical measurements of liver size with ultrasound when performed by medical students.

    PubMed

    Hunter, Selena A; Brimble, Justin; Weatherall, Mark; Galletly, Duncan C

    2014-11-07

    The accuracy of physical examination techniques in detecting liver disease is unclear. We sought to determine the perceived location of the lower liver border via scratch, percussion, palpation and ballottement with novice medical student examiners, compared with ultrasound localisation. Five novice medical students learnt four liver examination techniques and measured the lower liver border in 19 healthy volunteers. The difference between the examination technique and ultrasound (bias) and limits of agreement of each method were estimated by mixed linear models and shown using Bland-Altman- like plots. All techniques had similar bias for the lower liver border, between 1.6 and 1.9 cm superior to the ultrasound measurement. Percussion had the smallest variability with increasing liver size. Limits of agreement were wide for all techniques, smallest for palpation (6.04 cm) and largest for scratch (7.2 cm) compared to the mean liver distance of 8 cm. Conclusion There was no difference in bias between the scratch, percussion, palpation and ballottement techniques regarding the lower liver border. All techniques had very wide limits of agreement, although palpation had the smallest. Liver size examination by novice medical students in healthy subjects is unreliable. Further research is needed using examiners with a different level of expertise and participants of varying body habitus and confirmed liver disease.

  15. Evaluation of tests of maximum kicking performance.

    PubMed

    Markovic, G; Dizdar, D; Jaric, S

    2006-06-01

    Despite the important role of kicking in various athletic activities, the reliability of tests of maximum kicking performance has not been evaluated. The aim of the present study was to assess the reproducibility of performance of standing kick, instep kick and drop kick. Male physical education students (n=77) were tested on maximum kicking performance by means of a standard Doppler radar gun. The maximal ball speed in the standing kick, instep kick and drop kick (averaged across the subjects and trials) were 19.8+/-1.9 m s(-1), 26.7+/-2.7 m s(-1) and 25.3+/-2.2 m s(-1), respectively. There were no significant differences in the tested performances among the consecutive kicking trials of each test. The intraclass correlation coefficients ranged between 0.94 and 0.96 (95% confidence intervals 0.93-0.97). The limits of agreement for maximum ball speed in all three tests ranged from 0.2+/-1.4 m(-1) to 0.3+/-1.3 m s(-1), suggesting that in 95% of repeated trials the ball speed might be from 1.2 m s(-1) less to 1.6 m s(-1) greater than the original estimate. The coefficients of variation for all kicking tests were between 2.6% and 3.3% (95% confidence intervals; 2.2-3.9%) suggesting a low intra-subject variability. Due to a high reliability, relative simplicity, and a small number of participants needed to detect worthwhile changes, the evaluated kicking tests could be highly recommended for sport specific profiling and early selection of young athletes, as well as for the assessment of training procedures and other interventions applied on individual teams of elite soccer, rugby or American football players.

  16. [Perceptions of dental fluorosis and evaluation of agreement between parents and children: validation of a questionnaire].

    PubMed

    Furtado, Gabriela Eugênio de Sousa; Sousa, Maria da Luz Rosário de; Barbosa, Taís de Souza; Wada, Ronaldo Seichi; Martínez-Mier, Esperanza de los Angeles; Almeida, Maria Eneide Leitão de

    2012-08-01

    This study aimed to validate the Child's and Parent's Questionnaire about Teeth Appearance and to evaluate concerns relative to fluorosis among 213 pairs of parents and 12-year-old children from two regions of Brazil. Reliability was assessed by Cronbach's alpha and intraclass correlation coefficient, and construct and criterion validity by Spearman's correlations. Student t-test was used to compare the two regions and to assess parent/child agreement. Internal consistency was acceptable, and test-retest reliability was moderate to excellent. Perception of moderate to severe fluorosis and clinical data were significantly correlated, as were perception of fluorosis and subjects' concerns. Although parents from Rafael Arruda, Ceará State, showed a higher perception of fluorosis, parental concern was greater in Piracicaba, São Paulo State. Parents were more worried and dissatisfied with their children's dental appearance than the children themselves. This version of the questionnaire proved to be valid and reliable for assessing children's and parents' perceptions of dental fluorosis.

  17. [Evaluation of healthcare quality for acute cerebrovascular disease in the context of the service level agreement].

    PubMed

    Millán, Eduardo; Olascoaga Arrate, Adela; Garai, Idoia

    2009-04-01

    The service level agreement establishes the quality requirements for those services contracted by the Basque Government Health Department from Osakidetza-Servicio Vasco de Salud. Acute cerebrovascular disease (ACVD) is one of the care processes with quality specifications. To outline the procedure adopted to evaluate ACVD care and the results obtained in four hospitals in Vizcaya between 2003 and 2007. In 2003, a work group consisting of clinicians, hospital and quality assurance managers, and experts from the Regional Health Board chose a series of indicators which would be measured by an external auditor. This group reviews the results annually and sets objectives for the following financial year. The improvement in almost all the indicators has been significant, and those with high ratings from the beginning have maintained their level. The percentage of patients who had a CAT scan in the first six hours after arriving at hospital increased from 57% to 85%, and the administration of anticoagulants within 12 hours increased from 70% of cases to 90%. The fibrinolysis rate was 3.8% in two hospitals. The percentage of patients who began rehabilitation whilst admitted was less than 3%. After operating for five years, the procedure adopted, which involves collaboration between clinical, management and planning staff, has been shown to be viable and effective in improving the quality of ACVD care.

  18. Formative Evaluation in the Performance Context.

    ERIC Educational Resources Information Center

    Dick, Walter; King, Debby

    1994-01-01

    Reviews the traditional formative evaluation model used by instructional designers; summarizes Kirkpatrick's model of evaluation; proposes the integration of part of Kirkpatrick's model with traditional formative evaluation; and discusses performance-context formative evaluation. (three references) (LRW)

  19. Does evaluator experience have an impact on the diagnosis of lumbar spine instability in dynamic MRI? Interobserver agreement study.

    PubMed

    Patriarca, Lucia; Letteriello, Mayla; Di Cesare, Ernesto; Barile, Antonio; Gallucci, Massimo; Splendiani, Alessandra

    2015-06-01

    We aimed to evaluate interobserver agreement in the definition of spine instability among spine neuroradiologists with or without experience in dynamic magnetic resonance imaging (MRI). Two expert neuroradiologists and two residents retrospectively evaluated the pre-operative dynamic MRI examinations of patients with vertebral instability. Segmental motion, defined as excessive (more than 3 mm) translational motion from supine to upright, was investigated in 103 subjects (309 segments) using kinetic MRI. Radiographic parameters which can help indicate segmental instability include disc degeneration, facet joint osteoarthritis, and ligament flavum hypertrophy. These three radiographic parameters were simultaneously evaluated, and the combinations corresponding to significant segmental instability at each level were determined. The agreement among the neuroradiologists was calculated using the kappa coefficient. All patients had neurosurgical intervention to stabilize the spine. Agreement was high among experienced and non-experienced neuroradiologists. Agreement was nearly perfect for spinal location of spinal instability. This study demonstrates that the experience of the evaluator has a low impact on the assessment of spinal instability if correct classification is used. The interobserver agreement confirms the usefulness and safety of kinetic MRI in the correct diagnosis of spinal instability even by less experienced evaluators. © The Author(s) 2015.

  20. Evaluation of agreement in corneal thickness measurements obtained using optical coherence tomography and ultrasound technique and determination of its specificity in keratoconus screening

    NASA Astrophysics Data System (ADS)

    Gunvant, P.; Darner, R.

    2011-03-01

    The aims of the present study are 1) to evaluate inter and intra observer repeatability of optical coherence tomography corneal thickness measurements 2) to investigate the agreement in corneal thickness obtained using an ultrasound pachymeter and the non-contact high resolution optical coherence tomography 3) to evaluate the false positive rate of identifying keratoconic suspects on the basis of standard machine protocol. Measurements were performed on 51 eyes of 51 individuals without any known corneal pathology. Altman and Bland plots were analyzed to determine agreement of corneal thickness measurements obtained using optical coherence tomography and ultrasound pachymeter; linear regression analysis was performed to evaluate its interchangeability. The agreement between the optical coherence tomography and ultrasonic pachymeter measurements was best for the central corneal thickness with a mean bias of 13.4 microns, with optical coherence tomography values being lower than the ultrasound pachymeter. The agreement of measurements in the mid-peripheral cornea was poor, with bias in measurements ranging from 33 to 55 microns. The optical coherence tomography measurements were repeatable with no differences in values between intra and inter observer repeat measurements. Using standard machine protocol for keratoconus screening, utilizing 1 out of 4 criteria gave a specificity of 86% and using 2 of the 4 criteria gave a specificity of 98%.

  1. 48 CFR 2936.604 - Performance evaluation.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 48 Federal Acquisition Regulations System 7 2011-10-01 2011-10-01 false Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor performance as required in FAR 36.604. Normally, the performance report must be prepared by the...

  2. Performance Evaluation of the United Nations Environment ...

    EPA Pesticide Factsheets

    A request for technical collaboration between the UNEP and the US EPA resulted in the establishment of a MCRADA. The purpose of this agreement was to evaluate an air quality monitoring system (referred to as the UNEP pod) developed by the UNEP for use in environmental situations where more sophisticated monitoring instrumentation was not available. The US EPA has conducted numerous evaluations of other similar sensor pods at its Research Triangle Park, NC research campus and has trained staff as well as established research designs for such efforts. Under the terms of the MCRADA, the US EPA would operate the pod using UNEP provided operating procedures in a manner consistent with its planned intent of deployment. The US EPA would collect air quality monitoring data from the pod involving select environmental measures over a period of approximately one month. Reference monitoring data collected from collocated federal regulatory monitors would be used to establish a comparison between the two systems and thus establishment of performance characteristics. In addition, the US EPA would provide feedback information to the UNEP as to observed ease of use features of the pod that would be beneficial in its future evolution and deployment. The UNEP recently developed a multipollutant sensor pod called the UNEP Air Quality Monitoring Unit, herein simply defined as the UNEP pod (http://aqicn.org/faq/2015-10-28/unep-air-quality-monitoring-station/). First introduced in 20

  3. Final report of the NRC-Agreement State Working Group to evaluate control and accountability of licensed devices

    SciTech Connect

    1996-10-01

    US NRC staff acknowledged that licensees were having problems maintaining control over and accountability for devices containing radioactive material. In June 1995, NRC approved the staff`s suggestion to form a joint NRC-Agreement State Working Group to evaluate the problem and propose solutions. The staff indicated that the Working Group was necessary to address the concerns from a national perspective, allow for a broad level of Agreement State input, and to reflect their experience. Agreement State participation in the process was essential since some Agreement States have implemented effective programs for oversight of device users. This report includes the 5 recommendations proposed by the Working Group to increase regulatory oversight, increase control and accountability of devices, ensure proper disposal, and ensure disposal of orphaned devices. Specifically, the Working Group recommends that: (1) NRC and Agreement States increase regulatory oversight for users of certain devices; (2) NRC and Agreement State impose penalties on persons losing devices; (3) NRC and Agreement States ensure proper disposal of orphaned devices; (4) NRC encourage States to implement similar oversight programs for users of Naturally-Occurring or Accelerator- Produced Material; and (5) NRC encourage non-licensed stakeholders to take appropriate actions, such as instituting programs for material identification.

  4. [Agreement between Clinical Evaluation and Structured Clinical Interviews in Psychosomatic Inpatients].

    PubMed

    Reichert, Cornelia; Henniger, Stephan; Jäger, Burkard; de Zwaan, Martina

    2015-05-01

    The goal of this study was to determine the agreement between axis I mental disorders assessed with a structured clinical interview (SCID) and independently obtained non-structured clinical diagnoses in 185 psychosomatic in-patients. Additionally, the study focuses on the detection of potential predictors for the level of agreement. Diagnostic agreement was poor to moderate for the mood, anxiety and somatoform disorder cluster (κ = 0.293-0.444). Only for eating disorders an almost complete concordance could be found (κ = 0.812). The predictor analysis indicated a significant positive association between the comorbidity rate and the agreement in mood disorders. Furthermore, the diagnostic agreement of anxiety disorders was significantly higher for female than for male patients. These results reveal that even a team-based clinical diagnosis, assessed over the period of a hospital stay, shows little agreement with SCID-diagnoses. The predictor analysis as well as the poor correlation in 3 of 4 diagnostic clusters suggest that conceptual differences of the disorder criteria as well as their clinical interpretation might influence the concordance between diagnoses. Further studies focusing on methodical factors might reveal further insights to the cause of the diagnostic discrepancies. © Georg Thieme Verlag KG Stuttgart · New York.

  5. Ocular Motor Score (OMS): a clinical tool to evaluating ocular motor functions in children. Intrarater and inter-rater agreement.

    PubMed

    Olsson, Monica; Teär Fahnehjelm, Kristina; Rydberg, Agneta; Ygge, Jan

    2015-08-01

    Ocular motor score (OMS) is a new clinical test protocol for evaluating ocular motor functions in children and young adults. OMS is a set of 15 important and relevant non-invasive ocular motor function parameters derived from clinical practice. The aim of the study was to evaluate OMS according to intrarater and inter-rater agreement. Forty children aged 4-10 years, 23 girls median age 6.5 (range 4.3-9.3) and 17 boys median age 5.8 (range 4.1-9.8) were included. The ocular motor functions were assessed and scored according to the OMS protocol. The examinations were videotaped. To obtain the intrarater agreement, the first author examined and scored the children twice, first in the clinic and 2 weeks later by watching the videotape. To obtain the inter-rater agreement, three other raters independently scored the ocular motor function of the children by watching the videotapes. The overall observed intrarater agreement was 88%, and the observed inter-rater agreement between the three raters was 80%. For none of the subtests was there an observed intrarater agreement lower than 65%. Three of the subtests had an observed inter-rater agreement of 65% or below. Overall there was high observed intra- and inter-rater agreement for the OMS test protocol. Subtests such as saccades and smooth pursuit were more difficult for raters to score similarly according the clinical OMS test protocol. © 2015 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

  6. Improving performance and agreement in injury coding using the Abbreviated Injury Scale: a training course helps.

    PubMed

    Joosse, Pieter; de Jongh, Mariska A C; van Delft-Schreurs, C C H M Katinka; Verhofstad, Michiel H J; Goslings, J Carel

    2014-01-01

    The aim of this study was to determine the influence of a dedicated training course on the ability of participants to assign correct codes and their inter-observer agreement using the Abbreviated Injury Scale (AIS98). Twelve participants followed a one-day training course in injury coding. Codes were recorded before, during and after the course. The number of correctly assigned codes and severity codes, as well as the Fleiss' kappas improved significantly during and after the course. This study emphasises the benefit of training in injury coding. Training improves the ability to assign correct codes and it reduces inter-observer variability. We advise all who are involved in injury coding to follow a dedicated training course.

  7. Does interrater (dis)agreement on Psychopathy Checklist scores in sexually violent predator trials suggest partisan allegiance in forensic evaluations?

    PubMed

    Murrie, Daniel C; Boccaccini, Marcus T; Johnson, Jeremy T; Janke, Chelsea

    2008-08-01

    Many studies reveal strong interrater agreement for Hare's Psychopathy Checklist-Revised (PCL-R) when used by trained raters in research contexts. However, no systematic research has examined agreement between PCL-R scores from independent clinicians who are retained by opposing sides in adversarial legal proceedings. We reviewed all 43 sexual-offender civil-commitment trials in one state and identified 23 cases in which opposing evaluators reported PCL-R total scores for the same individual. Differences between scores from opposing evaluators were usually in a direction that supported the party who retained their services. These score differences were greater in size than would be expected based on the instrument's standard error of measurement or the rater agreement values reported in previous PCL-R research. The intraclass correlation for absolute agreement for the PCL-R Total score from a single rater (ICC 1,A = .39) was well below levels of agreement observed for the PCL-R in research contexts, and below published test-retest values for the PCL-R. Results raise concerns about the potential for a forensic evaluator's "partisan allegiance" to influence PCL-R scores in adversarial proceedings.

  8. Energy performance evaluation of AAC

    NASA Astrophysics Data System (ADS)

    Aybek, Hulya

    The U.S. building industry constitutes the largest consumer of energy (i.e., electricity, natural gas, petroleum) in the world. The building sector uses almost 41 percent of the primary energy and approximately 72 percent of the available electricity in the United States. As global energy-generating resources are being depleted at exponential rates, the amount of energy consumed and wasted cannot be ignored. Professionals concerned about the environment have placed a high priority on finding solutions that reduce energy consumption while maintaining occupant comfort. Sustainable design and the judicious combination of building materials comprise one solution to this problem. A future including sustainable energy may result from using energy simulation software to accurately estimate energy consumption and from applying building materials that achieve the potential results derived through simulation analysis. Energy-modeling tools assist professionals with making informed decisions about energy performance during the early planning phases of a design project, such as determining the most advantageous combination of building materials, choosing mechanical systems, and determining building orientation on the site. By implementing energy simulation software to estimate the effect of these factors on the energy consumption of a building, designers can make adjustments to their designs during the design phase when the effect on cost is minimal. The primary objective of this research consisted of identifying a method with which to properly select energy-efficient building materials and involved evaluating the potential of these materials to earn LEED credits when properly applied to a structure. In addition, this objective included establishing a framework that provides suggestions for improvements to currently available simulation software that enhance the viability of the estimates concerning energy efficiency and the achievements of LEED credits. The primary objective

  9. Evaluating GC/MS Performance

    SciTech Connect

    Alcaraz, A; Dougan, A

    2006-11-26

    and Water Check': By selecting View - Diagnostics/Vacuum Control - Vacuum - Air and Water Check. A Yes/No dialogue box will appear; select No (use current values). It is very important to select No! Otherwise the tune values are drastically altered. The software program will generate a water/air report similar to figure 3. Evaluating the GC/MS system with a performance standard: This procedure should allow the analyst to verify that the chromatographic column and associated components are working adequately to separate the various classes of chemical compounds (e.g., hydrocarbons, alcohols, fatty acids, aromatics, etc.). Use the same GC/MS conditions used to collect the system background and solvent check (part 1 of this document). Figure 5 is an example of a commercial GC/MS column test mixture used to evaluate GC/MS prior to analysis.

  10. 48 CFR 36.604 - Performance evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL... Performance evaluation. See 42.1502(f) for the requirements for preparing past performance evaluations for...

  11. 13 CFR 304.4 - Performance evaluations.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... 13 Business Credit and Assistance 1 2011-01-01 2011-01-01 false Performance evaluations. 304.4... ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the management standards, financial accountability and program performance of each District Organization within three...

  12. Agreement between Therapists, Parents, Patients, and Independent Evaluators on Clinical Improvement in Pediatric Obsessive-Compulsive Disorder

    ERIC Educational Resources Information Center

    Lewin, Adam B.; Peris, Tara S.; De Nadai, Alessandro S.; McCracken, James T.; Piacentini, John

    2012-01-01

    Objective: Independent evaluators (IE) are used widely in clinical trials to make unbiased determinations of treatment response. By virtue of being kept blind to treatment condition, however, IEs are also kept unaware of many pertinent clinical details that are relevant for decisions about clinical improvement. In this study, agreement among…

  13. Agreement between Therapists, Parents, Patients, and Independent Evaluators on Clinical Improvement in Pediatric Obsessive-Compulsive Disorder

    ERIC Educational Resources Information Center

    Lewin, Adam B.; Peris, Tara S.; De Nadai, Alessandro S.; McCracken, James T.; Piacentini, John

    2012-01-01

    Objective: Independent evaluators (IE) are used widely in clinical trials to make unbiased determinations of treatment response. By virtue of being kept blind to treatment condition, however, IEs are also kept unaware of many pertinent clinical details that are relevant for decisions about clinical improvement. In this study, agreement among…

  14. 7 CFR 70.78 - Fees or charges for grading service performed under cooperative agreement.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... INSPECTION ACT (CONTINUED) VOLUNTARY GRADING OF POULTRY PRODUCTS AND RABBIT PRODUCTS Grading of Poultry Products and Rabbit Products Fees and Charges § 70.78 Fees or charges for grading service performed...

  15. 7 CFR 70.78 - Fees or charges for grading service performed under cooperative agreement.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... INSPECTION ACT (CONTINUED) VOLUNTARY GRADING OF POULTRY PRODUCTS AND RABBIT PRODUCTS Grading of Poultry Products and Rabbit Products Fees and Charges § 70.78 Fees or charges for grading service performed under...

  16. 7 CFR 70.78 - Fees or charges for grading service performed under cooperative agreement.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... INSPECTION ACT (CONTINUED) VOLUNTARY GRADING OF POULTRY PRODUCTS AND RABBIT PRODUCTS Grading of Poultry Products and Rabbit Products Fees and Charges § 70.78 Fees or charges for grading service performed...

  17. 7 CFR 70.78 - Fees or charges for grading service performed under cooperative agreement.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... INSPECTION ACT (CONTINUED) VOLUNTARY GRADING OF POULTRY PRODUCTS AND RABBIT PRODUCTS Grading of Poultry Products and Rabbit Products Fees and Charges § 70.78 Fees or charges for grading service performed...

  18. 7 CFR 70.78 - Fees or charges for grading service performed under cooperative agreement.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... INSPECTION ACT (CONTINUED) VOLUNTARY GRADING OF POULTRY PRODUCTS AND RABBIT PRODUCTS Grading of Poultry Products and Rabbit Products Fees and Charges § 70.78 Fees or charges for grading service performed...

  19. Performance and agreement of risk stratification instruments for postoperative delirium in persons aged 50 years or older.

    PubMed

    Jansen, Carolien J; Absalom, Anthony R; de Bock, Geertruida H; van Leeuwen, Barbara L; Izaks, Gerbrand J

    2014-01-01

    Several risk stratification instruments for postoperative delirium in older people have been developed because early interventions may prevent delirium. We investigated the performance and agreement of nine commonly used risk stratification instruments in an independent validation cohort of consecutive elective and emergency surgical patients aged ≥50 years with ≥1 risk factor for postoperative delirium. Data was collected prospectively. Delirium was diagnosed according to DSM-IV-TR criteria. The observed incidence of postoperative delirium was calculated per risk score per risk stratification instrument. In addition, the risk stratification instruments were compared in terms of area under the receiver operating characteristic (ROC) curve (AUC), and positive and negative predictive value. Finally, the positive agreement between the risk stratification instruments was calculated. When data required for an exact implementation of the original risk stratification instruments was not available, we used alternative data that was comparable. The study population included 292 patients: 60% men; mean age (SD), 66 (8) years; 90% elective surgery. The incidence of postoperative delirium was 9%. The maximum observed incidence per risk score was 50% (95%CI, 15-85%); for eight risk stratification instruments, the maximum observed incidence per risk score was ≤25%. The AUC (95%CI) for the risk stratification instruments varied between 0.50 (0.36-0.64) and 0.66 (0.48-0.83). No AUC was statistically significant from 0.50 (p≥0.11). Positive predictive values of the risk stratification instruments varied between 0-25%, negative predictive values between 89-95%. Positive agreement varied between 0-66%. No risk stratification instrument showed clearly superior performance. In conclusion, in this independent validation cohort, the performance and agreement of commonly used risk stratification instruments for postoperative delirium was poor. Although some caution is needed

  20. How Successful Is Performance Evaluation?

    ERIC Educational Resources Information Center

    Gray, Frank

    We should no longer be wondering if we should have performance appraisal, rather we should be researching the elements necessary for it to be successfully implemented and to ensure that we receive maximum benefits for improved learning for our students. Performance appraisal can be defined as "a positive, systematic, individualized due…

  1. A Proposed RTN Officer Performance Evaluation System

    DTIC Science & Technology

    1989-12-01

    studiod at the Naval Postpraduate School and practical theories relating to personnel management and performance evaluation. 4 The research method includes...various systems are discussed as the researcher perceives them. The fact that there is probably no agreed upon, fool-proof method of evaluating an...Performance Evaluation System. The research methodology Includes the following three componen: (1) a study of pertinent performance evaluation

  2. 75 FR 52010 - Land and Water Conservation Fund Description and Notification, Performance Reports, Agreements...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-08-24

    ... National Park Service Land and Water Conservation Fund Description and Notification, Performance Reports... copy of the ICR packages free of charge. SUPPLEMENTARY INFORMATION: The Land and Water Conservation... Form Title: Land and Water Conservation Fund Description and Notification Form. OMB Control...

  3. Measuring agreement between rating interpretations and binary clinical interpretations of images: a simulation study of methods for quantifying the clinical relevance of an observer performance paradigm

    NASA Astrophysics Data System (ADS)

    Chakraborty, Dev P.

    2012-05-01

    Laboratory receiver operating characteristic (ROC) studies, that are often used to evaluate medical imaging systems, differ from ‘live’ clinical interpretations in several respects which could compromise their clinical relevance. The aim was to develop methodology for quantifying the clinical relevance of a laboratory ROC study. A simulator was developed to generate ROC ratings data and binary clinical interpretations classified as correct or incorrect for a common set of images interpreted under clinical and laboratory conditions. The area under the trapezoidal ROC curve (AUC) was used as the laboratory figure-of-merit and the fraction of correct clinical decisions as the clinical figure-of-merit. Conventional agreement measures (Pearson, Spearman, Kendall and kappa) between the bootstrap-induced fluctuations of the two figures of merit were estimated. A jackknife pseudovalue transformation applied to the figures of merit was also investigated as a way to capture agreement existing at the individual image level that could be lost at the figure-of-merit level. It is shown that the pseudovalues define a relevance-ROC curve. The area under this curve (rAUC) measures the ability of the laboratory figure-of-merit-based pseudovalues to correctly classify incorrect versus correct clinical interpretations. Therefore, rAUC is a measure of the clinical relevance of an ROC study. The conventional measures and rAUC were compared under varying simulator conditions. It was found that design details of the ROC study, namely the number of bins, the difficulty level of the images, the ratio of disease-present to disease-absent images and the unavoidable difference between laboratory and clinical performance levels, can lead to serious underestimation of the agreement as indicated by conventional agreement measures, even for perfectly correlated data, while rAUC showed high agreement and was relatively immune to these details. At the same time rAUC was sensitive to factors such

  4. Measuring agreement between rating interpretations and binary clinical interpretations of images: a simulation study of methods for quantifying the clinical relevance of an observer performance paradigm.

    PubMed

    Chakraborty, Dev P

    2012-05-21

    Laboratory receiver operating characteristic (ROC) studies, that are often used to evaluate medical imaging systems, differ from 'live' clinical interpretations in several respects which could compromise their clinical relevance. The aim was to develop methodology for quantifying the clinical relevance of a laboratory ROC study. A simulator was developed to generate ROC ratings data and binary clinical interpretations classified as correct or incorrect for a common set of images interpreted under clinical and laboratory conditions. The area under the trapezoidal ROC curve (AUC) was used as the laboratory figure-of-merit and the fraction of correct clinical decisions as the clinical figure-of-merit. Conventional agreement measures (Pearson, Spearman, Kendall and kappa) between the bootstrap-induced fluctuations of the two figures of merit were estimated. A jackknife pseudovalue transformation applied to the figures of merit was also investigated as a way to capture agreement existing at the individual image level that could be lost at the figure-of-merit level. It is shown that the pseudovalues define a relevance-ROC curve. The area under this curve (rAUC) measures the ability of the laboratory figure-of-merit-based pseudovalues to correctly classify incorrect versus correct clinical interpretations. Therefore, rAUC is a measure of the clinical relevance of an ROC study. The conventional measures and rAUC were compared under varying simulator conditions. It was found that design details of the ROC study, namely the number of bins, the difficulty level of the images, the ratio of disease-present to disease-absent images and the unavoidable difference between laboratory and clinical performance levels, can lead to serious underestimation of the agreement as indicated by conventional agreement measures, even for perfectly correlated data, while rAUC showed high agreement and was relatively immune to these details. At the same time rAUC was sensitive to factors such as

  5. Successful associateship agreements.

    PubMed

    Crafton, B C

    1997-08-01

    When evaluating potential associateship agreements, dentists need to recognize and understand how status, noncompete clauses, scheduling and compensation affect the strength of an associateship agreement. Dentists should not enter an associateship agreement without fully understanding the agreement and its obligations or without the help of an accountant and an attorney.

  6. Performance evaluation of IVC systems.

    PubMed

    Brandstetter, H; Scheer, M; Heinekamp, C; Gippner-Steppert, C; Loge, O; Ruprecht, L; Thull, B; Wagner, R; Wilhelm, P; Scheuber, H-P

    2005-01-01

    An expert Working Group was set up in December 2000 to develop recommendations for users and industry on the evaluation of proper function and operation of individually ventilated cage (IVC) systems. The full report of their recommendations is in two parts--'Part 1: Test Instructions' and 'Part 2: Evaluation Criteria'--both of which have been published in full on the Laboratory Animals Ltd website. They can be found at http://www.lal.org.uk/IVC/index.html. Evaluation of and feedback on the recommendations to further refine their use and scientific basis is encouraged. This Summary Report provides a brief overview of the background to the development of the full report and the issues it addresses.

  7. Evaluation of agreement between temporal series obtained from electrocardiogram and pulse wave.

    NASA Astrophysics Data System (ADS)

    Leikan, GM; Rossi, E.; Sanz, MCuadra; Delisle Rodríguez, D.; Mántaras, MC; Nicolet, J.; Zapata, D.; Lapyckyj, I.; Siri, L. Nicola; Perrone, MS

    2016-04-01

    Heart rate variability allows to study the cardiovascular autonomic nervous system modulation. Usually, this signal is obtained from the electrocardiogram (ECG). A simpler method for recording the pulse wave (PW) is by means of finger photoplethysmography (PPG), which also provides information about the duration of the cardiac cycle. In this study, the correlation and agreement between the time series of the intervals between heartbeats obtained from the ECG with those obtained from the PPG, were studied. Signals analyzed were obtained from young, healthy and resting subjects. For statistical analysis, the Pearson correlation coefficient and the Bland and Altman limits of agreement were used. Results show that the time series constructed from the PW would not replace the ones obtained from ECG.

  8. 48 CFR 2936.604 - Performance evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... CONTRACTING REQUIREMENTS CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 2936.604 Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor... reports must be made using Standard Form 1421, Performance Evaluation (Architect-Engineer) as...

  9. 13 CFR 304.4 - Performance evaluations.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Performance evaluations. 304.4 Section 304.4 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION, DEPARTMENT OF COMMERCE ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the...

  10. Improving Teacher Performance through Evaluation and Supervision.

    ERIC Educational Resources Information Center

    Drake, Jackson M.

    To guarantee an efficient educational system, effective evaluation and supervision of teacher performance are necessary. However, the evaluation of teacher performance presents two major problems: first, no clear definition or measure of effective teaching exists, and second, evaluation is perceived to have conflicting purposes, either as a…

  11. [Inter-observes agreement of Ishak and Metavir scores in histological evaluation of chronic viral hepatitis B and C].

    PubMed

    Rammeh, Soumaya; Khadra, Hajer Ben; Znaidi, Nadia Sabbegh; Romdhane, Neila Attia; Najjar, Taoufik; Bouzaidi, Slim; Zermani, Rachida

    2014-01-01

    Many classification systems are currently used for histological evaluation of the severity of chronic viral hepatitis, including the Ishak and Metavir scores, but there is not a consensus classification. The objective of this work was to study the intra and inter-observers agreement of these two scores in the histopathological analysis of liver biopsies in patients with chronic viral hepatitis B or C. Fifty nine patients were included in the study, 26 had chronic hepatitis C and 33 had chronic hepatitis B. To investigate the inter-observers agreement, the liver biopsies were analyzed separately by two pathologists without prior consensus reading. The two pathologists conducted then a consensual reading before reviewing all cases independently. Cohen's kappa coefficient was calculated and in case of asymmetry Spearman's rho coefficient. Before the consensus reading, the agreement was moderate for the analysis of histological activity with both scores (Metavir: kappa=0.41, Ishak: rho=0.58). For the analysis of fibrosis, the agreement was good with both scores (Metavir: kappa=0.61, Ishak: rho=0.86). The consensus reading has improved the reproducibility of the activity that has become good with both scores (Metavir: kappa=0.77, Ishak: rho=0.76). For fibrosis improvement was observed with the Ishak score which agreement became excellent (kappa=0.81). In conclusion, we recommend in routine practice, a combined score: Metavir for activity and Ishak for fibrosis and to make a double reading for each biopsy.

  12. Consistency in Piano Performance Evaluation.

    ERIC Educational Resources Information Center

    Wapnick, Joel; And Others

    1993-01-01

    Reports on a study of the use of musical scores and rating scales by 80 pianists who listened to 21 trials of solo piano music. Found that the use of musical scores and rating scales did not improve interrater reliability. Discovered that the subjects were less consistent when evaluating slow musical pieces than faster pieces. (CFR)

  13. Performance evaluation of generalized MSK

    NASA Astrophysics Data System (ADS)

    Galko, P.; Pasupathy, S.

    The computation of the performance of several optimal and suboptimal receivers for generalized MSK is discussed. The optimal receivers considered are Viterbi receivers and the optimal receivers based on a finite observation interval. Two suboptimal receivers, (1) optimized linear receivers based on finite observation intervals and (2) linear receivers based on approximating generalized MSK as an OQPSK signal, are considered as well. It is shown that the former receiver's performance may be computed exactly, while for the latter receiver it is possible to provide arbitrarily tight bounds on the performance. These analyses are illustrated by application to the two popular generalized MSK schemes of duobinary MSK (or FSOQ) and (1 + D)squared/4 MSK.

  14. 48 CFR 236.604 - Performance evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ..., DEPARTMENT OF DEFENSE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 236.604 Performance evaluation. (a) Preparation of performance reports. Use DD Form 2631, Performance Evaluation (Architect-Engineer), instead of SF 1421. (2) Prepare a...

  15. Comparative measurement of collagen bundle orientation by Fourier analysis and semiquantitative evaluation: reliability and agreement in Masson's trichrome, Picrosirius red and confocal microscopy techniques.

    PubMed

    Marcos-Garcés, V; Harvat, M; Molina Aguilar, P; Ferrández Izquierdo, A; Ruiz-Saurí, A

    2017-08-01

    Measurement of collagen bundle orientation in histopathological samples is a widely used and useful technique in many research and clinical scenarios. Fourier analysis is the preferred method for performing this measurement, but the most appropriate staining and microscopy technique remains unclear. Some authors advocate the use of Haematoxylin-Eosin (H&E) and confocal microscopy, but there are no studies comparing this technique with other classical collagen stainings. In our study, 46 human skin samples were collected, processed for histological analysis and stained with Masson's trichrome, Picrosirius red and H&E. Five microphotographs of the reticular dermis were taken with a 200× magnification with light microscopy, polarized microscopy and confocal microscopy, respectively. Two independent observers measured collagen bundle orientation with semiautomated Fourier analysis with the Image-Pro Plus 7.0 software and three independent observers performed a semiquantitative evaluation of the same parameter. The average orientation for each case was calculated with the values of the five pictures. We analyzed the interrater reliability, the consistency between Fourier analysis and average semiquantitative evaluation and the consistency between measurements in Masson's trichrome, Picrosirius red and H&E-confocal. Statistical analysis for reliability and agreement was performed with the SPSS 22.0 software and consisted of intraclass correlation coefficient (ICC), Bland-Altman plots and limits of agreement and coefficient of variation. Interrater reliability was almost perfect (ICC > 0.8) with all three histological and microscopy techniques and always superior in Fourier analysis than in average semiquantitative evaluation. Measurements were consistent between Fourier analysis by one observer and average semiquantitative evaluation by three observers, with an almost perfect agreement with Masson's trichrome and Picrosirius red techniques (ICC > 0.8) and a strong

  16. Evaluation of the activity of rheumatoid arthritis in clinical practice. Agreement between self-rated clinimetric evaluation and clinical evaluation with activity indexes: DAS28, CDAI and SDAI.

    PubMed

    Horta-Baas, Gabriel; Pérez Bolde-Hernández, Arturo; Hernández-Cabrera, María Fernanda; Vergara-Sánchez, Imelda; Romero-Figueroa, María Del Socorro

    2017-10-11

    To achieve control of rheumatoid arthritis (RA) it is necessary to be able to evaluate its activity. The American College of Rheumatology (ACR) recommends for this purpose indexes of activity that can be performed by the patient (PAS-II and RAPID-3) and IA including medical evaluation with laboratory studies (DAS28 and SDAI) or without them (CDAI). The objective was to analyze the concordance between self-rated clinimetric evaluation and clinimetric evaluation performed by the physician. Analytical cross-sectional study in 126 patients with RA. The agreement was evaluated through the weighted κ coefficient and the Krippendorff's α coefficient. The PAS-II and RAPID-3 significantly correlated with all variables included in the core set of measures recommended by the ACR/EULAR. The agreement between PAS-II and CDAI-SDAI was good (κ: 0.6, α: 0.61-0.62), and moderate with DAS28-ESR (κ: 0.53, α: 0.56). The concordance between RAPID-3 and CDAI-SDAI was moderate (κ: 0.55-0.57, α: 0.50-0.51), and moderate with DAS28-ESR (κ: 0.55, α: 0.53). When categorizing the activity in remission/low activity vs. moderate/severe activity, the agreement was greater with the PAS-II (0.59 vs. 0.34; P=.012). The good concordance between PAS-II and SDAI supports their use in clinical practice, especially if biomarkers of inflammation or the possibility of joint count are not available. However, in order to recommend its routine application in clinical practice, it is necessary to perform longitudinal studies that assess its responsiveness. Copyright © 2017 Elsevier España, S.L.U. All rights reserved.

  17. Evaluating judge performance in sport.

    PubMed

    Looney, Marilyn A

    2004-01-01

    Many sports, such as, gymnastics, diving, ski jumping, and figure skating, use judges' scores to determine the winner of a competition. These judges use some type of rating scale when judging performances (e.g., figure skating: 0.0 - 6.0). Sport governing bodies have the responsibility of setting and enforcing quality control parameters for judge performance. Given the judging scandals in figure skating at the 1998 and 2002 Olympics, judge performance in sport is receiving greater scrutiny. The purpose of this article is to illustrate how results from Rasch analyses can be used to provide in-depth feedback to judges about their scoring patterns. Nine judges' scores for 20 pairs of figure skaters who competed at the 2002 Winter Olympics were analyzed using a four-faceted (skater pair ability, skating aspect difficulty, program difficulty, and judge severity) Rasch rating scale model that was not common to all judges. Fit statistics, the logical ordering of skating aspects, skating programs, and separation indices all indicated a good fit of the data to the model. The type of feedback that can be given to judges about their scoring pattern was illustrated for one judge (USA) whose performance was flagged as being unpredictable. Feedback included a detailed description of how the rating scale was used; for example, 10% of all marks given by the American judge were unexpected by the model (Z > |2|). Three figures illustrated differences between the judge's observed and expected marks arranged according to the pairs' skating order and final placement in the competition. Scores which may represent "nationalistic bias" or a skating order influence were flagged by looking at these figures. If sport governing bodies wish to improve the performance of their judges, they need to employ methods that monitor the internal consistency of each judge as a many-facet Rasch analysis does.

  18. Inter-observer agreement on a checklist to evaluate scientific publications in the field of animal reproduction.

    PubMed

    Simoneit, Céline; Heuwieser, Wolfgang; Arlt, Sebastian P

    2012-01-01

    This study's objective was to determine respondents' inter-observer agreement on a detailed checklist to evaluate three exemplars (one case report, one randomized controlled study without blinding, and one blinded, randomized controlled study) of the scientific literature in the field of bovine reproduction. Fourteen international scientists in the field of animal reproduction were provided with the three articles, three copies of the checklist, and a supplementary explanation. Overall, 13 responded to more than 90% of the items. Overall repeatability between respondents using Fleiss's κ was 0.35 (fair agreement). Combining the "strongly agree" and "agree" responses and the "strongly disagree" and "disagree" responses increased κ to 0.49 (moderate agreement). Evaluation of information given in the three articles on housing of the animals (35% identical answers) and preconditions or pretreatments (42%) varied widely. Even though the overall repeatability was fair, repeatability concerning the important categories was high (e.g., level of agreement=98%). Our data show that the checklist is a reasonable and practical supporting tool to assess the quality of publications. Therefore, it may be used in teaching and practicing evidence-based veterinary medicine. It can support training in systematic and critical appraisal of information and in clinical decision making.

  19. A new performance evaluation tool

    SciTech Connect

    Kindl, F.H.

    1996-12-31

    The paper describes a Steam Cycle Diagnostic Program (SCDP), that has been specifically designed to respond to the increasing need of electric power generators for periodic performance monitoring, and quick identification of the causes for any observed increase in fuel consumption. There is a description of program objectives, modeling and test data inputs, results, underlying program logic, validation of program accuracy by comparison with acceptance test quality data, and examples of program usage.

  20. GPS User Equipment Performance Evaluation.

    DTIC Science & Technology

    1979-11-01

    Unit Device Controller Assembly ( UDCA ) * Satellite Signal Generator Assembly (SSGA) • Dynanic Frequency Synthesizer Assembly (DFSA) * Jamming...Post Run Data (PR)) under operator control. The UDCA performs the following primary functions: * Receive digital data from I)I’A, buffer and transfer to...collected by the 1IJKA, reformatted, and sent to the I)IA, and vice versa, via a data bus interface. The UDCA consists of the following elcliiti S

  1. Lubricant Evaluation and Performance 2

    DTIC Science & Technology

    1994-02-01

    POWER DIRECTORATE WRIGHT LABORATORY AIR FORCE MATERIEL COMMAND WRIGHT-PATrERSON AIR FORCE BASE , OHIO 45433-7103 94 5 10 011 NOTICE When government...INTRODUCTION I R DEVELOPMENT OF IMPROVED METHODS FOR MEASURING LUBRICANT PERFORMANCE 3 1 OXIDATIVE STABILITY OF ESTER BASE LUBRICANTS 3 a. Introduction 3 b...7) Conclusions 134 i. Stability Testing of Cyclophosphazene Based Fluids 134 (1) Introduction 134 (2) Effect of Metal Specimens 134 (3) Effect of a

  2. The polar bear management agreement for the southern Beaufort Sea: an evaluation of the first ten years of a unique conservation agreement

    USGS Publications Warehouse

    Brower, C.D.; Carpenter, A.; Branigan, M.L.; Calvert, W.; Evans, T.; Fischbach, A.S.; Nagy, J.A.; Schliebe, S.; Stirling, I.

    2002-01-01

    Polar bears (Ursus maritimus) of the southern Beaufort Sea population, distributed from approximately Icy Cape, west of Point Barrow, to Pearce Point, east of Paulatuk in Canada, are harvested by hunters from both countries. In Canada, quotas to control polar bear hunting have been in place, with periodic modifications, since 1968. In Alaska, passage of the United State Marine Mammal Protection Act (MMPA) of 1972 banned polar bear hunting unless done by Alaska Natives for subsistence. However, the MMPA placed no restrictions on numbers or composition of the subsistence hunt, leaving open the potential for an overharvest with no possible legal management response until the population was declared depleted. Recognizing that as a threat to the conservation of the shared polar bear population, the Inuvialuit Game Council from Canada and the North Slop Borough from Alaska negotiated and signed a user-to-user agreement, the Polar Bear Management Agreement for the Southern Beaufort Sea, in 1988. We reviewed the functioning of the agreement through its first 10 years and concluded that, overall, it has been successful because both the total harvest and the proportion of females in the harvest have been contained within sustainable limits. However, harvest monitoring needs to be improved in Alaska, and awareness of the need to prevent overharvest of females needs to be increased in both countries. This agreement is a useful model for other user-to-user conservation agreements.

  3. 77 FR 32712 - Technical Report: Evaluation of the Enhancing Vehicle-to-Vehicle Crash Compatibility Agreement...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-06-01

    ... National Highway Traffic Safety Administration Technical Report: Evaluation of the Enhancing Vehicle-to...), Department of Transportation. ACTION: Request for comments on technical report. SUMMARY: This notice announces NHTSA's publication of a Technical Report reviewing and evaluating the Enhancing...

  4. INTEGRATED WATER TREATMENT SYSTEM PERFORMANCE EVALUATION

    SciTech Connect

    SEXTON RA; MEEUWSEN WE

    2009-03-12

    This document describes the results of an evaluation of the current Integrated Water Treatment System (IWTS) operation against design performance and a determination of short term and long term actions recommended to sustain IWTS performance.

  5. Model Performance Evaluation and Scenario Analysis (MPESA)

    EPA Pesticide Factsheets

    Model Performance Evaluation and Scenario Analysis (MPESA) assesses the performance with which models predict time series data. The tool was developed Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM)

  6. S-191 sensor performance evaluation

    NASA Technical Reports Server (NTRS)

    Hughes, C. L.

    1975-01-01

    A final analysis was performed on the Skylab S-191 spectrometer data received from missions SL-2, SL-3, and SL-4. The repeatability and accuracy of the S-191 spectroradiometric internal calibration was determined by correlation to the output obtained from well-defined external targets. These included targets on the moon and earth as well as deep space. In addition, the accuracy of the S-191 short wavelength autocalibration was flight checked by correlation of the earth resources experimental package S-191 outputs and the Backup Unit S-191 outputs after viewing selected targets on the moon.

  7. Measuring agreement between ratings interpretations and binary clinical interpretations of images: a simulation study of methods for quantifying the clinical relevance of an observer performance paradigm

    PubMed Central

    Chakraborty, Dev P.

    2012-01-01

    Laboratory receiver operating characteristic (ROC) studies, that are often used to evaluate medical imaging systems, differ from “live” clinical interpretations in several respects which could compromise their clinical relevance. The aim was to develop methodology for quantifying the clinical relevance of a laboratory ROC study. A simulator was developed to generate ROC ratings data and binary clinical interpretations classified as correct or incorrect for a common set of images interpreted under clinical and laboratory conditions. The area under the trapezoidal ROC curve was used as the laboratory figure-of-merit and the fraction of correct clinical decisions as the clinical figure-of-merit. Conventional agreement measures (Pearson, Spearman, Kendall and kappa) between the bootstrap-induced fluctuations of the two figures-of-merit were estimated. A jackknife pseudovalue transformation applied to the figures-of-merit was also investigated as a way to capture agreement existing at the individual image level that could be lost at the figure-of-merit level. It is shown that the pseudovalues define a relevance ROC curve the area under which (rAUC) measures the ability of the laboratory figure-of-merit based pseudovalues to correctly classify incorrect vs. correct clinical interpretations, and is a measure of the clinical relevance of an ROC study. The conventional measures and rAUC were compared under varying simulator conditions. It was found that design details of the ROC study, namely the number of bins, the difficulty level of the images, the ratio of disease-present to disease-absent images, and the unavoidable difference between laboratory and clinical performance levels, can seriously underestimate the agreement as indicated by conventional agreement measures, even for perfectly correlated data, while rAUC showed high agreement and was relatively immune to these details. At the same time rAUC was sensitive to factors such as intrinsic correlation between the

  8. Agreement evaluation of AVHRR and MODIS 16-day composite NDVI data sets

    USGS Publications Warehouse

    Ji, L.; Gallo, K.; Eidenshink, J.C.; Dwyer, J.

    2008-01-01

    Satellite-derived normalized difference vegetation index (NDVI) data have been used extensively to detect and monitor vegetation conditions at regional and global levels. A combination of NDVI data sets derived from AVHRR and MODIS can be used to construct a long NDVI time series that may also be extended to VIIRS. Comparative analysis of NDVI data derived from AVHRR and MODIS is critical to understanding the data continuity through the time series. In this study, the AVHRR and MODIS 16-day composite NDVI products were compared using regression and agreement analysis methods. The analysis shows a high agreement between the AVHRR-NDVI and MODIS-NDVI observed from 2002 and 2003 for the conterminous United States, but the difference between the two data sets is appreciable. Twenty per cent of the total difference between the two data sets is due to systematic difference, with the remainder due to unsystematic difference. The systematic difference can be eliminated with a linear regression-based transformation between two data sets, and the unsystematic difference can be reduced partially by applying spatial filters to the data. We conclude that the continuity of NDVI time series from AVHRR to MODIS is satisfactory, but a linear transformation between the two sets is recommended.

  9. Evaluation of solar pond performance

    SciTech Connect

    Wittenberg, L.J.

    1980-01-01

    The City of Miamisburg, Ohio, constructed during 1978 a large, salt-gradient solar pond as part of its community park development project. The thermal energy stored in the pond is being used to heat an outdoor swimming pool in the summer and an adjacent recreational building during part of the winter. This solar pond, which occupies an area of 2020 m/sup 2/ (22,000 sq. ft.), was designed from experience obtained at smaller research ponds located at Ohio State University, the University of New Mexico and similar ponds operated in Israel. During the summer of 1979, the initial heat (40,000 kWh, 136 million Btu) was withdrawn from the solar pond to heat the outdoor swimming pool. All of the data collection systems were installed and functioned as designed so that operational data were obtained. The observed performance of the pond was compared with several of the predicted models for this type of pond. (MHR)

  10. Evaluation of holistic sexuality education: A European expert group consensus agreement.

    PubMed

    Ketting, Evert; Friele, Minou; Michielsen, Kristien

    2016-01-01

    Holistic sexuality education (HSE) is a new concept in sexuality education (SE). Since it differs from other types of SE in a number of important respects, strategies developed for the evaluation of the latter are not necessarily applicable to HSE. In this paper the authors provide a basis for discussion on how to evaluate HSE. First, the international literature on evaluation of SE in general was reviewed in terms of its applicability to HSE. Second, the European Expert Group on Sexuality Education extensively discussed the requirements of its evaluation and suggested appropriate indicators and methods for evaluating HSE. The European experience in SE is scarcely represented in the general evaluation literature. The majority of the literature focuses on impact and neglects programme and implementation evaluations. Furthermore, the current literature demonstrates that evaluation criteria predominantly focus on the public health impact, while there is not yet a consensus on sexual well-being criteria and aspects of positive sexuality, which are crucial parts of HSE. Finally, experimental designs are still considered the gold standard, yet several of the conditions for their use are not fulfilled in HSE. Realising that a new evaluation framework for HSE is needed, the European expert group initiated its development and agreed upon a number of indicators that provide a starting point for further discussion. Aside from the health impact, the quality of SE programmes and their implementation also deserve attention and should be evaluated. To be applicable to HSE, the evaluation criteria need to cover more than the typical public health aspects. Since they do not register long-term and multi-component characteristics, evaluation methods such as randomised controlled trials are not sufficiently suitable for HSE. The evaluation design should rely on a number of different information sources from mixed methods that are complemented and triangulated to build a plausible case

  11. Colorimetric evaluation of display performance

    NASA Astrophysics Data System (ADS)

    Kosmowski, Bogdan B.

    2001-08-01

    The development of information techniques, using new technologies, physical phenomena and coding schemes, enables new application areas to be benefited form the introduction of displays. The full utilization of the visual perception of a human operator, requires the color coding process to be implemented. The evolution of displays, from achromatic (B&W) and monochromatic, to multicolor and full-color, enhances the possibilities of information coding, creating however a need for the quantitative methods of display parameter assessment. Quantitative assessment of color displays, restricted to photometric measurements of their parameters, is an estimate leading to considerable errors. Therefore, the measurements of a display's color properties have to be based on spectral measurements of the display and its elements. The quantitative assessment of the display system parameters should be made using colorimetric systems like CIE1931, CIE1976 LAB or LUV. In the paper, the constraints on the measurement method selection for the color display evaluation are discussed and the relations between their qualitative assessment and the ergonomic conditions of their application are also presented. The paper presents the examples of using LUV colorimetric system and color difference (Delta) E in the optimization of color liquid crystal displays.

  12. [Personnel standardization in clinical diagnosis of goiter: how to evaluate agreement among thyroid examiners?].

    PubMed

    Matute, J; Boy, E

    1992-06-01

    The use of the t Student and Cochran tests to evaluate central tendency measures, as well as the F test to evaluate variability and correlation analysis, have been incorrectly used for the evaluation of concordance between thyroid examiners. This paper presents the intraclass Kappa test (Bloch & Kraemer, 1989), as well as the experience of its use in Central America to standardize thyroid examiner personnel who participated in national surveys carried out during 1990 to determine goiter prevalence.

  13. Laser Plasma Microthruster Performance Evaluation

    NASA Astrophysics Data System (ADS)

    Luke, James R.; Phipps, Claude R.

    2003-05-01

    The micro laser plasma thruster (μLPT) is a sub-kilogram thruster that is capable of meeting the Air Force requirements for the Attitude Control System on a 100-kg class small satellite. The μLPT uses one or more 4W diode lasers to ablate a solid fuel, producing a jet of hot gas or plasma which creates thrust with a high thrust/power ratio. A pre-prototype continuous thrust experiment has been constructed and tested. The continuous thrust experiment uses a 505 mm long continuous loop fuel tape, which consists of a black laser-absorbing fuel material on a transparent plastic substrate. When the laser is operated continuously, the exhaust plume and thrust vector are steered in the direction of the tape motion. Thrust steering can be avoided by pulsing the laser. A torsion pendulum thrust stand has been constructed and calibrated. Many fuel materials and substrates have been tested. Best performance from a non-energetic fuel material was obtained with black polyvinyl chloride (PVC), which produced an average of 70 μN thrust and coupling coefficient (Cm) of 190 μN/W. A proprietary energetic material was also tested, in which the laser initiates a non-propagating detonation. This material produced 500 μN of thrust.

  14. Adolescent Loneliness and Social Skills: Agreement and Discrepancies Between Self-, Meta-, and Peer-Evaluations.

    PubMed

    Lodder, G M A; Goossens, L; Scholte, R H J; Engels, R C M E; Verhagen, M

    2016-12-01

    Lonely adolescents report that they have poor social skills, but it is unknown whether this is due to an accurate perception of a social skills deficit, or a biased negative perception. This is an important distinction, as actual social skills deficits require different treatments than biased negative perceptions. In this study, we compared self-reported social skills evaluations with peer-reported social skills and meta-evaluations of social skills (i.e., adolescents' perceptions of how they believe their classmates evaluate them). Based on the social skills view, we expected negative relations between loneliness and these three forms of social skills evaluations. Based on the bias view, we expected lonely adolescents to have more negative self- and meta-evaluations compared to peer-evaluations of social skills. Participants were 1342 adolescents (48.64 % male, M age = 13.95, SD = .54). All classmates rated each other in a round-robin design to obtain peer-evaluations. Self- and meta-evaluations were obtained using self-reports. Data were analyzed using polynomial regression analyses and response surface modeling. The results indicated that, when self-, peer- and meta-evaluations were similar, a greater sense of loneliness was related to poorer social skills. Loneliness was also related to larger discrepancies between self- and peer-evaluations of loneliness, but not related to the direction of these discrepancies. Thus, for some lonely adolescents, loneliness may be related to an actual social skills deficit, whereas for others a biased negative perception of one's own social skills or a mismatch with the environment may be related to their loneliness. This implies that different mechanisms may underlie loneliness, which has implications for interventions.

  15. Theory and Practice on Teacher Performance Evaluation

    ERIC Educational Resources Information Center

    Yonghong, Cai; Chongde, Lin

    2006-01-01

    Teacher performance evaluation plays a key role in educational personnel reform, so it has been an important yet difficult issue in educational reform. Previous evaluations on teachers failed to make strict distinction among the three dominant types of evaluation, namely, capability, achievement, and effectiveness. Moreover, teacher performance…

  16. Agreement studies in radiology research.

    PubMed

    Farzin, B; Gentric, J-C; Pham, M; Tremblay-Paquet, S; Brosseau, L; Roy, C; Jamali, S; Chagnon, M; Darsaut, T E; Guilbert, F; Naggara, O; Raymond, J

    2017-03-01

    The goal of this study was to estimate the frequency and the quality of agreement studies published in diagnostic imaging journals. All studies published between January 2011 and December 2012 in four radiology journals were reviewed. Four trained readers evaluated agreement studies using a 24-item form that included the 15 items of the Guidelines for Reporting Reliability and Agreement Studies criteria. Of 2229 source titles, 280 studies (13%) reported agreement. The mean number of patients per study was 81±99 (SD) (range, 0-180). Justification for sample size was found in 9 studies (3%). The number of raters was≤2 in 226 studies (81%). No intra-observer study was performed in 212 (76%) articles. Confidence intervals and interpretation of statistical estimates were provided in 98 (35%) and 147 (53%) of the studies, respectively. In 168 studies (60%), the agreement study was not mentioned in the discussion section. In 8 studies (3%), reporting of the agreement study was judged to be adequate. Twenty studies (7%) were dedicated to agreement. Agreement studies are preliminary and not adequately reported. Studies dedicated to agreement are infrequent. They are research opportunities that should be promoted. Copyright © 2016 Éditions françaises de radiologie. Published by Elsevier Masson SAS. All rights reserved.

  17. Multicentre evaluation of multidisciplinary team meeting agreement on diagnosis in diffuse parenchymal lung disease: a case-cohort study.

    PubMed

    Walsh, Simon L F; Wells, Athol U; Desai, Sujal R; Poletti, Venerino; Piciucchi, Sara; Dubini, Alessandra; Nunes, Hilario; Valeyre, Dominique; Brillet, Pierre Y; Kambouchner, Marianne; Morais, António; Pereira, José M; Moura, Conceição Souto; Grutters, Jan C; van den Heuvel, Daniel A; van Es, Hendrik W; van Oosterhout, Matthijs F; Seldenrijk, Cornelis A; Bendstrup, Elisabeth; Rasmussen, Finn; Madsen, Line B; Gooptu, Bibek; Pomplun, Sabine; Taniguchi, Hiroyuki; Fukuoka, Junya; Johkoh, Takeshi; Nicholson, Andrew G; Sayer, Charlie; Edmunds, Lilian; Jacob, Joseph; Kokosi, Maria A; Myers, Jeffrey L; Flaherty, Kevin R; Hansell, David M

    2016-07-01

    Diffuse parenchymal lung disease represents a diverse and challenging group of pulmonary disorders. A consistent diagnostic approach to diffuse parenchymal lung disease is crucial if clinical trial data are to be applied to individual patients. We aimed to evaluate inter-multidisciplinary team agreement for the diagnosis of diffuse parenchymal lung disease. We did a multicentre evaluation of clinical data of patients who presented to the interstitial lung disease unit of the Royal Brompton and Harefield NHS Foundation Trust (London, UK; host institution) and required multidisciplinary team meeting (MDTM) characterisation between March 1, 2010, and Aug 31, 2010. Only patients whose baseline clinical, radiological, and, if biopsy was taken, pathological data were undertaken at the host institution were included. Seven MDTMs, consisting of at least one clinician, radiologist, and pathologist, from seven countries (Denmark, France, Italy, Japan, Netherlands, Portugal, and the UK) evaluated cases of diffuse parenchymal lung disease in a two-stage process between Jan 1, and Oct 15, 2015. First, the clinician, radiologist, and pathologist (if lung biopsy was completed) independently evaluated each case, selected up to five differential diagnoses from a choice of diffuse lung diseases, and chose likelihoods (censored at 5% and summing to 100% in each case) for each of their differential diagnoses, without inter-disciplinary consultation. Second, these specialists convened at an MDTM and reviewed all data, selected up to five differential diagnoses, and chose diagnosis likelihoods. We compared inter-observer and inter-MDTM agreements on patient first-choice diagnoses using Cohen's kappa coefficient (κ). We then estimated inter-observer and inter-MDTM agreement on the probability of diagnosis using weighted kappa coefficient (κw). We compared inter-observer and inter-MDTM confidence of patient first-choice diagnosis. Finally, we evaluated the prognostic significance of a

  18. Caregivers' agreement and validity of indirect functional analysis: a cross cultural evaluation across multiple problem behavior topographies.

    PubMed

    Virues-Ortega, Javier; Segui-Duran, David; Descalzo-Quero, Alberto; Carnerero, Jose Julio; Martin, Neil

    2011-01-01

    The Motivation Assessment Scale is an aid for hypothesis-driven functional analysis. This study presents its Spanish cross-cultural validation while examining psychometric attributes not yet explored. The study sample comprised 80 primary caregivers of children with autism. Acceptability, scaling assumptions, internal consistency, factor structure, inter-assessor reliability and agreement, and known-group validity analyses were performed. Scaling assumptions, internal consistency (Cronbach alpha of 0.75) and factor structure were satisfactory other than for the Escape domain which demonstrated low internal consistency (0.65), inadequate scaling assumptions (multitrait analysis, 50% success rate) and did not constitute a separate factor. Caregivers' agreement for the primary function reached 73.9% and known group-validity hypotheses across behavior topographies were partially met. The clinical appropriateness of the scale is discussed.

  19. HENC performance evaluation and plutonium calibration

    SciTech Connect

    Menlove, H.O.; Baca, J.; Pecos, J.M.; Davidson, D.R.; McElroy, R.D.; Brochu, D.B.

    1997-10-01

    The authors have designed a high-efficiency neutron counter (HENC) to increase the plutonium content in 200-L waste drums. The counter uses totals neutron counting, coincidence counting, and multiplicity counting to determine the plutonium mass. The HENC was developed as part of a Cooperative Research and Development Agreement between the Department of Energy and Canberra Industries. This report presents the results of the detector modifications, the performance tests, the add-a-source calibration, and the plutonium calibration at Los Alamos National Laboratory (TA-35) in 1996.

  20. When the A Is for Agreement: Factors that Affect Educators' Evaluations of Student Essays

    ERIC Educational Resources Information Center

    Shores, Michael; Weseley, Allyson J.

    2007-01-01

    Research has established that a variety of factors predict educators' perceptions of students' performance; however, no studies have looked at the impact of educators' political views. The present experiment investigated the effect of educators' political biases on their grading of student essays. Participants included 122 volunteers who were…

  1. Conductor gestures influence evaluations of ensemble performance

    PubMed Central

    Morrison, Steven J.; Price, Harry E.; Smedley, Eric M.; Meals, Cory D.

    2014-01-01

    Previous research has found that listener evaluations of ensemble performances vary depending on the expressivity of the conductor’s gestures, even when performances are otherwise identical. It was the purpose of the present study to test whether this effect of visual information was evident in the evaluation of specific aspects of ensemble performance: articulation and dynamics. We constructed a set of 32 music performances that combined auditory and visual information and were designed to feature a high degree of contrast along one of two target characteristics: articulation and dynamics. We paired each of four music excerpts recorded by a chamber ensemble in both a high- and low-contrast condition with video of four conductors demonstrating high- and low-contrast gesture specifically appropriate to either articulation or dynamics. Using one of two equivalent test forms, college music majors and non-majors (N = 285) viewed sixteen 30 s performances and evaluated the quality of the ensemble’s articulation, dynamics, technique, and tempo along with overall expressivity. Results showed significantly higher evaluations for performances featuring high rather than low conducting expressivity regardless of the ensemble’s performance quality. Evaluations for both articulation and dynamics were strongly and positively correlated with evaluations of overall ensemble expressivity. PMID:25104944

  2. An Evaluation of the CDC's Community-Based Breastfeeding Supplemental Cooperative Agreement: Reach, Strategies, Barriers, Facilitators, and Lessons Learned.

    PubMed

    Lilleston, Pamela; Nhim, Kunthea; Rutledge, Gia

    2015-11-01

    Community-based organizations (CBOs) have an important role to play in promoting breastfeeding continuation among mothers. The Centers for Disease Control and Prevention's Nutrition, Physical Activity, and Obesity Program's Cooperative Agreement Breastfeeding Supplement funded 6 state health departments to support CBOs to implement community-based breastfeeding support activities. Study objectives were to (1) describe the reach of the Cooperative Agreement, (2) describe breastfeeding support strategies implemented by state health departments and CBOs, and (3) understand the barriers and facilitators to implementing community-based breastfeeding support strategies. Qualitative and quantitative data were abstracted from state health departments' final evaluation reports. Qualitative data were analyzed for common themes using deductive and inductive approaches. Within the 6 states funded by the Cooperative Agreement, 66 primary CBOs implemented breastfeeding support strategies and reported 59 256 contacts with mothers. Support strategies included incorporating lactation services into community-based programs, training staff, providing walk-in locations for lactation support, connecting breastfeeding mothers to resources, and providing services that reflect community-specific culture. Community partnerships, network building, stakeholders' commitment, and programmatic and policy environments were key facilitators of program success. Key lessons learned include the importance of time in creating lasting organizational change, use of data for program improvement, choosing the right partners, taking a collective approach, and leveraging resources. © International Lactation Consultant Association 2015.

  3. Performance Evaluation of Undulator Radiation at CEBAF

    SciTech Connect

    Chuyu Liu, Geoffrey Krafft, Guimei Wang

    2010-05-01

    The performance of undulator radiation (UR) at CEBAF with a 3.5 m helical undulator is evaluated and compared with APS undulator-A radiation in terms of brilliance, peak brilliance, spectral flux, flux density and intensity distribution.

  4. ATAMM enhancement and multiprocessor performance evaluation

    NASA Technical Reports Server (NTRS)

    Stoughton, John W.; Mielke, Roland R.; Som, Sukhamoy; Obando, Rodrigo; Malekpour, Mahyar R.; Jones, Robert L., III; Mandala, Brij Mohan V.

    1991-01-01

    ATAMM (Algorithm To Architecture Mapping Model) enhancement and multiprocessor performance evaluation is discussed. The following topics are included: the ATAMM model; ATAMM enhancement; ADM (Advanced Development Model) implementation of ATAMM; and ATAMM support tools.

  5. Improvement of Automotive Part Supplier Performance Evaluation

    NASA Astrophysics Data System (ADS)

    Kongmunee, Chalermkwan; Chutima, Parames

    2016-05-01

    This research investigates the problem of the part supplier performance evaluation in a major Japanese automotive plant in Thailand. Its current evaluation scheme is based on experiences and self-opinion of the evaluators. As a result, many poor performance suppliers are still considered as good suppliers and allow to supply parts to the plant without further improvement obligation. To alleviate this problem, the brainstorming session among stakeholders and evaluators are formally conducted. The result of which is the appropriate evaluation criteria and sub-criteria. The analytical hierarchy process is also used to find suitable weights for each criteria and sub-criteria. The results show that a newly developed evaluation method is significantly better than the previous one in segregating between good and poor suppliers.

  6. Evaluation of high-performance computing software

    SciTech Connect

    Browne, S.; Dongarra, J.; Rowan, T.

    1996-12-31

    The absence of unbiased and up to date comparative evaluations of high-performance computing software complicates a user`s search for the appropriate software package. The National HPCC Software Exchange (NHSE) is attacking this problem using an approach that includes independent evaluations of software, incorporation of author and user feedback into the evaluations, and Web access to the evaluations. We are applying this approach to the Parallel Tools Library (PTLIB), a new software repository for parallel systems software and tools, and HPC-Netlib, a high performance branch of the Netlib mathematical software repository. Updating the evaluations with feed-back and making it available via the Web helps ensure accuracy and timeliness, and using independent reviewers produces unbiased comparative evaluations difficult to find elsewhere.

  7. Assessment beyond Performance: Phenomenography in Educational Evaluation

    ERIC Educational Resources Information Center

    Micari, Marina; Light, Gregory; Calkins, Susanna; Streitwieser, Bernhard

    2007-01-01

    Increasing calls for accountability in education have promoted improvements in quantitative evaluation approaches that measure student performance; however, this has often been to the detriment of qualitative approaches, reducing the richness of educational evaluation as an enterprise. In this article the authors assert that it is not merely…

  8. Building Leadership Talent through Performance Evaluation

    ERIC Educational Resources Information Center

    Clifford, Matthew

    2015-01-01

    Most states and districts scramble to provide professional development to support principals, but "principal evaluation" is often lost amid competing priorities. Evaluation is an important method for supporting principal growth, communicating performance expectations to principals, and improving leadership practice. It provides leaders…

  9. Neglected Areas in Evaluating Writing Performance.

    ERIC Educational Resources Information Center

    Keech, Catharine Lucas

    The heavy concentration of time and funds to measure writing performance is the major reason other areas deserving scrutiny are so often neglected by evaluators. Three failings typical of the field of writing assessment as it is conducted for the purpose of program evaluation are: (1) a failure to view writing as a multiple construct; (2) a…

  10. Reference Service Standards, Performance Criteria, and Evaluation.

    ERIC Educational Resources Information Center

    Schwartz, Diane G.; Eakin, Dottie

    1986-01-01

    Describes process by which reference service standards were developed at a university medical library and their impact on the evaluation of work of librarians. Highlights include establishment of preliminary criteria, literature review, reference service standards, performance evaluation, peer review, and staff development. Checklist of reference…

  11. Automatic Singing Performance Evaluation for Untrained Singers

    NASA Astrophysics Data System (ADS)

    Cao, Chuan; Li, Ming; Wu, Xiao; Suo, Hongbin; Liu, Jian; Yan, Yonghong

    In this letter, we present an automatic approach of objective singing performance evaluation for untrained singers by relating acoustic measurements to perceptual ratings of singing voice quality. Several acoustic parameters and their combination features are investigated to find objective correspondences of the perceptual evaluation criteria. Experimental results show relative strong correlation between perceptual ratings and the combined features and the reliability of the proposed evaluation system is tested to be comparable to human judges.

  12. Course Evaluation. II: Interpretation of Student Performance on Evaluative Tests

    ERIC Educational Resources Information Center

    Aikenhead, Glen S.

    1974-01-01

    Reports the results of a comparative evaluation of Harvard Project Physics (HPP) and non-HPP student performance, and demonstrates the ability of a new test construction paradigm to generate valuable feedback for curriculum developers, teachers, and students. (JR)

  13. Principal Performance Areas and Principal Evaluation.

    ERIC Educational Resources Information Center

    Fletcher, Thomas E.; McInerney, William D.

    1995-01-01

    Summarizes a study that surveyed Indiana superintendents and examined their principal-evaluation instruments. Superintendents were asked which of 21 performance domains were most important and whether these were currently being assessed. Respondents generally agreed that all 21 performance domains identified by the National Policy Board for…

  14. Does agreement on institutional values and leadership issues between deans and surgery chairs predict their institutions' performance?

    PubMed

    Souba, Wiley W; Mauger, David; Day, David V

    2007-03-01

    To gain a better understanding of the values that medical school deans and surgery chairs consider most essential for effective leadership, to assess their perceptions of the values and leadership climate in their institutions, and to test the premise that agreement on leadership values and climate predict greater organizational effectiveness and performance. From June 2005 through March 2006, questionnaires designed to assess leadership core values and organizational leadership climate were mailed to medical school deans and surgery chairs of the 125 U.S. academic health centers. Institutional performance measures used were the National Institutes of Health (NIH) standing and U.S. News and World Report ranking of each institution. Sixty-eight surgery chairs (54%) and 60 deans (48%) returned surveys. Q-sort results on 38 positive leadership values indicated that integrity, trust, and vision were considered the most important core values for effective leadership by both chairs and deans. Both groups ranked business acumen, authority, and institutional reputation as least important. Deans consistently ranked the leadership climate as being healthier (more positive) than did their surgery chairs on multiple scale items: leadership is widely shared (P = .005), information is widely shared (P = .002), missions are aligned (P = .003), open communication is the norm (P = .009), good performance is rewarded (P = .01), teamwork is widely practiced (P = .01), and leaders are held accountable (P = 002). Tighter alignment between chairs and deans on core values and on the leadership climate scale correlated with higher school and department NIH standing and higher U.S. News and World Report medical school and hospital ranking (P < .05). Although surgery chairs and deans espouse similar core leadership values, deans believe that a healthier leadership climate exists in their institutions than their surgery chairs do. The study findings suggest that tighter leadership alignment

  15. Can't get no satisfaction? Will pay for performance help?: toward an economic framework for understanding performance-based risk-sharing agreements for innovative medical products.

    PubMed

    Towse, Adrian; Garrison, Louis P

    2010-01-01

    This article examines performance-based risk-sharing agreements for pharmaceuticals from a theoretical economic perspective. We position these agreements as a form of coverage with evidence development. New performance-based risk sharing could produce a more efficient market equilibrium, achieved by adjustment of the price post-launch to reflect outcomes combined with a new approach to the post-launch costs of evidence collection. For this to happen, the party best able to manage or to bear specific risks must do so. Willingness to bear risk will depend not only on ability to manage it, but on the degree of risk aversion. We identify three related frameworks that provide relevant insights: value of information, real option theory and money-back guarantees. We identify four categories of risk sharing: budget impact, price discounting, outcomes uncertainty and subgroup uncertainty. We conclude that a value of information/real option framework is likely to be the most helpful approach for understanding the costs and benefits of risk sharing. There are a number of factors that are likely to be crucial in determining if performance-based or risk-sharing agreements are efficient and likely to become more important in the future: (i) the cost and practicality of post-launch evidence collection relative to pre-launch; (ii) the feasibility of coverage with evidence development without a pre-agreed contract as to how the evidence will be used to adjust price, revenues or use, in which uncertainty around the pay-off to additional research will reduce the incentive for the manufacturer to collect the information; (iii) the difficulty of writing and policing risk-sharing agreements; (iv) the degree of risk aversion (and therefore opportunity to trade) on the part of payers and manufacturers; and (v) the extent of transferability of data from one country setting to another to support coverage with evidence development in a risk-sharing framework. There is no doubt that

  16. Performance evaluation of advanced industrial SPECT system with diverging collimator.

    PubMed

    Park, Jang Guen; Jung, Sung-Hee; Kim, Jong Bum; Moon, Jinho; Yeom, Yeon Soo; Kim, Chan Hyeong

    2014-12-01

    An advanced industrial SPECT system with 12-fold-array diverging collimator was developed for flow visualization in industrial reactors and was discussed in the previous study. The present paper describes performance evaluation of the SPECT system under both static- and dynamic- flow conditions. Under static conditions, the movement of radiotracer inside the test reactor was compared with that of color tracer (blue ink) captured with a high-speed camera. The comparison of the reconstructed images obtained with the radiotracer and the SPECT system showed fairly good agreement with video-frames of the color tracer obtained with the camera. Based on the results of the performance evaluation, it is concluded that the SPECT system is suitable for investigation and visualization of flows in industrial flow reactors.

  17. Evaluating the performance of clinical dietitians.

    PubMed

    Gates, G E; Holdt, C S

    1993-05-01

    The purposes of this study were to describe how clinical managers evaluate the performance of clinical dietitians and to examine managers' opinions about performance appraisal. Managers from 55 acute-care hospitals in seven midwestern states responded to a telephone survey about their appraisal of the performance of clinical dietitians. Most of the clinical managers had developed criteria with written standards for evaluating performance. Respondents evaluated the dietitians once a year and relied primarily on chart audits, other work samples, and critical incidents to judge performance. Managers in 32 of the hospitals asked their subordinates to complete a self-appraisal, and almost all of the managers negotiated with the dietitians to identify goals for professional improvement. Respondents' reasons for conducting performance appraisals were indicative of a participative management style. During the interviews, many clinical managers requested help in improving their performance appraisal systems, which suggests a need for additional training in conducting performance appraisals. The findings indicate that most clinical managers were following recommended guidelines for conducting performance appraisals.

  18. Supplier Performance Evaluation and Rating System (SPEARS)

    SciTech Connect

    Oged, M.; Warner, D.; Gurbuz, E.

    1993-03-01

    The SSCL Magnet Quality Assurance Department has implemented a Supplier Performance Evaluation and Rating System (SPEARS) to assess supplier performance throughout the development and production stages of the SSCL program. The main objectives of SPEARS are to promote teamwork and recognize performance. This paper examines the current implementation of SPEARS. MSD QA supports the development and production of SSCsuperconducting magnets while implementing the requirements of DOE Order 5700.6C. The MSD QA program is based on the concept of continuous improvement in quality and productivity. The QA program requires that procurement of items and services be controlled to assure conformance to specification. SPEARS has been implemented to meet DOE requirements and to enhance overall confidence in supplier performance. Key elements of SPEARS include supplier evaluation and selection as well as evaluation of furnished quality through source inspection, audit, and receipt inspection. These elements are described in this paper.

  19. Performance Evaluation Model for Application Layer Firewalls

    PubMed Central

    Yang, Wu; Dong, Hui; Zhang, Jiangchuan

    2016-01-01

    Application layer firewalls protect the trusted area network against information security risks. However, firewall performance may affect user experience. Therefore, performance analysis plays a significant role in the evaluation of application layer firewalls. This paper presents an analytic model of the application layer firewall, based on a system analysis to evaluate the capability of the firewall. In order to enable users to improve the performance of the application layer firewall with limited resources, resource allocation was evaluated to obtain the optimal resource allocation scheme in terms of throughput, delay, and packet loss rate. The proposed model employs the Erlangian queuing model to analyze the performance parameters of the system with regard to the three layers (network, transport, and application layers). Then, the analysis results of all the layers are combined to obtain the overall system performance indicators. A discrete event simulation method was used to evaluate the proposed model. Finally, limited service desk resources were allocated to obtain the values of the performance indicators under different resource allocation scenarios in order to determine the optimal allocation scheme. Under limited resource allocation, this scheme enables users to maximize the performance of the application layer firewall. PMID:27893803

  20. Performance Evaluation Model for Application Layer Firewalls.

    PubMed

    Xuan, Shichang; Yang, Wu; Dong, Hui; Zhang, Jiangchuan

    2016-01-01

    Application layer firewalls protect the trusted area network against information security risks. However, firewall performance may affect user experience. Therefore, performance analysis plays a significant role in the evaluation of application layer firewalls. This paper presents an analytic model of the application layer firewall, based on a system analysis to evaluate the capability of the firewall. In order to enable users to improve the performance of the application layer firewall with limited resources, resource allocation was evaluated to obtain the optimal resource allocation scheme in terms of throughput, delay, and packet loss rate. The proposed model employs the Erlangian queuing model to analyze the performance parameters of the system with regard to the three layers (network, transport, and application layers). Then, the analysis results of all the layers are combined to obtain the overall system performance indicators. A discrete event simulation method was used to evaluate the proposed model. Finally, limited service desk resources were allocated to obtain the values of the performance indicators under different resource allocation scenarios in order to determine the optimal allocation scheme. Under limited resource allocation, this scheme enables users to maximize the performance of the application layer firewall.

  1. Effects of Performers' External Characteristics on Performance Evaluations.

    ERIC Educational Resources Information Center

    Bermingham, Gudrun A.

    2000-01-01

    States that fairness has been a major concern in the field of music adjudication. Reviews the research literature to reveal information about three external characteristics (race, gender, and physical attractiveness) that may affect judges' performance evaluations and influence fairness of music adjudication. Includes references. (CMK)

  2. Performance Evaluation of Nano-JASMINE

    NASA Astrophysics Data System (ADS)

    Hatsutori, Y.; Kobayashi, Y.; Gouda, N.; Yano, T.; Murooka, J.; Niwa, Y.; Yamada, Y.

    We report the results of performance evaluation of the first Japanese astrometry satellite, Nano-JASMINE. It is a very small satellite and weighs only 35 kg. It aims to carry out astrometry measurement of nearby bright stars (z ≤ 7.5 mag) with an accuracy of 3 milli-arcseconds. Nano-JASMINE will be launched by Cyclone-4 rocket in August 2011 from Brazil. The current status is in the process of evaluating the performances. A series of performance tests and numerical analysis were conducted. As a result, the engineering model (EM) of the telescope was measured to be achieving a diffraction-limited performance and confirmed that it has enough performance for scientific astrometry.

  3. Performance Evaluation of Nano-JASMINE

    NASA Astrophysics Data System (ADS)

    Hatsutori, Y.; Kobayashi, Y.; Gouda, N.; Yano, T.; Murooka, J.; Niwa, Y.; Yamada, Y.

    2011-02-01

    We report the results of performance evaluation of the first Japanese astrometry satellite, Nano-JASMINE. It is a very small satellite and weighs only 35 kg. It aims to carry out astrometry measurement of nearby bright stars (z ≤ 7.5 mag) with an accuracy of 3 milli-arcseconds. Nano-JASMINE will be launched by Cyclone-4 rocket in August 2011 from Brazil. The current status is in the process of evaluating the performances. A series of performance tests and numerical analysis were conducted. As a result, the engineering model (EM) of the telescope was measured to be achieving a diffraction-limited performance and confirmed that it has enough performance for scientific astrometry.

  4. Evaluating student performance in clinical dietetics.

    PubMed

    Novascone, M A

    1985-06-01

    The focus of this study was on the development and field-testing of a set of behaviorally anchored rating scales for evaluating the clinical performance of dietetic students. The scales emphasized the application of skills and knowledge. A variation of the Smith-Kendall technique was used to develop the scales. The 42 participants involved in instrument development included dietetic students, didactic and clinical instructors, and dietetic practitioners. The completed instrument contained 8 dimension statements and 70 behavioral anchors. The instrument was field-tested in 16 clinical rotations within 8 dietetic education programs. Evaluators not only rated student performance but also critiqued the format and content of the scales. The mid-to-upper portions of each scale were used most frequently, and little score variation within or across programs was noted. The scales were deemed appropriate for formative evaluation; however, some evaluators who had to grade students' performance expressed a desire for performance standards defined in terms of grades. Because the process used to develop the instrument facilitated the articulation of performance criteria, it is recommended as a practical approach to setting performance standards.

  5. Evaluate reformer performance at a glance

    SciTech Connect

    Nag, A.

    1996-02-01

    Catalytic reforming is becoming increasingly important in replacing octane lost as the removal of lead from worldwide gasoline pools continues. A method has been developed that can quickly evaluate the performance of any catalytic reformer. The catalytic naphtha reforming process primarily involves three well-known reactions. These are aromatization of naphthenes, cyclization of paraffins and hydrocracking of paraffins. Hydrogen is produced in the process of aromatization and dehydrocyclization of paraffins. Reformer performance is normally evaluated with a reformate analysis (PONA) and yield of C{sub 5{sup +}} reformate. This method of quick evaluation of reformer performance is based upon the main assumption that the increase in hydrocarbon moles in the process is equal to the number of C{single_bond}C bond ruptures and one mole of hydrogen is absorbed to saturate the same. This new method calculates aromatization efficiency, paraffin conversion, aromatic selectivity and finally the paraffin, naphthene and aromatic content of C{sub 5{sup +}} reformate.

  6. Smith Newton Vehicle Performance Evaluation (Brochure)

    SciTech Connect

    Not Available

    2012-08-01

    The Fleet Test and Evaluation Team at the U.S. Department of Energy's National Renewable Energy Laboratory is evaluating and documenting the performance of electric and plug-in hybrid electric drive systems in medium-duty trucks across the nation. Through this project, Smith Electric Vehicles will build and deploy 500 all-electric medium-duty trucks. The trucks will be deployed in diverse climates across the country.

  7. Performance Evaluation and Benchmarking of Intelligent Systems

    SciTech Connect

    Madhavan, Raj; Messina, Elena; Tunstel, Edward

    2009-09-01

    To design and develop capable, dependable, and affordable intelligent systems, their performance must be measurable. Scientific methodologies for standardization and benchmarking are crucial for quantitatively evaluating the performance of emerging robotic and intelligent systems technologies. There is currently no accepted standard for quantitatively measuring the performance of these systems against user-defined requirements; and furthermore, there is no consensus on what objective evaluation procedures need to be followed to understand the performance of these systems. The lack of reproducible and repeatable test methods has precluded researchers working towards a common goal from exchanging and communicating results, inter-comparing system performance, and leveraging previous work that could otherwise avoid duplication and expedite technology transfer. Currently, this lack of cohesion in the community hinders progress in many domains, such as manufacturing, service, healthcare, and security. By providing the research community with access to standardized tools, reference data sets, and open source libraries of solutions, researchers and consumers will be able to evaluate the cost and benefits associated with intelligent systems and associated technologies. In this vein, the edited book volume addresses performance evaluation and metrics for intelligent systems, in general, while emphasizing the need and solutions for standardized methods. To the knowledge of the editors, there is not a single book on the market that is solely dedicated to the subject of performance evaluation and benchmarking of intelligent systems. Even books that address this topic do so only marginally or are out of date. The research work presented in this volume fills this void by drawing from the experiences and insights of experts gained both through theoretical development and practical implementation of intelligent systems in a variety of diverse application domains. The book presents

  8. Can Nephrologists Use Ultrasound to Evaluate the Inferior Vena Cava? A Cross-Sectional Study of the Agreement between a Nephrologist and a Cardiologist

    PubMed Central

    Muniz Pazeli, José; Fagundes Vidigal, Daniel; Cestari Grossi, Tarcísio; Silva Fernandes, Natália Maria; Colugnati, Fernando; Baumgratz de Paula, Rogério; Sanders-Pinheiro, Hélady

    2014-01-01

    Background/Aims The costs and the need for a specialist impair the implementation of ultrasonography for evaluating the inferior vena cava (IVC) to assess the volemic status in hemodialysis patients. We investigated whether a nephrologist with limited ultrasound training can accurately assess the IVC in patients undergoing hemodialysis. Methods A cardiologist and a nephrologist consecutively measured the indexed IVC expiratory diameter (VCDi) and the IVC collapsibility index (IVCCI) of 52 patients during hemodialysis sessions. In protocol I, the nephrologist used a regular ultrasound system (RUS) and the cardiologist used a cardiovascular ultrasound equipment; in protocol II, the machines were interchanged. Pearson and kappa coefficients and the interexaminer agreement by the Bland-Altman method were calculated. Results The VCDi measurements showed a strong correlation in both protocols (r = 0.88 and 0.84 in protocols I and II, respectively). The volemic classifications were excellent in protocol I (kappa = 0.82 and 0.93 by VCDi and IVCCI, respectively) and substantial in protocol II (kappa = 0.77 and 0.75 by VCDi and IVCCI, respectively). The interexaminer agreement on the VCDi measurements was very good in both protocols. Conclusions Ultrasound evaluation of the IVC can be performed by nephrologists using an RUS to assess the volemic status in hemodialysis patients. PMID:24926312

  9. Prospective safety performance evaluation on construction sites.

    PubMed

    Wu, Xianguo; Liu, Qian; Zhang, Limao; Skibniewski, Miroslaw J; Wang, Yanhong

    2015-05-01

    This paper presents a systematic Structural Equation Modeling (SEM) based approach for Prospective Safety Performance Evaluation (PSPE) on construction sites, with causal relationships and interactions between enablers and the goals of PSPE taken into account. According to a sample of 450 valid questionnaire surveys from 30 Chinese construction enterprises, a SEM model with 26 items included for PSPE in the context of Chinese construction industry is established and then verified through the goodness-of-fit test. Three typical types of construction enterprises, namely the state-owned enterprise, private enterprise and Sino-foreign joint venture, are selected as samples to measure the level of safety performance given the enterprise scale, ownership and business strategy are different. Results provide a full understanding of safety performance practice in the construction industry, and indicate that the level of overall safety performance situation on working sites is rated at least a level of III (Fair) or above. This phenomenon can be explained that the construction industry has gradually matured with the norms, and construction enterprises should improve the level of safety performance as not to be eliminated from the government-led construction industry. The differences existing in the safety performance practice regarding different construction enterprise categories are compared and analyzed according to evaluation results. This research provides insights into cause-effect relationships among safety performance factors and goals, which, in turn, can facilitate the improvement of high safety performance in the construction industry. Copyright © 2015 Elsevier Ltd. All rights reserved.

  10. Smith Newton Vehicle Performance Evaluation - Cumulative (Brochure)

    SciTech Connect

    Not Available

    2014-08-01

    The Fleet Test and Evaluation Team at the U.S. Department of Energy's National Renewable Energy Laboratory is evaluating and documenting the performance of electric and plug-in hybrid electric drive systems in medium-duty trucks across the nation. U.S. companies participating in this evaluation project received funding from the American Recovery and Reinvestment Act to cover part of the cost of purchasing these vehicles. Through this project, Smith Electric Vehicles is building and deploying 500 all-electric medium-duty trucks that will be deployed by a variety of companies in diverse climates across the country.

  11. Performance evaluations of demountable electrical connections

    NASA Astrophysics Data System (ADS)

    Niemann, R. C.; Cha, Y. S.; Hull, J. R.; Buckles, W. E.; Daugherty, M. A.

    Electrical conductors operating in cryogenic environments can require demountable connections along their lengths. The connections must have low resistance and high reliability and should allow ready assembly and disassembly. In this work, the performance of two types of connections has been evaluated. The first connection type is a clamped surface-to-surface joint. The second connection type is a screwed joint that incorporates male and female machine-thread components. The connections for copper conductors have been evaluated experimentally at 77 K. Experimental variables included thread surface treatment and assembly methods. The results of the evaluations are presented.

  12. Medicare program; performance criteria and statistical standards for evaluating intermediary performance during fiscal year 1984--HCFA. Proposed notice.

    PubMed

    1984-04-12

    This notice would update the performance criteria and statistical standards to be used for evaluating the performance of fiscal intermediaries in the administration of the Medicare program for fiscal year 1984. The performance criteria and statistical standards have been developed from available statistical data contained in routine intermediary reports; past performance results for the intermediaries; and from substantive input from the intermediary community, HCFA central office and HCFA regional offices. The results of these evaluations would be considered whenever we enter into, renew, or terminate an intermediary agreement; assign or reassign providers of services to an intermediary; or designate regional or national intermediaries.

  13. Final Report of Development of a Clinical Performance Evaluation Tool, 1978-79.

    ERIC Educational Resources Information Center

    Gloucester County Coll., Sewell, NJ.

    The objectives of this project were to (1) develop a criterion-referenced test of clinical performance capable of evaluating skill mastery, (2) establish congruent validity, (3) establish degree of inter-rater agreement, (4) determine whether performance expectations were the same for challenge exam applicants as for course-enrolled students, (5)…

  14. Evaluating Performance Portability of OpenACC

    SciTech Connect

    Sabne, Amit J; Sakdhnagool, Putt; Lee, Seyong; Vetter, Jeffrey S

    2015-01-01

    Accelerator-based heterogeneous computing is gaining momentum in High Performance Computing arena. However, the increased complexity of the accelerator architectures demands more generic, high-level programming models. OpenACC is one such attempt to tackle the problem. While the abstraction endowed by OpenACC offers productivity, it raises questions on its portability. This paper evaluates the performance portability obtained by OpenACC on twelve OpenACC programs on NVIDIA CUDA, AMD GCN, and Intel MIC architectures. We study the effects of various compiler optimizations and OpenACC program settings on these architectures to provide insights into the achieved performance portability.

  15. 48 CFR 436.604 - Performance evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Service 436.604... require a performance evaluation report on the work done by the architect-engineer after the completion of or during the construction of the designed project....

  16. Simplified method for video performance evaluation

    NASA Astrophysics Data System (ADS)

    Harshbarger, John H.

    1996-04-01

    Meaningful performance evaluation of video equipment can be complex, requiring specialized equipment in which results must be interpreted by technically trained operators. The alternative to this has been to attempt evaluation by visual inspection of patterns such as the SMPTE RP-133 Medical Imaging Standard. However this involves subjective interpretation and does not indicate the point in a system at which degradation has occurred. The video waveform of such a pattern is complex and not suitable for quantitative analysis. The principal factors which influence quality of a video image on a day-to-day basis are resolution, gray scale and color, if employed. If these qualities are transmitted and displayed without degradation beyond acceptable limits, suitable performance is assured. Performance evaluation by inspection of the image produced on a video display monitor is subject to interpretation; this is resolved by inserting, at the display, the original 'perfect' electronically generated waveform to serve as a reference. Thus the viewer has a specific visual comparison as the basis for performance evaluation. Another valuable feature of the test pattern insert is that a test segment can be placed on recorded images. Thus each image recalled by tape playback or from digital storage will carry an integral means for quality assurance.

  17. GENERAL METHODS FOR REMEDIAL PERFORMANCE EVALUATIONS

    EPA Science Inventory

    This document was developed by an EPA-funded project to explain technical considerations and principles necessary to evaluated the performance of ground-water contamination remediations at hazardous waste sites. This is neither a "cookbook", nor an encyclopedia of recommended fi...

  18. Performance Evaluation of a Semantic Perception Classifier

    DTIC Science & Technology

    2013-09-01

    Performance Evaluation of a Semantic Perception Classifier by Craig Lennon, Barry Bodt, Marshal Childers, Rick Camden, Arne Suppe, Luis...Camden and Nicoleta Florea Engility Corporation Luis Navarro-Serment and Arne Suppe Carnegie Mellon University...Lennon, Barry Bodt, Marshal Childers, Rick Camden,* Arne Suppe, † Luis Navarro-Serment, † and Nicoleta Florea* 5d. PROJECT NUMBER 5e. TASK

  19. Performance evaluation of an air solar collector

    NASA Technical Reports Server (NTRS)

    1979-01-01

    Indoor tests on signal-glazed flat-plate collector are described in report. Marhsall Space Flight Center solar simulator is used to make tests. Test included evaluations on thermal performance under various combinations of flow rate, incident flux, inlet temperature, and wind speed. Results are presented in graph/table form.

  20. ASBESTOS IN DRINKING WATER PERFORMANCE EVALUATION STUDIES

    EPA Science Inventory

    Performance evaluations of laboratories testing for asbestos in drinking water according to USEPA Test Method 100.1 or 100.2 are complicated by the difficulty of providing stable sample dispersions of asbestos in water. Reference samples of a graduated series of chrysotile asbes...

  1. ASBESTOS IN DRINKING WATER PERFORMANCE EVALUATION STUDIES

    EPA Science Inventory

    Performance evaluations of laboratories testing for asbestos in drinking water according to USEPA Test Method 100.1 or 100.2 are complicated by the difficulty of providing stable sample dispersions of asbestos in water. Reference samples of a graduated series of chrysotile asbest...

  2. EVALUATION OF CONFOCAL MICROSCOPY SYSTEM PERFORMANCE

    EPA Science Inventory

    BACKGROUND. The confocal laser scanning microscope (CLSM) has enormous potential in many biological fields. Currently there is a subjective nature in the assessment of a confocal microscope's performance by primarily evaluating the system with a specific test slide provided by ea...

  3. The Performance Evaluation of Corporate Universities

    ERIC Educational Resources Information Center

    Cappiello, Giuseppe; Pedrini, Giulio

    2017-01-01

    The aim of this paper is to illustrate the phenomenon of corporate universities from the perspective of the evaluation of their performance. Corporate universities have a hybrid nature that can be referred to both as a business unit and as a higher education institution. Having reviewed the literature on corporate universities and performance…

  4. Performance Evaluation for Non-Teaching Professionals.

    ERIC Educational Resources Information Center

    Panebianco, Anthony F.

    The program Performance Evaluation for Non-Teaching Professionals at the State University of New York Institute of Technology at Utica/Rome provides periodic assessments as required by institutional policy. The system is intended to establish a standard for judging quality of an employee's work and a rational and uniform basis for appraising…

  5. Performance evaluation of lightweight piezocomposite curved actuator

    NASA Astrophysics Data System (ADS)

    Goo, Nam Seo; Kim, Cheol; Park, Hoon C.; Yoon, Kwang J.

    2001-07-01

    A numerical method for the performance evaluation of LIPCA actuators is proposed using a finite element method. Fully-coupled formulations for piezo-electric materials are introduced and eight-node incompatible elements used. After verifying the developed code, the behavior of LIPCA actuators is investigated.

  6. GENERAL METHODS FOR REMEDIAL PERFORMANCE EVALUATIONS

    EPA Science Inventory

    This document was developed by an EPA-funded project to explain technical considerations and principles necessary to evaluated the performance of ground-water contamination remediations at hazardous waste sites. This is neither a "cookbook", nor an encyclopedia of recommended fi...

  7. Measures of Searcher Performance: A Psychometric Evaluation.

    ERIC Educational Resources Information Center

    Wildemuth, Barbara M.; And Others

    1993-01-01

    Describes a study of medical students that was conducted to evaluate measures of performance on factual searches of INQUIRER, a full-text database in microbiology. Measures relating to recall, precision, search term overlap, and efficiency are discussed; reliability and construct validity are considered; and implications for future research are…

  8. 48 CFR 36.604 - Performance evaluation.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 48 Federal Acquisition Regulations System 1 2011-10-01 2011-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 36.604...

  9. 48 CFR 36.604 - Performance evaluation.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 48 Federal Acquisition Regulations System 1 2014-10-01 2014-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 36.604...

  10. 48 CFR 236.604 - Performance evaluation.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 48 Federal Acquisition Regulations System 3 2011-10-01 2011-10-01 false Performance evaluation. 236.604 Section 236.604 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS...

  11. 48 CFR 436.604 - Performance evaluation.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 48 Federal Acquisition Regulations System 4 2014-10-01 2014-10-01 false Performance evaluation. 436.604 Section 436.604 Federal Acquisition Regulations System DEPARTMENT OF AGRICULTURE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Service 436.604...

  12. 48 CFR 236.604 - Performance evaluation.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 48 Federal Acquisition Regulations System 3 2013-10-01 2013-10-01 false Performance evaluation. 236.604 Section 236.604 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS...

  13. 48 CFR 436.604 - Performance evaluation.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 48 Federal Acquisition Regulations System 4 2013-10-01 2013-10-01 false Performance evaluation. 436.604 Section 436.604 Federal Acquisition Regulations System DEPARTMENT OF AGRICULTURE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Service 436.604...

  14. 48 CFR 2936.604 - Performance evaluation.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 48 Federal Acquisition Regulations System 7 2013-10-01 2012-10-01 true Performance evaluation. 2936.604 Section 2936.604 Federal Acquisition Regulations System DEPARTMENT OF LABOR GENERAL CONTRACTING REQUIREMENTS CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 2936.604...

  15. 48 CFR 236.604 - Performance evaluation.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 48 Federal Acquisition Regulations System 3 2012-10-01 2012-10-01 false Performance evaluation. 236.604 Section 236.604 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS...

  16. 48 CFR 236.604 - Performance evaluation.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 48 Federal Acquisition Regulations System 3 2014-10-01 2014-10-01 false Performance evaluation. 236.604 Section 236.604 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS...

  17. 48 CFR 36.604 - Performance evaluation.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 48 Federal Acquisition Regulations System 1 2013-10-01 2013-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 36.604...

  18. 48 CFR 436.604 - Performance evaluation.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 48 Federal Acquisition Regulations System 4 2011-10-01 2011-10-01 false Performance evaluation. 436.604 Section 436.604 Federal Acquisition Regulations System DEPARTMENT OF AGRICULTURE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Service 436.604...

  19. 48 CFR 36.604 - Performance evaluation.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 48 Federal Acquisition Regulations System 1 2012-10-01 2012-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 36.604...

  20. 48 CFR 436.604 - Performance evaluation.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 48 Federal Acquisition Regulations System 4 2012-10-01 2012-10-01 false Performance evaluation. 436.604 Section 436.604 Federal Acquisition Regulations System DEPARTMENT OF AGRICULTURE SPECIAL CATEGORIES OF CONTRACTING CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Service 436.604...

  1. 48 CFR 2936.604 - Performance evaluation.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 48 Federal Acquisition Regulations System 7 2014-10-01 2014-10-01 false Performance evaluation. 2936.604 Section 2936.604 Federal Acquisition Regulations System DEPARTMENT OF LABOR GENERAL CONTRACTING REQUIREMENTS CONSTRUCTION AND ARCHITECT-ENGINEER CONTRACTS Architect-Engineer Services 2936.604...

  2. EVALUATION OF CONFOCAL MICROSCOPY SYSTEM PERFORMANCE

    EPA Science Inventory

    BACKGROUND. The confocal laser scanning microscope (CLSM) has enormous potential in many biological fields. Currently there is a subjective nature in the assessment of a confocal microscope's performance by primarily evaluating the system with a specific test slide provided by ea...

  3. Autonomous Road Driving Arenas for Performance Evaluation

    DTIC Science & Technology

    2004-08-01

    The development of performance metrics is critical in the evaluation and advancement of intelligent systems . Obtaining the pinnacle of intelligence...in autonomous vehicles requires evolutionary standards and community support. In order to analyze and compare competing implementations of intelligent ... systems , the critical components of the system must be decoupled to facilitate repeatable trials that target specific aspects of the system’s overall

  4. Optical Storage Performance Modeling and Evaluation.

    ERIC Educational Resources Information Center

    Behera, Bailochan; Singh, Harpreet

    1990-01-01

    Evaluates different types of storage media for long-term archival storage of large amounts of data. Existing storage media are reviewed, including optical disks, optical tape, magnetic storage, and microfilm; three models are proposed based on document storage requirements; performance analysis is considered; and cost effectiveness is discussed.…

  5. Performance Evaluation of Dense Gas Dispersion Models.

    NASA Astrophysics Data System (ADS)

    Touma, Jawad S.; Cox, William M.; Thistle, Harold; Zapert, James G.

    1995-03-01

    This paper summarizes the results of a study to evaluate the performance of seven dense gas dispersion models using data from three field experiments. Two models (DEGADIS and SLAB) are in the public domain and the other five (AIRTOX, CHARM, FOCUS, SAFEMODE, and TRACE) are proprietary. The field data used are the Desert Tortoise pressurized ammonia releases, Burro liquefied natural gas spill tests, and the Goldfish anhydrous hydrofluoric acid spill experiments. Desert Tortoise and Goldfish releases were simulated as horizontal jet releases, and Burro as a liquid pool. Performance statistics were used to compare maximum observed concentrations and plume half-width to those predicted by each model. Model performance varied and no model exhibited consistently good performance across all three databases. However, when combined across the three databases, all models performed within a factor of 2. Problems encountered are discussed in order to help future investigators.

  6. Performance evaluation of two personal bioaerosol samplers.

    PubMed

    Tolchinsky, Alexander D; Sigaev, Vladimir I; Varfolomeev, Alexander N; Uspenskaya, Svetlana N; Cheng, Yung S; Su, Wei-Chung

    2011-01-01

    In this study, the performance of two newly developed personal bioaerosol samplers for monitoring the level of environmental and occupational airborne microorganisms was evaluated. These new personal bioaerosol samplers were designed based on a swirling cyclone with recirculating liquid film. The performance evaluation included collection efficiency tests using inert aerosols, the bioaerosol survival test using viable airborne microorganism, and the evaluation of using non-aqueous collection liquid for long-period sampling. The test results showed that these two newly developed personal bioaerosol samplers are capable of doing high efficiency, aerosol sampling (the cutoff diameters are around 0.7 μm for both samplers), and have proven to provide acceptable survival for the collected bioaerosols. By using an appropriate non-aqueous collection liquid, these two personal bioaerosol samplers should be able to permit continuous, long-period bioaerosol sampling with considerable viability for the captured bioaerosols.

  7. PEAPOL (Program Evaluation at the Performance Objective Level) Outside Evaluation.

    ERIC Educational Resources Information Center

    Auvil, Mary S.

    In evaluating this pilot project, which developed a computer system for assessing student progress and cost effectiveness as related to achievement of performance objectives, interviews were conducted with project participants, including project staff, school administrators, and the auto shop instructors. Project documents were reviewed and a…

  8. An identity verifier evaluation of performance

    SciTech Connect

    Maxwell, R.L.

    1987-01-01

    Because the development of personnel identity verifiers is active in several areas, it is important that an independent comparative evaluation of such devices be continuously pursued for the security industry to apply such devices. An evaluation of several verifiers was recently conducted (in the winter of 1986/1987) at Sandia National Laboratories. In a nonrigorous attempt to comparatively evaluate these verifiers in a field security environment, about 80 individuals were enrolled in five different verifiers. The enrollees were than encouraged to attempt a verification on each device several times a day for about four months such that both single try and multiple try information could be extracted from the data. Results indicated a general improvement in verifier performance with regard to accuracy and operating time compared to previous similar evaluations of verifiers at Sandia.

  9. Behavioral patterns of environmental performance evaluation programs.

    PubMed

    Li, Wanxin; Mauerhofer, Volker

    2016-11-01

    During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

  10. Error Reduction Program. [combustor performance evaluation codes

    NASA Technical Reports Server (NTRS)

    Syed, S. A.; Chiappetta, L. M.; Gosman, A. D.

    1985-01-01

    The details of a study to select, incorporate and evaluate the best available finite difference scheme to reduce numerical error in combustor performance evaluation codes are described. The combustor performance computer programs chosen were the two dimensional and three dimensional versions of Pratt & Whitney's TEACH code. The criteria used to select schemes required that the difference equations mirror the properties of the governing differential equation, be more accurate than the current hybrid difference scheme, be stable and economical, be compatible with TEACH codes, use only modest amounts of additional storage, and be relatively simple. The methods of assessment used in the selection process consisted of examination of the difference equation, evaluation of the properties of the coefficient matrix, Taylor series analysis, and performance on model problems. Five schemes from the literature and three schemes developed during the course of the study were evaluated. This effort resulted in the incorporation of a scheme in 3D-TEACH which is usuallly more accurate than the hybrid differencing method and never less accurate.

  11. Performance evaluation of fingerprint verification systems.

    PubMed

    Cappelli, Raffaele; Maio, Dario; Maltoni, Davide; Wayman, James L; Jain, Anil K

    2006-01-01

    This paper is concerned with the performance evaluation of fingerprint verification systems. After an initial classification of biometric testing initiatives, we explore both the theoretical and practical issues related to performance evaluation by presenting the outcome of the recent Fingerprint Verification Competition (FVC2004). FVC2004 was organized by the authors of this work for the purpose of assessing the state-of-the-art in this challenging pattern recognition application and making available a new common benchmark for an unambiguous comparison of fingerprint-based biometric systems. FVC2004 is an independent, strongly supervised evaluation performed at the evaluators' site on evaluators' hardware. This allowed the test to be completely controlled and the computation times of different algorithms to be fairly compared. The experience and feedback received from previous, similar competitions (FVC2000 and FVC2002) allowed us to improve the organization and methodology of FVC2004 and to capture the attention of a significantly higher number of academic and commercial organizations (67 algorithms were submitted for FVC2004). A new, "Light" competition category was included to estimate the loss of matching performance caused by imposing computational constraints. This paper discusses data collection and testing protocols, and includes a detailed analysis of the results. We introduce a simple but effective method for comparing algorithms at the score level, allowing us to isolate difficult cases (images) and to study error correlations and algorithm "fusion." The huge amount of information obtained, including a structured classification of the submitted algorithms on the basis of their features, makes it possible to better understand how current fingerprint recognition systems work and to delineate useful research directions for the future.

  12. Performance Evaluation of a Data Validation System

    NASA Technical Reports Server (NTRS)

    Wong, Edmond (Technical Monitor); Sowers, T. Shane; Santi, L. Michael; Bickford, Randall L.

    2005-01-01

    Online data validation is a performance-enhancing component of modern control and health management systems. It is essential that performance of the data validation system be verified prior to its use in a control and health management system. A new Data Qualification and Validation (DQV) Test-bed application was developed to provide a systematic test environment for this performance verification. The DQV Test-bed was used to evaluate a model-based data validation package known as the Data Quality Validation Studio (DQVS). DQVS was employed as the primary data validation component of a rocket engine health management (EHM) system developed under NASA's NGLT (Next Generation Launch Technology) program. In this paper, the DQVS and DQV Test-bed software applications are described, and the DQV Test-bed verification procedure for this EHM system application is presented. Test-bed results are summarized and implications for EHM system performance improvements are discussed.

  13. Cavitation performance evaluation for a condensate pump

    NASA Astrophysics Data System (ADS)

    Yu, A.; Yu, W. P.; Pan, Z. B.; Luo, X. W.; Ji, B.; Y Xu, H.

    2013-12-01

    Cavitation in a condensate pump with specific speed of 95 m·m3s-1·min-1 was treated in this study. Cavitation performance for the pump was tested experimentally, and the steady state cavitating flows in the pump impeller were simulated by RANS method as well as a homogeneous cavitation model. It is noted that cavitating flow simulation reasonably depicted cavitation development in the pump. Compared to the tested results, the numerical simulation basically predicted later performance drops due to cavitation. Unfortunately, the cavitation simulation at the operation condition of 50% best efficiency point could not predict the head drop up to 3%. By applying the concept of relative cavity length cavitation performance evaluation is achieved. For better application, future study is necessary to establish the relation between relative cavity length and performance drop.

  14. Performance evaluation soil samples utilizing encapsulation technology

    DOEpatents

    Dahlgran, James R.

    1999-01-01

    Performance evaluation soil samples and method of their preparation using encapsulation technology to encapsulate analytes which are introduced into a soil matrix for analysis and evaluation by analytical laboratories. Target analytes are mixed in an appropriate solvent at predetermined concentrations. The mixture is emulsified in a solution of polymeric film forming material. The emulsified solution is polymerized to form microcapsules. The microcapsules are recovered, quantitated and introduced into a soil matrix in a predetermined ratio to form soil samples with the desired analyte concentration.

  15. Performance evaluation soil samples utilizing encapsulation technology

    DOEpatents

    Dahlgran, J.R.

    1999-08-17

    Performance evaluation soil samples and method of their preparation uses encapsulation technology to encapsulate analytes which are introduced into a soil matrix for analysis and evaluation by analytical laboratories. Target analytes are mixed in an appropriate solvent at predetermined concentrations. The mixture is emulsified in a solution of polymeric film forming material. The emulsified solution is polymerized to form microcapsules. The microcapsules are recovered, quantitated and introduced into a soil matrix in a predetermined ratio to form soil samples with the desired analyte concentration. 1 fig.

  16. Performance evaluation soil samples utilizing encapsulation technology

    SciTech Connect

    Dahlgran, James R.

    1997-12-01

    Performance evaluation soil samples and method of their preparation are described using encapsulation technology to encapsulate analytes which are introduced into a soil matrix for analysis and evaluation by analytical laboratories. Target analytes are mixed in an appropriate solvent at predetermined concentrations. The mixture is emulsified in a solution of polymeric film forming material. The emulsified solution is polymerized to form microcapsules. The microcapsules are recovered, quantitated and introduced into a soil matrix in a predetermined ratio to form soil samples with the desired analyte concentration.

  17. Performance Evaluation Methods for Assistive Robotic Technology

    NASA Astrophysics Data System (ADS)

    Tsui, Katherine M.; Feil-Seifer, David J.; Matarić, Maja J.; Yanco, Holly A.

    Robots have been developed for several assistive technology domains, including intervention for Autism Spectrum Disorders, eldercare, and post-stroke rehabilitation. Assistive robots have also been used to promote independent living through the use of devices such as intelligent wheelchairs, assistive robotic arms, and external limb prostheses. Work in the broad field of assistive robotic technology can be divided into two major research phases: technology development, in which new devices, software, and interfaces are created; and clinical, in which assistive technology is applied to a given end-user population. Moving from technology development towards clinical applications is a significant challenge. Developing performance metrics for assistive robots poses a related set of challenges. In this paper, we survey several areas of assistive robotic technology in order to derive and demonstrate domain-specific means for evaluating the performance of such systems. We also present two case studies of applied performance measures and a discussion regarding the ubiquity of functional performance measures across the sampled domains. Finally, we present guidelines for incorporating human performance metrics into end-user evaluations of assistive robotic technologies.

  18. Solar power plant performance evaluation: simulation and experimental validation

    NASA Astrophysics Data System (ADS)

    Natsheh, E. M.; Albarbar, A.

    2012-05-01

    In this work the performance of solar power plant is evaluated based on a developed model comprise photovoltaic array, battery storage, controller and converters. The model is implemented using MATLAB/SIMULINK software package. Perturb and observe (P&O) algorithm is used for maximizing the generated power based on maximum power point tracker (MPPT) implementation. The outcome of the developed model are validated and supported by a case study carried out using operational 28.8kW grid-connected solar power plant located in central Manchester. Measurements were taken over 21 month's period; using hourly average irradiance and cell temperature. It was found that system degradation could be clearly monitored by determining the residual (the difference) between the output power predicted by the model and the actual measured power parameters. It was found that the residual exceeded the healthy threshold, 1.7kW, due to heavy snow in Manchester last winter. More important, the developed performance evaluation technique could be adopted to detect any other reasons that may degrade the performance of the P V panels such as shading and dirt. Repeatability and reliability of the developed system performance were validated during this period. Good agreement was achieved between the theoretical simulation and the real time measurement taken the online grid connected solar power plant.

  19. [Municipalities Stratification for Health Performance Evaluation].

    PubMed

    Calvo, Maria Cristina Marino; Lacerda, Josimari Telino de; Colussi, Claudia Flemming; Schneider, Ione Jayce Ceola; Rocha, Thiago Augusto Hernandes

    2016-01-01

    to propose and present a stratification of Brazilian municipalities into homogeneous groups for evaluation studies of health management performance. this was a methodological study, with selected indicators which classify municipalities according to conditions that influence the health management and population size; data for the year 2010 were collected from demographic and health databases; correlation tests and factor analysis were used. seven strata were identified - Large-sized; Medium-sized with favorable, regular or unfavorable influences; and Small-sized with favorable, regular or unfavorable influences -; there was a concentration of municipalities with favorable influences in strata with better purchasing power and funding, as well as a concentration of municipalities with unfavorable influences in the North and Northeast regions. the proposed classification grouped similar municipalities regarding influential factors in health management, which allowed the identification of comparable groups of municipalities, setting up a consistent alternative to performance evaluation studies.

  20. Comparison and Agreement Between the Richmond Agitation-Sedation Scale and the Riker Sedation-Agitation Scale in Evaluating Patients’ Eligibility for Delirium Assessment in the ICU

    PubMed Central

    Guzman, Oscar; Campbell, Noll L.; Walroth, Todd; Tricker, Jason L.; Hui, Siu L.; Perkins, Anthony; Zawahiri, Mohammed; Buckley, John D.; Farber, Mark O.; Ely, E. Wesley; Boustani, Malaz A.

    2012-01-01

    Background: Delirium evaluation in patients in the ICU requires the use of an arousal/sedation assessment tool prior to assessing consciousness. The Richmond Agitation-Sedation Scale (RASS) and the Riker Sedation-Agitation Scale (SAS) are well-validated arousal/sedation tools. We sought to assess the concordance of RASS and SAS assessments in determining eligibility of patients in the ICU for delirium screening using the confusion assessment method for the ICU (CAM-ICU). Methods: We performed a prospective cohort study in the adult medical, surgical, and progressive (step-down) ICUs of a tertiary care, university-affiliated, urban hospital in Indianapolis, Indiana. The cohort included 975 admissions to the ICU between January and October 2009. Results: The outcome measures of interest were the correlation and agreement between RASS and SAS measurements. In 2,469 RASS and SAS paired screens, the rank correlation using the Spearman correlation coefficient was 0.91, and the agreement between the two screening tools for assessing CAM-ICU eligibility as estimated by the κ coefficient was 0.93. Analysis showed that 70.1% of screens were eligible for CAM-ICU assessment using RASS (7.1% sedated [RASS −3 to −1]; 62.6% calm [0]; and 0.4% restless, agitated [+1 to +3]), compared with 72.1% using SAS (5% sedated [SAS 3]; 66.5% calm [4]; and 0.6% anxious, agitated [5, 6]). In the mechanically ventilated subgroup, RASS identified 19.1% CAM-ICU eligible patients compared with 24.6% by SAS. The correlation coefficient in this subgroup was 0.70 and the agreement was 0.81. Conclusion: Both SAS and RASS led to similar rates of delirium assessment using the CAM-ICU. PMID:22539644

  1. Performance Evaluation of Kitchen Exhaust Draft Hoods.

    DTIC Science & Technology

    1980-03-01

    1-ACI827 JOHNS - MANVILLE SALES CORP DENVER CO RESEARCH AND DEV-ETC F/e 13/1 PERFORMANCE EVALUATION OF KITCHEN EXHAUST DRAFT HOOOS. (U) MAR 80 P 8...ORGANIZATION NAME AND ADDRESS 10. PROGRAM ELEMENT PROJECT. TASK AREA a WOPK UNIT NUMOERS Johns - Manville Sales Corper a, t Research & Development Center /0004...P. B. SHEPHERD, R. H. NEISEL JOHNS - MANVILLE SALES CORPORATION RESEARCH & DEVELOPMENT CENTER KEN-CARYL RANCH, DENVER, COLORADO 80217 MARCH 1980 FINAL

  2. Assessing agreement between preclinical magnetic resonance imaging and histology: An evaluation of their image qualities and quantitative results.

    PubMed

    Elschner, Cindy; Korn, Paula; Hauptstock, Maria; Schulz, Matthias C; Range, Ursula; Jünger, Diana; Scheler, Ulrich

    2017-01-01

    One consequence of demographic change is the increasing demand for biocompatible materials for use in implants and prostheses. This is accompanied by a growing number of experimental animals because the interactions between new biomaterials and its host tissue have to be investigated. To evaluate novel materials and engineered tissues the use of non-destructive imaging modalities have been identified as a strategic priority. This provides the opportunity for studying interactions repeatedly with individual animals, along with the advantages of reduced biological variability and decreased number of laboratory animals. However, histological techniques are still the golden standard in preclinical biomaterial research. The present article demonstrates a detailed method comparison between histology and magnetic resonance imaging. This includes the presentation of their image qualities as well as the detailed statistical analysis for assessing agreement between quantitative measures. Exemplarily, the bony ingrowth of tissue engineered bone substitutes for treatment of a cleft-like maxillary bone defect has been evaluated. By using a graphical concordance analysis the mean difference between MRI results and histomorphometrical measures has been examined. The analysis revealed a slightly but significant bias in the case of the bone volume [Formula: see text] and a clearly significant deviation for the remaining defect width [Formula: see text] But the study although showed a considerable effect of the analyzed section position to the quantitative result. It could be proven, that the bias of the data sets was less originated due to the imaging modalities, but mainly on the evaluation of different slice positions. The article demonstrated that method comparisons not always need the use of an independent animal study, additionally.

  3. Project Performance Evaluation Using Deep Belief Networks

    NASA Astrophysics Data System (ADS)

    Nguvulu, Alick; Yamato, Shoso; Honma, Toshihisa

    A Project Assessment Indicator (PAI) Model has recently been applied to evaluate monthly project performance based on 15 project elements derived from the project management (PM) knowledge areas. While the PAI Model comprehensively evaluates project performance, it lacks objectivity and universality. It lacks objectivity because experts assign model weights intuitively based on their PM skills and experience. It lacks universality because the allocation of ceiling scores to project elements is done ad hoc based on the empirical rule without taking into account the interactions between the project elements. This study overcomes these limitations by applying a DBN approach where the model automatically assigns weights and allocates ceiling scores to the project elements based on the DBN weights which capture the interaction between the project elements. We train our DBN on 5 IT projects of 12 months duration and test it on 8 IT projects with less than 12 months duration. We completely eliminate the manual assigning of weights and compute ceiling scores of project elements based on DBN weights. Our trained DBN evaluates monthly project performance of the 8 test projects based on the 15 project elements to within a monthly relative error margin of between ±1.03 and ±3.30%.

  4. Metrics for Offline Evaluation of Prognostic Performance

    NASA Technical Reports Server (NTRS)

    Saxena, Abhinav; Celaya, Jose; Saha, Bhaskar; Saha, Sankalita; Goebel, Kai

    2010-01-01

    Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

  5. Model Performance Evaluation and Scenario Analysis (MPESA) Tutorial

    EPA Science Inventory

    This tool consists of two parts: model performance evaluation and scenario analysis (MPESA). The model performance evaluation consists of two components: model performance evaluation metrics and model diagnostics. These metrics provides modelers with statistical goodness-of-fit m...

  6. Model Performance Evaluation and Scenario Analysis (MPESA) Tutorial

    EPA Science Inventory

    This tool consists of two parts: model performance evaluation and scenario analysis (MPESA). The model performance evaluation consists of two components: model performance evaluation metrics and model diagnostics. These metrics provides modelers with statistical goodness-of-fit m...

  7. Analytical performance evaluation for autonomous sensor fusion

    NASA Astrophysics Data System (ADS)

    Chang, K. C.

    2008-04-01

    A distributed data fusion system consists of a network of sensors, each capable of local processing and fusion of sensor data. There has been a great deal of work in developing distributed fusion algorithms applicable to a network centric architecture. Currently there are at least a few approaches including naive fusion, cross-correlation fusion, information graph fusion, maximum a posteriori (MAP) fusion, channel filter fusion, and covariance intersection fusion. However, in general, in a distributed system such as the ad hoc sensor networks, the communication architecture is not fixed. Each node has knowledge of only its local connectivity but not the global network topology. In those cases, the distributed fusion algorithm based on information graph type of approach may not scale due to its requirements to carry long pedigree information for decorrelation. In this paper, we focus on scalable fusion algorithms and conduct analytical performance evaluation to compare their performance. The goal is to understand the performance of those algorithms under different operating conditions. Specifically, we evaluate the performance of channel filter fusion, Chernoff fusion, Shannon Fusion, and Battachayya fusion algorithms. We also compare their results to NaÃve fusion and "optimal" centralized fusion algorithms under a specific communication pattern.

  8. Preclinical Performance Evaluation of Percutaneous Glucose Biosensors

    PubMed Central

    Soto, Robert J.; Schoenfisch, Mark H.

    2015-01-01

    The utility of continuous glucose monitoring devices remains limited by an obstinate foreign body response (FBR) that degrades the analytical performance of the in vivo sensor. A number of novel materials that resist or delay the FBR have been proposed as outer, tissue-contacting glucose sensor membranes as a strategy to improve sensor accuracy. Traditionally, researchers have examined the ability of a material to minimize the host response by assessing adsorbed cell morphology and tissue histology. However, these techniques do not adequately predict in vivo glucose sensor function, necessitating sensor performance evaluation in a relevant animal model prior to human testing. Herein, the effects of critical experimental parameters, including the animal model and data processing methods, on the reliability and usefulness of preclinical sensor performance data are considered. PMID:26085566

  9. Group 3: Performance evaluation and assessment

    NASA Technical Reports Server (NTRS)

    Frink, A.

    1981-01-01

    Line-oriented flight training provides a unique learning experience and an opportunity to look at aspects of performance other types of training did not provide. Areas such as crew coordination, resource management, leadership, and so forth, can be readily evaluated in such a format. While individual performance is of the utmost importance, crew performance deserves equal emphasis, therefore, these areas should be carefully observed by the instructors as an rea for discussion in the same way that individual performane is observed. To be effective, it must be accepted by the crew members, and administered by the instructors as pure training-learning through experience. To keep open minds, to benefit most from the experience, both in the doing and in the follow-on discussion, it is essential that it be entered into with a feeling of freedom, openness, and enthusiasm. Reserve or defensiveness because of concern for failure must be inhibit participation.

  10. Evaluating Algorithm Performance Metrics Tailored for Prognostics

    NASA Technical Reports Server (NTRS)

    Saxena, Abhinav; Celaya, Jose; Saha, Bhaskar; Saha, Sankalita; Goebel, Kai

    2009-01-01

    Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

  11. Agreement and discrepancy between mother and child in the evaluation of children's anxiety symptoms and anxiety life interference.

    PubMed

    Pereira, Ana Isabel; Muris, Peter; Barros, Luisa; Goes, Rita; Marques, Teresa; Russo, Vanessa

    2015-03-01

    This study explored the agreement and discrepancy between mother and child reports of children's anxiety symptoms and anxiety life interference. A large community sample of 1,065 Portuguese children aged between 7 and 14 years and their mothers completed a DSM-based anxiety symptoms scale. For a subsample of 135 children with an anxiety disorder, additional data on children's anxiety life interference and maternal anxiety and depression symptoms were collected. The results showed that children generally reported higher levels of anxiety symptoms than their mothers. Overall, most correlations between mother and child reports of anxiety symptoms were significant but in the low to moderate range, with the strongest associations for symptoms of specific phobias and school phobia. In the subsample of children with an anxiety disorder, mothers reported higher levels of anxiety life interference than children, and the correlation between mother and child reports of anxiety life interference was significant but again modest in magnitude. Lastly, maternal anxiety was positively associated with the discrepancy between mother and child reports of anxiety symptoms. Together, the results of this study further underline the importance of a multi-informant approach in the evaluation of children's anxiety problems.

  12. Evaluating the agreement between recordings and simulation results: use of both seismological and engineering criteria within the framework of Euroseistest Verification and Validation Project (E2VP)

    NASA Astrophysics Data System (ADS)

    Maufroy, Emeline; Chaljub, Emmanuel; Bard, Pierre-Yves; Hollender, Fabrice

    2013-04-01

    Numerical prediction of the ground motion is a major challenge for seismic hazard assessment, especially in regions of low to moderate seismicity where only few data are available. With the continuous improvement of the 3-D numerical methods and the increase of computational power, it is now possible to simulate earthquake ground motion even for realistic configurations, for example large models (size of tens of kilometers) including low shear wave velocities (< 200 m/s) and site effects up to 4-5 Hz. However at those frequencies the ground motion is affected by a large variety of features: for examples lithology of the rocks, geometry of the free surface and of the near-surface structures, damping. The diversity and the potential combination of these features slow down the understanding of the ground motion in the high-frequency range and thus increase the difficulty to obtain a satisfying agreement between predicted and recorded waveforms. We perform a comparison exercise between recorded waveforms and their predictions by 3-D numerical methods. This work is based on the international project E2VP (Euroseistest Verification and Validation Project) on the Mygdonian basin, northwest of Thessaloniki, Greece. It is not so simple to decide the criteria of what is good or poor agreement between recordings and their numerical predictions. The experience in E2VP shows the answer could be a matter of point of view. Our goal is to evaluate the reliability of the simulation tools for civil engineering design purposes, but it is definitely necessary to include the seismologist point of view as well; their expertise is essential in order to identify the reason of discrepancy between recordings and their numerical predictions, and thus to suggest ways of improvement. We discuss on the respective interest of several seismological and engineering parameters (including PGA, elastic spectral acceleration, Arias intensity, relative significant duration, transfer functions, and full

  13. Are Teachers' Unions Really to Blame? Collective Bargaining Agreements and Their Relationships with District Resource Allocation and Student Performance in California

    ERIC Educational Resources Information Center

    Strunk, Katharine O.

    2011-01-01

    Increased spending and decreased student performance have been attributed in part to teachers' unions and to the collective bargaining agreements (CBAs) they negotiate with school boards. However, only recently have researchers begun to examine impacts of specific aspects of CBAs on student and district outcomes. This article uses a unique measure…

  14. Performance evaluation of triangulation based range sensors.

    PubMed

    Guidi, Gabriele; Russo, Michele; Magrassi, Grazia; Bordegoni, Monica

    2010-01-01

    The performance of 2D digital imaging systems depends on several factors related with both optical and electronic processing. These concepts have originated standards, which have been conceived for photographic equipment and bi-dimensional scanning systems, and which have been aimed at estimating different parameters such as resolution, noise or dynamic range. Conversely, no standard test protocols currently exist for evaluating the corresponding performances of 3D imaging systems such as laser scanners or pattern projection range cameras. This paper is focused on investigating experimental processes for evaluating some critical parameters of 3D equipment, by extending the concepts defined by the ISO standards to the 3D domain. The experimental part of this work concerns the characterization of different range sensors through the extraction of their resolution, accuracy and uncertainty from sets of 3D data acquisitions of specifically designed test objects whose geometrical characteristics are known in advance. The major objective of this contribution is to suggest an easy characterization process for generating a reliable comparison between the performances of different range sensors and to check if a specific piece of equipment is compliant with the expected characteristics.

  15. Performance evaluation of an automotive thermoelectric generator

    NASA Astrophysics Data System (ADS)

    Dubitsky, Andrei O.

    Around 40% of the total fuel energy in typical internal combustion engines (ICEs) is rejected to the environment in the form of exhaust gas waste heat. Efficient recovery of this waste heat in automobiles can promise a fuel economy improvement of 5%. The thermal energy can be harvested through thermoelectric generators (TEGs) utilizing the Seebeck effect. In the present work, a versatile test bench has been designed and built in order to simulate conditions found on test vehicles. This allows experimental performance evaluation and model validation of automotive thermoelectric generators. An electrically heated exhaust gas circuit and a circulator based coolant loop enable integrated system testing of hot and cold side heat exchangers, thermoelectric modules (TEMs), and thermal interface materials at various scales. A transient thermal model of the coolant loop was created in order to design a system which can maintain constant coolant temperature under variable heat input. Additionally, as electrical heaters cannot match the transient response of an ICE, modelling was completed in order to design a relaxed exhaust flow and temperature history utilizing the system thermal lag. This profile reduced required heating power and gas flow rates by over 50%. The test bench was used to evaluate a DOE/GM initial prototype automotive TEG and validate analytical performance models. The maximum electrical power generation was found to be 54 W with a thermal conversion efficiency of 1.8%. It has been found that thermal interface management is critical for achieving maximum system performance, with novel designs being considered for further improvement.

  16. Evaluating iterative reconstruction performance in computed tomography

    SciTech Connect

    Chen, Baiyu Solomon, Justin; Ramirez Giraldo, Juan Carlos; Samei, Ehsan

    2014-12-15

    Purpose: Iterative reconstruction (IR) offers notable advantages in computed tomography (CT). However, its performance characterization is complicated by its potentially nonlinear behavior, impacting performance in terms of specific tasks. This study aimed to evaluate the performance of IR with both task-specific and task-generic strategies. Methods: The performance of IR in CT was mathematically assessed with an observer model that predicted the detection accuracy in terms of the detectability index (d′). d′ was calculated based on the properties of the image noise and resolution, the observer, and the detection task. The characterizations of image noise and resolution were extended to accommodate the nonlinearity of IR. A library of tasks was mathematically modeled at a range of sizes (radius 1–4 mm), contrast levels (10–100 HU), and edge profiles (sharp and soft). Unique d′ values were calculated for each task with respect to five radiation exposure levels (volume CT dose index, CTDI{sub vol}: 3.4–64.8 mGy) and four reconstruction algorithms (filtered backprojection reconstruction, FBP; iterative reconstruction in imaging space, IRIS; and sinogram affirmed iterative reconstruction with strengths of 3 and 5, SAFIRE3 and SAFIRE5; all provided by Siemens Healthcare, Forchheim, Germany). The d′ values were translated into the areas under the receiver operating characteristic curve (AUC) to represent human observer performance. For each task and reconstruction algorithm, a threshold dose was derived as the minimum dose required to achieve a threshold AUC of 0.9. A task-specific dose reduction potential of IR was calculated as the difference between the threshold doses for IR and FBP. A task-generic comparison was further made between IR and FBP in terms of the percent of all tasks yielding an AUC higher than the threshold. Results: IR required less dose than FBP to achieve the threshold AUC. In general, SAFIRE5 showed the most significant dose reduction

  17. Evaluating iterative reconstruction performance in computed tomography.

    PubMed

    Chen, Baiyu; Ramirez Giraldo, Juan Carlos; Solomon, Justin; Samei, Ehsan

    2014-12-01

    Iterative reconstruction (IR) offers notable advantages in computed tomography (CT). However, its performance characterization is complicated by its potentially nonlinear behavior, impacting performance in terms of specific tasks. This study aimed to evaluate the performance of IR with both task-specific and task-generic strategies. The performance of IR in CT was mathematically assessed with an observer model that predicted the detection accuracy in terms of the detectability index (d'). d' was calculated based on the properties of the image noise and resolution, the observer, and the detection task. The characterizations of image noise and resolution were extended to accommodate the nonlinearity of IR. A library of tasks was mathematically modeled at a range of sizes (radius 1-4 mm), contrast levels (10-100 HU), and edge profiles (sharp and soft). Unique d' values were calculated for each task with respect to five radiation exposure levels (volume CT dose index, CTDIvol: 3.4-64.8 mGy) and four reconstruction algorithms (filtered backprojection reconstruction, FBP; iterative reconstruction in imaging space, IRIS; and sinogram affirmed iterative reconstruction with strengths of 3 and 5, SAFIRE3 and SAFIRE5; all provided by Siemens Healthcare, Forchheim, Germany). The d' values were translated into the areas under the receiver operating characteristic curve (AUC) to represent human observer performance. For each task and reconstruction algorithm, a threshold dose was derived as the minimum dose required to achieve a threshold AUC of 0.9. A task-specific dose reduction potential of IR was calculated as the difference between the threshold doses for IR and FBP. A task-generic comparison was further made between IR and FBP in terms of the percent of all tasks yielding an AUC higher than the threshold. IR required less dose than FBP to achieve the threshold AUC. In general, SAFIRE5 showed the most significant dose reduction potentials (11-54 mGy, 77%-84%), followed by

  18. Performance Evaluation of Emerging High Performance Computing Technologies using WRF

    NASA Astrophysics Data System (ADS)

    Newby, G. B.; Morton, D.

    2008-12-01

    The Arctic Region Supercomputing Center (ARSC) has evaluated multicore processors and other emerging processor technologies for a variety of high performance computing applications in the earth and space sciences, especially climate and weather applications. A flagship effort has been to assess dual core processor nodes on ARSC's Midnight supercomputer, in which two-socket systems were compared to eight-socket systems. Midnight is utilized for ARSC's twice-daily weather research and forecasting (WRF) model runs, available at weather.arsc.edu. Among other findings on Midnight, it was found that the Hypertransport system for interconnecting Opteron processors, memory, and other subsystems does not scale as well on eight-socket (sixteen processor) systems as well as two-socket (four processor) systems. A fundamental limitation is the cache snooping operation performed whenever a computational thread accesses main memory. This increases memory latency as the number of processor sockets increases. This is particularly noticeable on applications such as WRF that are primarily CPU-bound, versus applications that are bound by input/output or communication. The new Cray XT5 supercomputer at ARSC features quad core processors, and will host a variety of scaling experiments for WRF, CCSM4, and other models. Early results will be presented, including a series of WRF runs for Alaska with grid resolutions under 2km. ARSC will discuss a set of standardized test cases for the Alaska domain, similar to existing test cases for CONUS. These test cases will provide different configuration sizes and resolutions, suitable for single processors up to thousands. Beyond multi-core Opteron-based supercomputers, ARSC has examined WRF and other applications on additional emerging technologies. One such technology is the graphics processing unit, or GPU. The 9800-series nVidia GPU was evaluated with the cuBLAS software library. While in-socket GPUs might be forthcoming in the future, current

  19. Seismic Performance Evaluation of Concentrically Braced Frames

    NASA Astrophysics Data System (ADS)

    Hsiao, Po-Chien

    Concentrically braced frames (CBFs) are broadly used as lateral-load resisting systems in buildings throughout the US. In high seismic regions, special concentrically braced frames (SCBFs) where ductility under seismic loading is necessary. Their large elastic stiffness and strength efficiently sustains the seismic demands during smaller, more frequent earthquakes. During large, infrequent earthquakes, SCBFs exhibit highly nonlinear behavior due to brace buckling and yielding and the inelastic behavior induced by secondary deformation of the framing system. These response modes reduce the system demands relative to an elastic system without supplemental damping. In design the re reduced demands are estimated using a response modification coefficient, commonly termed the R factor. The R factor values are important to the seismic performance of a building. Procedures put forth in FEMAP695 developed to R factors through a formalized procedure with the objective of consistent level of collapse potential for all building types. The primary objective of the research was to evaluate the seismic performance of SCBFs. To achieve this goal, an improved model including a proposed gusset plate connection model for SCBFs that permits accurate simulation of inelastic deformations of the brace, gusset plate connections, beams and columns and brace fracture was developed and validated using a large number of experiments. Response history analyses were conducted using the validated model. A series of different story-height SCBF buildings were designed and evaluated. The FEMAP695 method and an alternate procedure were applied to SCBFs and NCBFs. NCBFs are designed without ductile detailing. The evaluation using P695 method shows contrary results to the alternate evaluation procedure and the current knowledge in which short-story SCBF structures are more venerable than taller counterparts and NCBFs are more vulnerable than SCBFs.

  20. Iowa Flood Center Model Performance Evaluation

    NASA Astrophysics Data System (ADS)

    Quintero, F.; Krajewski, W. F.; Mantilla, R.; Seo, B. C.

    2016-12-01

    We evaluated the performance of a hydrologic model which produces real-time flow forecasts. The model was developed by the Iowa Flood Center (IFC) and it is implemented operationally to produce streamflow forecast for the communities of the state of Iowa in the United States. The model parameters are calibration-free. It has a parsimonious structure that reproduces the more significant processes involved in the transformation from rainfall to runoff. The operational model uses a rainfall forcing produced by IFC, derived from the combination of rainfall fields of seven NEXRAD radars. This rainfall forcing does not include bias adjustment from rain gauges, due to the non-existence of a raingage network that enable the correction in real-time. Therefore, the model was also evaluated using the bias-adjusted rainfall product Stage IV. We used six years of IFC rainfall and Stage IV to evaluate the performance of the hydrologic model and the sensitivity of the flow simulations to the model input. The model was not calibrated to any particular rainfall product. The distributed structure of the model allows obtaining results at any channel of the drainage network. We produced simulated hydrographs at about 140 locations with different sub-basin spatial scales, where USGS streamflow observations are available. We compared flow simulations to observations and obtained several metrics of error including Nash Sutcliffe efficiency, normalized root mean square error, volume error and time to peak error. We also evaluated the number of occurrences of hits and false alarms of discharge forecasts exceeding flood stage.

  1. Performance evaluation of swimmers: scientific tools.

    PubMed

    Smith, David J; Norris, Stephen R; Hogg, John M

    2002-01-01

    The purpose of this article is to provide a critical commentary of the physiological and psychological tools used in the evaluation of swimmers. The first-level evaluation should be the competitive performance itself, since it is at this juncture that all elements interplay and provide the 'highest form' of assessment. Competition video analysis of major swimming events has progressed to the point where it has become an indispensable tool for coaches, athletes, sport scientists, equipment manufacturers, and even the media. The breakdown of each swimming performance at the individual level to its constituent parts allows for comparison with the predicted or sought after execution, as well as allowing for comparison with identified world competition levels. The use of other 'on-going' monitoring protocols to evaluate training efficacy typically involves criterion 'effort' swims and specific training sets where certain aspects are scrutinised in depth. Physiological parameters that are often examined alongside swimming speed and technical aspects include oxygen uptake, heart rate, blood lactate concentration, blood lactate accumulation and clearance rates. Simple and more complex procedures are available for in-training examination of technical issues. Strength and power may be quantified via several modalities although, typically, tethered swimming and dry-land isokinetic devices are used. The availability of a 'swimming flume' does afford coaches and sport scientists a higher degree of flexibility in the type of monitoring and evaluation that can be undertaken. There is convincing evidence that athletes can be distinguished on the basis of their psychological skills and emotional competencies and that these differences become further accentuated as the athlete improves. No matter what test format is used (physiological, biomechanical or psychological), similar criteria of validity must be ensured so that the test provides useful and associative information

  2. Performance evaluation of MPEG internet video coding

    NASA Astrophysics Data System (ADS)

    Luo, Jiajia; Wang, Ronggang; Fan, Kui; Wang, Zhenyu; Li, Ge; Wang, Wenmin

    2016-09-01

    Internet Video Coding (IVC) has been developed in MPEG by combining well-known existing technology elements and new coding tools with royalty-free declarations. In June 2015, IVC project was approved as ISO/IEC 14496-33 (MPEG- 4 Internet Video Coding). It is believed that this standard can be highly beneficial for video services in the Internet domain. This paper evaluates the objective and subjective performances of IVC by comparing it against Web Video Coding (WVC), Video Coding for Browsers (VCB) and AVC High Profile. Experimental results show that IVC's compression performance is approximately equal to that of the AVC High Profile for typical operational settings, both for streaming and low-delay applications, and is better than WVC and VCB.

  3. Performance evaluation of bound diamond ring tools

    SciTech Connect

    Piscotty, M.A.; Taylor, J.S.; Blaedel, K.L.

    1995-07-14

    LLNL is collaborating with the Center for Optics Manufacturing (COM) and the American Precision Optics Manufacturers Association (APOMA) to optimize bound diamond ring tools for the spherical generation of high quality optical surfaces. An important element of this work is establishing an experimentally-verified link between tooling properties and workpiece quality indicators such as roughness, subsurface damage and removal rate. In this paper, we report on a standardized methodology for assessing ring tool performance and its preliminary application to a set of commercially-available wheels. Our goals are to (1) assist optics manufacturers (users of the ring tools) in evaluating tools and in assessing their applicability for a given operation, and (2) provide performance feedback to wheel manufacturers to help optimize tooling for the optics industry. Our paper includes measurements of wheel performance for three 2-4 micron diamond bronze-bond wheels that were supplied by different manufacturers to nominally- identical specifications. Preliminary data suggests that the difference in performance levels among the wheels were small.

  4. Evaluating cryostat performance for naval applications

    NASA Astrophysics Data System (ADS)

    Knoll, David; Willen, Dag; Fesmire, James; Johnson, Wesley; Smith, Jonathan; Meneghelli, Barry; Demko, Jonathan; George, Daniel; Fowler, Brian; Huber, Patti

    2012-06-01

    The Navy intends to use High Temperature Superconducting Degaussing (HTSDG) coil systems on future Navy platforms. The Navy Metalworking Center (NMC) is leading a team that is addressing cryostat configuration and manufacturing issues associated with fabricating long lengths of flexible, vacuum-jacketed cryostats that meet Navy shipboard performance requirements. The project includes provisions to evaluate the reliability performance, as well as proofing of fabrication techniques. Navy cryostat performance specifications include less than 1 Wm-1 heat loss, 2 MPa working pressure, and a 25-year vacuum life. Cryostat multilayer insulation (MLI) systems developed on the project have been validated using a standardized cryogenic test facility and implemented on 5-meterlong test samples. Performance data from these test samples, which were characterized using both LN2 boiloff and flow-through measurement techniques, will be presented. NMC is working with an Integrated Project Team consisting of Naval Sea Systems Command, Naval Surface Warfare Center-Carderock Division, Southwire Company, nkt cables, Oak Ridge National Laboratory (ORNL), ASRC Aerospace, and NASA Kennedy Space Center (NASA-KSC) to complete these efforts. Approved for public release; distribution is unlimited. This material is submitted with the understanding that right of reproduction for governmental purposes is reserved for the Office of Naval Research, Arlington, Virginia 22203-1995.

  5. Performance, physiological, and oculometer evaluation of VTOL landing displays

    NASA Technical Reports Server (NTRS)

    North, R. A.; Stackhouse, S. P.; Graffunder, K.

    1979-01-01

    A methodological approach to measuring workload was investigated for evaluation of new concepts in VTOL aircraft displays. Physiological, visual response, and conventional flight performance measures were recorded for landing approaches performed in the NASA Visual Motion Simulator (VMS). Three displays (two computer graphic and a conventional flight director), three crosswind amplitudes, and two motion base conditions (fixed vs. moving base) were tested in a factorial design. Multivariate discriminant functions were formed from flight performance and/or visual response variables. The flight performance variable discriminant showed maximum differentation between crosswind conditions. The visual response measure discriminant maximized differences between fixed vs. motion base conditions and experimental displays. Physiological variables were used to attempt to predict the discriminant function values for each subject/condition trial. The weights of the physiological variables in these equations showed agreement with previous studies. High muscle tension, light but irregular breathing patterns, and higher heart rate with low amplitude all produced higher scores on this scale and thus represent higher workload levels.

  6. Evaluation of stroke performance in tennis.

    PubMed

    Vergauwen, L; Spaepen, A J; Lefevre, J; Hespel, P

    1998-08-01

    In the present studies, the Leuven Tennis Performance Test (LTPT), a newly developed test procedure to measure stroke performance in match-like conditions in elite tennis players, was evaluated as to its value for research purposes. The LTPT is enacted on a regular tennis court. It consists of first and second services, and of returning balls projected by a machine to target zones indicated by a lighted sign. Neutral, defensive, and offensive tactical situations are elicited by appropriately programming the machine. Stroke quality is determined from simultaneous measurements of error rate, ball velocity, and precision of ball placement. A velocity/precision (VP) an a velocity/precision/error (VPE) index are also calculated. The validity and sensitivity of the LTPT were determined by verifying whether LTPT scores reflect minor differences in tennis ranking on the one hand and the effects of fatigue on the other hand. Compared with lower ranked players, higher ones made fewer errors (P < 0.05). In addition, stroke velocity was higher (P < 0.05), and lateral stroke precision, VP, and VPE scores were better (P < 0.05) in the latter. Furthermore, fatigue induced by a prolonged tennis load increased (P < 0.05) error rate and decreased (P < 0.05) stroke velocity and the VP and VPE indices. It is concluded that the LTPT is an accurate, reliable, and valid instrument for the evaluation of stroke quality in high-level tennis players.

  7. Ground truth and benchmarks for performance evaluation

    NASA Astrophysics Data System (ADS)

    Takeuchi, Ayako; Shneier, Michael; Hong, Tsai Hong; Chang, Tommy; Scrapper, Christopher; Cheok, Geraldine S.

    2003-09-01

    Progress in algorithm development and transfer of results to practical applications such as military robotics requires the setup of standard tasks, of standard qualitative and quantitative measurements for performance evaluation and validation. Although the evaluation and validation of algorithms have been discussed for over a decade, the research community still faces a lack of well-defined and standardized methodology. The range of fundamental problems include a lack of quantifiable measures of performance, a lack of data from state-of-the-art sensors in calibrated real-world environments, and a lack of facilities for conducting realistic experiments. In this research, we propose three methods for creating ground truth databases and benchmarks using multiple sensors. The databases and benchmarks will provide researchers with high quality data from suites of sensors operating in complex environments representing real problems of great relevance to the development of autonomous driving systems. At NIST, we have prototyped a High Mobility Multi-purpose Wheeled Vehicle (HMMWV) system with a suite of sensors including a Riegl ladar, GDRS ladar, stereo CCD, several color cameras, Global Position System (GPS), Inertial Navigation System (INS), pan/tilt encoders, and odometry . All sensors are calibrated with respect to each other in space and time. This allows a database of features and terrain elevation to be built. Ground truth for each sensor can then be extracted from the database. The main goal of this research is to provide ground truth databases for researchers and engineers to evaluate algorithms for effectiveness, efficiency, reliability, and robustness, thus advancing the development of algorithms.

  8. Evaluation of inter-observer agreement when using a clinical respiratory scoring system in pre-weaned dairy calves.

    PubMed

    Buczinski, S; Faure, C; Jolivet, S; Abdallah, A

    2016-07-01

    To determine inter-observer agreement for a clinical scoring system for the detection of bovine respiratory disease complex in calves, and the impact of classification of calves as sick or healthy based on different cut-off values. Two third-year veterinary students (Observer 1 and 2) and one post-graduate student (Observer 3) received 4 hours of training on scoring dairy calves for signs of respiratory disease, including rectal temperature, cough, eye and nasal discharge, and ear position. Observers 1 and 2 scored 40 pre-weaning dairy calves 24 hours apart (80 observations) over three visits to a calf-rearing facility, and Observers 1, 2 and 3 scored 20 calves on one visit. Inter-observer agreement was assessed using percentage of agreement (PA) and Kappa statistics for individual clinical signs, comparing Observers 1 and 2. Agreement between the three observers for total clinical score was assessed using cut-off values of ≥4, ≥5 and ≥6 to indicate unhealthy calves. Inter-observer PA for rectal temperature was 0.68, for cough 0.78, for nasal discharge 0.62, for eye discharge 0.63, and for ear position 0.85. Kappa values for all clinical signs indicated slight to fair agreement (<0.4), except temperature that had moderate agreement (0.6). The Fleiss' Kappa for total score, using cut-offs of ≥4, ≥5 and ≥6 to indicate unhealthy calves, was 0.35, 0.06 and 0.13, respectively, indicating slight to fair agreement. There was important inter-observer discrepancies in scoring clinical signs of respiratory disease, using relatively inexperienced observers. These disagreements may ultimately mean increased false negative or false positive diagnoses and incorrect treatment of cases. Visual assessment of clinical signs associated with bovine respiratory disease needs to be thoroughly validated when disease monitoring is based on the use of a clinical scoring system.

  9. Manipulator Performance Evaluation Using Fitts' Taping Task

    SciTech Connect

    Draper, J.V.; Jared, B.C.; Noakes, M.W.

    1999-04-25

    Metaphorically, a teleoperator with master controllers projects the user's arms and hands into a re- mote area, Therefore, human users interact with teleoperators at a more fundamental level than they do with most human-machine systems. Instead of inputting decisions about how the system should func- tion, teleoperator users input the movements they might make if they were truly in the remote area and the remote machine must recreate their trajectories and impedance. This intense human-machine inter- action requires displays and controls more carefully attuned to human motor capabilities than is neces- sary with most systems. It is important for teleoperated manipulators to be able to recreate human trajectories and impedance in real time. One method for assessing manipulator performance is to observe how well a system be- haves while a human user completes human dexterity tasks with it. Fitts' tapping task has been, used many times in the past for this purpose. This report describes such a performance assessment. The International Submarine Engineering (ISE) Autonomous/Teleoperated Operations Manipulator (ATOM) servomanipulator system was evalu- ated using a generic positioning accuracy task. The task is a simple one but has the merits of (1) pro- ducing a performance function estimate rather than a point estimate and (2) being widely used in the past for human and servomanipulator dexterity tests. Results of testing using this task may, therefore, allow comparison with other manipulators, and is generically representative of a broad class of tasks. Results of the testing indicate that the ATOM manipulator is capable of performing the task. Force reflection had a negative impact on task efficiency in these data. This was most likely caused by the high resistance to movement the master controller exhibited with the force reflection engaged. Measurements of exerted forces were not made, so it is not possible to say whether the force reflection helped partici- pants

  10. Performance Evaluation of the SPT-140

    NASA Technical Reports Server (NTRS)

    Manzella, David; Sarmiento, Charles; Sankovic, John; Haag, Tom

    1997-01-01

    As part of an on-going cooperative program with industry, an engineering model SPT-140 Hall thruster, which may be suitable for orbit insertion and station-keeping of geosynchronous communication satellites, was evaluated with respect to thrust and radiated electromagnetic interference at the NASA Lewis Research Center. Performance measurements were made using a laboratory model propellant feed system and commercial power supplies. The engine was operated in a space simulation chamber capable of providing background pressures of 4 x 10(exp -6) Torr or less during thruster operation. Thrust was measured at input powers ranging from 1.5 to 5 kilowatts with two different output filter configurations. The broadband electromagnetic emission spectra generated by the engine was also measured for a range of frequencies from 0.01 to 18,000 Mhz. These results are compared to the noise threshold of the measurement system and MIL-STD-461C where appropriate.

  11. Evaluation of a takeoff performance monitoring system

    NASA Technical Reports Server (NTRS)

    Middleton, David B.; Srivatsan, Raghavachari

    1987-01-01

    A takeoff performance monitoring system (TOPMS) has been developed to provide the pilot with graphic/numeric information pertinent to his decision to continue or abort a takeoff. The TOPMS instrument display consists primarily of a runway graphic overlaid with symbolic status, predictive, and advisory information including: (1) current position and airspeed, (2) predicted locations for reaching decision speed and rotation speed, (3) groundroll limit for reaching the rotation speed, (4) predicted stop point for an aborted takeoff from current conditions, (5) engine-failure flags, and (6) an overall situation advisory flag which recommends continuation or rejection of the takeoff. In this study, over 30 experienced multiengine pilots evaluated the TOPMS display on the Langley B-737 real-time research simulator. The display was judged to be easy to monitor and comprehend.

  12. Performance evaluation of mail-scanning cameras

    NASA Astrophysics Data System (ADS)

    Rajashekar, Umesh; Vu, Tony Tuan; Hooning, John E.; Bovik, Alan Conrad

    2010-04-01

    Letter-scanning cameras (LSCs) form the front- end imaging systems for virtually all mail-scanning systems that are currently used to automatically sort mail products. As with any vision-dependent technology, the quality of the images generated by the camera is fundamental to the overall performance of the system. We present novel techniques for objective evaluation of LSCs using comparative imaging-a technique that involves measuring the fidelity of target images produced by a camera with reference to an image of the same target captured at very high quality. Such a framework provides a unique opportunity to directly quantify the camera's ability to capture real-world targets, such as handwritten and printed text. Noncomparative techniques were also used to measure properties such as the camera's modulation transfer function, dynamic range, and signal-to-noise ratio. To simulate real-world imaging conditions, application-specific test samples were designed using actual mail product materials.

  13. How might North American oil and gas markets have performed with a Free Trade Agreement in 1970?

    SciTech Connect

    Watkins, G.C.; Waverman, L.

    1993-12-31

    Deregulation on both sides of the U.S.-Canadian border has made certain aspects of trade agreements largely superfluous in the near term. It is over the longer term that the impact of the NAFTA will become apparent. To grapple with this issue, simulations are attempted of oil and gas trade between the United States and Canada as if the NAFTA had been in place before the first oil price shock of 1973. The simulations suggest substantial additional exports of Canadian oil and gas would have enabled the United States to back out volumes of OPEC oil during the critical years of the late 1970s and early 1980s. This would have served to dampen world oil markets during the years of OPEC ascendancy-not dramatically, but not negligibly either. By promoting closer integration of energy markets, the NAFTA should lead to more cohesive North American responses to any future world oil shocks. 13 refs., 8 tabs.

  14. Performance Evaluations of Ceramic Wafer Seals

    NASA Technical Reports Server (NTRS)

    Dunlap, Patrick H., Jr.; DeMange, Jeffrey J.; Steinetz, Bruce M.

    2006-01-01

    Future hypersonic vehicles will require high temperature, dynamic seals in advanced ramjet/scramjet engines and on the vehicle airframe to seal the perimeters of movable panels, flaps, and doors. Seal temperatures in these locations can exceed 2000 F, especially when the seals are in contact with hot ceramic matrix composite sealing surfaces. NASA Glenn Research Center is developing advanced ceramic wafer seals to meet the needs of these applications. High temperature scrub tests performed between silicon nitride wafers and carbon-silicon carbide rub surfaces revealed high friction forces and evidence of material transfer from the rub surfaces to the wafer seals. Stickage between adjacent wafers was also observed after testing. Several design changes to the wafer seals were evaluated as possible solutions to these concerns. Wafers with recessed sides were evaluated as a potential means of reducing friction between adjacent wafers. Alternative wafer materials are also being considered as a means of reducing friction between the seals and their sealing surfaces and because the baseline silicon nitride wafer material (AS800) is no longer commercially available.

  15. Performance Evaluation of Photovoltaic Solar Air Conditioning

    NASA Astrophysics Data System (ADS)

    Snegirjovs, A.; Shipkovs, P.; Lebedeva, K.; Kashkarova, G.; Migla, L.; Gantenbein, P.; Omlin, L.

    2016-12-01

    Information on the electrical-driven solar air conditioning (SAC) is rather scanty. A considerable body of technical data mostly concerns large-scale photo-voltaic solar air conditioning (PV-SAC) systems. Reliable information about the energy output has arisen only in recent years; however, it is still not easily accessible, and sometimes its sources are closed. Despite these facts, solar energy researchers, observers and designers devote special attention to this type of SAC systems. In this study, performance evaluation is performed for the PV-SAC technology, in which low-power (up to 15 kWp of cooling power on average) systems are used. Such a system contains a PV electric-driven compression chiller with cold and heat sensible thermal storage capacities, and a rejected energy unit used for preheating domestic hot water (DHW). In a non-cooling season, it is possible to partly employ the system in the reverse mode for DHW production. In this mode, the ambient air serves as a heat source. Besides, free cooling is integrated in the PV-SAC concept.

  16. Performance Evaluation Modeling of Network Sensors

    NASA Technical Reports Server (NTRS)

    Clare, Loren P.; Jennings, Esther H.; Gao, Jay L.

    2003-01-01

    Substantial benefits are promised by operating many spatially separated sensors collectively. Such systems are envisioned to consist of sensor nodes that are connected by a communications network. A simulation tool is being developed to evaluate the performance of networked sensor systems, incorporating such metrics as target detection probabilities, false alarms rates, and classification confusion probabilities. The tool will be used to determine configuration impacts associated with such aspects as spatial laydown, and mixture of different types of sensors (acoustic, seismic, imaging, magnetic, RF, etc.), and fusion architecture. The QualNet discrete-event simulation environment serves as the underlying basis for model development and execution. This platform is recognized for its capabilities in efficiently simulating networking among mobile entities that communicate via wireless media. We are extending QualNet's communications modeling constructs to capture the sensing aspects of multi-target sensing (analogous to multiple access communications), unimodal multi-sensing (broadcast), and multi-modal sensing (multiple channels and correlated transmissions). Methods are also being developed for modeling the sensor signal sources (transmitters), signal propagation through the media, and sensors (receivers) that are consistent with the discrete event paradigm needed for performance determination of sensor network systems. This work is supported under the Microsensors Technical Area of the Army Research Laboratory (ARL) Advanced Sensors Collaborative Technology Alliance.

  17. Automated Retinal Layer Segmentation Using Spectral Domain Optical Coherence Tomography: Evaluation of Inter-Session Repeatability and Agreement between Devices

    PubMed Central

    Terry, Louise; Cassels, Nicola; Lu, Kelly; Acton, Jennifer H.; Margrain, Tom H.; North, Rachel V.; Fergusson, James; White, Nick; Wood, Ashley

    2016-01-01

    Retinal and intra-retinal layer thicknesses are routinely generated from optical coherence tomography (OCT) images, but on-board software capabilities and image scaling assumptions are not consistent across devices. This study evaluates the device-independent Iowa Reference Algorithms (Iowa Institute for Biomedical Imaging) for automated intra-retinal layer segmentation and image scaling for three OCT systems. Healthy participants (n = 25) underwent macular volume scans using a Cirrus HD-OCT (Zeiss), 3D-OCT 1000 (Topcon), and a non-commercial long-wavelength (1040nm) OCT on two occasions. Mean thickness of 10 intra-retinal layers was measured in three ETDRS subfields (fovea, inner ring and outer ring) using the Iowa Reference Algorithms. Where available, total retinal thicknesses were measured using on-board software. Measured axial eye length (AEL)-dependent scaling was used throughout, with a comparison made to the system-specific fixed-AEL scaling. Inter-session repeatability and agreement between OCT systems and segmentation methods was assessed. Inter-session coefficient of repeatability (CoR) for the foveal subfield total retinal thickness was 3.43μm, 4.76μm, and 5.98μm for the Zeiss, Topcon, and long-wavelength images respectively. For the commercial software, CoR was 4.63μm (Zeiss) and 7.63μm (Topcon). The Iowa Reference Algorithms demonstrated higher repeatability than the on-board software and, in addition, reliably segmented all 10 intra-retinal layers. With fixed-AEL scaling, the algorithm produced significantly different thickness values for the three OCT devices (P<0.05), with these discrepancies generally characterized by an overall offset (bias) and correlations with axial eye length for the foveal subfield and outer ring (P<0.05). This correlation was reduced to an insignificant level in all cases when AEL-dependent scaling was used. Overall, the Iowa Reference Algorithms are viable for clinical and research use in healthy eyes imaged with

  18. Space Shuttle UHF Communications Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Hwu, Shian U.; Loh, Yin-Chung; Kroll, Quin D.; Sham, Catherine C.

    2004-01-01

    An extension boom is to be installed on the starboard side of the Space Shuttle Orbiter (SSO) payload bay for thermal tile inspection and repairing. As a result, the Space Shuttle payload bay Ultra High Frequency (UHF) antenna will be under the boom. This study is to evaluate the Space Shuttle UHF communication performance for antenna at a suitable new location. To insure the RF coverage performance at proposed new locations, the link margin between the UHF payload bay antenna and Extravehicular Activity (EVA) Astronauts at a range distance of 160 meters from the payload bay antenna was analyzed. The communication performance between Space Shuttle Orbiter and International Space Station (SSO-ISS) during rendezvous was also investigated. The multipath effects from payload bay structures surrounding the payload bay antenna were analyzed. The computer simulation tool based on the Geometrical Theory of Diffraction method (GTD) was used to compute the signal strengths. The total field strength was obtained by summing the direct fields from the antennas and the reflected and diffracted fields from the surrounding structures. The computed signal strengths were compared to the signal strength corresponding to the 0 dB link margin. Based on the results obtained in this study, RF coverage for SSO-EVA and SSO- ISS communication links was determined for the proposed payload bay antenna UHF locations. The RF radiation to the Orbiter Docking System (ODS) pyros, the payload bay avionics, and the Shuttle Remote Manipulator System (SRMS) from the new proposed UHF antenna location was also investigated to ensure the EMC/EMI compliances.

  19. Healthcare system intervention for prevention of birth injuries - process evaluation of self-assessment, peer review, feedback and agreement for change.

    PubMed

    Nyström, Monica E; Westerlund, Anna; Höög, Elisabet; Millde-Luthander, Charlotte; Högberg, Ulf; Grunewald, Charlotta

    2012-08-24

    Patient safety is fundamental in high quality healthcare systems but despite an excellent record of perinatal care in Sweden some children still suffer from substandard care and unnecessary birth injuries. Sustainable patient safety improvements assume changes in key actors' mental models, norms and culture as well as in the tools, design and organisation of work. Interventions positively affecting team mental models on safety issues are a first step to enhancing change. Our purpose was to study a national intervention programme for the prevention of birth injuries with the aim to elucidate how the main interventions of self-assessment, peer review, feedback and written agreement for change affected the teams and their mental model of patient safety, and thereby their readiness for change. Knowledge of relevant considerations before implementing this type of patient safety intervention series could thereby be increased. Eighty participants in twenty-seven maternity units were interviewed after the first intervention sequence of the programme. A content analysis using a priori coding was performed in order to relate results to the anticipated outcomes of three basic interventions: self-assessment, peer review and written feedback, and agreement for change. The self-assessment procedure was valuable and served as a useful tool for elucidating strengths and weaknesses and identifying areas for improvement for a safer delivery in maternity units. The peer-review intervention was appreciated, despite it being of less value when considering the contribution to explicit outcome effects (i.e. new input to team mental models and new suggestions for actions). The feedback report and the mutual agreement on measures for improvements reached when signing the contract seemed exert positive pressures for change. Our findings are in line with several studies stressing the importance of self-evaluation by encouraging a thorough review of objectives, practices and outcomes for the

  20. Relationships among Client and Counselor Agreement about the Working Alliance, Session Evaluations, and Change in Client Symptoms Using Response Surface Analysis

    ERIC Educational Resources Information Center

    Marmarosh, Cheri L.; Kivlighan, Dennis M., Jr.

    2012-01-01

    Two studies explored how counselor and client agreement on the therapy alliance, at the beginning of treatment, influenced early session evaluations and symptom change. Unlike prior studies that operationalized alliance convergence as either a profile similarity correlation or a difference score, the present study used polynomial regression and…

  1. Substantial agreement of referee recommendations at a general medical journal--a peer review evaluation at Deutsches Ärzteblatt International.

    PubMed

    Baethge, Christopher; Franklin, Jeremy; Mertens, Stephan

    2013-01-01

    Peer review is the mainstay of editorial decision making for medical journals. There is a dearth of evaluations of journal peer review with regard to reliability and validity, particularly in the light of the wide variety of medical journals. Studies carried out so far indicate low agreement among reviewers. We present an analysis of the peer review process at a general medical journal, Deutsches Ärzteblatt International. 554 reviewer recommendations on 206 manuscripts submitted between 7/2008 and 12/2009 were analyzed: 7% recommended acceptance, 74% revision and 19% rejection. Concerning acceptance (with or without revision) versus rejection, there was a substantial agreement among reviewers (74.3% of pairs of recommendations) that was not reflected by Fleiss' or Cohen's kappa (<0.2). The agreement rate amounted to 84% for acceptance, but was only 31% for rejection. An alternative kappa-statistic, however, Gwet's kappa (AC1), indicated substantial agreement (0.63). Concordance between reviewer recommendation and editorial decision was almost perfect when reviewer recommendations were unanimous. The correlation of reviewer recommendations and citations as counted by Web of Science was low (partial correlation adjusted for year of publication: -0.03, n.s.). Although our figures are similar to those reported in the literature our conclusion differs from the widely held view that reviewer agreement is low: Based on overall agreement we consider the concordance among reviewers sufficient for the purposes of editorial decision making. We believe that various measures, such as positive and negative agreement or alternative Kappa values are superior to the application of Cohen's or Fleiss' Kappa in the analysis of nominal or ordinal level data regarding reviewer agreement. Also, reviewer recommendations seem to be a poor proxy for citations because, for example, manuscripts will be changed considerably during the revision process.

  2. Evaluation of compliance with the self-regulation agreement of the food and drink vending machine sector in primary schools in Madrid, Spain, in 2008.

    PubMed

    Royo-Bordonada, Miguel A; Martínez-Huedo, María A

    2014-01-01

    To evaluate compliance with the self-regulation agreement of the food and drink vending machine sector in primary schools in Madrid, Spain. Cross-sectional study of the prevalence of vending machines in 558 primary schools in 2008. Using the directory of all registered primary schools in Madrid, we identified the presence of machines by telephone interviews and evaluated compliance with the agreement by visiting the schools and assessing accessibility, type of publicity, the products offered and knowledge of the agreement. The prevalence of schools with vending machines was 5.8%. None of the schools reported knowledge of the agreement or of its nutritional guidelines, and most machines were accessible to primary school pupils (79.3%) and packed with high-calorie, low-nutrient-dense foods (58.6%). Compliance with the self-regulation agreement of the vending machines sector was low. Stricter regulation should receive priority in the battle against the obesity epidemic. Copyright © 2013 SESPAS. Published by Elsevier Espana. All rights reserved.

  3. Performance evaluation of electrochemical concentration cell ozonesondes

    NASA Technical Reports Server (NTRS)

    Torres, A. L.; Bandy, A. R.

    1977-01-01

    Laboratory calibrations of more than a hundred electrochemical concentration cell (ECC) ozonesondes were determined relative to UV-photometry. The average intercept and slope, 0 plus or minus 5 nb and 0.96 plus or minus 0.06, respectively, indicate reasonable agreement with UV photometry, but with considerable variation from one ECC ozonesonde to another. The time required to reach 85% of the final reaction to a step-change in ozone concentration was found to average 51 seconds. Application of the individual calibrations to 20 sets of 1976 flight data reduced the average of the differences between ozonesonde and Dobson spectrophotometric measurements of total ozone from 3.9 to 1.3%. A similar treatment of a set of 10 1977 flight records improved the average ECC-Dobson agreement from -8.5 to -1.4%. Although systematic differences were reduced, no significant effect on the random variations was evident.

  4. 78 FR 26794 - Prospective Grant of Start-Up Exclusive Evaluation Option License Agreement: Gene Therapy and...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2013-05-08

    ... License Agreement: Gene Therapy and Cell-Based Therapy for Cardiac Arrhythmias AGENCY: National Institutes... limited to ``Gene therapy and cell-based therapy for cardiac arrhythmias in humans.'' Upon the expiration..., as well as cardiac cells or cardiac-like cells derived from embryonic stem cells or mesenchymal...

  5. Evaluating the Ability of and Enabling a Blind Adult with Learning Disability to Sign a Tenancy Agreement

    ERIC Educational Resources Information Center

    Waight, Mary Philomena; Oldreive, Warren James

    2012-01-01

    This paper aims to describe the process undertaken by Speech and Language Therapy and Occupational Therapy to assess a gentleman with learning disabilities and visual impairment with regard to his capacity to sign a tenancy agreement. It describes the method used to assess the gentleman's mental capacity before exploring the system used to provide…

  6. MAP [Mutual Agreement Program] Program Outcomes in the Initial Demonstration States: An Evaluative Summary of Research. Resource Document Number 7.

    ERIC Educational Resources Information Center

    Rosenfeld, Anne H.

    Mutual Agreement Programming (MAP) is an innovative technique, developed under Department of Labor sponsorship, designed to increase the efficacy and humanity of prisoner rehabilitative programs and the parole review process. It was tried on an experimental demonstration basis in institutions in Wisconsin, California, and Arizona during 1972-73.…

  7. Evaluating the Ability of and Enabling a Blind Adult with Learning Disability to Sign a Tenancy Agreement

    ERIC Educational Resources Information Center

    Waight, Mary Philomena; Oldreive, Warren James

    2012-01-01

    This paper aims to describe the process undertaken by Speech and Language Therapy and Occupational Therapy to assess a gentleman with learning disabilities and visual impairment with regard to his capacity to sign a tenancy agreement. It describes the method used to assess the gentleman's mental capacity before exploring the system used to provide…

  8. Performance Evaluation and the Internet 2 Performance Initiative.

    ERIC Educational Resources Information Center

    Simco, Greg

    2001-01-01

    Explains the Internet 2 collaborative end-to-end performance initiative that focuses on performance measurement, analysis, and improvements that lead to a standard set of network capabilities and limitations. Discusses results of this performance initiative, including providing direction for current and future network development. (Author/LRW)

  9. Evaluation of transmitting performance of cylindrical polycapillary

    NASA Astrophysics Data System (ADS)

    Xiaoyan, Lin; Yude, Li; Guotai, Tan; Tianxi, Sun

    2007-03-01

    Based on a detailed ray-tracing code for capillary optics, a MATLAB program for the simulation of X-ray transmission in a cylindrical polycapillary is described. The simulated and experimental results for the spatial distributions and power density gain of the X-rays in the beam guided through a cylindrical polycapillary are in good agreement, and the results show that the spatial distribution of the X-rays in the beam guided through a cylindrical polycapillary is uneven.

  10. Evaluation of an Advanced-Practice Physical Therapist in a Specialty Shoulder Clinic: Diagnostic Agreement and Effect on Wait Times

    PubMed Central

    Robarts, Susan; Kennedy, Deborah; McKnight, Cheryl; MacLeod, Anne Marie; Holtby, Richard

    2013-01-01

    ABSTRACT Purpose: To examine the role of an advanced-practice physiotherapist (APP) with respect to (1) agreement with an orthopaedic surgeon on diagnosis and management of patients with shoulder problems; (2) wait times; and (3) satisfaction with care. Methods: This prospective study involved patients with shoulder complaints who were referred to a shoulder specialist in a tertiary care centre. Agreement was examined on seven major diagnostic categories, need for further examination and surgery, and type of surgical procedure. Wait times were compared between the APP- and surgeon-led clinics from referral date to date of initial consultation, date of final diagnostic test, and date of confirmed diagnosis and planned treatment. A modified and validated version of the Visit-Specific Satisfaction Instrument assessed satisfaction in seven domains. Kappa (κ) coefficients and bias- and prevalence-adjusted kappa (PABAK) values were calculated, and strength of agreement was categorized. Wait time and satisfaction data were examined using non-parametric statistics. Results: Agreement on major diagnostic categories varied from 0.68 (good) to 0.96 (excellent). Agreement with respect to indication for surgery was κ=0.75, p<0.001; 95% CI, 0.62–0.88 (good). Wait time for APP assessment was significantly shorter than wait time for surgeon consultation at all time points (p<0.001); the surgeon's wait time was significantly reduced over 3 years. High satisfaction was reported in all components of care received from both health care providers. Conclusions: Using experienced physiotherapists in an extended role reduces wait times without compromising patient clinical management and overall satisfaction. PMID:24381382

  11. Visually Impaired Drivers Who Use Bioptic Telescopes: Self-Assessed Driving Skills and Agreement With On-Road Driving Evaluation

    PubMed Central

    Owsley, Cynthia; McGwin, Gerald; Elgin, Jennifer; Wood, Joanne M.

    2014-01-01

    Purpose. To compare self-assessed driving habits and skills of licensed drivers with central visual loss who use bioptic telescopes to those of age-matched normally sighted drivers, and to examine the association between bioptic drivers' impressions of the quality of their driving and ratings by a “backseat” evaluator. Methods. Participants were licensed bioptic drivers (n = 23) and age-matched normally sighted drivers (n = 23). A questionnaire was administered addressing driving difficulty, space, quality, exposure, and, for bioptic drivers, whether the telescope was helpful in on-road situations. Visual acuity and contrast sensitivity were assessed. Information on ocular diagnosis, telescope characteristics, and bioptic driving experience was collected from the medical record or in interview. On-road driving performance in regular traffic conditions was rated independently by two evaluators. Results. Like normally sighted drivers, bioptic drivers reported no or little difficulty in many driving situations (e.g., left turns, rush hour), but reported more difficulty under poor visibility conditions and in unfamiliar areas (P < 0.05). Driving exposure was reduced in bioptic drivers (driving 250 miles per week on average vs. 410 miles per week for normally sighted drivers, P = 0.02), but driving space was similar to that of normally sighted drivers (P = 0.29). All but one bioptic driver used the telescope in at least one driving task, and 56% used the telescope in three or more tasks. Bioptic drivers' judgments about the quality of their driving were very similar to backseat evaluators' ratings. Conclusions. Bioptic drivers show insight into the overall quality of their driving and areas in which they experience driving difficulty. They report using the bioptic telescope while driving, contrary to previous claims that it is primarily used to pass the vision screening test at licensure. PMID:24370830

  12. Visually impaired drivers who use bioptic telescopes: self-assessed driving skills and agreement with on-road driving evaluation.

    PubMed

    Owsley, Cynthia; McGwin, Gerald; Elgin, Jennifer; Wood, Joanne M

    2014-01-15

    To compare self-assessed driving habits and skills of licensed drivers with central visual loss who use bioptic telescopes to those of age-matched normally sighted drivers, and to examine the association between bioptic drivers' impressions of the quality of their driving and ratings by a "backseat" evaluator. Participants were licensed bioptic drivers (n = 23) and age-matched normally sighted drivers (n = 23). A questionnaire was administered addressing driving difficulty, space, quality, exposure, and, for bioptic drivers, whether the telescope was helpful in on-road situations. Visual acuity and contrast sensitivity were assessed. Information on ocular diagnosis, telescope characteristics, and bioptic driving experience was collected from the medical record or in interview. On-road driving performance in regular traffic conditions was rated independently by two evaluators. Like normally sighted drivers, bioptic drivers reported no or little difficulty in many driving situations (e.g., left turns, rush hour), but reported more difficulty under poor visibility conditions and in unfamiliar areas (P < 0.05). Driving exposure was reduced in bioptic drivers (driving 250 miles per week on average vs. 410 miles per week for normally sighted drivers, P = 0.02), but driving space was similar to that of normally sighted drivers (P = 0.29). All but one bioptic driver used the telescope in at least one driving task, and 56% used the telescope in three or more tasks. Bioptic drivers' judgments about the quality of their driving were very similar to backseat evaluators' ratings. Bioptic drivers show insight into the overall quality of their driving and areas in which they experience driving difficulty. They report using the bioptic telescope while driving, contrary to previous claims that it is primarily used to pass the vision screening test at licensure.

  13. Quality performance of laboratory testing in pharmacies: a collaborative evaluation.

    PubMed

    Zaninotto, Martina; Miolo, Giorgia; Guiotto, Adriano; Marton, Silvia; Plebani, Mario

    2016-11-01

    The quality performance and the comparability between results of pharmacies point-of-care-testing (POCT) and institutional laboratories have been evaluated. Eight pharmacies participated in the project: a capillary specimen collected by the pharmacist and, simultaneously, a lithium-heparin sample drawn by a physician of laboratory medicine for the pharmacy customers (n=106) were analyzed in the pharmacy and in the laboratory, respectively. Glucose, cholesterol, HDL-cholesterol, triglycerides, creatinine, uric acid, aspartate aminotransferase, alanine aminotransferase, were measured using: Reflotron, n=5; Samsung, n=1; Cardiocheck PA, n=1; Cholestech LDX, n=1 and Cobas 8000. The POCT analytical performance only (phase 2) were evaluated testing, in pharmacies and in the laboratory, the lithium heparin samples from a female drawn fasting daily in a week, and a control sample containing high concentrations of glucose, cholesterol and triglycerides. For all parameters, except triglycerides, the slopes showed a satisfactory correlation. For triglycerides, a median value higher in POCT in comparison to the laboratory (1.627 mmol/L vs. 0.950 mmol/L) has been observed. The agreement in the subjects classification, demonstrates that for glucose, 70% of the subjects show concentrations below the POCT recommended level (5.8-6.1 mmol/L), while 56% are according to the laboratory limit (<5.6 mmol/L). Total cholesterol exhibits a similar trend while POCT triglycerides show a greater percentage of increased values (21% vs. 9%). The reduction in triglycerides bias (phase 2) suggests that differences between POCT and central laboratory is attributable to a pre-analytical problem. The results confirm the acceptable analytical performance of POCT pharmacies and specific criticisms in the pre- and post-analytical phases.

  14. DRACS thermal performance evaluation for FHR

    SciTech Connect

    Lv, Q.; Lin, H. C.; Kim, I. H.; Sun, X.; Christensen, R. N.; Blue, T. E.; Yoder, G. L.; Wilson, D. F.; Sabharwall, P.

    2015-03-01

    Direct Reactor Auxiliary Cooling System (DRACS) is a passive decay heat removal system proposed for the Fluoride-salt-cooled High-temperature Reactor (FHR) that combines coated particle fuel and a graphite moderator with a liquid fluoride salt as the coolant. The DRACS features three coupled natural circulation/convection loops, relying completely on buoyancy as the driving force. These loops are coupled through two heat exchangers, namely, the DRACS Heat Exchanger and the Natural Draft Heat Exchanger. In addition, a fluidic diode is employed to minimize the parasitic flow into the DRACS primary loop and correspondingly the heat loss to the DRACS during normal operation of the reactor, and to keep the DRACS ready for activation, if needed, during accidents. To help with the design and thermal performance evaluation of the DRACS, a computer code using MATLAB has been developed. This code is based on a one-dimensional formulation and its principle is to solve the energy balance and integral momentum equations. By discretizing the DRACS system in the axial direction, a bulk mean temperature is assumed for each mesh cell. The temperatures of all the cells, as well as the mass flow rates in the DRACS loops, are predicted by solving the governing equations that are obtained by integrating the energy conservation equation over each cell and integrating the momentum conservation equation over each of the DRACS loops. In addition, an intermediate heat transfer loop equipped with a pump has also been modeled in the code. This enables the study of flow reversal phenomenon in the DRACS primary loop, associated with the pump trip process. Experimental data from a High-Temperature DRACS Test Facility (HTDF) are not available yet to benchmark the code. A preliminary code validation is performed by using natural circulation experimental data available in the literature, which are as closely relevant as possible. The code is subsequently applied to the HTDF that is under

  15. High-Performance Monopropellants and Catalysts Evaluated

    NASA Technical Reports Server (NTRS)

    Reed, Brian D.

    2004-01-01

    The NASA Glenn Research Center is sponsoring efforts to develop advanced monopropellant technology. The focus has been on monopropellant formulations composed of an aqueous solution of hydroxylammonium nitrate (HAN) and a fuel component. HAN-based monopropellants do not have a toxic vapor and do not need the extraordinary procedures for storage, handling, and disposal required of hydrazine (N2H4). Generically, HAN-based monopropellants are denser and have lower freezing points than N2H4. The performance of HAN-based monopropellants depends on the selection of fuel, the HAN-to-fuel ratio, and the amount of water in the formulation. HAN-based monopropellants are not seen as a replacement for N2H4 per se, but rather as a propulsion option in their own right. For example, HAN-based monopropellants would prove beneficial to the orbit insertion of small, power-limited satellites because of this propellant's high performance (reduced system mass), high density (reduced system volume), and low freezing point (elimination of tank and line heaters). Under a Glenn-contracted effort, Aerojet Redmond Rocket Center conducted testing to provide the foundation for the development of monopropellant thrusters with an I(sub sp) goal of 250 sec. A modular, workhorse reactor (representative of a 1-lbf thruster) was used to evaluate HAN formulations with catalyst materials. Stoichiometric, oxygen-rich, and fuelrich formulations of HAN-methanol and HAN-tris(aminoethyl)amine trinitrate were tested to investigate the effects of stoichiometry on combustion behavior. Aerojet found that fuelrich formulations degrade the catalyst and reactor faster than oxygen-rich and stoichiometric formulations do. A HAN-methanol formulation with a theoretical Isp of 269 sec (designated HAN269MEO) was selected as the baseline. With a combustion efficiency of at least 93 percent demonstrated for HAN-based monopropellants, HAN269MEO will meet the I(sub sp) 250 sec goal.

  16. Evaluating performance of high efficiency mist eliminators

    SciTech Connect

    Waggoner, Charles A.; Parsons, Michael S.; Giffin, Paxton K.

    2013-07-01

    Processing liquid wastes frequently generates off gas streams with high humidity and liquid aerosols. Droplet laden air streams can be produced from tank mixing or sparging and processes such as reforming or evaporative volume reduction. Unfortunately these wet air streams represent a genuine threat to HEPA filters. High efficiency mist eliminators (HEME) are one option for removal of liquid aerosols with high dissolved or suspended solids content. HEMEs have been used extensively in industrial applications, however they have not seen widespread use in the nuclear industry. Filtering efficiency data along with loading curves are not readily available for these units and data that exist are not easily translated to operational parameters in liquid waste treatment plants. A specialized test stand has been developed to evaluate the performance of HEME elements under use conditions of a US DOE facility. HEME elements were tested at three volumetric flow rates using aerosols produced from an iron-rich waste surrogate. The challenge aerosol included submicron particles produced from Laskin nozzles and super micron particles produced from a hollow cone spray nozzle. Test conditions included ambient temperature and relative humidities greater than 95%. Data collected during testing HEME elements from three different manufacturers included volumetric flow rate, differential temperature across the filter housing, downstream relative humidity, and differential pressure (dP) across the filter element. Filter challenge was discontinued at three intermediate dPs and the filter to allow determining filter efficiency using dioctyl phthalate and then with dry surrogate aerosols. Filtering efficiencies of the clean HEME, the clean HEME loaded with water, and the HEME at maximum dP were also collected using the two test aerosols. Results of the testing included differential pressure vs. time loading curves for the nine elements tested along with the mass of moisture and solid

  17. Performance Evaluation of Resource Management in Cloud Computing Environments.

    PubMed

    Batista, Bruno Guazzelli; Estrella, Julio Cezar; Ferreira, Carlos Henrique Gomes; Filho, Dionisio Machado Leite; Nakamura, Luis Hideo Vasconcelos; Reiff-Marganiec, Stephan; Santana, Marcos José; Santana, Regina Helena Carlucci

    2015-01-01

    Cloud computing is a computational model in which resource providers can offer on-demand services to clients in a transparent way. However, to be able to guarantee quality of service without limiting the number of accepted requests, providers must be able to dynamically manage the available resources so that they can be optimized. This dynamic resource management is not a trivial task, since it involves meeting several challenges related to workload modeling, virtualization, performance modeling, deployment and monitoring of applications on virtualized resources. This paper carries out a performance evaluation of a module for resource management in a cloud environment that includes handling available resources during execution time and ensuring the quality of service defined in the service level agreement. An analysis was conducted of different resource configurations to define which dimension of resource scaling has a real influence on client requests. The results were used to model and implement a simulated cloud system, in which the allocated resource can be changed on-the-fly, with a corresponding change in price. In this way, the proposed module seeks to satisfy both the client by ensuring quality of service, and the provider by ensuring the best use of resources at a fair price.

  18. Performance evaluation of an infrared thermocouple.

    PubMed

    Chen, Chiachung; Weng, Yu-Kai; Shen, Te-Ching

    2010-01-01

    The measurement of the leaf temperature of forests or agricultural plants is an important technique for the monitoring of the physiological state of crops. The infrared thermometer is a convenient device due to its fast response and nondestructive measurement technique. Nowadays, a novel infrared thermocouple, developed with the same measurement principle of the infrared thermometer but using a different detector, has been commercialized for non-contact temperature measurement. The performances of two-kinds of infrared thermocouples were evaluated in this study. The standard temperature was maintained by a temperature calibrator and a special black cavity device. The results indicated that both types of infrared thermocouples had good precision. The error distribution ranged from -1.8 °C to 18 °C as the reading values served as the true values. Within the range from 13 °C to 37 °C, the adequate calibration equations were the high-order polynomial equations. Within the narrower range from 20 °C to 35 °C, the adequate equation was a linear equation for one sensor and a two-order polynomial equation for the other sensor. The accuracy of the two kinds of infrared thermocouple was improved by nearly 0.4 °C with the calibration equations. These devices could serve as mobile monitoring tools for in situ and real time routine estimation of leaf temperatures.

  19. Performance Evaluation of an Infrared Thermocouple

    PubMed Central

    Chen, Chiachung; Weng, Yu-Kai; Shen, Te-Ching

    2010-01-01

    The measurement of the leaf temperature of forests or agricultural plants is an important technique for the monitoring of the physiological state of crops. The infrared thermometer is a convenient device due to its fast response and nondestructive measurement technique. Nowadays, a novel infrared thermocouple, developed with the same measurement principle of the infrared thermometer but using a different detector, has been commercialized for non-contact temperature measurement. The performances of two-kinds of infrared thermocouples were evaluated in this study. The standard temperature was maintained by a temperature calibrator and a special black cavity device. The results indicated that both types of infrared thermocouples had good precision. The error distribution ranged from −1.8 °C to 18 °C as the reading values served as the true values. Within the range from 13 °C to 37 °C, the adequate calibration equations were the high-order polynomial equations. Within the narrower range from 20 °C to 35 °C, the adequate equation was a linear equation for one sensor and a two-order polynomial equation for the other sensor. The accuracy of the two kinds of infrared thermocouple was improved by nearly 0.4 °C with the calibration equations. These devices could serve as mobile monitoring tools for in situ and real time routine estimation of leaf temperatures. PMID:22163458

  20. LANDSAT-4 horizon scanner performance evaluation

    NASA Technical Reports Server (NTRS)

    Bilanow, S.; Chen, L. C.; Davis, W. M.; Stanley, J. P.

    1984-01-01

    Representative data spans covering a little more than a year since the LANDSAT-4 launch were analyzed to evaluate the flight performance of the satellite's horizon scanner. High frequency noise was filtered out by 128-point averaging. The effects of Earth oblateness and spacecraft altitude variations are modeled, and residual systematic errors are analyzed. A model for the predicted radiance effects is compared with the flight data and deficiencies in the radiance effects modeling are noted. Correction coefficients are provided for a finite Fourier series representation of the systematic errors in the data. Analysis of the seasonal dependence of the coefficients indicates the effects of some early mission problems with the reference attitudes which were computed by the onboard computer using star trackers and gyro data. The effects of sun and moon interference, unexplained anomalies in the data, and sensor noise characteristics and their power spectrum are described. The variability of full orbit data averages is shown. Plots of the sensor data for all the available data spans are included.

  1. Developing 'robust performance benchmarks' for the next Australian Health Care Agreement: the need for a new framework

    PubMed Central

    Duckett, Stephen J; Ward, Michael

    2008-01-01

    If the outcomes of the recent COAG meeting are implemented, Australia will have a new set of benchmarks for its health system within a few months. This is a non-trivial task. Choice of benchmarks will, explicitly or implicitly, reflect a framework about how the health system works, what is important or to be valued and how the benchmarks are to be used. In this article we argue that the health system is dynamic and so benchmarks need to measure flows and interfaces rather than simply cross-sectional or static performance. We also argue that benchmarks need to be developed taking into account three perspectives: patient, clinician and funder. Each of these perspectives is critical and good performance from one perspective or on one dimension doesn't imply good performance on either (or both) of the others. The three perspectives (we term the dimensions patient assessed value, performance on clinical interventions and efficiency) can each be decomposed into a number of elements. For example, patient assessed value is influenced by timeliness, cost to the patient, the extent to which their expectations are met, the way they are treated and the extent to which there is continuity of care. We also argue that the way information is presented is important: cross sectional, dated measures provide much less information and are much less useful than approaches based on statistical process control. The latter also focuses attention on improvement and trends, encouraging action rather than simply blame of poorer performers. PMID:18439247

  2. 40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Performance Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On... emissions to an add-on control device that is a PTE Meet the requirements for a PTE EPA method 204...

  3. 40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Performance Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On... emissions to an add-on control device that is a PTE Meet the requirements for a PTE EPA method 204...

  4. 40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Performance Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On... emissions to an add-on control device that is a PTE Meet the requirements for a PTE EPA method 204...

  5. Methodology for Evaluation of Diagnostic Performance

    SciTech Connect

    Metz, Charles E.

    2003-02-19

    developing statistical tests to evaluate the significance of measured differences between ROC curves. These are especially important tasks in medical applications, because various practical issues usually limit the number of patients with clearly established diagnostic truth that can be included in any study that seeks to measure diagnostic performance objectively. Other progress has been made in relating ROC analysis to cost/benefit analysis, and in generalizing ROC methods to accommodate some diagnostic tasks where more than two decision alternatives are available. ROC analysis clearly provides the most rigorous and fruitful approach for such assessments but, like many other powerful techniques that provide useful insight concerning complex situations, it currently suffers from limitations, particularly in evaluation studies that involve small case samples. However, the potential of this relatively new analytic approach and the concepts on which it is based have not been fully explored. The research proposed here is designed to refine and supplement existing ROC methodology to increase both the accuracy and the precision of its results.

  6. Performance and evaluation of real-time multicomputer control systems

    NASA Technical Reports Server (NTRS)

    Shin, K. G.

    1983-01-01

    New performance measures, detailed examples, modeling of error detection process, performance evaluation of rollback recovery methods, experiments on FTMP, and optimal size of an NMR cluster are discussed.

  7. In vivo assessment by parents and a physician using the Amsterdam Infant Stool Scale provided better inter-rater agreement than photographic evaluation.

    PubMed

    Wojtyniak, Katarzyna; Horvath, Andrea; Dziechciarz, Piotr

    2016-09-08

    This study assessed the inter-rater variability of stool assessment, comparing the judgement of parents and a physician using the Amsterdam Infant Stool Scale (AISS) and the evaluation by another physician using photographs. The stools of children aged two to 18 months, who were not toilet-trained, were independently assessed in vivo using the AISS by the parents and the first physician. Another physician, unaware of the results of the in vivo evaluation, assessed two stool photographs taken by the first physician with a smartphone. Having analysed 100 stools, we found excellent inter-rater agreement between the parents and the first physician for consistency (κ: 0.87; 95% confidence interval [95% CI] 0.78-0.95) and colour (κ: 0.81; 95% CI: 0.71-0.91) and good inter-rater agreement for the amount (κ: 0.79; 95% CI 0.7-0.88). We found moderate inter-rater agreement between the parents' in vivo assessment and the second physician's photographic assessment for stool consistency (κ: 0.5; 95% CI 0.36-0.64) and amount (κ: 0.44; 95% CI 0.29-0.59) and a fair inter-rater agreement for colour (κ: 0.33; 95% CI 0.21-0.45). When parents and a physician used the AISS under in vivo conditions, there was better inter-rater agreement than photographic evaluation by a second physician. ©2016 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

  8. 48 CFR 8.606 - Evaluating FPI performance.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    .... 8.606 Section 8.606 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION.... 8.606 Evaluating FPI performance. Agencies shall evaluate FPI contract performance in accordance with subpart 42.15. Performance evaluations do not negate the requirements of 8.602 and 8.604, but they...

  9. 48 CFR 8.606 - Evaluating FPI performance.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    .... 8.606 Section 8.606 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION.... 8.606 Evaluating FPI performance. Agencies shall evaluate FPI contract performance in accordance with subpart 42.15. Performance evaluations do not negate the requirements of 8.602 and 8.604, but they...

  10. 48 CFR 8.606 - Evaluating FPI performance.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    .... 8.606 Section 8.606 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION.... 8.606 Evaluating FPI performance. Agencies shall evaluate FPI contract performance in accordance with subpart 42.15. Performance evaluations do not negate the requirements of 8.602 and 8.604, but they...

  11. 48 CFR 2452.216-73 - Performance evaluation plan.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 48 Federal Acquisition Regulations System 6 2010-10-01 2010-10-01 true Performance evaluation plan... 2452.216-73 Performance evaluation plan. As prescribed in 2416.406(e)(3), insert the following clause in all award fee contracts: Performance Evaluation Plan (AUG 1987) (a) The Government...

  12. 48 CFR 2936.201 - Evaluation of contractor performance.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Evaluation of contractor... Construction 2936.201 Evaluation of contractor performance. The HCA must establish procedures to evaluate construction contractor performance and prepare performance reports as required by FAR 36.201....

  13. Evaluation of performance of veterinary in-clinic hematology analyzers.

    PubMed

    Rishniw, Mark; Pion, Paul D

    2016-12-01

    A previous study provided information regarding the quality of in-clinic veterinary biochemistry testing. However, no similar studies for in-clinic veterinary hematology testing have been conducted. The objective of this study was to assess the quality of hematology testing in veterinary in-clinic laboratories using results obtained from testing 3 levels of canine EDTA blood samples. Clinicians prepared blood samples to achieve measurand concentrations within, below, and above their RIs and evaluated the samples in triplicate using their in-clinic analyzers. Quality was assessed by comparison of calculated total error with quality requirements, determination of sigma metrics, use of a quality goal index, and agreement between in-clinic and reference laboratory instruments. Suitability for statistical quality control was determined using adaptations from the computerized program, EZRules3. Evaluation of 10 veterinary in-clinic hematology analyzers showed that these instruments often fail to meet quality requirements. At least 60% of analyzers reasonably determined RBC, WBC, HCT, and HGB, when assessed by most quality goal criteria; platelets were less reliably measured, with 80% deemed suitable for low platelet counts, but only 30% for high platelet counts, and automated differential leukocyte counts were generally considered unsuitable for clinical use with fewer than 40% of analyzers meeting the least stringent quality goal requirements. Fewer than 50% of analyzers were able to meet requirements for statistical quality control for any measurand. These findings reflect the current status of in-clinic hematology analyzer performance and provide a basis for future evaluations of the quality of veterinary laboratory testing. © 2016 American Society for Veterinary Clinical Pathology.

  14. [Evaluation of the agreement of results obtained from ABI Prism 7000 and 7700 sequencers in the quantification of hepatitis B virus DNA].

    PubMed

    Sertöz, R Yazan; Erensoy, S; Pas, S; Niesters, H G M

    2005-04-01

    There are different methods and systems for quantification of HBV-DNA in clinical virology laboratories. The aim of this study was to evaluate the agreement of the polymerase chain reaction (PCR) protocol with ABI Prism 7000 instrument (PE Biosystems) which was designed and optimised for ABI Prism 7700 (PE Biosystems). Serum samples obtained from 168 chronic hepatitis B patients were treated with "High Pure Viral Nucleic Acid Kit" (Roche Applied Science, USA), and MagnaPure LC isolation station (Roche Applied Science, Germany) was used for HBV-DNA isolation. Real time PCR procedure which amplifies pre-S gene of HBV genome was performed. Amplification and detection steps of all samples were performed with ABI Prism 7700 and 7000 Sequence Detection Systems. Among 168 samples, results of 124 serum samples were found to be in dynamic ranges of the tests. The results of these 124 samples obtained from ABI 7000 and ABI 7700 were concordant. Among the rest of 44 samples; one yielded higher than 10(10) copies/mL with two of the systems; six samples gave results higher than 10(10) copies/mL only with 7700; thirty samples were found negative with both of the systems; seven samples were positive (320-1220 copies/mL) with 7000 but negative with 7700. As a result this PCR protocol can be used in ABI 7000 system according to viral quality control (VQC) results. However, since the results of samples with HBV-DNA less than 1 x 10(6) copy/ml were discordant with the results obtained by ABI 7700 system, it can be concluded that different systems must not be used for the management and monitoring of the same patient.

  15. 40 CFR 35.115 - Evaluation of performance.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 40 Protection of Environment 1 2010-07-01 2010-07-01 false Evaluation of performance. 35.115... Evaluation of performance. (a) Joint evaluation process. The applicant and the Regional Administrator will... description of the evaluation process and a reporting schedule must be included in the work plan (see § 35.107...

  16. 40 CFR 35.515 - Evaluation of performance.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... Administrator's decision under the dispute processes in 40 CFR 31.70. (d) Evaluation reports. The Regional... 40 Protection of Environment 1 2010-07-01 2010-07-01 false Evaluation of performance. 35.515....515 Evaluation of performance. (a) Joint evaluation process. The applicant and the Regional...

  17. Performance Evaluation of Voice Over Internet Protocol

    DTIC Science & Technology

    2002-12-01

    Table 1. Codec Comparison ...........................................................................................17 Table 2. VoIP Packet Priority...31 Table 9. Comparison of VoIP Performance Measurement ............................................42 Table 10. Mean Opinion Score...environment. A VoIP performance measurement on a local Ethernet is used as the baseline for performance comparison . Furthermore, this research

  18. Evaluating Administrative Performance. An ERS Report.

    ERIC Educational Resources Information Center

    Nygaard, Debra D.

    The evaluation of administrative and supervisory personnel is receiving increasing attention by State legislatures, the public at large, and the education profession. At least nine States now mandate periodic, formal evaluations of administrative and supervisory personnel in their public schools. As a result of these State mandates and the…

  19. Evaluation of seven hypotheses for metamemory performance in rhesus monkeys

    PubMed Central

    Basile, Benjamin M.; Schroeder, Gabriel R.; Brown, Emily Kathryn; Templer, Victoria L.; Hampton, Robert R.

    2014-01-01

    Knowing the extent to which nonhumans and humans share mechanisms for metacognition will advance our understanding of cognitive evolution and will improve selection of model systems for biomedical research. Some nonhuman species avoid difficult cognitive tests, seek information when ignorant, or otherwise behave in ways consistent with metacognition. There is agreement that some nonhuman animals “succeed” in these metacognitive tasks, but little consensus about the cognitive mechanisms underlying performance. In one paradigm, rhesus monkeys visually searched for hidden food when ignorant of the location of the food, but acted immediately when knowledgeable. This result has been interpreted as evidence that monkeys introspectively monitored their memory to adaptively control information seeking. However, convincing alternative hypotheses have been advanced that might also account for the adaptive pattern of visual searching. We evaluated seven hypotheses using a computerized task in which monkeys chose either to take memory tests immediately or to see the answer again before proceeding to the test. We found no evidence to support the hypotheses of behavioral cue association, rote response learning, expectancy violation, response competition, generalized search strategy, or postural mediation. In contrast, we repeatedly found evidence to support the memory monitoring hypothesis. Monkeys chose to see the answer when memory was poor, either from natural variation or experimental manipulation. We found limited evidence that monkeys also monitored the fluency of memory access. Overall, the evidence indicates that rhesus monkeys can use memory strength as a discriminative cue for information seeking, consistent with introspective monitoring of explicit memory. PMID:25365530

  20. Performance Analysis of GYRO: A Tool Evaluation

    SciTech Connect

    Worley, P.; Roth, P.; Candy, J.; Shan, Hongzhang; Mahinthakumar,G.; Sreepathi, S.; Carrington, L.; Kaiser, T.; Snavely, A.; Reed, D.; Zhang, Y.; Huck, K.; Malony, A.; Shende, S.; Moore, S.; Wolf, F.

    2005-06-26

    The performance of the Eulerian gyrokinetic-Maxwell solver code GYRO is analyzed on five high performance computing systems. First, a manual approach is taken, using custom scripts to analyze the output of embedded wall clock timers, floating point operation counts collected using hardware performance counters, and traces of user and communication events collected using the profiling interface to Message Passing Interface (MPI) libraries. Parts of the analysis are then repeated or extended using a number of sophisticated performance analysis tools: IPM, KOJAK, SvPablo, TAU, and the PMaC modeling tool suite. The paper briefly discusses what has been discovered via this manual analysis process, what performance analyses are inconvenient or infeasible to attempt manually, and to what extent the tools show promise in accelerating or significantly extending the manual performance analyses.

  1. A Management System for Computer Performance Evaluation.

    DTIC Science & Technology

    1981-12-01

    large unused capacity indicates a potential cost performance improvement (i.e. the potential to perform more within current costs or reduce costs ...necessary to bring the performance of the computer system in line with operational goals. : (Ref. 18 : 7) The General Accouting Office estimates that the...tasks in attempting to improve the efficiency and effectiveness of their computer systems. Cost began to plan an important role in the life of a

  2. Maintaining Interrater Agreement of Core Assessment Instruments in a Multisite Randomized Controlled Clinical Trial: The Randomized Evaluation of Sedation Titration for Respiratory Failure (RESTORE) Trial.

    PubMed

    Lebet, Ruth; Hayakawa, Jennifer; Chamblee, Tracy B; Tala, Joana A; Singh, Nakul; Wypij, David; Curley, Martha A Q

    RESTORE (Randomized Evaluation of Sedation Titration for Respiratory Failure) was a cluster randomized clinical trial evaluating a sedation strategy in children 2 weeks to <18 years of age with acute respiratory failure supported on mechanical ventilation. A total of 31 U.S. pediatric intensive care units (PICUs) participated in the trial. Staff nurse rater agreement on measures used to assess a critical component of treatment fidelity was essential throughout the 4-year data collection period. The purpose of the study is to describe the method of establishing and maintaining interrater agreement (IRA) of two core clinical assessment instruments over the course of the clinical trial. IRA cycles were carried out at all control and intervention sites and included a minimum of five measurements of the State Behavioral Scale (SBS) and Withdrawal Assessment Tool-Version 1 (WAT-1). Glasgow Coma Scale scores were also obtained. PICUs demonstrating <80% agreement repeated their IRA cycle. Fleiss's kappa coefficient was used to assess IRA. Repeated IRA cycles were required for 8% of 226 SBS cycles and 2% of 222 WAT-1 cycles. Fleiss's kappa coefficients from more than 1,350 paired assessments were .86 for SBS and .92 for WAT-1, demonstrating strong agreement and similar to .91 for the Glasgow Coma Scale. There was no difference in Fleiss's kappa for any of the instruments based on unit size or timing of assessment (earlier or later in the study). For SBS scores, Fleiss's kappa was significantly different in larger and smaller PICUs (.82 vs. .92, p = .003); however, Fleiss's kappa for both groups indicated excellent agreement. Monitoring measurement reliability is an essential step in ensuring treatment fidelity and, thus, the validity of study results. Standardization on the use of these core assessment instruments among participating sites was achieved and maintained throughout the trial.

  3. 40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... emissions to an add-on control device that is a PTE Meet the requirements for a PTE EPA method 204...

  4. 40 CFR Table 6 to Subpart Wwww of... - Basic Requirements for Performance Tests, Performance Evaluations, and Design Evaluations for New...

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... Tests, Performance Evaluations, and Design Evaluations for New and Existing Sources Using Add-On Control... emissions to an add-on control device that is a PTE Meet the requirements for a PTE EPA method 204...

  5. Evaluating Performances of Solar-Energy Systems

    NASA Technical Reports Server (NTRS)

    Jaffe, L. D.

    1987-01-01

    CONC11 computer program calculates performances of dish-type solar thermal collectors and power systems. Solar thermal power system consists of one or more collectors, power-conversion subsystems, and powerprocessing subsystems. CONC11 intended to aid system designer in comparing performance of various design alternatives. Written in Athena FORTRAN and Assembler.

  6. Evaluating Performances of Solar-Energy Systems

    NASA Technical Reports Server (NTRS)

    Jaffe, L. D.

    1987-01-01

    CONC11 computer program calculates performances of dish-type solar thermal collectors and power systems. Solar thermal power system consists of one or more collectors, power-conversion subsystems, and powerprocessing subsystems. CONC11 intended to aid system designer in comparing performance of various design alternatives. Written in Athena FORTRAN and Assembler.

  7. FLUORESCENT TRACER EVALUATION OF PROTECTIVE CLOTHING PERFORMANCE

    EPA Science Inventory

    Field studies evaluating chemical protective clothing (CPC), which is often employed as a primary control option to reduce occupational exposures during pesticide applications, are limited. This study, supported by the U.S. Environmental Protection Agency (EPA), was designed to...

  8. FLUORESCENT TRACER EVALUATION OF PROTECTIVE CLOTHING PERFORMANCE

    EPA Science Inventory

    Field studies evaluating chemical protective clothing (CPC), which is often employed as a primary control option to reduce occupational exposures during pesticide applications, are limited. This study, supported by the U.S. Environmental Protection Agency (EPA), was designed to...

  9. Evaluation of a pharmaceutical risk-sharing agreement when patients are screened for the probability of success.

    PubMed

    Mahjoub, Reza; Ødegaard, Fredrik; Zaric, Gregory S

    2017-06-19

    We analyze a game-theoretic model of a risk-sharing agreement between a payer and a pharmaceutical firm. The drug manufacturer chooses the price while the payer sets the rebate rate and decides which patients are eligible for treatment. The manufacturer provides the payer with a rebate for nonresponding patients. We generalize on the existing literature, by making both price and rebate rate decision variables, allowing the rebate rate to be different from 100%, and incorporating 2 types of administrative costs. We identify a threshold for the expected probability of response for classifying the drug as a mass-market or niche type and investigate the optimal solutions for both types. We also identify a threshold for the rebate rate at which the net benefits become equal for responding and nonresponding patients. Through numerical examples, we examine how various parameters impact the drug manufacturer's and the payer's optimal solution. Copyright © 2017 John Wiley & Sons, Ltd.

  10. Evaluation of the agreement between guidelines and initial antihypertensive drug treatment using a national health care reimbursement database.

    PubMed

    Meneton, Pierre; Ricordeau, Philippe; Weill, Alain; Tuppin, Philippe; Samson, Solène; Allemand, Hubert; Durieux, Pierre; Ménard, Joël

    2012-06-01

    To test the agreement between guidelines for the management of hypertension and medical practices while avoiding frequent limitations such as the use of non-representative samples of practitioners and self-reporting of their practices over a short period of time. The characteristics of initial antihypertensive drug treatment in a large representative sample of the French population aged 50-80 (n = 17 855) were collected from a national health care reimbursement database and compared with national guidelines over a 5-year period. Major discrepancies are observed including the use of non-recommended drug classes such as loop and potassium sparing diuretics alone or in association and the absence of distinction between patients according to their age. More minor discrepancies are the preferential use of mono-therapies over drug combinations and of some bi-therapies among those recommended. Some degree of concordance with the guidelines is also observed including the specific characteristics of the treatment of diabetics compared with other categories of patients and the preferential use of long-acting dihydropyridine calcium antagonists and of low-dose thiazide diuretics when these drug classes are chosen. Several of these discrepancies or concordances, which mainly reflect general practitioner (GP) activity, show time trends over the entire follow-up period with no significant effect of the guideline released during this period. At the French national level, the agreement between initial antihypertensive drug treatment and guidelines varies considerably depending on the characteristics of the treatment that are considered. The GPs who delivered the treatment do not seem to have been influenced by the guidelines released over the last decade. © 2011 Blackwell Publishing Ltd.

  11. EVALUATION OF VENTILATION PERFORMANCE FOR INDOOR SPACE

    EPA Science Inventory

    The paper discusses a personal-computer-based application of computational fluid dynamics that can be used to determine the turbulent flow field and time-dependent/steady-state contaminant concentration distributions within isothermal indoor space. (NOTE: Ventilation performance ...

  12. EVALUATION OF VENTILATION PERFORMANCE FOR INDOOR SPACE

    EPA Science Inventory

    The paper discusses a personal-computer-based application of computational fluid dynamics that can be used to determine the turbulent flow field and time-dependent/steady-state contaminant concentration distributions within isothermal indoor space. (NOTE: Ventilation performance ...

  13. Patterned Armor Performance Evaluation for Multiple Impacts

    DTIC Science & Technology

    2003-08-01

    return it to the originator. Army Research Laboratory Aberdeen Proving Ground , MD 21005-5069 ARL-TR-3038 August 2003 Patterned Armor ...patterned armor performance against multiple impacts. This performance measure can then be compared to a well-posed multiple-hit criterion to assess...Aberdeen Proving Ground , MD, September 2002. de Rosset, W. S. Reactive Armor Model Sensitivity Studies; ARL-TR-1849; U.S. Army Research Laboratory

  14. Evaluation of performance impairment by spacecraft contaminants

    NASA Technical Reports Server (NTRS)

    Geller, I.; Hartman, R. J., Jr.; Mendez, V. M.

    1977-01-01

    The environmental contaminants (isolated as off-gases in Skylab and Apollo missions) were evaluated. Specifically, six contaminants were evaluated for their effects on the behavior of juvenile baboons. The concentrations of contaminants were determined through preliminary range-finding studies with laboratory rats. The contaminants evaluated were acetone, methyl ethyl ketone (MEK), methyl isobutyl ketone (MIBK), trichloroethylene (TCE), heptane and Freon 21. When the studies of the individual gases were completed, the baboons were also exposed to a mixture of MEK and TCE. The data obtained revealed alterations in the behavior of baboons exposed to relatively low levels of the contaminants. These findings were presented at the First International Symposium on Voluntary Inhalation of Industrial Solvents in Mexico City, June 21-24, 1976. A preprint of the proceedings is included.

  15. Building China's municipal healthcare performance evaluation system: a Tuscan perspective.

    PubMed

    Li, Hao; Barsanti, Sara; Bonini, Anna

    2012-08-01

    Regional healthcare performance evaluation systems can help optimize healthcare resources on regional basis and improve the performance of healthcare services provided. The Tuscany region in Italy is a good example of an institution which meets these requirements. China has yet to build such a system based on international experience. In this paper, based on comparative studies between Tuscany and China, we propose that the managing institutions in China's experimental cities can select and commission a third-party agency to, respectively, evaluate the performance of their affiliated hospitals and community health service centers. Following some features of the Tuscan experience, the Chinese municipal healthcare performance evaluation system can be built by focusing on the selection of an appropriate performance evaluation agency, the design of an adequate performance evaluation mechanism and the formulation of a complete set of laws, rules and regulations. When a performance evaluation system at city level is formed, the provincial government can extend the successful experience to other cities.

  16. Team Primacy Concept (TPC) Based Employee Evaluation and Job Performance

    ERIC Educational Resources Information Center

    Muniute, Eivina I.; Alfred, Mary V.

    2007-01-01

    This qualitative study explored how employees learn from Team Primacy Concept (TPC) based employee evaluation and how they use the feedback in performing their jobs. TPC based evaluation is a form of multirater evaluation, during which the employee's performance is discussed by one's peers in a face-to-face team setting. The study used Kolb's…

  17. Performance evaluation of matrix gradient coils.

    PubMed

    Jia, Feng; Schultz, Gerrit; Testud, Frederik; Welz, Anna Masako; Weber, Hans; Littin, Sebastian; Yu, Huijun; Hennig, Jürgen; Zaitsev, Maxim

    2016-02-01

    In this paper, we present a new performance measure of a matrix coil (also known as multi-coil) from the perspective of efficient, local, non-linear encoding without explicitly considering target encoding fields. An optimization problem based on a joint optimization for the non-linear encoding fields is formulated. Based on the derived objective function, a figure of merit of a matrix coil is defined, which is a generalization of a previously known resistive figure of merit for traditional gradient coils. A cylindrical matrix coil design with a high number of elements is used to illustrate the proposed performance measure. The results are analyzed to reveal novel features of matrix coil designs, which allowed us to optimize coil parameters, such as number of coil elements. A comparison to a scaled, existing multi-coil is also provided to demonstrate the use of the proposed performance parameter. The assessment of a matrix gradient coil profits from using a single performance parameter that takes the local encoding performance of the coil into account in relation to the dissipated power.

  18. Evaluating growth performance of young stands

    Treesearch

    A. L. Roe; R. E. Benson

    1966-01-01

    A simple procedure for evaluating the diameter growth of young stands in relation to potential growth is described. A comparison technique is developed which contrasts relative diameter of crop trees to the relative diameter growth of the last decade to show the condition and trend of growth in the stand. The method is objective, easy to use, and has several...

  19. Criteria for Evaluating the Performance of Compilers

    DTIC Science & Technology

    1974-10-01

    id efl !,i% programs, except remove all statement labels. Subtract the ba-c; 162 values obtained by compiling and running a program cont.ziing the... Thesis on Optimal Evaluation Order for Expressions with Redundant Subexpressions, Computer Science Department, Carnegie-Mellon University, Pittsburgh

  20. Disaggregating Pupil Performance Scores: Evaluating School Effectiveness.

    ERIC Educational Resources Information Center

    Allen, Henriette L.; Tadlock, James A.

    This report describes various components of the process of disaggregating student achievement data and provides examples of each component. Information is provided to allow school districts to conduct their own school effectiveness evaluation. Results of the California Achievement Tests form one of the bases of the analysis. The underlying…

  1. Seismic performance evaluation of substation structures

    SciTech Connect

    Hwang, H.H.M.; Huo, J.R.

    1995-12-31

    This paper presents an approach for evaluating seismic hazards at the site and generating fragility curves for structures such as the capacitor bank in one of the major substations in the Memphis electric transmission system. The results from this study will be used to determine the adequacy of electric supply to several major hospitals in downtown Memphis after a large New Madrid earthquake.

  2. Performance Evaluation of Artificial Intelligence Systems

    DTIC Science & Technology

    1987-08-17

    difficulty Veit and Callero (1981) have Aq developed an evaluation technique called the Subjective Transfer Function (STF) ’-~ ~approach. In the STF...Information Retrieval, Montreal, Canada. Veit, C.T., M. Callero . (1981) Subjective Transfer Function Approach to Complex System " 4Analysis. Rand Corp

  3. Performance evaluation of 1 kw PEFC

    SciTech Connect

    Komaki, Hideaki; Tsuchiyama, Syozo

    1996-12-31

    This report covers part of a joint study on a PEFC propulsion system for surface ships, summarized in a presentation to this Seminar, entitled {open_quote}Study on a PEFC Propulsion System for Surface Ships{close_quotes}, and which envisages application to a 1,500 DWT cargo vessel. The aspect treated here concerns the effects brought on PEFC operating performance by conditions particular to shipboard operation. The performance characteristics were examined through tests performed on a 1 kw stack and on a single cell (Manufactured by Fuji Electric Co., Ltd.). The tests covered the items (1) to (4) cited in the headings of the sections that follow. Specifications of the stack and single cell are as given.

  4. Performance evaluation of SAR/GMTI algorithms

    NASA Astrophysics Data System (ADS)

    Garber, Wendy; Pierson, William; Mcginnis, Ryan; Majumder, Uttam; Minardi, Michael; Sobota, David

    2016-05-01

    There is a history and understanding of exploiting moving targets within ground moving target indicator (GMTI) data, including methods for modeling performance. However, many assumptions valid for GMTI processing are invalid for synthetic aperture radar (SAR) data. For example, traditional GMTI processing assumes targets are exo-clutter and a system that uses a GMTI waveform, i.e. low bandwidth (BW) and low pulse repetition frequency (PRF). Conversely, SAR imagery is typically formed to focus data at zero Doppler and requires high BW and high PRF. Therefore, many of the techniques used in performance estimation of GMTI systems are not valid for SAR data. However, as demonstrated by papers in the recent literature,1-11 there is interest in exploiting moving targets within SAR data. The techniques employed vary widely, including filter banks to form images at multiple Dopplers, performing smear detection, and attempting to address the issue through waveform design. The above work validates the need for moving target exploitation in SAR data, but it does not represent a theory allowing for the prediction or bounding of performance. This work develops an approach to estimate and/or bound performance for moving target exploitation specific to SAR data. Synthetic SAR data is generated across a range of sensor, environment, and target parameters to test the exploitation algorithms under specific conditions. This provides a design tool allowing radar systems to be tuned for specific moving target exploitation applications. In summary, we derive a set of rules that bound the performance of specific moving target exploitation algorithms under variable operating conditions.

  5. 24 CFR 968.330 - PHA performance and evaluation report.

    Code of Federal Regulations, 2013 CFR

    2013-04-01

    ... 24 Housing and Urban Development 4 2013-04-01 2013-04-01 false PHA performance and evaluation... 250 or More Public Housing Units) § 968.330 PHA performance and evaluation report. For any FFY in which a PHA has received assistance under this subpart, the PHA shall submit a Performance and...

  6. 24 CFR 968.330 - PHA performance and evaluation report.

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... 24 Housing and Urban Development 4 2012-04-01 2012-04-01 false PHA performance and evaluation... 250 or More Public Housing Units) § 968.330 PHA performance and evaluation report. For any FFY in which a PHA has received assistance under this subpart, the PHA shall submit a Performance and...

  7. Performance evaluation of BK amputees through graded load carrying tests.

    PubMed

    Roy, A K; Ganguli, S; Datta, S R; Chatterjee, B B; Roy, B N; Bose, K S

    1977-01-01

    The ergonomic approach to performance evaluation in orthopaedic rehabilitation presents problems because of the cumbersome and time-consuming measurement and test procedures involved. This paper describes a method of performance evaluation through graded load carrying tests which makes it possible to set up regression equations which can be used in routine clinical practice for prediction of the performance of below-knee amputees.

  8. 48 CFR 8.406-7 - Contractor Performance Evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Contractor Performance... ACQUISITION PLANNING REQUIRED SOURCES OF SUPPLIES AND SERVICES Federal Supply Schedules 8.406-7 Contractor Performance Evaluation. Ordering activities must prepare an evaluation of contractor performance for...

  9. Generalized periodic discharges and 'triphasic waves': A blinded evaluation of inter-rater agreement and clinical significance.

    PubMed

    Foreman, Brandon; Mahulikar, Advait; Tadi, Prasanna; Claassen, Jan; Szaflarski, Jerzy; Halford, Jonathan J; Dean, Brian C; Kaplan, Peter W; Hirsch, Lawrence J; LaRoche, Suzette

    2016-02-01

    Generalized periodic discharges (GPDs) are associated with nonconvulsive seizures. Triphasic waves (TWs), a subtype of GPDs, have been described in relation to metabolic encephalopathy and not felt to be associated with seizures. We sought to establish the consistency of use of this descriptive term and its association with seizures. 11 experts in continuous EEG monitoring scored 20 cEEG samples containing GPDs using Standardized Critical Care EEG Terminology. In the absence of patient information, the inter-rater agreement (IRA) for EEG descriptors including TWs was assessed along with raters' clinical EEG interpretation and compared with actual patient information. The IRA for 'generalized' and 'periodic' was near-perfect (kappa=0.81), but fair for 'triphasic' (kappa=0.33). Patients with TWs were as likely to develop seizures as those without (25% vs 26%, N.S.) and surprisingly, patients with TWs were less likely to have toxic-metabolic encephalopathy than those without TWs (55% vs 79%, p<0.01). While IRA for the terms "generalized" and "periodic" is high, it is only fair for TWs. EEG interpreted as TWs presents similar risk for seizures as GPDs without triphasic appearance. GPDs are commonly associated with metabolic encephalopathy, but 'triphasic' appearance is not predictive. Conventional association of 'triphasic waves' with specific clinical conditions may lead to inaccurate EEG interpretation. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

  10. Using Ratio Analysis to Evaluate Financial Performance.

    ERIC Educational Resources Information Center

    Minter, John; And Others

    1982-01-01

    The ways in which ratio analysis can help in long-range planning, budgeting, and asset management to strengthen financial performance and help avoid financial difficulties are explained. Types of ratios considered include balance sheet ratios, net operating ratios, and contribution and demand ratios. (MSE)

  11. Game Performance Evaluation in Male Goalball Players.

    PubMed

    Molik, Bartosz; Morgulec-Adamowicz, Natalia; Kosmol, Andrzej; Perkowski, Krzysztof; Bednarczuk, Grzegorz; Skowroński, Waldemar; Gomez, Miguel Angel; Koc, Krzysztof; Rutkowska, Izabela; Szyman, Robert J

    2015-11-22

    Goalball is a Paralympic sport exclusively for athletes who are visually impaired and blind. The aims of this study were twofold: to describe game performance of elite male goalball players based upon the degree of visual impairment, and to determine if game performance was related to anthropometric characteristics of elite male goalball players. The study sample consisted of 44 male goalball athletes. A total of 38 games were recorded during the Summer Paralympic Games in London 2012. Observations were reported using the Game Efficiency Sheet for Goalball. Additional anthropometric measurements included body mass (kg), body height (cm), the arm span (cm) and length of the body in the defensive position (cm). The results differentiating both groups showed that the players with total blindness obtained higher means than the players with visual impairment for game indicators such as the sum of defense (p = 0.03) and the sum of good defense (p = 0.04). The players with visual impairment obtained higher results than those with total blindness for attack efficiency (p = 0.04), the sum of penalty defenses (p = 0.01), and fouls (p = 0.01). The study showed that athletes with blindness demonstrated higher game performance in defence. However, athletes with visual impairment presented higher efficiency in offensive actions. The analyses confirmed that body mass, body height, the arm span and length of the body in the defensive position did not differentiate players' performance at the elite level.

  12. Game Performance Evaluation in Male Goalball Players

    PubMed Central

    Molik, Bartosz; Morgulec-Adamowicz, Natalia; Kosmol, Andrzej; Perkowski, Krzysztof; Bednarczuk, Grzegorz; Skowroński, Waldemar; Gomez, Miguel Angel; Koc, Krzysztof; Rutkowska, Izabela; Szyman, Robert J

    2015-01-01

    Goalball is a Paralympic sport exclusively for athletes who are visually impaired and blind. The aims of this study were twofold: to describe game performance of elite male goalball players based upon the degree of visual impairment, and to determine if game performance was related to anthropometric characteristics of elite male goalball players. The study sample consisted of 44 male goalball athletes. A total of 38 games were recorded during the Summer Paralympic Games in London 2012. Observations were reported using the Game Efficiency Sheet for Goalball. Additional anthropometric measurements included body mass (kg), body height (cm), the arm span (cm) and length of the body in the defensive position (cm). The results differentiating both groups showed that the players with total blindness obtained higher means than the players with visual impairment for game indicators such as the sum of defense (p = 0.03) and the sum of good defense (p = 0.04). The players with visual impairment obtained higher results than those with total blindness for attack efficiency (p = 0.04), the sum of penalty defenses (p = 0.01), and fouls (p = 0.01). The study showed that athletes with blindness demonstrated higher game performance in defence. However, athletes with visual impairment presented higher efficiency in offensive actions. The analyses confirmed that body mass, body height, the arm span and length of the body in the defensive position did not differentiate players’ performance at the elite level. PMID:26834872

  13. Performance evaluation of a liquid solar collector

    NASA Technical Reports Server (NTRS)

    1979-01-01

    Report describes thermal performance and structural-load tests on commercial single glazed flat-plate solar collector with gross area of 63.5 sq ft that uses water as heat-transfer medium. Report documents test instrumentation and procedures and presents data as tables and graphs. Results are analyzed by standard data-reduction methods.

  14. Performance Evaluation Gravity Probe B Design

    NASA Technical Reports Server (NTRS)

    Francis, Ronnie; Wells, Eugene M.

    1996-01-01

    This final report documents the work done to develop a 6 degree-of-freedom simulation of the Lockheed Martin Gravity Probe B (GPB) Spacecraft. This simulation includes the effects of vehicle flexibility and propellant slosh. The simulation was used to investigate the control performance of the spacecraft when subjected to realistic on orbit disturbances.

  15. Space Shuttle Underside Astronaut Communications Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Hwu, Shian U.; Dobbins, Justin A.; Loh, Yin-Chung; Kroll, Quin D.; Sham, Catherine C.

    2005-01-01

    The Space Shuttle Ultra High Frequency (UHF) communications system is planned to provide Radio Frequency (RF) coverage for astronauts working underside of the Space Shuttle Orbiter (SSO) for thermal tile inspection and repairing. This study is to assess the Space Shuttle UHF communication performance for astronauts in the shadow region without line-of-sight (LOS) to the Space Shuttle and Space Station UHF antennas. To insure the RF coverage performance at anticipated astronaut worksites, the link margin between the UHF antennas and Extravehicular Activity (EVA) Astronauts with significant vehicle structure blockage was analyzed. A series of near-field measurements were performed using the NASA/JSC Anechoic Chamber Antenna test facilities. Computational investigations were also performed using the electromagnetic modeling techniques. The computer simulation tool based on the Geometrical Theory of Diffraction (GTD) was used to compute the signal strengths. The signal strength was obtained by computing the reflected and diffracted fields along the propagation paths between the transmitting and receiving antennas. Based on the results obtained in this study, RF coverage for UHF communication links was determined for the anticipated astronaut worksite in the shadow region underneath the Space Shuttle.

  16. Training the ACRIN 6666 Investigators and Effects of Feedback on Breast Ultrasound Interpretive Performance and Agreement in BI-RADS Ultrasound Feature Analysis

    PubMed Central

    Berg, Wendie A.; Blume, Jeffrey D.; Cormack, Jean B.; Mendelson, Ellen B.

    2013-01-01

    OBJECTIVE Qualification tasks in mammography and breast ultrasound were developed for the American College of Radiology Imaging Network (ACRIN) 6666 Investigators. We sought to assess the effects of feedback on breast ultrasound interpretive performance and agreement in BI-RADS feature analysis among a subset of these experienced observers. MATERIALS AND METHODS After a 1-hour didactic session on BI-RADS: Ultrasound, an interpretive skills quiz set of 70 orthogonal sets of breast ultrasound images including 25 (36%) malignancies was presented to 100 experienced breast imaging observers. Thirty-five observers reviewed the quiz set twice: first without and then with immediate feedback of consensus feature analysis, management recommendations, and pathologic truth. Observer performance (sensitivity, specificity, area under the curve [AUC]) was calculated without feedback and with feedback. Kappas were determined for agreement on feature analysis and assessments. RESULTS For 35 observers without feedback, the mean sensitivity was 89% (range, 68–100%); specificity, 62% (range, 42–82%); and AUC, 82% (range, 73–89%). With feedback, the mean sensitivity was 93% (range, 80–100%; mean increase, 4%; range of increase, 0–12%; p < 0.0001), the mean specificity was 61% (range, 45–73%; mean decrease, 1%; range of change, −18% to 11%; p = 0.19), and the mean AUC was 84% (range, 78–90%; mean increase, 2%; range of change, −3% to 9%; p < 0.0001). Three breast imagers in the lowest quartile of initial performance showed the greatest improvement in sensitivity with no change or improvement in AUC. The kappa values for feature analysis did not change, but there was improved agreement about final assessments, with the kappa value increasing from 0.53 (SE, 0.02) without feedback to 0.59 (SE, 0.02) with feedback (p < 0.0001). CONCLUSION Most experienced breast imagers showed excellent breast ultrasound interpretive skills. Immediate feedback of consensus BI

  17. SAFIR operation and evaluation of it's performance

    NASA Astrophysics Data System (ADS)

    Kawasaki, Z.-I.; Yamamoto, K.; Matsuura, K.; Richard, P.; Matsui, Toshiaki; Sonoi, Yasuo; Shimokura, Naoyoshi

    1994-06-01

    SAFIR (Surveillance et d'Alerte Foudre par Interferometrie Radioelectrique) has been equipped and operated in Japan since June 12th, 1991 as a cooperative project among Osaka University, Kansai Electric Power Co. INC.(KEPCO), and the French manufacturer DIMENSIONS. The operational coverage covers Northern Kinki District, Wakasa District, and Hokuriku District. Hokuriku District is well known for its winter thunderstorm activity. The method for the evaluation was to take the cross-correlation between the meteorological radar echo pattern and the distribution pattern of lightning discharges detected by SAFIR. We obtained high cross-correlation coefficients and concluded that the SAFIR locations were shown to have statistically high accuracy. We also show the case study of the occurrence of the lightning strike, which is recorded by KEPCO, to evaluate the usefulness of the warning by SAFIR.

  18. Evaluating Suit Fit Using Performance Degradation

    NASA Technical Reports Server (NTRS)

    Margerum, Sarah E.; Cowley, Matthew; Harvill, Lauren; Benson, Elizabeth; Rajulu, Sudhakar

    2011-01-01

    The Mark III suit has multiple sizes of suit components (arm, leg, and gloves) as well as sizing inserts to tailor the fit of the suit to an individual. This study sought to determine a way to identify the point an ideal suit fit transforms into a bad fit and how to quantify this breakdown using mobility-based physical performance data. This study examined the changes in human physical performance via degradation of the elbow and wrist range of motion of the planetary suit prototype (Mark III) with respect to changes in sizing and as well as how to apply that knowledge to suit sizing options and improvements in suit fit. The methods implemented in this study focused on changes in elbow and wrist mobility due to incremental suit sizing modifications. This incremental sizing was within a range that included both optimum and poor fit. Suited range of motion data was collected using a motion analysis system for nine isolated and functional tasks encompassing the elbow and wrist joints. A total of four subjects were tested with motions involving both arms simultaneously as well as the right arm only. The results were then compared across sizing configurations. The results of this study indicate that range of motion may be used as a viable parameter to quantify at what stage suit sizing causes a detriment in performance; however the human performance decrement appeared to be based on the interaction of multiple joints along a limb, not a single joint angle. The study was able to identify a preliminary method to quantify the impact of size on performance and to develop a means to gauge tolerances around optimal size. More work is needed to improve the assessment of optimal fit and to compensate for multiple joint interactions.

  19. Evaluating Suit Fit Using Performance Degradation

    NASA Technical Reports Server (NTRS)

    Margerum, Sarah E.; Cowley, Matthew; Harvill, Lauren; Benson, Elizabeth; Rajulu, Sudhakar

    2012-01-01

    The Mark III planetary technology demonstrator space suit can be tailored to an individual by swapping the modular components of the suit, such as the arms, legs, and gloves, as well as adding or removing sizing inserts in key areas. A method was sought to identify the transition from an ideal suit fit to a bad fit and how to quantify this breakdown using a metric of mobility-based human performance data. To this end, the degradation of the range of motion of the elbow and wrist of the suit as a function of suit sizing modifications was investigated to attempt to improve suit fit. The sizing range tested spanned optimal and poor fit and was adjusted incrementally in order to compare each joint angle across five different sizing configurations. Suited range of motion data were collected using a motion capture system for nine isolated and functional tasks utilizing the elbow and wrist joints. A total of four subjects were tested with motions involving both arms simultaneously as well as the right arm by itself. Findings indicated that no single joint drives the performance of the arm as a function of suit size; instead it is based on the interaction of multiple joints along a limb. To determine a size adjustment range where an individual can operate the suit at an acceptable level, a performance detriment limit was set. This user-selected limit reveals the task-dependent tolerance of the suit fit around optimal size. For example, the isolated joint motion indicated that the suit can deviate from optimal by as little as -0.6 in to -2.6 in before experiencing a 10% performance drop in the wrist or elbow joint. The study identified a preliminary method to quantify the impact of size on performance and developed a new way to gauge tolerances around optimal size.

  20. Frequency Domain Evaluation of Helmet Padding Performance

    DTIC Science & Technology

    2014-01-24

    F717 [8] have been used to evaluate helmets including motorcycle, football , and hockey helmets to ensure a basic level of protection. These standards...injury, including concussion and traumatic brain injury. These topics are outside the scope of this research and will not be addressed in this paper. The...Document. [6] Moss, W. C., and King, M. J., 2011. Impact response of us army and national football league helmet pad systems. Tech. rep., DTIC Document. [7

  1. An urban energy performance evaluation system and its computer implementation.

    PubMed

    Wang, Lei; Yuan, Guan; Long, Ruyin; Chen, Hong

    2017-12-15

    To improve the urban environment and effectively reflect and promote urban energy performance, an urban energy performance evaluation system was constructed, thereby strengthening urban environmental management capabilities. From the perspectives of internalization and externalization, a framework of evaluation indicators and key factors that determine urban energy performance and explore the reasons for differences in performance was proposed according to established theory and previous studies. Using the improved stochastic frontier analysis method, an urban energy performance evaluation and factor analysis model was built that brings performance evaluation and factor analysis into the same stage for study. According to data obtained for the Chinese provincial capitals from 2004 to 2013, the coefficients of the evaluation indicators and key factors were calculated by the urban energy performance evaluation and factor analysis model. These coefficients were then used to compile the program file. The urban energy performance evaluation system developed in this study was designed in three parts: a database, a distributed component server, and a human-machine interface. Its functions were designed as login, addition, edit, input, calculation, analysis, comparison, inquiry, and export. On the basis of these contents, an urban energy performance evaluation system was developed using Microsoft Visual Studio .NET 2015. The system can effectively reflect the status of and any changes in urban energy performance. Beijing was considered as an example to conduct an empirical study, which further verified the applicability and convenience of this evaluation system. Copyright © 2017 Elsevier Ltd. All rights reserved.

  2. Prospective cohort study of ultrasound-ultrasound and ultrasound-MR enterography agreement in the evaluation of pediatric small bowel Crohn disease.

    PubMed

    Dillman, Jonathan R; Smith, Ethan A; Sanchez, Ramon; DiPietro, Michael A; Dehkordy, Soudabeh Fazeli; Adler, Jeremy; DeMatos-Maillard, Vera; Khalatbari, Shokoufeh; Davenport, Matthew S

    2016-04-01

    There is a paucity of published literature describing ultrasound (US)-US and US-MR enterography (MRE) inter-radiologist agreement in pediatric small bowel Crohn disease. To prospectively assess US-US and US-MRE inter-radiologist agreement in pediatric small bowel Crohn disease. Institutional Review Board approval and informed consent/assent were obtained for this HIPAA-compliant prospective cohort study of children with newly diagnosed distal small bowel Crohn disease (July 2012 to December 2014). Enrolled subjects (n = 29) underwent two small bowel US examinations performed by blinded independent radiologists both before and at multiple time points after initiation of medical therapy (231 unique US examinations, in total); 134 US examinations were associated with concurrent MRE. The MRE examination was interpreted by a third blinded radiologist. The following was documented on each examination: involved length of ileum (cm); maximum bowel wall thickness (mm); amount of bowel wall and mesenteric Doppler signal, and presence of stricture, penetrating disease and/or abscess. Inter-radiologist agreement was assessed with single-measure, three-way, mixed-model intra-class correlation coefficients (ICC) and prevalence-adjusted, bias-adjusted kappa statistics (κ). Numbers in brackets are 95% confidence intervals. Ultrasound-US agreement was moderate for involved length (ICC: 0.41 [0.35-0.49]); substantial for maximum bowel wall thickness (ICC: 0.67 [0.64-0.70]); moderate for bowel wall Doppler signal (ICC: 0.53 [0.48-0.59]); slight for mesenteric Doppler signal (ICC: 0.25 [0.18-0.42]), and moderate to almost perfect for stricture (κ: 0.54), penetrating disease (κ: 0.80), and abscess (κ: 0.96). US-MRE agreement was moderate for involved length (ICC: 0.42 [0.37-0.49]); substantial for maximum bowel wall thickness (ICC: 0.66 [0.65-0.69]), and substantial to almost perfect for stricture (κ: 0.61), penetrating disease (κ: 0.72) and abscess (κ: 0.88). Ultrasound

  3. Evaluating the Performance of Administrators: The Process and the Tools.

    ERIC Educational Resources Information Center

    Herman, Jerry J.

    1991-01-01

    Describes the various roles (monitor, information gatherer, communicator and feedback provider, clarifier, coanalyzer, assister, resource provider, and motivator) played by the supervisor when evaluating administrators. Presents a sample evaluation instrument assessing five major performance areas (management, professionalism, leadership,…

  4. Tribological performance evaluation of oil mist lubrication

    SciTech Connect

    Shamim, A.; Kettleborough, C.F. )

    1994-09-01

    In this research work, the tribological performance of oil mist lubrication (pure mist), as applied to rolling element bearings, was investigated. In the first part of this research, tests were conducted to compare the performances of oil mist and conventional oil sump lubrication in terms of operating temperature and friction with variation of load and speed. In the second part, the two methods of lubrication were compared directly under endurance test conditions. The oil mist lubricated high-precision angular contact test bearings ran cooler by about 10 C. Also, the oil mist lubricated bearings had about 25 percent less friction. In the third part, endurance tests were conducted to investigate the influence of oil mist lubrication on the life of rolling element bearings. Weibull and maximum likelihood analysis of the endurance test data indicated that, in addition to savings in energy, oil mist lubrication provides better wear and fatigue protection to the test bearings compared to conventional sump lubrication.

  5. Brookfield Homes Passive House Performance Evaluation

    SciTech Connect

    A. Herk; Poerschke, A.; Beach, R.

    2016-02-01

    In 2012-2013, IBACOS worked with a builder, Brookfield Homes in Denver, Colorado, to design and construct a Passive House certified model home. IBACOS used several modeling programs and calculation methods to complete the final design package along with Brookfield's architect KGA Studio. This design package included upgrades to the thermal enclosure, basement insulation, windows, and heating, ventilation, and air conditioning. Short-term performance testing in the Passive House was done during construction and after construction.

  6. Performance Evaluation Method for Dissimilar Aircraft Designs

    NASA Technical Reports Server (NTRS)

    Walker, H. J.

    1979-01-01

    A rationale is presented for using the square of the wingspan rather than the wing reference area as a basis for nondimensional comparisons of the aerodynamic and performance characteristics of aircraft that differ substantially in planform and loading. Working relationships are developed and illustrated through application to several categories of aircraft covering a range of Mach numbers from 0.60 to 2.00. For each application, direct comparisons of drag polars, lift-to-drag ratios, and maneuverability are shown for both nondimensional systems. The inaccuracies that may arise in the determination of aerodynamic efficiency based on reference area are noted. Span loading is introduced independently in comparing the combined effects of loading and aerodynamic efficiency on overall performance. Performance comparisons are made for the NACA research aircraft, lifting bodies, century-series fighter aircraft, F-111A aircraft with conventional and supercritical wings, and a group of supersonic aircraft including the B-58 and XB-70 bomber aircraft. An idealized configuration is included in each category to serve as a standard for comparing overall efficiency.

  7. Performance Evaluation of Hyperspectral Chemical Detection Systems

    NASA Astrophysics Data System (ADS)

    Truslow, Eric

    Remote sensing of chemical vapor plumes is a difficult but important task with many military and civilian applications. Hyperspectral sensors operating in the long wave infrared (LWIR) regime have well demonstrated detection capabilities. However, the identification of a plume's chemical constituents, based on a chemical library, is a multiple hypothesis-testing problem that standard detection metrics do not fully describe. Our approach partitions and weights a confusion matrix to develop both the standard detection metrics and an identification metric based on the Dice index. Using the developed metrics, we demonstrate that using a detector bank followed by an identifier can achieve superior performance relative to either algorithm individually. Performance of the cascaded system relies on the first pass reliably detecting the plume. However, detection performance is severely hampered by the inclusion of plume pixels in estimates of background quantities. We demonstrate that this problem, known as contamination, can be mitigated by iteratively applying a spatial filter to the detected pixels. Multiple detection and filtering passes can remove nearly all contamination from the background estimates, a vast improvement over single-pass techniques.

  8. Performance Evaluation of Network Centric Warfare Oriented Intelligent Systems

    DTIC Science & Technology

    2001-09-01

    Performance Evaluation o f Network Centric Warfare Oriented Intelligent Systems Edward Dawidowicz, Member, IEEE Abstract The concepts o f Network...performance evaluation o f NCW oriented intelligent systems . The warfighter desires the ’right’ information at the ’right’ time. Such information can be...to 00-00-2001 4. TITLE AND SUBTITLE Performance Evaluation of Network Centric Warfare Oriented Intelligent Systems 5a. CONTRACT NUMBER 5b. GRANT

  9. [Evaluation of agreement between brushing cytology diagnosis and histology evaluation of biopsy from gastric mucosa based on analysis of 362 cases].

    PubMed

    Dziecioł, J; Musiałowicz, B; Barwijuk-Machała, M; Kisielewski, W; Kemona, A; Sobaniec-Lotowska, M; Sulkowski, S

    1994-04-01

    Retrospective analysis is presented for the diagnoses basing on brushing cytology and biopsy histology in 362 patients selected from the total number of 8600 cytologic examinations of gastric mucosa performed in this Department in the years 1984-1992. Endoscopy suggested neoplasma in 58 cases, peptic ulcer in 146 and gastritis in 158 cases. In 64 cytologic specimens neoplastic cells were found (17.7%). Histologic evaluation, in addition to brushing cytology, was possible in 316 cases; in 186 on gastroscopy, in 82 in surgical specimens, in 48 on postmortem. In one case only of positive brushing cytology the diagnosis of cancer was confirmed (1.7%). In 16 cases (8.2%) the brushing cytology is stressed, especially in monitoring subjects of high risk.

  10. Evaluation of Improvements to Brayton Cycle Performance.

    DTIC Science & Technology

    1986-05-29

    34 Report No. MTR-7274, The MITRE Corporation, July 1976. 10. Boyce, M.P., Vyas , Y.K., and Trevillion, W.L., "The External Combustion Steam Injected Gas...for Power, Vol. 102, January 1980, pp. 42-49. 27. Keenan, J.H., Keyes, F.G., Hill , P.G., and Moore, J.G., StamTables, John Wiley & Sons, New York, 1978...Turbines and Power Vol. 107, October 1985, pp. 880-889. 29. Fraas, A P., Engineering Evaluation of Energy Systems, McGraw- Hill , New York, 1982

  11. Officer Performance Evaluation Systems: Officer Survey

    DTIC Science & Technology

    1984-11-01

    evaluation. It ^? .tinn°"Inr?.f ’^^’ ^^^ ^^^ ^’T^^^ *°’"^ ^"^ ’^’ procedurVs be modified to reduce inflation, and (2) an assignment planning ...The survey, a copy of which is provided as Appendix C, was planned as an informal, low-key effort to provide additional data for ongoing research on...nonsignificant, the univariate results should be interpreted as trends that, if consistent with findings from related items, might be useful in planning future

  12. Performance Evaluation of a Clinical PACS Module

    NASA Astrophysics Data System (ADS)

    Taira, Ricky K.; Cho, Paul S.; Huang, H. K.; Mankovich, Nicholas J.; Boechat, Maria I.

    1989-05-01

    Picture archiving and communication systems (PACS) are now clinically available in limited radiologic applications. The benefits, acceptability, and reliablity of these systems have thus far been mainly speculative and anecdotal. This paper discusses the evaluation of a PACS module implemented in the pediatric radiology section of a 700-bed teaching hospital. The PACS manages all pediatric inpatient images including conventional x-rays and contrast studies (obtained with a computed radiography system), magnetic resonance images, and relevant ultrasound images. A six-monitor workstation is available for image review.

  13. Performance evaluation of video on ethernet

    SciTech Connect

    Pihlman, M.; Farrell, R.

    1993-08-01

    The purpose of this project was to determine the feasibility of using an ethernet local area network (LAN) to support videoconferencing connections between CAMEO Macintosh desktop videoconferencing systems. The specific goals were to: (1) to ensure that CAMEO video could be transported-without protocol modification-via existing ethernet networks, and would do so without ``bringing-down`` the network; (2) to measure the effect of CAMEO video connections on ethernet traffic; (3) to evaluate qualitatively how generated ethernet traffic effects the CAMEO video; and (4) to evaluate qualitatively how multiple CAMEO connections work between two routered ethernet networks via a backbone. High quality CAMEO video can be transported on an ethernet network and between routered networks, via a backbone. The number of simultaneous video connections possible on an ethernet segment would probably be less than 45, since each connection uses 2.2% of the network and errors increase rapidly as video connections are made. However, the actual number of simultaneous video connections possible will depend upon your network implementation and the amount of ``normal`` traffic present. The remainder of this report discusses the effect of CAMEO video on our networks.

  14. An hierarchical approach to performance evaluation of expert systems

    NASA Technical Reports Server (NTRS)

    Dominick, Wayne D. (Editor); Kavi, Srinu

    1985-01-01

    The number and size of expert systems is growing rapidly. Formal evaluation of these systems - which is not performed for many systems - increases the acceptability by the user community and hence their success. Hierarchical evaluation that had been conducted for computer systems is applied for expert system performance evaluation. Expert systems are also evaluated by treating them as software systems (or programs). This paper reports many of the basic concepts and ideas in the Performance Evaluation of Expert Systems Study being conducted at the University of Southwestern Louisiana.

  15. PERFORMANCE EVALUATION OF TYPE I MARINE SANITATION DEVICES

    EPA Science Inventory

    This performance test was designed to evaluate the effectiveness of two Type I Marine Sanitation Devices (MSDs): the Electro Scan Model EST 12, manufactured by Raritan Engineering Company, Inc., and the Thermopure-2, manufactured by Gross Mechanical Laboratories, Inc. Performance...

  16. PERFORMANCE EVALUATION OF TYPE I MARINE SANITATION DEVICES

    EPA Science Inventory

    This performance test was designed to evaluate the effectiveness of two Type I Marine Sanitation Devices (MSDs): the Electro Scan Model EST 12, manufactured by Raritan Engineering Company, Inc., and the Thermopure-2, manufactured by Gross Mechanical Laboratories, Inc. Performance...

  17. Phased array performance evaluation with photoelastic visualization

    SciTech Connect

    Ginzel, Robert; Dao, Gavin

    2014-02-18

    New instrumentation and a widening range of phased array transducer options are affording the industry a greater potential. Visualization of the complex wave components using the photoelastic system can greatly enhance understanding of the generated signals. Diffraction, mode conversion and wave front interaction, together with beam forming for linear, sectorial and matrix arrays, will be viewed using the photoelastic system. Beam focus and steering performance will be shown with a range of embedded and surface targets within glass samples. This paper will present principles and sound field images using this visualization system.

  18. ATAMM enhancement and multiprocessing performance evaluation

    NASA Technical Reports Server (NTRS)

    Stoughton, John W.

    1994-01-01

    The algorithm to architecture mapping model (ATAAM) is a Petri net based model which provides a strategy for periodic execution of a class of real-time algorithms on multicomputer dataflow architecture. The execution of large-grained, decision-free algorithms on homogeneous processing elements is studied. The ATAAM provides an analytical basis for calculating performance bounds on throughput characteristics. Extension of the ATAMM as a strategy for cyclo-static scheduling provides for a truly distributed ATAMM multicomputer operating system. An ATAAM testbed consisting of a centralized graph manager and three processors is described using embedded firmware on 68HC11 microcontrollers.

  19. Assisting allied health in performance evaluation: a systematic review.

    PubMed

    Lizarondo, Lucylynn; Grimmer, Karen; Kumar, Saravana

    2014-11-14

    Performance evaluation raises several challenges to allied health practitioners and there is no agreed approach to measuring or monitoring allied health service performance. The aim of this review was to examine the literature on performance evaluation in healthcare to assist in the establishment of a framework that can guide the measurement and evaluation of allied health clinical service performance. This review determined the core elements of a performance evaluation system, tools for evaluating performance, and barriers to the implementation of performance evaluation. A systematic review of the literature was undertaken. Five electronic databases were used to search for relevant articles: MEDLINE, Embase, CINAHL, PsychInfo, and Academic Search Premier. Articles which focussed on any allied health performance evaluation or those which examined performance in health care in general were considered in the review. Content analysis was used to synthesise the findings from individual articles. A total of 37 articles were included in the review. The literature suggests there are core elements involved in performance evaluation which include prioritising clinical areas for measurement, setting goals, selecting performance measures, identifying sources of feedback, undertaking performance measurement, and reporting the results to relevant stakeholders. The literature describes performance evaluation as multi-dimensional, requiring information or data from more than one perspective to provide a rich assessment of performance. A range of tools or instruments are available to capture various perspectives and gather a comprehensive picture of health care quality. Every allied health care delivery system has different performance needs and will therefore require different approaches. However, there are core processes that can be used as a framework to evaluate allied health performance. A careful examination of barriers to performance evaluation and subsequent tailoring of

  20. Performance Evaluation of the NEXT Ion Engine

    NASA Technical Reports Server (NTRS)

    Soulas, George C.; Domonkos, Matthew T.; Patterson, Michael J.

    2003-01-01

    The performance test results of three NEXT ion engines are presented. These ion engines exhibited peak specific impulse and thrust efficiency ranges of 4060 4090 s and 0.68 0.69, respectively, at the full power point of the NEXT throttle table. The performance of the ion engines satisfied all project requirements. Beam flatness parameters were significantly improved over the NSTAR ion engine, which is expected to improve accelerator grid service life. The results of engine inlet pressure and temperature measurements are also presented. Maximum main plenum, cathode, and neutralizer pressures were 12,000 Pa, 3110 Pa, and 8540 Pa, respectively, at the full power point of the NEXT throttle table. Main plenum and cathode inlet pressures required about 6 hours to increase to steady-state, while the neutralizer required only about 0.5 hour. Steady-state engine operating temperature ranges throughout the power throttling range examined were 179 303 C for the discharge chamber magnet rings and 132 213 C for the ion optics mounting ring.

  1. Safety performance evaluation of taekwondo headgear.

    PubMed

    O'Sullivan, David M; Fife, Gabriel P; Pieter, Willy; Shin, Insik

    2013-05-01

    With over 20 years of taekwondo concussion research highlighting the high incidence of injury, previous studies recommend an investigation of headgear impact attenuation performance. To examine impact attenuation differences between the anterior, posterior and sides of selected taekwondo headgear brands. Between-groups. Biomechanics laboratory. Five different commercially available taekwondo headgear were selected for impact testing. A 50th percentile Hybrid II Dummy Crash Test head and neck was fitted with the selected helmet and was bolted to a 25 kg steel torso-like structure. Each headgear model was impacted eight times to the anterior, posterior and sides by a 6.75 kg bowling ball at three heights to produce 52.25, 85 and 144 J strikes. Resultant head linear acceleration. Two-way (Helmet×Location) mixed analysis of variance with repeated measures on the second factor was performed to determine the differences between headgear by location of impact. There was a two-way (Helmet×Location) interaction for acceleration (η(2)=0.368). Taekwondo headgear manufacturers and sport governing bodies must consider improving the design of especially anterior helmet properties.

  2. Evaluating Models of Human Performance: Safety-Critical Systems Applications

    NASA Technical Reports Server (NTRS)

    Feary, Michael S.

    2012-01-01

    This presentation is part of panel discussion on Evaluating Models of Human Performance. The purpose of this panel is to discuss the increasing use of models in the world today and specifically focus on how to describe and evaluate models of human performance. My presentation will focus on discussions of generating distributions of performance, and the evaluation of different strategies for humans performing tasks with mixed initiative (Human-Automation) systems. I will also discuss issues with how to provide Human Performance modeling data to support decisions on acceptability and tradeoffs in the design of safety critical systems. I will conclude with challenges for the future.

  3. Coherent lidar airborne windshear sensor - Performance evaluation

    NASA Technical Reports Server (NTRS)

    Targ, Russell; Kavaya, Michael J.; Huffaker, R. Milton; Bowles, Roland L.

    1991-01-01

    As part of the NASA/FAA National Integrated Windshear Program, a measurable windshear hazard index has been defined that can be remotely sensed from an aircraft, to give the pilot information about the wind conditions along the flight path. A technology analysis and end-to-end performance simulation measuring signal-to-noise ratios and resulting wind velocity errors for competing coherent laser radar (lidar) systems have been carried out. The results show that a Ho:YAG lidar at a wavelength of 2.1 microns and a CO2 lidar at 10.6 microns can give the pilot information about the line-of-sight component of a windshear threat from his present position to a region extending 2-4 km in front of the aircraft. This constitutes a warning time of 20-40 s, even in conditions of moderately heavy precipitation.

  4. Traction contact performance evaluation at high speeds

    NASA Technical Reports Server (NTRS)

    Tevaarwerk, J. L.

    1981-01-01

    The results of traction tests performed on two fluids are presented. These tests covered a pressure range of 1.0 to 2.5 GPa, an inlet temperature range of 30 'C to 70 'C, a speed range of 10 to 80 m/sec, aspect ratios of .5 to 5 and spin from 0 to 2.1 percent. The test results are presented in the form of two dimensionless parameters, the initial traction slope and the maximum traction peak. With the use of a suitable rheological fluid model the actual traction curves measured can now be reconstituted from the two fluid parameters. More importantly, the knowledge of these parameters together with the fluid rheological model, allow the prediction of traction under conditions of spin, slip and any combination thereof. Comparison between theoretically predicted traction under these conditions and those measured in actual traction tests shows that this method gives good results.

  5. Human performance evaluation of a pathway HMD

    NASA Astrophysics Data System (ADS)

    Lorenz, Bernd; Tobben, Helmut; Schmerwitz, Sven

    2005-05-01

    Head-up displays (HUD) and helmet (or head)-mounted displays (HMD) aim at reducing the pilot's visual scanning cost in support of concurrent monitoring of both instrument information (near domain) and the outside environment (far domain). An HMD used in combination with a head tracker enables the assessment of the pilot"s head direction in real time allowing symbologies to remain spatially linked to elements of the outside environment. The paper examines the potential added benefits of improved flight path tracking to be expected by displaying symbologies of a virtual 3D perspective pathway plus predictor information on an HMD. Results of a high-fidelity flight-simulation experiment are reported that involved a series of curved approaches supported with such a pathway HMD. The study used a monocular retinal-scanning HMD and involved 18 pilots. Dependent human performance data were derived from flight path tracking measures, subjective measures of mental workload and situation awareness and pilot reactions in response to an unexpected rare event in the outside scene (intruding aircraft on the active runway for the intended landing). Comparison with a standard head-down ILS baseline condition revealed a mix of performance costs and benefits, which is consistent with most of the human factors literature on the general use of HUDs and of HUDs used in combination with pathway guidance: The pathway HMD promoted substantially better flight path tracking but caused also a delayed response to the unexpected event. This effect points to some disadvantages of HUDs referred to as 'attention capture', which may become exaggerated by the additional use of pathway guidance symbology.

  6. Evaluation of PV Module Field Performance

    SciTech Connect

    Wohlgemuth, John; Silverman, Timothy; Miller, David C.; McNutt, Peter; Kempe, Michael; Deceglie, Michael

    2015-06-14

    This paper describes an effort to inspect and evaluate PV modules in order to determine what failure or degradation modes are occurring in field installations. This paper will report on the results of six site visits, including the Sacramento Municipal Utility District (SMUD) Hedge Array, Tucson Electric Power (TEP) Springerville, Central Florida Utility, Florida Solar Energy Center (FSEC), the TEP Solar Test Yard, and University of Toledo installations. The effort here makes use of a recently developed field inspection data collection protocol, and the results were input into a corresponding database. The results of this work have also been used to develop a draft of the IEC standard for climate and application specific accelerated stress testing beyond module qualification. TEP Solar Test Yard, and University of Toledo installations. The effort here makes use of a recently developed field inspection data collection protocol, and the results were input into a corresponding database. The results of this work have also been used to develop a draft of the IEC standard for climate and application specific accelerated stress testing beyond module qualification. TEP Solar Test Yard, and University of Toledo installations. The effort here makes use of a recently developed field inspection data collection protocol, and the results were input into a corresponding database. The results of this work have also been used to develop a draft of the IEC standard for climate and application specific accelerated stress testing beyond module qualification.

  7. Hydrogen-fueled postal vehicle performance evaluation

    NASA Technical Reports Server (NTRS)

    Hall, R. A.

    1979-01-01

    Fuel consumption, range, and emissions data were obtained while operating a hydrogen-fueled postal delivery vehicle over a defined Postal Service Driving Cycle and the 1975 Urban Driving Cycle. The vehicle's fuel consumption was 0.366 pounds of hydrogen per mile over the postal driving cycle and 0.22 pounds of hydrogen per mile over the urban driving cycle. These data correspond to 6.2 and 10.6 mpg equivalent gasoline mileage for the two driving cycles, respectively. The vehicle's range was 24.2 miles while being operated on the postal driving cycle. Vehicle emissions were measured over the urban driving cycle. HC and CO emissions were quite low, as would be expected. The oxides of nitrogen were found to be 4.86 gm/mi, a value which is well above the current Federal and California standards. Vehicle limitations discussed include excessive engine flashbacks, inadequate acceleration capability the engine air/fuel ratio, the water injection systems, and the cab temperature. Other concerns are safety considerations, iron-titanium hydride observed in the fuel system, evidence of water in the engine rocker cover, and the vehicle maintenance required during the evaluation.

  8. Performance evaluation of a parallel sparse lattice Boltzmann solver

    SciTech Connect

    Axner, L. Bernsdorf, J. Zeiser, T. Lammers, P. Linxweiler, J. Hoekstra, A.G.

    2008-05-01

    We develop a performance prediction model for a parallelized sparse lattice Boltzmann solver and present performance results for simulations of flow in a variety of complex geometries. A special focus is on partitioning and memory/load balancing strategy for geometries with a high solid fraction and/or complex topology such as porous media, fissured rocks and geometries from medical applications. The topology of the lattice nodes representing the fluid fraction of the computational domain is mapped on a graph. Graph decomposition is performed with both multilevel recursive-bisection and multilevel k-way schemes based on modified Kernighan-Lin and Fiduccia-Mattheyses partitioning algorithms. Performance results and optimization strategies are presented for a variety of platforms, showing a parallel efficiency of almost 80% for the largest problem size. A good agreement between the performance model and experimental results is demonstrated.

  9. Performance evaluation of a parallel sparse lattice Boltzmann solver

    NASA Astrophysics Data System (ADS)

    Axner, L.; Bernsdorf, J.; Zeiser, T.; Lammers, P.; Linxweiler, J.; Hoekstra, A. G.

    2008-05-01

    We develop a performance prediction model for a parallelized sparse lattice Boltzmann solver and present performance results for simulations of flow in a variety of complex geometries. A special focus is on partitioning and memory/load balancing strategy for geometries with a high solid fraction and/or complex topology such as porous media, fissured rocks and geometries from medical applications. The topology of the lattice nodes representing the fluid fraction of the computational domain is mapped on a graph. Graph decomposition is performed with both multilevel recursive-bisection and multilevel k-way schemes based on modified Kernighan-Lin and Fiduccia-Mattheyses partitioning algorithms. Performance results and optimization strategies are presented for a variety of platforms, showing a parallel efficiency of almost 80% for the largest problem size. A good agreement between the performance model and experimental results is demonstrated.

  10. Brookfield Homes Passive House Performance Evaluation

    SciTech Connect

    Herk, A.; Poerschke, A.; Beach, R.

    2016-02-04

    In 2012-2013, IBACOS worked with a builder, Brookfield Homes in Denver, Colorado, to design and construct a Passive House certified model home. IBACOS used several modeling programs and calculation methods to complete the final design package along with Brookfield's architect KGA Studio. This design package included upgrades to the thermal enclosure, basement insulation, windows, and heating, ventilation, and air conditioning. Short-term performance testing in the Passive House was done during construction and after construction. Testing with a blower door indicated that whole-building air leakage to the outside was 324 CFM and 0.60 ACH50. The other two test homes had little short-term testing done post-construction by the local energy rater. IBACOS then monitored the energy consumption and whole-house comfort conditions of that occupied Passive House after one year of operation and compared the monitoring results to those for two other occupied test houses in the same area with similar square footage but slightly different floor plans. IBACOS also assisted the builder, Brookfield Homes, in researching design scenarios for Zero Energy Ready Home and ENERGY STAR acceptance levels. IBACOS also assisted Brookfield in conceptualizing product for Denver's Brighton Heights area. Brookfield was considering building to Zero Energy Ready Home standards in that location. IBACOS provided strategies that Brookfield may draw from in the event the builder chooses to pursue a Zero Energy Ready Home plan for that market.

  11. Performance evaluation of solar water sterilization system

    SciTech Connect

    Saitoh, Takeo; El-Ghetany, H.H.

    1998-07-01

    In most countries, the contaminated water is the major cause of most of the water-born diseases. Solar energy can be used in this field because the inactivation of micro-organisms is done by the ultraviolet solar radiation. A pilot solar system for sterilizing the contaminated water is designed, constructed and tested. The experimental data showed good viability for using solar energy in the sterilization process. A mathematical model of the solar sterilizer is also presented. The governing equations are solved numerically using fourth-order Runge-Kutta method. The effects of environmental conditions (ambient temperature, wind speed and solar radiation) on the solar sterilizer performance are examined. It is found that the system is affected by the ambient temperature, wind speed, ultraviolet solar radiation intensity, level of contamination of water, quantity of water being exposed, contact area between the transparent water container in the solar sterilizer and absorber plate and system geometrical parameters. It is pointed that, for a partial cloud condition, low ambient temperature and high wind speed the thermal efficiency of the solar sterilizer was minimum.

  12. Thrust Stand for Electric Propulsion Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Markusic, T. E.; Jones, J. E.; Cox, M. D.

    2004-01-01

    An electric propulsion thrust stand capable of supporting thrusters with total mass of up to 125 kg and 1 mN to 1 N thrust levels has been developed and tested. The mechanical design features a conventional hanging pendulum arm attached to a balance mechanism that transforms horizontal motion into amplified vertical motion, with accommodation for variable displacement sensitivity. Unlike conventional hanging pendulum thrust stands, the deflection is independent of the length of the pendulum arm, and no reference structure is required at the end of the pendulum. Displacement is measured using a non-contact, optical linear gap displacement transducer. Mechanical oscillations are attenuated using a passive, eddy current damper. An on-board microprocessor-based level control system, which includes a two axis accelerometer and two linear-displacement stepper motors, continuously maintains the level of the balance mechanism - counteracting mechanical %era drift during thruster testing. A thermal control system, which includes heat exchange panels, thermocouples, and a programmable recirculating water chiller, continuously adjusts to varying thermal loads to maintain the balance mechanism temperature, to counteract thermal drifts. An in-situ calibration rig allows for steady state calibration both prior to and during thruster testing. Thrust measurements were carried out on a well-characterized 1 kW Hall thruster; the thrust stand was shown to produce repeatable results consistent with previously published performance data.

  13. Evaluating the performance of clinical pharmacy faculty: putting the ACCP template to use.

    PubMed

    Schumock, G T; Crawford, S Y; Giusto, D A; Hutchinson, R A

    1993-01-01

    The responsibilities of clinical faculty members are often multifaceted and may include direct patient care, didactic and experiential teaching, research, and administrative duties. Specialization, poorly defined standards of care, and lack of direct supervision have traditionally made performance evaluation difficult. We implemented a method to evaluate clinical faculty as they carried out patient care activities using a revised template for the evaluation of a clinical pharmacist developed by the American College of Clinical Pharmacy Clinical Practice Affairs Committee. In addition, it allows individuals to report and evaluate their own performance in the areas of patient care, instructional activity, university and public service, research and scholarly activities, and administrative duties. Teaching evaluations from clerkship students and residents are also submitted and assessed during the annual interview. To determine the usefulness of the evaluation, including the template, we surveyed the opinions of clinical faculty (nontenured) at four primary practice sites (response rate 92%). Mean scores for responses suggested agreement with statements as to the merits of the evaluation system; however, there was some variation among practice sites. Incorporating the template into a broad evaluation system was effective in facilitating improved job performance and career development. Adaptation of the template may be practice site dependent and should be coordinated by a participative approach. Additional assessment may be facilitated by physician, nurse, or peer evaluation.

  14. Thrust Stand for Electric Propulsion Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Polzin, Kurt A.; Markusic, Thomas E.; Stanojev, Boris J.; Dehoyos, Amado; Spaun, Benjamin

    2006-01-01

    An electric propulsion thrust stand capable of supporting testing of thrusters having a total mass of up to 125 kg and producing thrust levels between 100 microN to 1 N has been developed and tested. The design features a conventional hanging pendulum arm attached to a balance mechanism that converts horizontal deflections produced by the operating thruster into amplified vertical motion of a secondary arm. The level of amplification is changed through adjustment of the location of one of the pivot points linking the system. Response of the system depends on the relative magnitudes of the restoring moments applied by the displaced thruster mass and the twisting torsional pivots connecting the members of the balance mechanism. Displacement is measured using a non-contact, optical linear gap displacement transducer and balance oscillatory motion is attenuated using a passive, eddy-current damper. The thrust stand employs an automated leveling and thermal control system. Pools of liquid gallium are used to deliver power to the thruster without using solid wire connections, which can exert undesirable time-varying forces on the balance. These systems serve to eliminate sources of zero-drift that can occur as the stand thermally or mechanically shifts during the course of an experiment. An in-situ calibration rig allows for steady-state calibration before, during and after thruster operation. Thrust measurements were carried out on a cylindrical Hall thruster that produces mN-level thrust. The measurements were very repeatable, producing results that compare favorably with previously published performance data, but with considerably smaller uncertainty.

  15. Sexism and Beautyism in Women's Evaluations of Peer Performance.

    ERIC Educational Resources Information Center

    Cash, Thomas F.; Trimer, Claire A.

    1984-01-01

    Investigated independent and interactive effects of physical attractiveness (PA), sex, and task sex-typing on performance evaluations by 216 college women. Found that the halo effect ("beauty is talent") of PA operated when subjects evaluated both sexes, with the exception of ratings of attractive women in out-of-role ("masculine") performances.…

  16. Sexism and Beautyism in Women's Evaluations of Peer Performance.

    ERIC Educational Resources Information Center

    Cash, Thomas F.; Trimer, Claire A.

    1984-01-01

    Investigated independent and interactive effects of physical attractiveness (PA), sex, and task sex-typing on performance evaluations by 216 college women. Found that the halo effect ("beauty is talent") of PA operated when subjects evaluated both sexes, with the exception of ratings of attractive women in out-of-role ("masculine") performances.…

  17. 48 CFR 36.201 - Evaluation of contractor performance.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Evaluation of contractor performance. 36.201 Section 36.201 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION... Contracting for Construction 36.201 Evaluation of contractor performance. See 42.1502(e) for the...

  18. Transformational Classroom Leadership: A Novel Approach to Evaluating Classroom Performance

    ERIC Educational Resources Information Center

    Pounder, James S.

    2008-01-01

    In higher education, student evaluation of teaching is widely used as a measure of an academic's teaching performance despite considerable disagreement as to its value. This paper begins by examining the merit of teaching evaluations with reference to the factors influencing the accuracy of the teaching evaluation process. One of the central…

  19. Using Business Performance To Evaluate Multimedia Training in Manufacturing.

    ERIC Educational Resources Information Center

    Lachenmaier, Lynn S.; Moor, William C.

    1997-01-01

    Discusses training evaluation and shows how an abbreviated form of Kirkpatrick's four-level evaluation model can be used effectively to evaluate multimedia-based manufacturing training. Topics include trends in manufacturing training, quantifying performance improvement, and statistical comparisons using the Mann-Whitney test and the Tukey Quick…

  20. At-Risk Youth Appearance and Job Performance Evaluation

    ERIC Educational Resources Information Center

    Freeburg, Beth Winfrey; Workman, Jane E.

    2008-01-01

    The goal of this study was to identify the relationship of at-risk youth workplace appearance to other job performance criteria. Employers (n = 30; each employing from 1 to 17 youths) evaluated 178 at-risk high school youths who completed a paid summer employment experience. Appearance evaluations were significantly correlated with evaluations of…

  1. A Performance Measurement and Evaluation Environment for Information Systems.

    ERIC Educational Resources Information Center

    Dominick, Wayne D.

    1987-01-01

    Describes the concept of an integrated environment which allows managers to evaluate and measure the performance of computer based information systems. Both system efficiency evaluation and user interaction evaluation are addressed, and MADAM, a system currently operational at the University of Southwestern Louisiana, is briefly described.…

  2. How Universities Evaluate Faculty Performance: A Survey of Department Heads.

    ERIC Educational Resources Information Center

    Centra, John A.

    Department heads from 134 institutions (mainly universities) indicated the weight they generally give to various criteria for evaluating individual faculty members. The questionnaire they responded to included: criteria used for evaluating overall faculty performance; sources of information for evaluating teaching; and kinds of information used…

  3. Can glenoid wear be accurately assessed using x-ray imaging? Evaluating agreement of x-ray and magnetic resonance imaging (MRI) Walch classification.

    PubMed

    Kopka, Michaela; Fourman, Mitchell; Soni, Ashish; Cordle, Andrew C; Lin, Albert

    2017-09-01

    The Walch classification is the most recognized means of assessing glenoid wear in preoperative planning for shoulder arthroplasty. This classification relies on advanced imaging, which is more expensive and less practical than plain radiographs. The purpose of this study was to determine whether the Walch classification could be accurately applied to x-ray images compared with magnetic resonance imaging (MRI) as the gold standard. We hypothesized that x-ray images cannot adequately replace advanced imaging in the evaluation of glenoid wear. Preoperative axillary x-ray images and MRI scans of 50 patients assessed for shoulder arthroplasty were independently reviewed by 5 raters. Glenoid wear was individually classified according to the Walch classification using each imaging modality. The raters then collectively reviewed the MRI scans and assigned a consensus classification to serve as the gold standard. The κ coefficient was used to determine interobserver agreement for x-ray images and independent MRI reads, as well as the agreement between x-ray images and consensus MRI. The inter-rater agreement for x-ray images and MRIs was "moderate" (κ = 0.42 and κ = 0.47, respectively) for the 5-category Walch classification (A1, A2, B1, B2, C) and "moderate" (κ = 0.54 and κ = 0.59, respectively) for the 3-category Walch classification (A, B, C). The agreement between x-ray images and consensus MRI was much lower: "fair-to-moderate" (κ = 0.21-0.51) for the 5-category and "moderate" (κ = 0.36-0.60) for the 3-category Walch classification. The inter-rater agreement between x-ray images and consensus MRI is "fair-to-moderate." This is lower than the previously reported reliability of the Walch classification using computed tomography scans. Accordingly, x-ray images are inferior to advanced imaging when assessing glenoid wear. Copyright © 2017 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights

  4. Reinvigorating performance evaluation: first steps in a local health department.

    PubMed

    Smith, Kathleen N; Gunzenhauser, Jeffrey D; Fielding, Jonathan E

    2010-01-01

    The ability of a local health department to assess and improve employee performance through an effective evaluation process is critical to overall organizational success. A constructive performance evaluation process not only provides meaningful feedback on work performance but also provides opportunities to reinforce work behaviors that support the organization's mission, to recognize exceptional work, and to guide future growth and learning. The Los Angeles County Department of Public Health is creating a new approach to performance evaluation that recognizes 3 distinct components of work performance: standard business practices, competencies, and standards of practice. This multidimensional perspective acknowledges that the expectations of workers are complex and that evaluations of performance are not easily captured with single-dimension assessment tools. This report describes the conceptual relationships of these 3 components and how they integrate to form a single performance evaluation process. Key elements within this structure include a base document of competencies for all workers, expanded competency sets for professional staff, role-specific duty statements for workers who perform similar work, and standards of competent practice related to the mission of units to which individuals are assigned. Key first steps are to define the terminology of performance evaluation and to create role-specific duty statements.

  5. Performance evaluation methodology for historical document image binarization.

    PubMed

    Ntirogiannis, Konstantinos; Gatos, Basilis; Pratikakis, Ioannis

    2013-02-01

    Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization evaluation methodology for historical handwritten/machine-printed document images. In the proposed evaluation scheme, the recall and precision evaluation measures are properly modified using a weighting scheme that diminishes any potential evaluation bias. Additional performance metrics of the proposed evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based evaluation measures demonstrate the validity of the proposed evaluation scheme.

  6. A Conceptual Approach to Sex-Fair Performance Evaluation.

    ERIC Educational Resources Information Center

    DeLong, Barbara J.

    Preplanning to insure sex-fair evaluation of student performance in physical education should include: (1) establishment of instructional and performance objectives for each activity; (2) development of performance standards which take into account ability levels and documented biological differences between the sexes; and (3) a well-defined…

  7. Concluding Thoughts: Observing, Promoting, Evaluating, and Reviewing Research Performance.

    ERIC Educational Resources Information Center

    Creswell, John W.

    1986-01-01

    When institutional personnel assess faculty research performance, they should consider the extent to which the institution rewards research, ways to encourage faculty to be productive, criteria for evaluating research performance, and the specific steps useful in reviewing research performance within academic units. (Author/MSE)

  8. Evaluating Preference for Graphic Feedback on Correct versus Incorrect Performance

    ERIC Educational Resources Information Center

    Sigurdsson, Sigurdur O.; Ring, Brandon M.

    2013-01-01

    The current study evaluated preferences of undergraduate students for graphic feedback on percentage of incorrect performance versus feedback on percentage of correct performance. A total of 108 participants were enrolled in the study and received graphic feedback on performance on 12 online quizzes. One half of participants received graphic…

  9. Individual-reader diagnostic performance and between-reader agreement in assessment of subjects with Parkinsonian syndrome or dementia using 123I-ioflupane injection (DaTscan) imaging.

    PubMed

    Seibyl, John P; Kupsch, Andreas; Booij, Jan; Grosset, Donald G; Costa, Durval C; Hauser, Robert A; Darcourt, Jacques; Bajaj, Nin; Walker, Zuzana; Marek, Kenneth; McKeith, Ian; O'Brien, John T; Tatsch, Klaus; Tolosa, Eduardo; Dierckx, Rudi A; Grachev, Igor D

    2014-08-01

    Establishing an early, accurate diagnosis is fundamental for appropriate clinical management of patients with movement disorders or dementia. Ioflupane (123)I Injection (DaTscan, (123)I-ioflupane) is an important adjunct to support the clinical diagnosis. Understanding individual-reader diagnostic performance of (123)I-ioflupane in a variety of clinical scenarios is essential. Sensitivity, specificity, interreader, and intrareader data from 5 multicenter clinical studies were reviewed. The different study designs offered an assortment of variables to assess the effects on the diagnostic performance of (123)I-ioflupane: on-site versus 3-5 blinded image readers, number of image evaluations, early/uncertain versus late/confirmed clinical diagnosis as reference standard, and subjects with movement disorders versus dementia. Eight hundred eighteen subjects had individual-reader efficacy data available for analysis. In general, sensitivity and specificity were high and comparable between on-site versus blinded independent readers. In subjects with dementia, when the clinical diagnosis was made at month 12 versus baseline, specificity improved from 77.4%-91.2% to 81.6%-95.0%. In subjects with movement disorders, this effect was observed to an even greater extent, when diagnostic performance using month-18 diagnosis as a reference standard (sensitivity, 67.0%-73.7%; specificity, 75.0%-83.3%) was compared versus month-36 diagnosis (77.5%-80.3% and 90.3%-96.8%, respectively). Diagnostic performance was similar in subjects with dementia (74.4%-89.9% and 77.4%-95.0%, respectively) and subjects with movement disorders (67.0%-97.9% and 71.4%-98.4%, respectively). In most of the comparisons, between-reader agreement was very good (almost perfect), with κ ranging from 0.81 to 1.00. Within-reader agreement, measured in 1 study, was 100% for 3 blinded readers. Individual-reader diagnostic performance, as assessed by measuring sensitivity and specificity of (123)I-ioflupane to

  10. Advanced Video Analysis Needs for Human Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Campbell, Paul D.

    1994-01-01

    Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

  11. Advanced Video Analysis Needs for Human Performance Evaluation

    NASA Technical Reports Server (NTRS)

    Campbell, Paul D.

    1994-01-01

    Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

  12. Evaluating the performance of equations for estimating glomerular filtration rate.

    PubMed

    Stevens, Lesley A; Zhang, Yaping; Schmid, Christopher H

    2008-01-01

    Glomerular filtration rate (GFR) is an important indicator of kidney function, critical for detection, evaluation and management of chronic kidney disease (CKD). GFR cannot be practically measured in most clinical or research settings; therefore, estimating equations are used as a primary measure of kidney function. A considerable body of literature now evaluates the performance of GFR estimating equations. The results of these studies are often not comparable, because of variation in GFR measurement methods, endogenous filtration marker assays and tools by which the equations were evaluated. In this article, methods for the evaluation of GFR estimating equations are discussed. Topics addressed include statistical methods used in development and validation of equations; explanation of measures of performance used for evaluation, with focus on distinction between bias, precision and accuracy, and with reference to examples of published evaluations of creatinine- and cystatin C-based equations; explanation of errors in GFR estimates; and challenges and questions in reporting performance of GFR estimating equations.

  13. Quick Guide: Power Purchase Agreements

    SciTech Connect

    2010-06-25

    Introduction to Federal power purchase agreements (PPAs), including available FEMP services and technical assistance as well as questions to ask when evaluating PPAs for a Federal renewable energy project.

  14. Beta-Testing Agreement | FNLCR

    Cancer.gov

    Beta-Testing Agreements are appropriate forlimited term evaluation and applications development of new software, technology, or equipment platforms by the Frederick National Labin collaboration with an external commercial partner. It may

  15. Models for evaluating the performability of degradable computing systems

    NASA Technical Reports Server (NTRS)

    Wu, L. T.

    1982-01-01

    Recent advances in multiprocessor technology established the need for unified methods to evaluate computing systems performance and reliability. In response to this modeling need, a general modeling framework that permits the modeling, analysis and evaluation of degradable computing systems is considered. Within this framework, several user oriented performance variables are identified and shown to be proper generalizations of the traditional notions of system performance and reliability. Furthermore, a time varying version of the model is developed to generalize the traditional fault tree reliability evaluation methods of phased missions.

  16. Web-based evaluation of Parkinson's disease subjects: objective performance capacity measurements and subjective characterization profiles.

    PubMed

    Kondraske, George V; Stewart, R Malcolm

    2008-01-01

    Parkinson's Disease (PD) is classified as a progressively degenerative movement disorder, affecting approximately 0.2% of the population and resulting in decreased performance in a wide variety of activities of daily living. Motivated by needs associated with the conduct of multi-center clinical trials, early detection, and the optimization of routine management of individuals with PD, we have developed a three-tiered approach to evaluation of PD and other neurologic diseases/disorders. One tier is characterized as 'web-based evaluation', consisting of objective performance capacity tests and subjective questionnaires that target history and symptom evaluation. Here, we present the initial evaluation of three representative, self-administered, objective, web-based performance capacity tests (simple visual-hand response speed, rapid alternating movement quality, and upper extremity neuromotor channel capacity). Twenty-one subjects (13 with PD, 8 without neurologic disease) were evaluated. Generally good agreement was obtained with lab-based tests executed with an experienced test administrator. We conclude that objective performance capacity testing is a feasible component of a web-based evaluation for PD, providing a sufficient level of fidelity to be useful.

  17. Evaluation of Level of Agreement in Bordetella Species Identification in Three U.S. Laboratories during a Period of Increased Pertussis.

    PubMed

    Burgos-Rivera, Brunilís; Lee, Adria D; Bowden, Katherine E; Faulkner, Amanda E; Seaton, Brent L; Lembke, Bryndon D; Cartwright, Charles P; Martin, Stacey W; Tondella, M Lucia

    2015-06-01

    While PCR is the most common method used for detecting Bordetella pertussis in the United States, most laboratories use insertion sequence 481 (IS481), which is not specific for B. pertussis; therefore, the relative contribution of other Bordetella species is not understood. The objectives of this study were to evaluate the proportion of other Bordetella species misidentified as B. pertussis during a period of increased pertussis incidence, determine the level of agreement in Bordetella species detection between U.S. commercial laboratories and the CDC, and assess the relative diagnostic sensitivity of CDC's PCR assay when using a different PCR master mix. Specimens collected between May 2012 and May 2013 were tested at two U.S. commercial laboratories for B. pertussis and B. parapertussis detection. Every fifth specimen positive for IS481 and/or IS1001 with cycle threshold (CT) values of ≤35 was sent to CDC for PCR testing that identifies Bordetella species. Specimens with indeterminate or negative results in the CDC PCR were tested using an alternate PCR master mix. Of 755 specimens, there was agreement in species identification for 83.4% (n = 630). Of the specimens with different identifications (n = 125), 79.2% (n = 99) were identified as indeterminate B. pertussis at CDC. Overall, 0.66% (n = 5) of the specimens were identified as B. holmesii or B. bronchiseptica at CDC. Of 115 specimens with indeterminate or negative results, 46.1% (n = 53) were B. pertussis positive when tested by an alternate master mix, suggesting a possible increase in assay sensitivity. This study demonstrates good agreement between the two U.S. commercial laboratories and CDC and little misidentification of Bordetella species during the 2012 U.S. epidemic.

  18. Evaluation of the agreement among three handheld blood glucose meters and a laboratory blood analyzer for measurement of blood glucose concentration in Hispaniolan Amazon parrots (Amazona ventralis).

    PubMed

    Acierno, Mark J; Mitchell, Mark A; Schuster, Patricia J; Freeman, Diana; Sanchez-Migallon Guzman, David; Tully, Thomas N

    2009-02-01

    To determine the degree of agreement between 3 commercially available point-of-care blood glucose meters and a laboratory analyzer for measurement of blood glucose concentrations in Hispaniolan Amazon parrots (Amazona ventralis). 20 healthy adult Hispaniolan Amazon parrots. A 26-gauge needle and 3-mL syringe were used to obtain a blood sample (approx 0.5 mL) from a jugular vein of each parrot. Small volumes of blood (0.6 to 1.5 microL) were used to operate each of the blood glucose meters, and the remainder was placed into lithium heparin microtubes and centrifuged. Plasma was harvested and frozen at -30 degrees C. Within 5 days after collection, plasma samples were thawed and plasma glucose concentrations were measured by means of the laboratory analyzer. Agreement between pairs of blood glucose meters and between each blood glucose meter and the laboratory analyzer was evaluated by means of the Bland-Altman method, and limits of agreement (LOA) were calculated. None of the results of the 3 blood glucose meters agreed with results of the laboratory analyzer. Each point-of-care blood glucose meter underestimated the blood glucose concentration, and the degree of negative bias was not consistent (meter A bias, -94.9 mg/dL [LOA, -148.0 to -41.7 mg/dL]; meter B bias, -52 mg/dL [LOA, -107.5 to 3.5 mg/dL]; and meter C bias, -78.9 mg/dL [LOA, -137.2 to -20.6 mg/dL]). On the basis of these results, use of handheld blood glucose meters in the diagnosis or treatment of Hispaniolan Amazon parrots and other psittacines cannot be recommended.

  19. A methodological framework for assessing agreement between cost-effectiveness outcomes estimated using alternative sources of data on treatment costs and effects for trial-based economic evaluations.

    PubMed

    Achana, Felix; Petrou, Stavros; Khan, Kamran; Gaye, Amadou; Modi, Neena

    2017-02-09

    A new methodological framework for assessing agreement between cost-effectiveness endpoints generated using alternative sources of data on treatment costs and effects for trial-based economic evaluations is proposed. The framework can be used to validate cost-effectiveness endpoints generated from routine data sources when comparable data is available directly from trial case report forms or from another source. We illustrate application of the framework using data from a recent trial-based economic evaluation of the probiotic Bifidobacterium breve strain BBG administered to babies less than 31 weeks of gestation. Cost-effectiveness endpoints are compared using two sources of information; trial case report forms and data extracted from the National Neonatal Research Database (NNRD), a clinical database created through collaborative efforts of UK neonatal services. Focusing on mean incremental net benefits at £30,000 per episode of sepsis averted, the study revealed no evidence of discrepancy between the data sources (two-sided p values >0.4), low probability estimates of miscoverage (ranging from 0.039 to 0.060) and concordance correlation coefficients greater than 0.86. We conclude that the NNRD could potentially serve as a reliable source of data for future trial-based economic evaluations of neonatal interventions. We also discuss the potential implications of increasing opportunity to utilize routinely available data for the conduct of trial-based economic evaluations.

  20. Development, Demonstration, Testing, and Evaluation Efforts Associated with the Oak Ridge Reservation`s Land Disposal Restrictions Federal Facility Compliance Agreement

    SciTech Connect

    Abraham, T.J., Conley, T.B.

    1995-12-31

    On June 12, 1992, the U. S. Department of Energy Oak Ridge Operations Office and the U. S. Environmental Protection Agency (EPA) Region IV signed a Federal Facility Compliance Agreement (FFCA) to regulate the treatment of wastes governed by the Land Disposal Restrictions (LDR) of the Resource Conservation and Recovery Act (RCRA). Compliance Requirement 5 of the agreement states that `. . . DOE shall submit to EPA for review and approval a plan for the treatment of the LDR prohibited wastes identified in Appendices 1B, 2B, and 3B. This plan must identify the treatment strategy for such wastes to meet LDR treatment standards and must include a schedule, not to exceed two (2) years after the submittal of this plan (i.e., March 1995), for the evaluation and prioritization of treatment method options, treatability studies, if required, and technology development. The FFCA divided the mixed wastes currently stored on the Oak Ridge Reservation (ORR) into two categories. Appendix A listed those wastes for which existing treatment methods and facilities exist. Appendix B listed wastes for which no identified treatment methods or facilities exist on the ORR.

  1. Effects of Performer Attractiveness, Stage Behavior, and Dress on Violin Performance Evaluation.

    ERIC Educational Resources Information Center

    Wapnick, Joel; Mazza, Jolan Kovacs; Darrow, Alice-Ann

    1998-01-01

    Determines whether nonmusical attributes of violinists affects judges' rating of their performance. Rated 12 subjects on video, audiovideo, and audio recordings. Reveals significant interactions between performance evaluation and dress, and between evaluation and stage behavior; there was no significant interaction with attractiveness. (DSK)

  2. Performance and Scalability Evaluation of the Ceph Parallel File System

    SciTech Connect

    Wang, Feiyi; Nelson, Mark; Oral, H Sarp; Settlemyer, Bradley W; Atchley, Scott; Caldwell, Blake A; Hill, Jason J

    2013-01-01

    Ceph is an open-source and emerging parallel distributed file and storage system technology. By design, Ceph assumes running on unreliable and commodity storage and network hardware and provides reliability and fault-tolerance through controlled object placement and data replication. We evaluated the Ceph technology for scientific high-performance computing (HPC) environments. This paper presents our evaluation methodology, experiments, results and observations from mostly parallel I/O performance and scalability perspectives. Our work made two unique contributions. First, our evaluation is performed under a realistic setup for a large-scale capability HPC environment using a commercial high-end storage system. Second, our path of investigation, tuning efforts, and findings made direct contributions to Ceph's development and improved code quality, scalability, and performance. These changes should also benefit both Ceph and HPC communities at large. Throughout the evaluation, we observed that Ceph still is an evolving technology under fast-paced development and showing great promises.

  3. 10 CFR 1045.9 - RD classification performance evaluation.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... Program Management of the Restricted Data and Formerly Restricted Data Classification System § 1045.9 RD classification performance evaluation. (a) Heads of agencies shall ensure that RD management officials and...

  4. 10 CFR 1045.9 - RD classification performance evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... Program Management of the Restricted Data and Formerly Restricted Data Classification System § 1045.9 RD classification performance evaluation. (a) Heads of agencies shall ensure that RD management officials and...

  5. 10 CFR 1045.9 - RD classification performance evaluation.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... Program Management of the Restricted Data and Formerly Restricted Data Classification System § 1045.9 RD classification performance evaluation. (a) Heads of agencies shall ensure that RD management officials and...

  6. 10 CFR 1045.9 - RD classification performance evaluation.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... Program Management of the Restricted Data and Formerly Restricted Data Classification System § 1045.9 RD classification performance evaluation. (a) Heads of agencies shall ensure that RD management officials and...

  7. 10 CFR 1045.9 - RD classification performance evaluation.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... Program Management of the Restricted Data and Formerly Restricted Data Classification System § 1045.9 RD classification performance evaluation. (a) Heads of agencies shall ensure that RD management officials and...

  8. Model Performance Evaluation and Scenario Analysis (MPESA) Tutorial

    EPA Pesticide Factsheets

    The model performance evaluation consists of metrics and model diagnostics. These metrics provides modelers with statistical goodness-of-fit measures that capture magnitude only, sequence only, and combined magnitude and sequence errors.

  9. Solid rocket booster performance evaluation model. Volume 4: Program listing

    NASA Technical Reports Server (NTRS)

    1974-01-01

    All subprograms or routines associated with the solid rocket booster performance evaluation model are indexed in this computer listing. An alphanumeric list of each routine in the index is provided in a table of contents.

  10. AVIRIS performance during the 1987 flight season: An AVIRIS project assessment and summary of the NASA-sponsored performance evaluation

    NASA Technical Reports Server (NTRS)

    Vane, Gregg; Porter, Wallace M.; Reimer, John H.; Chrien, Thomas G.; Green, Robert O.

    1988-01-01

    Results are presented of the assessment of AVIRIS performance during the 1987 flight season by the AVIRIS project and the earth scientists who were chartered by NASA to conduct an independent data quality and sensor performance evaluation. The AVIRIS evaluation program began in late June 1987 with the sensor meeting most of its design requirements except for signal-to-noise ratio in the fourth spectrometer, which was about half of the required level. Several events related to parts failures and design flaws further reduced sensor performance over the flight season. Substantial agreement was found between the assessments by the project and the independent investigators of the effects of these various factors. A summary of the engineering work that is being done to raise AVIRIS performance to its required level is given. In spite of degrading data quality over the flight season, several exciting scientific results were obtained from the data. These include the mapping of the spatial variation of atmospheric precipitable water, detection of environmentally-induced shifts in the spectral red edge of stressed vegetation, detection of spectral features related to pigment, leaf water and ligno-cellulose absorptions in plants, and the identification of many diagnostic mineral absorption features in a variety of geological settings.

  11. Monte Carlo simulation of Ray-Scan 64 PET system and performance evaluation using GATE toolkit

    NASA Astrophysics Data System (ADS)

    Li, Suying; Zhang, Qiushi; Vuletic, Ivan; Xie, Zhaoheng; Yang, Kun; Ren, Qiushi

    2017-02-01

    In this study, we aimed to develop a GATE model for the simulation of Ray-Scan 64 PET scanner and model its performance characteristics. A detailed implementation of system geometry and physical process were included in the simulation model. Then we modeled the performance characteristics of Ray-Scan 64 PET system for the first time, based on National Electrical Manufacturers Association (NEMA) NU-2 2007 protocols and validated the model against experimental measurement, including spatial resolution, sensitivity, counting rates and noise equivalent count rate (NECR). Moreover, an accurate dead time module was investigated to simulate the counting rate performance. Overall results showed reasonable agreement between simulation and experimental data. The validation results showed the reliability and feasibility of the GATE model to evaluate major performance of Ray-Scan 64 PET system. It provided a useful tool for a wide range of research applications.

  12. Using hybrid method to evaluate the green performance in uncertainty.

    PubMed

    Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

    2011-04-01

    Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

  13. Evaluating supplier quality performance using fuzzy analytical hierarchy process

    NASA Astrophysics Data System (ADS)

    Ahmad, Nazihah; Kasim, Maznah Mat; Rajoo, Shanmugam Sundram Kalimuthu

    2014-12-01

    Evaluating supplier quality performance is vital in ensuring continuous supply chain improvement, reducing the operational costs and risks towards meeting customer's expectation. This paper aims to illustrate an application of Fuzzy Analytical Hierarchy Process to prioritize the evaluation criteria in a context of automotive manufacturing in Malaysia. Five main criteria were identified which were quality, cost, delivery, customer serviceand technology support. These criteria had been arranged into hierarchical structure and evaluated by an expert. The relative importance of each criteria was determined by using linguistic variables which were represented as triangular fuzzy numbers. The Center of Gravity defuzzification method was used to convert the fuzzy evaluations into their corresponding crisps values. Such fuzzy evaluation can be used as a systematic tool to overcome the uncertainty evaluation of suppliers' performance which usually associated with human being subjective judgments.

  14. Evaluating response to mood stabilizers in patients with mixed depression: A study of agreement between three different mania rating scales and a depression rating scale.

    PubMed

    Shansis, Flávio Milman; Reche, Mateus; Capp, Edison

    2016-06-01

    The aim of the present study was to evaluate agreement between three pairs formed by one of three mania scales (Young Mania Rating Scale [YMRS], Bech-Rafaelsen Mania Scale [BRMS], or the Clinician-Administered Rating Scale for Mania [CARS-M]) and a single depression scale (21-item Hamilton Depression Rating Scale [21-HAM-D]) for evaluation of response to mood stabilizers in patients with mixed bipolar disorder. Between 2010 and 2014, 68 consecutive bipolar type I and II outpatients with mixed depression as per DSM-IV-TR and Cincinnati criteria were included in this 8-week open-label trial to randomly receive carbamazepine, lithium carbonate, or valproic acid as monotherapy. Patterns of response (defined as a reduction of at least 50% in one of the mania scales and on the 21-HAM-D) were strikingly similar: 21-HAM-D+YMRS=22.1%, 21-HAM-D+BRMS=20.6%, and 21-HAM-D+CARS-M=23.5% (p<0.368). Assessment of agreement revealed very high kappa coefficients: 21-HAM-D+YMRS vs. 21-HAM-D+CARS-M, kappa=0.87; 21-HAM-D+YMRS vs. 21-HAM-D+BRMS, kappa=0.78; 21-HAM-D+CARS-M vs. 21-HAM-D+BRMS, kappa=0.91 (p<0.001). The decision to combine a depression rating scale with any one mania rating scale to assess treatment response in patients with mixed depression is questionable. The present study suggests that any one of the three tested mania rating scales (YMRS, BRMS, and CARS-M) can be combined with the 21-HAM-D to assess treatment response in patients with mixed bipolar disorder. This should give clinicians an added measure of confidence in using this strategy until valid, and specific instruments are developed for assessment of mixed states. Copyright © 2016 Elsevier B.V. All rights reserved.

  15. The Seven No-No's of Performance Evaluation.

    ERIC Educational Resources Information Center

    Johnston, David L.

    1999-01-01

    Presents seven Machiavellian personnel evaluation blunders that strip workers of their dignity and demoralize them. Performance evaluators err when playing "Trivial Pursuit," the "Shell Game,""I Preceptor,""Gotcha,""I Spy," the "Procrustean Bed," and "Open-Ended Story-Time"…

  16. Estimating Costs for Development of Candidate Performance Evaluation Procedures.

    ERIC Educational Resources Information Center

    Payne, David A.

    This paper contains cost unit tables and instructions for their use in estimating the total cost of evaluating a given instructional objective or group of objectives. Included is a list of analytical procedures to be followed in the development of any device to evaluate student performance, (e.g., a unit exam in child development or an attitude…

  17. A Performance Management System: Research, Design, Introduction and Evaluation.

    ERIC Educational Resources Information Center

    Beer, Michael; And Others

    1978-01-01

    The Performance Management System (PMS) is used by Corning Glass to assess its managerial and professional personnel. PMS emphasizes development over evaluation. It utilizes ipsative measurement and integrates results with behavior centered appraisal. This paper describes the development, design, operation, and evaluation of PMS. (Author/SJL)

  18. Using Conjoint Analysis to Evaluate and Reward Teaching Performance

    ERIC Educational Resources Information Center

    Bacon, Donald R.; Zheng, Yilong; Stewart, Kim A.; Johnson, Carol J.; Paul, Pallab

    2016-01-01

    Although widely used, student evaluations of teaching do not address several factors that should be considered in evaluating teaching performance such as new course preparations, teaching larger classes, and inconvenient class times. Consequently, the incentive exists to avoid certain teaching assignments to achieve high SET scores while…

  19. Evaluating Organizational Performance: Rational, Natural, and Open System Models

    ERIC Educational Resources Information Center

    Martz, Wes

    2013-01-01

    As the definition of organization has evolved, so have the approaches used to evaluate organizational performance. During the past 60 years, organizational theorists and management scholars have developed a comprehensive line of thinking with respect to organizational assessment that serves to inform and be informed by the evaluation discipline.…

  20. Evaluating Value-Added Methods of Estimating of Teacher Performance

    ERIC Educational Resources Information Center

    Guarino, Cassandra M.; Reckase, Mark D.; Wooldridge, Jeffrey M.

    2011-01-01

    Accurate indicators of educational effectiveness are needed to advance national policy goals of raising student achievement and closing social/cultural based achievement gaps. If constructed and used appropriately, such indicators for both program evaluation and the evaluation of teacher and school performance could have a transformative effect on…

  1. The Seven No-No's of Performance Evaluation.

    ERIC Educational Resources Information Center

    Johnston, David L.

    1999-01-01

    Presents seven Machiavellian personnel evaluation blunders that strip workers of their dignity and demoralize them. Performance evaluators err when playing "Trivial Pursuit," the "Shell Game,""I Preceptor,""Gotcha,""I Spy," the "Procrustean Bed," and "Open-Ended Story-Time"…

  2. Research Performance Evaluation: Some Critical Thoughts on Standard Bibliometric Indicators

    ERIC Educational Resources Information Center

    Anninos, Loukas N.

    2014-01-01

    The bibliometric methodology is an established technique for research evaluation as it offers an objective determination and comparison of research performance. This paper aims to critically assess some standard bibliometric indicators commonly used (based on publication and citation counts) to evaluate academic units, and examine whether there…

  3. Objective Situation Awareness Measurement Based on Performance Self-Evaluation

    NASA Technical Reports Server (NTRS)

    DeMaio, Joe

    1998-01-01

    The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

  4. Operator performance evaluation using multi criteria decision making methods

    NASA Astrophysics Data System (ADS)

    Rani, Ruzanita Mat; Ismail, Wan Rosmanira; Razali, Siti Fatihah

    2014-06-01

    Operator performance evaluation is a very important operation in labor-intensive manufacturing industry because the company's productivity depends on the performance of its operators. The aims of operator performance evaluation are to give feedback to operators on their performance, to increase company's productivity and to identify strengths and weaknesses of each operator. In this paper, six multi criteria decision making methods; Analytical Hierarchy Process (AHP), fuzzy AHP (FAHP), ELECTRE, PROMETHEE II, Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) and VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) are used to evaluate the operators' performance and to rank the operators. The performance evaluation is based on six main criteria; competency, experience and skill, teamwork and time punctuality, personal characteristics, capability and outcome. The study was conducted at one of the SME food manufacturing companies in Selangor. From the study, it is found that AHP and FAHP yielded the "outcome" criteria as the most important criteria. The results of operator performance evaluation showed that the same operator is ranked the first using all six methods.

  5. Physician attitudes, self-estimated performance and actual compliance with locally peer-defined quality evaluation criteria.

    PubMed

    Saturno, P J; Palmer, R H; Gascón, J J

    1999-12-01

    Physicians' agreement with quality evaluation criteria, and estimates of their own and their colleagues' compliance with these criteria were compared with actual compliance. Physicians practicing in 10 health centers in Spain defined 13 quality evaluation criteria for two patient conditions (upper respiratory infections and high serum cholesterol). Compliance with criteria was measured by an external team, using random samples of medical records stratified by condition in each health center (n= 1,000). Concurrently, physicians were surveyed regarding agreement with the criteria, and were asked to estimate their own and their health center's rate of compliance with these criteria. Agreement ratings varied from 5.9 to 9.1 on a 10-point scale. Actual compliance rates ranged from 1.8 to 91.7% of records. Agreement correlated significantly with self-reported compliance but not with actual compliance. Estimates of one's own and one's health center compliance were positive and significantly correlated for all criteria, but were significantly higher for oneself than for one's health center for six of 13 criteria. Wide variation in physicians' agreement on quality criteria and in actual performance reveal a lack of clear guidelines. Agreement on criteria did not always translate into compliance with criteria. Physicians tended to rate their own performance as better than the average of their peers, suggesting that aggregate data may not influence physicians to change. Self-estimate of one's own or one's colleagues performance is not a good proxy for actual performance so that peer ratings are of dubious value for performance appraisal.

  6. Evaluation of Long Term Performance of Continuously Running Atomic Fountains

    DTIC Science & Technology

    2014-05-28

    Std Z39-18 | Bureau International des Poids et Mesures Metrologia Metrologia 51 (2014) 263–269 doi:10.1088/0026-1394/51/3/263 Evaluation of long term...MAY 2014 2. REPORT TYPE 3. DATES COVERED 00-00-2014 to 00-00-2014 4. TITLE AND SUBTITLE Evaluation of long term performance of continuously...engineering and evaluation . The workhorses of the timing community, commercial caesium beams and hydrogen masers, which do not incorporate any laser technology

  7. Chinese Middle School Teachers' Preferences Regarding Performance Evaluation Measures

    ERIC Educational Resources Information Center

    Liu, Shujie; Xu, Xianxuan; Stronge, James H.

    2016-01-01

    Teacher performance evaluation currently is receiving unprecedented attention from policy makers, scholars, and practitioners worldwide. This study is one of the few studies of teacher perceptions regarding teacher performance measures that focus on China. We employed a quantitative dominant mixed research design to investigate Chinese teachers'…

  8. Sources of Bias in Performance Evaluation: Two Experiments

    ERIC Educational Resources Information Center

    Feldman, Jack M.; Hilterman, Robert J.

    1977-01-01

    Reports two experiments designed to determine if (1) low-performing blacks would be evaluated lower than comparable whites while high-performing blacks would be rated higher than white counterparts, and (2) perceived social class, not race, would be the relevant variable in the operation of the stereotype confirmation - contrast process. Available…

  9. Chinese Middle School Teachers' Preferences Regarding Performance Evaluation Measures

    ERIC Educational Resources Information Center

    Liu, Shujie; Xu, Xianxuan; Stronge, James H.

    2016-01-01

    Teacher performance evaluation currently is receiving unprecedented attention from policy makers, scholars, and practitioners worldwide. This study is one of the few studies of teacher perceptions regarding teacher performance measures that focus on China. We employed a quantitative dominant mixed research design to investigate Chinese teachers'…

  10. State Education Grant Job Training Partnership Act Performance Evaluation Handbook.

    ERIC Educational Resources Information Center

    Pennsylvania State Dept. of Education, Harrisburg. Bureau of Vocational and Adult Education.

    This handbook presents the policies and procedures of the performance evaluation system for the State Education Grant (SEG). (The SEG is that 8 percent of Title II-A of the Job Training Partnership Act (JTPA) designated for administration by the state education agency.) Chapter I contains the general requirements of the SEG performance evaluation…

  11. Evaluation of performance parameters of indigenously developed roots pumping system

    NASA Astrophysics Data System (ADS)

    Maqsood, M.; Usman, A.; Bodla, M. F.; Ali, J.

    2016-08-01

    Roots pumping systems are widely used in industries to generate vacuum with high pumping speed. In the present work, the performance parameters of indigenously developed Roots pumping system have been studied. The performance parameters being studied are the ultimate pressure, working temperature, compression ratio and pumping speed. Ultimate pressure of the Roots pump after continuous running of eight hours is found to be 1.1x10-3 mbar. The most important parameter of the roots pump is the zero-gas flow compression Ratio (Ko) which is found to be 18 for the pumping system under study. Efficiency of Roots pump is found to be 76% which is in good agreement as reported in the literature.

  12. Performance evaluation of a texture-based segmentation algorithm

    NASA Astrophysics Data System (ADS)

    Sadjadi, Firooz A.

    1991-07-01

    Texture segmentations are crucial components of many remote sensing, scene analysis, and object recognition systems. However, very little attention has been paid to the problem of performance evaluation in the numerous algorithms that have been proposed by the image understanding community. In this paper, a particular algorithm is introduced and its performance is evaluated in a systematic manner on a wide range of scene and scenarios. Both the algorithm and the methodology used in its evaluation have significance in numerous applications in the computer-based image understanding field.

  13. The Impact of Self-Evaluation Instruction on Student Self-Evaluation, Music Performance, and Self-Evaluation Accuracy

    ERIC Educational Resources Information Center

    Hewitt, Michael P.

    2011-01-01

    The author sought to determine whether self-evaluation instruction had an impact on student self-evaluation, music performance, and self-evaluation accuracy of music performance among middle school instrumentalists. Participants (N = 211) were students at a private middle school located in a metropolitan area of a mid-Atlantic state. Students in…

  14. The Impact of Self-Evaluation Instruction on Student Self-Evaluation, Music Performance, and Self-Evaluation Accuracy

    ERIC Educational Resources Information Center

    Hewitt, Michael P.

    2011-01-01

    The author sought to determine whether self-evaluation instruction had an impact on student self-evaluation, music performance, and self-evaluation accuracy of music performance among middle school instrumentalists. Participants (N = 211) were students at a private middle school located in a metropolitan area of a mid-Atlantic state. Students in…

  15. What to consider when evaluating shaker screen performance

    SciTech Connect

    Brown, M.H.

    1986-10-01

    Parameters most often used by manufacturers of shale shakers and shale shaker screens to judge and compare screen performance are discussed. They include screen conductance, separation efficiency and other methods by which screen performance is evaluated. The article also demonstrates that the D/sub 50/ cut point can be misleading if used alone to judge separation efficiency. And finally, field data provide comparisons of market grade and layered screen performance.

  16. The evaluation methods of sampling rate performance in GNSS receiver

    NASA Astrophysics Data System (ADS)

    Ke, Ting; Hu, Xiulin; Liu, Yuqi; Ran, Yihang

    2009-12-01

    This paper investigates into the performance of sampling rate on time discrimination of PRN code in GNSS, proposes an innovative performance evaluation criterion for actual time discrimination of noncommensurate sampling technique, and then develops an algorithm to quickly obtain this criterion. Computer simulation verification guarantees the correctness of the proposed fast algorithm. The proposed algorithm can be adopted in all PRN code ranging based applications to choose the "better" sampling rate, which could achieve better time discrimination performance with lower sampling rate.

  17. Strapdown system performance optimization test evaluations (SPOT), volume 1

    NASA Technical Reports Server (NTRS)

    Blaha, R. J.; Gilmore, J. P.

    1973-01-01

    A three axis inertial system was packaged in an Apollo gimbal fixture for fine grain evaluation of strapdown system performance in dynamic environments. These evaluations have provided information to assess the effectiveness of real-time compensation techniques and to study system performance tradeoffs to factors such as quantization and iteration rate. The strapdown performance and tradeoff studies conducted include: (1) Compensation models and techniques for the inertial instrument first-order error terms were developed and compensation effectivity was demonstrated in four basic environments; single and multi-axis slew, and single and multi-axis oscillatory. (2) The theoretical coning bandwidth for the first-order quaternion algorithm expansion was verified. (3) Gyro loop quantization was identified to affect proportionally the system attitude uncertainty. (4) Land navigation evaluations identified the requirement for accurate initialization alignment in order to pursue fine grain navigation evaluations.

  18. How the Brain Converts Negative Evaluation into Performance Facilitation.

    PubMed

    Prévost, Charlotte; Lau, Hakwan; Mobbs, Dean

    2017-01-04

    Surpassing negative evaluation is a recurrent theme of success stories. Yet, there is little evidence supporting the counterintuitive idea that negative evaluation might not only motivate people, but also enhance performance. To address this question, we designed a task that required participants to decide whether taking up a risky challenge after receiving positive or negative evaluations from independent judges. Participants believed that these evaluations were based on their prior performance on a related task. Results showed that negative evaluation caused a facilitation in performance. Concurrent functional magnetic resonance imaging revealed that the motivating effect of negative evaluation was represented in the insula and striatum, while the performance boost was associated with functional positive connectivity between the insula and a set of brain regions involved in goal-directed behavior and the orienting of attention. These findings provide new insight into the neural representation of negative evaluation-induced facilitation. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  19. An integrated evaluation for the performance of clinical engineering department.

    PubMed

    Yousry, Ahmed M; Ouda, Bassem K; Eldeib, Ayman M

    2014-01-01

    Performance benchmarking have become a very important component in all successful organizations nowadays that must be used by Clinical Engineering Department (CED) in hospitals. Many researchers identified essential mainstream performance indicators needed to improve the CED's performance. These studies revealed mainstream performance indicators that use the database of a CED to evaluate its performance. In this work, we believe that those indicators are insufficient for hospitals. Additional important indicators should be included to improve the evaluation accuracy. Therefore, we added new indicators: technical/maintenance indicators, economic indicators, intrinsic criticality indicators, basic hospital indicators, equipment acquisition, and safety indicators. Data is collected from 10 hospitals that cover different types of healthcare organizations. We developed a software tool that analyses collected data to provide a score for each CED under evaluation. Our results indicate that there is an average gap of 67% between the CEDs' performance and the ideal target. The reasons for the noncompliance are discussed in order to improve performance of CEDs under evaluation.

  20. A Statistical Evaluation of the Diagnostic Performance of MEDAS-The Medical Emergency Decision Assistance System

    PubMed Central

    Georgakis, D. Christine; Trace, David A.; Naeymi-Rad, Frank; Evens, Martha

    1990-01-01

    Medical expert systems require comprehensive evaluation of their diagnostic accuracy. The usefulness of these systems is limited without established evaluation methods. We propose a new methodology for evaluating the diagnostic accuracy and the predictive capacity of a medical expert system. We have adapted to the medical domain measures that have been used in the social sciences to examine the performance of human experts in the decision making process. Thus, in addition to the standard summary measures, we use measures of agreement and disagreement, and Goodman and Kruskal's λ and τ measures of predictive association. This methodology is illustrated by a detailed retrospective evaluation of the diagnostic accuracy of the MEDAS system. In a study using 270 patients admitted to the North Chicago Veterans Administration Hospital, diagnoses produced by MEDAS are compared with the discharge diagnoses of the attending physicians. The results of the analysis confirm the high diagnostic accuracy and predictive capacity of the MEDAS system. Overall, the agreement of the MEDAS system with the “gold standard” diagnosis of the attending physician has reached a 90% level.

  1. Physical Evaluation of Cleaning Performance: We Are Only Fooling Ourselves

    NASA Technical Reports Server (NTRS)

    Pratz, Earl; McCool, A. (Technical Monitor)

    2000-01-01

    Surface cleaning processes are normally evaluated using visual physical properties such as discolorations, streaking, staining and water-break-free conditions. There is an assumption that these physical methods will evaluate all surfaces all the time for all subsequent operations. We have found that these physical methods are lacking in sensitivity and selectivity with regard to surface residues and subsequent process performance. We will report several conditions where evaluations using visual physical properties are lacking. We will identify possible alternative methods and future needs for surface evaluations.

  2. Ultra-short-term heart rate variability indexes at rest and post-exercise in athletes: evaluating the agreement with accepted recommendations.

    PubMed

    Esco, Michael R; Flatt, Andrew A

    2014-09-01

    The purpose of this study was to evaluate the agreement of the vagal-related heart rate variability index, log-transformed root mean square of successive R-R intervals (lnRMSSD), measured under ultra-short-term conditions (< 60 seconds) with conventional longer term recordings of 5 minutes in collegiate athletes under resting and post-exercise conditions. Electrocardiographic readings were collected from twenty-three athletes within 5-minute segments at rest and at 25-30 minutes of supine recovery following a maximal exercise test. From each 5-minute segment, lnRMSSD was recorded as the criterion measure. Within each 5-minute segment, lnRMSSD was also determined from randomly selected ultra-short-term segments of 10-, 30-, and 60-seconds in length, which were compared to the criterion. When compared to the criterion measures, the significant intraclass correlation (from 0.98 to 0.81, p < 0.05) and typical error (from 0.11 to 0.34) increased as ultra-short-term measurement duration decreased (i.e., from 60 seconds to 10 seconds). In addition, the limits of agreement (Bias ± 1.98 SD) increased as ultra-short-term lnRMSSD duration decreased as follows: 0.00 ± 0.22 ms, -0.07 ± 0.41 ms, -0.20 ± 0.94 ms for the 60-, 30-, and 10-second pre-exercise segments, respectively, and -0.15 ± 0.39 ms, -0.14 ± 0.53 ms, -0.12 ± 0.76 ms for the 60-, 30-, and 10-second post-exercise segments, respectively. This study demonstrated that as ultra-short-term measurement duration decreased from 60 seconds to 10 seconds, the agreement to the criterion decreased. Therefore, 60 seconds appears to be an acceptable recording time for lnRMSSD data collection in collegiate athletes. Key PointsThe log-transformed root mean square of successive R-R intervals (lnRMSSD) is a vagal-related heart rate variability index that has become a promising method for monitoring individual adaptation to training when measured during resting or post-exercise conditions.This study demonstrated that ln

  3. Ultra-Short-Term Heart Rate Variability Indexes at Rest and Post-Exercise in Athletes: Evaluating the Agreement with Accepted Recommendations

    PubMed Central

    Esco, Michael R.; Flatt, Andrew A.

    2014-01-01

    The purpose of this study was to evaluate the agreement of the vagal-related heart rate variability index, log-transformed root mean square of successive R-R intervals (lnRMSSD), measured under ultra-short-term conditions (< 60 seconds) with conventional longer term recordings of 5 minutes in collegiate athletes under resting and post-exercise conditions. Electrocardiographic readings were collected from twenty-three athletes within 5-minute segments at rest and at 25-30 minutes of supine recovery following a maximal exercise test. From each 5-minute segment, lnRMSSD was recorded as the criterion measure. Within each 5-minute segment, lnRMSSD was also determined from randomly selected ultra-short-term segments of 10-, 30-, and 60-seconds in length, which were compared to the criterion. When compared to the criterion measures, the significant intraclass correlation (from 0.98 to 0.81, p < 0.05) and typical error (from 0.11 to 0.34) increased as ultra-short-term measurement duration decreased (i.e., from 60 seconds to 10 seconds). In addition, the limits of agreement (Bias ± 1.98 SD) increased as ultra-short-term lnRMSSD duration decreased as follows: 0.00 ± 0.22 ms, -0.07 ± 0.41 ms, -0.20 ± 0.94 ms for the 60-, 30-, and 10-second pre-exercise segments, respectively, and -0.15 ± 0.39 ms, -0.14 ± 0.53 ms, -0.12 ± 0.76 ms for the 60-, 30-, and 10-second post-exercise segments, respectively. This study demonstrated that as ultra-short-term measurement duration decreased from 60 seconds to 10 seconds, the agreement to the criterion decreased. Therefore, 60 seconds appears to be an acceptable recording time for lnRMSSD data collection in collegiate athletes. Key Points The log-transformed root mean square of successive R-R intervals (lnRMSSD) is a vagal-related heart rate variability index that has become a promising method for monitoring individual adaptation to training when measured during resting or post-exercise conditions. This study demonstrated that ln

  4. Development of a test protocol for evaluating EVA glove performance

    NASA Technical Reports Server (NTRS)

    Hinman, Elaine M.

    1992-01-01

    Testing gloved hand performance involves work from several disciplines. Evaluations performed in the course of reenabling a disabled hand, designing a robotic end effector or master controller, or hard-suit design have all yielded relevant information, and, in most cases, produced performance test methods. Most times, these test methods have been primarily oriented toward their parent discipline. For space operations, a comparative test which would provide a way to quantify pressure glove and end effector performance would be useful in dividing tasks between humans and robots. Such a test would have to rely heavily on sensored measurement, as opposed to questionnaires, to produce relevant data. However, at some point human preference would have to be taken into account. This paper presents a methodology for evaluating gloved hand performance which attempts to respond to these issues. Glove testing of a prototype glove design using this method is described.

  5. Evaluating the Sustained Performance of COTS-based Messaging Systems

    SciTech Connect

    Tran, Phong; Gosper, Jeff; Gorton, Ian

    2003-12-01

    Messaging systems, which include message brokers built on top of message-oriented middleware, have been used as middleware components in many enterprise application integration projects. There are many COTS-based messaging systems on the market, but there is little concrete understanding in the software industry on the performance of these different technologies. The authors have carried out a scenario-based evaluation of three leading messaging systems to provide insight into performance issues. The evaluation process includes a study of the sustained performance of the system under load. The result of this study is used to derive a generic metric for quantifying a messaging systems performance. The paper describes a synthetic transactional scenario, which is used for load tests and performance measurement. The results from executing this test scenario with three messaging systems are then presented and explained.

  6. Lactate study using umbilical cord blood: agreement between Lactate Pro hand-held devices with blood gas analyser and evaluation of lactate stability over time.

    PubMed

    Su, Tina Y; Reece, Mifanwy; Chua, Seng C

    2013-08-01

    Lactate measurements have become increasingly preferred over pH analysis in the evaluation of fetal acidaemia in labour. In a busy labour ward, often the umbilical cord may be sampled late and as a result yield unreliable lactate values. To investigate the agreement of hand-held device Lactate Pro with a reference method blood gas analyser and evaluate the stability of umbilical cord lactate values over time. Prospective study carried out at elective caesarean section. Sixteen umbilical cords were double clamped immediately after delivery with paired arterial and venous blood samples collected by an independent researcher, at varying time intervals, and processed by two Lactate Pro devices and a reference method blood gas analyser. A significant difference of -0.41 to 0.10 mmol/L was found when different groups of Lactate Pro devices were compared with blood gas analyser at lactate values up to 5.70 mmol/L, with average lactate value of 2.45 mmol/L. Over time, there is progressive rise in lactate samples obtained from the umbilical cord. Lactate Pro devices have a significant difference, but when used in clinical practice on cord blood after delivery, this is unlikely to be meaningful. In intrapartum fetal surveillance, a systematic overestimation might lead to unnecessary intervention. It is possible to retrospectively predict the likely level of lactate at birth in delayed cord samples. © 2013 The Authors ANZJOG © 2013 The Royal Australian and New Zealand College of Obstetricians and Gynaecologists.

  7. Hanford performance evaluation program for Hanford site analytical services

    SciTech Connect

    Markel, L.P.

    1995-09-01

    The U.S. Department of Energy (DOE) Order 5700.6C, Quality Assurance, and Title 10 of the Code of Federal Regulations, Part 830.120, Quality Assurance Requirements, states that it is the responsibility of DOE contractors to ensure that ``quality is achieved and maintained by those who have been assigned the responsibility for performing the work.`` Hanford Analytical Services Quality Assurance Plan (HASQAP) is designed to meet the needs of the Richland Operations Office (RL) for maintaining a consistent level of quality for the analytical chemistry services provided by contractor and commmercial analytical laboratory operations. Therefore, services supporting Hanford environmental monitoring, environmental restoration, and waste management analytical services shall meet appropriate quality standards. This performance evaluation program will monitor the quality standards of all analytical laboratories supporting the Hanforad Site including on-site and off-site laboratories. The monitoring and evaluation of laboratory performance can be completed by the use of several tools. This program will discuss the tools that will be utilized for laboratory performance evaluations. Revision 0 will primarily focus on presently available programs using readily available performance evaluation materials provided by DOE, EPA or commercial sources. Discussion of project specific PE materials and evaluations will be described in section 9.0 and Appendix A.

  8. Metrics for Performance Evaluation of Patient Exercises during Physical Therapy.

    PubMed

    Vakanski, Aleksandar; Ferguson, Jake M; Lee, Stephen

    2017-06-01

    The article proposes a set of metrics for evaluation of patient performance in physical therapy exercises. Taxonomy is employed that classifies the metrics into quantitative and qualitative categories, based on the level of abstraction of the captured motion sequences. Further, the quantitative metrics are classified into model-less and model-based metrics, in reference to whether the evaluation employs the raw measurements of patient performed motions, or whether the evaluation is based on a mathematical model of the motions. The reviewed metrics include root-mean square distance, Kullback Leibler divergence, log-likelihood, heuristic consistency, Fugl-Meyer Assessment, and similar. The metrics are evaluated for a set of five human motions captured with a Kinect sensor. The metrics can potentially be integrated into a system that employs machine learning for modelling and assessment of the consistency of patient performance in home-based therapy setting. Automated performance evaluation can overcome the inherent subjectivity in human performed therapy assessment, and it can increase the adherence to prescribed therapy plans, and reduce healthcare costs.

  9. Performance evaluation of infrared imaging system in field test

    NASA Astrophysics Data System (ADS)

    Wang, Chensheng; Guo, Xiaodong; Ren, Tingting; Zhang, Zhi-jie

    2014-11-01

    Infrared imaging system has been applied widely in both military and civilian fields. Since the infrared imager has various types and different parameters, for system manufacturers and customers, there is great demand for evaluating the performance of IR imaging systems with a standard tool or platform. Since the first generation IR imager was developed, the standard method to assess the performance has been the MRTD or related improved methods which are not perfect adaptable for current linear scanning imager or 2D staring imager based on FPA detector. For this problem, this paper describes an evaluation method based on the triangular orientation discrimination metric which is considered as the effective and emerging method to evaluate the synthesis performance of EO system. To realize the evaluation in field test, an experiment instrument is developed. And considering the importance of operational environment, the field test is carried in practical atmospheric environment. The test imagers include panoramic imaging system and staring imaging systems with different optics and detectors parameters (both cooled and uncooled). After showing the instrument and experiment setup, the experiment results are shown. The target range performance is analyzed and discussed. In data analysis part, the article gives the range prediction values obtained from TOD method, MRTD method and practical experiment, and shows the analysis and results discussion. The experimental results prove the effectiveness of this evaluation tool, and it can be taken as a platform to give the uniform performance prediction reference.

  10. Evaluating supplier quality performance using analytical hierarchy process

    NASA Astrophysics Data System (ADS)

    Kalimuthu Rajoo, Shanmugam Sundram; Kasim, Maznah Mat; Ahmad, Nazihah

    2013-09-01

    This paper elaborates the importance of evaluating supplier quality performance to an organization. Supplier quality performance evaluation reflects the actual performance of the supplier exhibited at customer's end. It is critical in enabling the organization to determine the area of improvement and thereafter works with supplier to close the gaps. Success of the customer partly depends on supplier's quality performance. Key criteria as quality, cost, delivery, technology support and customer service are categorized as main factors in contributing to supplier's quality performance. 18 suppliers' who were manufacturing automotive application parts evaluated in year 2010 using weight point system. There were few suppliers with common rating which led to common ranking observed by few suppliers'. Analytical Hierarchy Process (AHP), a user friendly decision making tool for complex and multi criteria problems was used to evaluate the supplier's quality performance challenging the weight point system that was used for 18 suppliers'. The consistency ratio was checked for criteria and sub-criteria. Final results of AHP obtained with no overlap ratings, therefore yielded a better decision making methodology as compared to weight point rating system.

  11. Performance evaluation of antenna arrays with noisy carrier reference

    NASA Technical Reports Server (NTRS)

    Yan, T. Y.; Clare, L. P.

    1981-01-01

    The performance evaluation of coherent receivers with noisy carrier references and multiple antennas is presented. The received signal is assumed to be residual carrier BPSK, with a PLL used for extracting the carrier. Explicit relationships between the error probabilities and the various system parameters are given. Specific results are given for the performance gain of combined carrier referencing over baseband only combining when the channel alignment process is ideal. A simple asymptotic expression for the performance gain is determined when the number of antennas used is increased without bound. Examples using Deep Space Network receivers illustrate the performance of each arraying structure.

  12. Performance indicators--their place in health care evaluation.

    PubMed

    Cope, I

    1992-01-01

    To report on some of the more important performance indicators used at St Vincent's Private Hospital, Sydney. Clinical data collected using DRG technology is reviewed by the Clinical Review Committee and its subcommittees. Administrative data and consumer satisfaction sampling by questionnaire are used to provide other performance indices. Performance indicators are reviewed on a quarterly basis to assess quality of care. The importance of definitions and subset analysis is emphasised and the cost effectiveness of using DRG technology to retrieve data is presented. Performance indicators are a cost-effective, sensitive tool to assist in the evaluation of the quality of health care.

  13. Tools for evaluating team performance in simulation-based training

    PubMed Central

    Rosen, Michael A; Weaver, Sallie J; Lazzara, Elizabeth H; Salas, Eduardo; Wu, Teresa; Silvestri, Salvatore; Schiebel, Nicola; Almeida, Sandra; King, Heidi B

    2010-01-01

    Teamwork training constitutes one of the core approaches for moving healthcare systems toward increased levels of quality and safety, and simulation provides a powerful method of delivering this training, especially for face-paced and dynamic specialty areas such as Emergency Medicine. Team performance measurement and evaluation plays an integral role in ensuring that simulation-based training for teams (SBTT) is systematic and effective. However, this component of SBTT systems is overlooked frequently. This article addresses this gap by providing a review and practical introduction to the process of developing and implementing evaluation systems in SBTT. First, an overview of team performance evaluation is provided. Second, best practices for measuring team performance in simulation are reviewed. Third, some of the prominent measurement tools in the literature are summarized and discussed relative to the best practices. Subsequently, implications of the review are discussed for the practice of training teamwork in Emergency Medicine. PMID:21063558

  14. Tools for evaluating team performance in simulation-based training.

    PubMed

    Rosen, Michael A; Weaver, Sallie J; Lazzara, Elizabeth H; Salas, Eduardo; Wu, Teresa; Silvestri, Salvatore; Schiebel, Nicola; Almeida, Sandra; King, Heidi B

    2010-10-01

    Teamwork training constitutes one of the core approaches for moving healthcare systems toward increased levels of quality and safety, and simulation provides a powerful method of delivering this training, especially for face-paced and dynamic specialty areas such as Emergency Medicine. Team performance measurement and evaluation plays an integral role in ensuring that simulation-based training for teams (SBTT) is systematic and effective. However, this component of SBTT systems is overlooked frequently. This article addresses this gap by providing a review and practical introduction to the process of developing and implementing evaluation systems in SBTT. First, an overview of team performance evaluation is provided. Second, best practices for measuring team performance in simulation are reviewed. Third, some of the prominent measurement tools in the literature are summarized and discussed relative to the best practices. Subsequently, implications of the review are discussed for the practice of training teamwork in Emergency Medicine.

  15. NREL Evaluates Performance of Fast-Charge Electric Buses

    SciTech Connect

    2016-09-16

    This real-world performance evaluation is designed to enhance understanding of the overall usage and effectiveness of electric buses in transit operation and to provide unbiased technical information to other agencies interested in adding such vehicles to their fleets. Initial results indicate that the electric buses under study offer significant fuel and emissions savings. The final results will help Foothill Transit optimize the energy-saving potential of its transit fleet. NREL's performance evaluations help vehicle manufacturers fine-tune their designs and help fleet managers select fuel-efficient, low-emission vehicles that meet their bottom line and operational goals. help Foothill Transit optimize the energy-saving potential of its transit fleet. NREL's performance evaluations help vehicle manufacturers fine-tune their designs and help fleet managers select fuel-efficient, low-emission vehicles that meet their bottom line and operational goals.

  16. Experimental Evaluation of High Performance Integrated Heat Pump

    SciTech Connect

    Miller, William A; Berry, Robert; Durfee, Neal; Baxter, Van D

    2016-01-01

    Integrated heat pump (IHP) technology provides significant potential for energy savings and comfort improvement for residential buildings. In this study, we evaluate the performance of a high performance IHP that provides space heating, cooling, and water heating services. Experiments were conducted according to the ASHRAE Standard 206-2013 where 24 test conditions were identified in order to evaluate the IHP performance indices based on the airside performance. Empirical curve fits of the unit s compressor maps are used in conjunction with saturated condensing and evaporating refrigerant conditions to deduce the refrigerant mass flowrate, which, in turn was used to evaluate the refrigerant side performance as a check on the airside performance. Heat pump (compressor, fans, and controls) and water pump power were measured separately per requirements of Standard 206. The system was charged per the system manufacturer s specifications. System test results are presented for each operating mode. The overall IHP performance metrics are determined from the test results per the Standard 206 calculation procedures.

  17. Agreement between gastrointestinal panel testing and standard microbiology methods for detecting pathogens in suspected infectious gastroenteritis: Test evaluation and meta-analysis in the absence of a reference standard

    PubMed Central

    Tsertsvadze, Alexander; Taylor-Phillips, Sian; McCarthy, Noel; Mistry, Hema; Manuel, Rohini; Mason, James

    2017-01-01

    Objective Multiplex gastrointestinal pathogen panel (GPP) tests simultaneously identify bacterial, viral and parasitic pathogens from the stool samples of patients with suspected infectious gastroenteritis presenting in hospital or the community. We undertook a systematic review to compare the accuracy of GPP tests with standard microbiology techniques. Review methods Searches in Medline, Embase, Web of Science and the Cochrane library were undertaken from inception to January 2016. Eligible studies compared GPP tests with standard microbiology techniques in patients with suspected gastroenteritis. Quality assessment of included studies used tailored QUADAS-2. In the absence of a reference standard we analysed test performance taking GPP tests and standard microbiology techniques in turn as the benchmark test, using random effects meta-analysis of proportions. Results No study provided an adequate reference standard with which to compare the test accuracy of GPP and conventional tests. Ten studies informed a meta-analysis of positive and negative agreement. Positive agreement across all pathogens was 0.93 (95% CI 0.90 to 0.96) when conventional methods were the benchmark and 0.68 (95% CI: 0.58 to 0.77) when GPP provided the benchmark. Negative agreement was high in both instances due to the high proportion of negative cases. GPP testing produced a greater number of pathogen-positive findings than conventional testing. It is unclear whether these additional ‘positives’ are clinically important. Conclusions GPP testing has the potential to simplify testing and accelerate reporting when compared to conventional microbiology methods. However the impact of GPP testing upon the management, treatment and outcome of patients is poorly understood and further studies are needed to evaluate the health economic impact of GPP testing compared with standard methods. The review protocol is registered with PROSPERO as CRD42016033320. PMID:28253337

  18. 40 CFR 35.3010 - Delegation agreement.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... agreement. (a) Before execution of the delegation agreement, the Regional Administrator must determine that... performance consistent with the requirements in § 35.3025 of this subpart, including the frequency, method...

  19. Evaluating the performance of sensory quality control: the case of boar taint.

    PubMed

    Meier-Dinkel, Lisa; Gertheiss, Jan; Müller, Simone; Wesoly, Raffael; Mörlein, Daniel

    2015-02-01

    Detection of malodours referred to as 'boar taint' in entire male pigs is essential for quality control when refraining piglet castration. This study analysed the sensitivity and specificity of sensory evaluation by trained assessors (n=18) compared to chemical analysis of two marker compounds (androstenone, skatole) in backfat (n=794). Taking the measurement uncertainty into consideration, several cut-off thresholds for chemical analysis were exemplarily evaluated. Using the panel average score, sensitivity and specificity of sensory analysis ranged from 61 to 69% and 77 to 85%, respectively. Performance of individual assessors varied highly (sensitivity: 47 to 86%; specificity: 45 to 88%) and correlated to olfactory acuity to the compounds. According to receiver operating characteristic-curves, the average panel performed better than single assessors regardless of the sensory criterion shift. Agreement plots illustrate that high skatole levels are better detected than high androstenone levels (useful for assessor feedback). The agreement between sensory and chemical analyses was moderate. Assessors need to be selected carefully. Copyright © 2014 Elsevier Ltd. All rights reserved.

  20. A fuzzy inference system to evaluate contract service provider performance.

    PubMed

    Cruz, Antonio Miguel; Denis, Ernesto Rodriguez

    2005-01-01

    This paper puts forward a fuzzy inference system for evaluating the quality performance of service contract providers. An Application Service Provider was designed and put online, featuring surveys to establish the most useful indicators to evaluate the quality of the service. This model was implemented in 10 separate hospitals. As a result, the service cost-acquisition cost ratio in these cases was reduced from 16.14% to 6.09% in the period 2001-January 2003.

  1. Performance evaluation: building blocks for credentialing and career advancement.

    PubMed

    Queen, V A

    1995-09-01

    With time and creativity, a performance evaluation can help nurse managers maintain safe and competent care delivery, meet organizational goals, assist nurses to develop professionally and even encourage ideas for future research. Some of the common problems encountered--time, paperwork and incongruent judgments--may arise between the evaluator and the evaluatee. This article discusses some of these very issues and offers some suggestions for how to handle, if not avoid, these difficulties.

  2. Smith Newton Vehicle Performance Evaluation - 3rd Quarter 2012 (Brochure)

    SciTech Connect

    Not Available

    2013-03-01

    The Fleet Test and Evaluation Team at the U.S. Department of Energy's National Renewable Energy Laboratory is evaluating and documenting the performance of electric and plug-in hybrid electric drive systems in medium-duty trucks across the nation. Through this project, Smith Electric Vehicles will build and deploy 500 all-electric medium-duty trucks. The trucks will be deployed in diverse climates across the country.

  3. A performance evaluation of the IBM 370/XT personal computer

    NASA Technical Reports Server (NTRS)

    Dominick, Wayne D. (Editor); Triantafyllopoulos, Spiros

    1984-01-01

    An evaluation of the IBM 370/XT personal computer is given. This evaluation focuses primarily on the use of the 370/XT for scientific and technical applications and applications development. A measurement of the capabilities of the 370/XT was performed by means of test programs which are presented. Also included is a review of facilities provided by the operating system (VM/PC), along with comments on the IBM 370/XT hardware configuration.

  4. Effects of Performer Attractiveness, Stage Behavior, and Dress on Evaluation of Children's Piano Performances.

    ERIC Educational Resources Information Center

    Wapnick, Joel; Mazza, Jolan Kovacs; Darrow, Alice Ann

    2000-01-01

    Examines whether selected nonmusical attributes of 20 sixth-grade pianists would affect ratings of their performances by 123 musically trained evaluators. States that the visual group evaluators viewed a videotape, without the sound, rating the pianists on appropriateness of dress, stage behavior, and physical attractiveness. The audio and…

  5. Multicenter performance evaluation of a second generation cortisol assay.

    PubMed

    Vogeser, Michael; Kratzsch, Jürgen; Ju Bae, Yoon; Bruegel, Mathias; Ceglarek, Uta; Fiers, Tom; Gaudl, Alexander; Kurka, Hedwig; Milczynski, Christoph; Prat Knoll, Cristina; Suhr, Anna C; Teupser, Daniel; Zahn, Ingrid; Ostlund, Richard E

    2017-05-01

    Untreated disorders of the adrenocortical system, such as Cushing's or Addison's disease, can be fatal, and accurate quantification of a patient's cortisol levels is vital for diagnosis. The objective of this study was to assess the analytical performance of a new fully-automated Elecsys® Cortisol II assay (second generation) to measure cortisol levels in serum and saliva. Four European investigational sites assessed the intermediate precision and reproducibility of the Cortisol II assay (Roche Diagnostics) under routine conditions. Method comparisons of the Cortisol II assay vs. liquid chromatography-tandem mass spectrometry (LC-MS/MS), the gold standard for cortisol measurement, were performed. Cortisol reference ranges from three US sites were determined using samples from self-reported healthy individuals. The coefficients of variation (CVs) for repeatability, intermediate precision, and reproducibility for serum samples were ≤2.6%, ≤5.8%, and ≤9.5%, respectively, and for saliva were ≤4.4% and ≤10.9%, and ≤11.4%, respectively. Agreement between the Cortisol II assay and LC-MS/MS in serum samples was close, with a slope of 1.02 and an intercept of 4.473 nmol/L. Reference range samples were collected from healthy individuals (n=300) and serum morning cortisol concentrations (5-95th percentile) were 166.1-507 nmol/L and afternoon concentrations were 73.8-291 nmol/L. Morning, afternoon, and midnight saliva concentrations (95th percentile) were 20.3, 6.94, and 7.56 nmol/L, respectively. The Cortisol II assay had good precision over the entire measuring range and had excellent agreement with LC-MS/MS. This test was found suitable for routine diagnostic application and will be valuable for the diagnosis of adrenocortical diseases.

  6. Statistical scoring procedures applicable to laboratory performance evaluation

    SciTech Connect

    Streets, W Elane

    2008-11-01

    Two statistical scoring procedures based on p-values have been developed to evaluate the overall performance of analytical laboratories performing environmental measurements. The overall scores of bias and standing are used to determine how consistently a laboratory is able to measure the true (unknown) value correctly over time. The overall scores of precision and standing are used to determine how well a laboratory is able to reproduce its measurements in the long run. Criteria are established for qualitatively labeling measurements as Acceptable, Warning, and Not Acceptable and for identifying areas where laboratories should re-evaluate their measurement procedures. These statistical scoring procedures are applied to two real environmental data sets.

  7. On-line evaluation of multiloop digital controller performance

    NASA Technical Reports Server (NTRS)

    Wieseman, Carol D.

    1993-01-01

    The purpose of this presentation is to inform the Guidance and Control community of capabilities which were developed by the Aeroservoelasticity Branch to evaluate the performance of multivariable control laws, on-line, during wind-tunnel testing. The capabilities are generic enough to be useful for all kinds of on-line analyses involving multivariable control in experimental testing. Consequently, it was decided to present this material at this workshop even though it has been presented elsewhere. Topics covered include: essential on-line analysis requirements; on-line analysis capabilities; on-line analysis software; frequency domain procedures; controller performance evaluation frequency-domain flutter suppression; and plant determination.

  8. Performance evaluation of BPM system in SSRF using PCA method

    NASA Astrophysics Data System (ADS)

    Chen, Zhi-Chu; Leng, Yong-Bin; Yan, Ying-Bing; Yuan, Ren-Xian; Lai, Long-Wei

    2014-07-01

    The beam position monitor (BPM) system is of most importance in a light source. The capability of the BPM depends on the resolution of the system. The traditional standard deviation on the raw data method merely gives the upper limit of the resolution. Principal component analysis (PCA) had been introduced in the accelerator physics and it could be used to get rid of the actual signals. Beam related information was extracted before the evaluation of the BPM performance. A series of studies had been made in the Shanghai Synchrotron Radiation Facility (SSRF) and PCA was proved to be an effective and robust method in the performance evaluations of our BPM system.

  9. Performance Evaluation of Steam Traps and Orifice Plates.

    DTIC Science & Technology

    1980-10-01

    ADlAO9dl 229 JOHNS - MANVILLE SALES CORP DENVER CO RESEARCH AND DEV-’ETC F/S 13/1 PERFOR1ANCE EVALUATION OF STEAM TRAPS AND ORIFICE PLATES.(U)/ OCT 80...AGENCY t REPORT FESA-TS-2085 41! PERFORMANCE EVALUATION OF STEAM TRAPS AND ORIFICE PLATES P. B. SHEPHERD JOHNS - MANVILLE SALES CORPORATION w RESEARCH...PERFORMING ORGANIZATION NAME ANED ADDPESS!_ i lFioC’iA.TCr ’.ETPlJ A~ Johns - Manville Sales Corporation &00* 0 - Research & Development Center qOll Ken

  10. Applied grinding wheel performance evaluation for optical fabrication

    SciTech Connect

    Piscotty, M.A.; Taylor, J.S.; Blaedel, K.L.

    1996-06-11

    We are collaborating with the Center for Optics Manufacturing (Rochester NY) to develop fine diamond grinding wheels for spherical grinding of glass optics. A standardized method for evaluating wheel performance includes in-process acoustic emission (AE). This paper includes recent AE measurements taken during the evaluation of several fine diamond grinding wheels and discusses how this new information might relate to the physical performance of the wheels. An interesting observation is also reported on the surface topography of worn bronze wheels using an interferometric profiler.

  11. Clinical Performance Evaluations of Third-Year Medical Students and Association With Student and Evaluator Gender.

    PubMed

    Riese, Alison; Rappaport, Leah; Alverson, Brian; Park, Sangshin; Rockney, Randal M

    2017-06-01

    Clinical performance evaluations are major components of medical school clerkship grades. But are they sufficiently objective? This study aimed to determine whether student and evaluator gender is associated with assessment of overall clinical performance. This was a retrospective analysis of 4,272 core clerkship clinical performance evaluations by 829 evaluators of 155 third-year students, within the Alpert Medical School grading database for the 2013-2014 academic year. Overall clinical performance, assessed on a three-point scale (meets expectations, above expectations, exceptional), was extracted from each evaluation, as well as evaluator gender, age, training level, department, student gender and age, and length of observation time. Hierarchical ordinal regression modeling was conducted to account for clustering of evaluations. Female students were more likely to receive a better grade than males (adjusted odds ratio [AOR] 1.30, 95% confidence interval [CI] 1.13-1.50), and female evaluators awarded lower grades than males (AOR 0.72, 95% CI 0.55-0.93), adjusting for department, observation time, and student and evaluator age. The interaction between student and evaluator gender was significant (P = .03), with female evaluators assigning higher grades to female students, while male evaluators' grading did not differ by student gender. Students who spent a short time with evaluators were also more likely to get a lower grade. A one-year examination of all third-year clerkship clinical performance evaluations at a single institution revealed that male and female evaluators rated male and female students differently, even when accounting for other measured variables.

  12. Idaho National Engineering Laboratory analytical services performance evaluation plan

    SciTech Connect

    Connolly, J.M.; Sailer, S.J.; Anderson, D.A.

    1994-03-01

    The Idaho National Engineering Laboratory`s (INEL`s) Sample Management Office (SMO) conducts a Performance Evaluation Program that ensures that data of known quality are supplied by the analytical. chemistry service organizations with which the INEL contracts. The Analytical Services Performance Evaluation Plan documents the routine monitoring and assessment of suppliers conducted by the SMO, and it describes the procedures that are followed to ensure that suppliers meet all appropriate requirements. Because high-quality analytical support is vital to the success of DOE Environmental Management programs at the INEL, the performance of organizations providing these services must be routinely monitored and assessed. Analytical disciplines for which performance is monitored include metals, organics, radiochemical, and miscellaneous classical analysis methods.

  13. Image performance evaluation of a 3D surgical imaging platform

    NASA Astrophysics Data System (ADS)

    Petrov, Ivailo E.; Nikolov, Hristo N.; Holdsworth, David W.; Drangova, Maria

    2011-03-01

    The O-arm (Medtronic Inc.) is a multi-dimensional surgical imaging platform. The purpose of this study was to perform a quantitative evaluation of the imaging performance of the O-arm in an effort to understand its potential for future nonorthopedic applications. Performance of the reconstructed 3D images was evaluated, using a custom-built phantom, in terms of resolution, linearity, uniformity and geometrical accuracy. Both the standard (SD, 13 s) and high definition (HD, 26 s) modes were evaluated, with the imaging parameters set to image the head (120 kVp, 100 mAs and 150 mAs, respectively). For quantitative noise characterization, the images were converted to Hounsfield units (HU) off-line. Measurement of the modulation transfer function revealed a limiting resolution (at 10% level) of 1.0 mm-1 in the axial dimension. Image noise varied between 15 and 19 HU for the HD and SD modes, respectively. Image intensities varied linearly over the measured range, up to 1300 HU. Geometric accuracy was maintained in all three dimensions over the field of view. The present study has evaluated the performance characteristics of the O-arm, and demonstrates feasibility for use in interventional applications and quantitative imaging tasks outside those currently targeted by the manufacturer. Further improvements to the reconstruction algorithms may further enhance performance for lower-contrast applications.

  14. A Novel Performance Evaluation Methodology for Single-Target Trackers.

    PubMed

    Kristan, Matej; Matas, Jiri; Leonardis, Ales; Vojir, Tomas; Pflugfelder, Roman; Fernandez, Gustavo; Nebehay, Georg; Porikli, Fatih; Cehovin, Luka

    2016-11-01

    This paper addresses the problem of single-target tracker performance evaluation. We consider the performance measures, the dataset and the evaluation system to be the most important components of tracker evaluation and propose requirements for each of them. The requirements are the basis of a new evaluation methodology that aims at a simple and easily interpretable tracker comparison. The ranking-based methodology addresses tracker equivalence in terms of statistical significance and practical differences. A fully-annotated dataset with per-frame annotations with several visual attributes is introduced. The diversity of its visual properties is maximized in a novel way by clustering a large number of videos according to their visual attributes. This makes it the most sophistically constructed and annotated dataset to date. A multi-platform evaluation system allowing easy integration of third-party trackers is presented as well. The proposed evaluation methodology was tested on the VOT2014 challenge on the new dataset and 38 trackers, making it the largest benchmark to date. Most of the tested trackers are indeed state-of-the-art since they outperform the standard baselines, resulting in a highly-challenging benchmark. An exhaustive analysis of the dataset from the perspective of tracking difficulty is carried out. To facilitate tracker comparison a new performance visualization technique is proposed.

  15. Molecular detection of common intestinal parasites: a performance evaluation of the BD Max™ Enteric Parasite Panel.

    PubMed

    Batra, R; Judd, E; Eling, J; Newsholme, W; Goldenberg, S D

    2016-11-01

    The purpose of this study was to evaluate the level of agreement of the BD Max™ Enteric Parasite Panel (EPP) with microscopy for the detection of Giardia duodenalis, Cryptosporidium spp. and Entamoeba histolytica in stool samples. A total of 372 stool samples (partly collected on the basis of positive microscopy and partly unselected, consecutive sample submitted for parasite investigation) were tested with EPP according to manufacturer's instructions and also using microscopy according to standard techniques. Discrepant samples were further tested using PCR by the National Parasitology reference laboratory. Levels of agreement and laboratory turnaround times were measured and compared. Overall, positive and negative percent agreement was high between the two methods. However, microscopy resulted in four false positives and one false negative for G. duodenalis and two false positives for Cryptosporidium. Additionally, microscopy could not differentiate between E. histolytica and Entamoeba dispar. Median laboratory turnaround time was 65 hours for microscopy; results from EPP could be available after four hours. Blastocycstis hominis was detected by microscopy in one sample and would have been missed if only EPP was performed. The EPP was a good alternative to microscopy, detecting a small number of additional positives that were missed by microscopy. The assay is significantly faster than microscopy and allows laboratory workflows to be streamlined. The risk of missing parasites that are not included in the EPP appears to be minimal in the studied population; however, there may be certain patient groups who would benefit from microscopic examination of stools.

  16. Lithographic performance evaluation of a contaminated EUV mask after cleaning

    SciTech Connect

    George, Simi; Naulleau, Patrick; Okoroanyanwu, Uzodinma; Dittmar, Kornelia; Holfeld, Christian; Wuest, Andrea

    2009-11-16

    The effect of surface contamination and subsequent mask surface cleaning on the lithographic performance of a EUV mask is investigated. SEMATECH's Berkeley micro-field exposure tool (MET) printed 40 nm and 50 nm line and space (L/S) patterns are evaluated to compare the performance of a contaminated and cleaned mask to an uncontaminated mask. Since the two EUV masks have distinct absorber architectures, optical imaging models and aerial image calculations were completed to determine any expected differences in performance. Measured and calculated Bossung curves, process windows, and exposure latitudes for the two sets of L/S patterns are compared to determine how the contamination and cleaning impacts the lithographic performance of EUV masks. The observed differences in mask performance are shown to be insignificant, indicating that the cleaning process did not appreciably affect mask performance.

  17. A Conceptual Framework for Evaluation of Public Health and Primary Care System Performance in Iran

    PubMed Central

    Jahanmehr, Nader; Rashidian, Arash; Khosravi, Ardeshir; Farzadfar, Farshad; Shariati, Mohammad; Majdzadeh, Reza; Sari, Ali Akbari; Mesdaghinia, Alireza

    2015-01-01

    Introduction: The main objective of this study was to design a conceptual framework, according to the policies and priorities of the ministry of health to evaluate provincial public health and primary care performance and to assess their share in the overall health impacts of the community. Methods: We used several tools and techniques, including system thinking, literature review to identify relevant attributes of health system performance framework and interview with the key stakeholders. The PubMed, Scopus, web of science, Google Scholar and two specialized databases of Persian language literature (IranMedex and SID) were searched using main terms and keywords. Following decision-making and collective agreement among the different stakeholders, 51 core indicators were chosen from among 602 obtained indicators in a four stage process, for monitoring and evaluation of Health Deputies. Results: We proposed a conceptual framework by identifying the performance area for Health Deputies between other determinants of health, as well as introducing a chain of results, for performance, consisting of Input, Process, Output and Outcome indicators. We also proposed 5 dimensions for measuring the performance of Health Deputies, consisting of efficiency, effectiveness, equity, access and improvement of health status. Conclusion: The proposed Conceptual Framework illustrates clearly the Health Deputies success in achieving best results and consequences of health in the country. Having the relative commitment of the ministry of health and Health Deputies at the University of Medical Sciences is essential for full implementation of this framework and providing the annual performance report. PMID:25946937

  18. Quality evaluation of moluodan concentrated pill using high-performance liquid chromatography fingerprinting coupled with chemometrics.

    PubMed

    Tao, Lingyan; Zhang, Qing; Wu, Yongjiang; Liu, Xuesong

    2016-12-01

    In this study, a fast and effective high-performance liquid chromatography method was developed to obtain a fingerprint chromatogram and quantitative analysis simultaneously of four indexes including gallic acid, chlorogenic acid, albiflorin and paeoniflorin of the traditional Chinese medicine Moluodan Concentrated Pill. The method was performed by using a Waters X-bridge C18 reversed phase column on an Agilent 1200S high-performance liquid chromatography system coupled with diode array detection. The mobile phase of the high-performance liquid chromatography method was composed of 20 mmol/L phosphate solution and acetonitrile with a 1 mL/min eluent velocity, under a detection temperature of 30°C and a UV detection wavelength of 254 nm. After the methodology validation, 16 batches of Moluodan Concentrated Pill were analyzed by this high-performance liquid chromatography method and both qualitative and quantitative evaluation results were achieved by similarity analysis, principal component analysis and hierarchical cluster analysis. The results of these three chemometrics were in good agreement and all indicated that batch 10 and batch 16 showed significant differences with the other 14 batches. This suggested that the developed high-performance liquid chromatography method could be applied in the quality evaluation of Moluodan Concentrated Pill.

  19. Preparation and performance evaluation of plain proliposomal systems for cytoprotection.

    PubMed

    Katare, O P; Vyas, S P; Dixit, V K

    1991-01-01

    Plain liposomal systems composed of soyabean lecithin, cholesterol and stearylamine were formulated using various approaches. The prepared products were characterized and evaluated for their cytoprotective performance against the necrotizing NSAID's (i.e. aspirin and phenylbutazone). Liposomes derived from proliposomes (effervescent granules based) demonstrated the best cytoprotective activity and physical and stability characteristics. This system was shown to be superior. An increased availability of regular and small sized liposome born phospholipids to the damaged mucosal systems accounted for its better and enhanced performance.

  20. High performance APCS conceptual design and evaluation scoping study

    SciTech Connect

    Soelberg, N.; Liekhus, K.; Chambers, A.; Anderson, G.

    1998-02-01

    This Air Pollution Control System (APCS) Conceptual Design and Evaluation study was conducted to evaluate a high-performance (APC) system for minimizing air emissions from mixed waste thermal treatment systems. Seven variations of high-performance APCS designs were conceptualized using several design objectives. One of the system designs was selected for detailed process simulation using ASPEN PLUS to determine material and energy balances and evaluate performance. Installed system capital costs were also estimated. Sensitivity studies were conducted to evaluate the incremental cost and benefit of added carbon adsorber beds for mercury control, specific catalytic reduction for NO{sub x} control, and offgas retention tanks for holding the offgas until sample analysis is conducted to verify that the offgas meets emission limits. Results show that the high-performance dry-wet APCS can easily meet all expected emission limits except for possibly mercury. The capability to achieve high levels of mercury control (potentially necessary for thermally treating some DOE mixed streams) could not be validated using current performance data for mercury control technologies. The engineering approach and ASPEN PLUS modeling tool developed and used in this study identified APC equipment and system performance, size, cost, and other issues that are not yet resolved. These issues need to be addressed in feasibility studies and conceptual designs for new facilities or for determining how to modify existing facilities to meet expected emission limits. The ASPEN PLUS process simulation with current and refined input assumptions and calculations can be used to provide system performance information for decision-making, identifying best options, estimating costs, reducing the potential for emission violations, providing information needed for waste flow analysis, incorporating new APCS technologies in existing designs, or performing facility design and permitting activities.