Development and evaluation of a method for calculating the Healthy Eating Index-2005 using the Nutrition Data System for Research

USDA-ARS?s Scientific Manuscript database

Objective: To develop and evaluate a method for calculating the Healthy Eating Index-2005 (HEI-2005) with the widely used Nutrition Data System for Research (NDSR) based on the method developed for use with the US Department of Agriculture’s (USDA) Food and Nutrient Dietary Data System (FNDDS) and M...

Assessing Change in the Teaching Practice of Faculty in a Faculty Development Program for Primary Care Physicians: Toward a Mixed Method Evaluation Approach.

ERIC Educational Resources Information Center

Pinheiro, Sandro O.; Rohrer, Jonathan D.; Heimann, C. F. Larry

This paper describes a mixed method evaluation study that was developed to assess faculty teaching behavior change in a faculty development fellowship program for community-based hospital faculty. Principles of adult learning were taught to faculty participants over the fellowship period. These included instruction in teaching methods, group…

Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).

PubMed

Duque-Ramos, Astrid; Boeker, Martin; Jansen, Ludger; Schulz, Stefan; Iniesta, Miguela; Fernández-Breis, Jesualdo Tomás

2014-01-01

To (1) evaluate the GoodOD guideline for ontology development by applying the OQuaRE evaluation method and metrics to the ontology artefacts that were produced by students in a randomized controlled trial, and (2) informally compare the OQuaRE evaluation method with gold standard and competency questions based evaluation methods, respectively. In the last decades many methods for ontology construction and ontology evaluation have been proposed. However, none of them has become a standard and there is no empirical evidence of comparative evaluation of such methods. This paper brings together GoodOD and OQuaRE. GoodOD is a guideline for developing robust ontologies. It was previously evaluated in a randomized controlled trial employing metrics based on gold standard ontologies and competency questions as outcome parameters. OQuaRE is a method for ontology quality evaluation which adapts the SQuaRE standard for software product quality to ontologies and has been successfully used for evaluating the quality of ontologies. In this paper, we evaluate the effect of training in ontology construction based on the GoodOD guideline within the OQuaRE quality evaluation framework and compare the results with those obtained for the previous studies based on the same data. Our results show a significant effect of the GoodOD training over developed ontologies by topics: (a) a highly significant effect was detected in three topics from the analysis of the ontologies of untrained and trained students; (b) both positive and negative training effects with respect to the gold standard were found for five topics. The GoodOD guideline had a significant effect over the quality of the ontologies developed. Our results show that GoodOD ontologies can be effectively evaluated using OQuaRE and that OQuaRE is able to provide additional useful information about the quality of the GoodOD ontologies.

Developing a Self-Report-Based Sequential Analysis Method for Educational Technology Systems: A Process-Based Usability Evaluation

ERIC Educational Resources Information Center

Lin, Yi-Chun; Hsieh, Ya-Hui; Hou, Huei-Tse

2015-01-01

The development of a usability evaluation method for educational systems or applications, called the self-report-based sequential analysis, is described herein. The method aims to extend the current practice by proposing self-report-based sequential analysis as a new usability method, which integrates the advantages of self-report in survey…

Evaluating the dynamic response of in-flight thrust calculation techniques during throttle transients

NASA Technical Reports Server (NTRS)

Ray, Ronald J.

1994-01-01

New flight test maneuvers and analysis techniques for evaluating the dynamic response of in-flight thrust models during throttle transients have been developed and validated. The approach is based on the aircraft and engine performance relationship between thrust and drag. Two flight test maneuvers, a throttle step and a throttle frequency sweep, were developed and used in the study. Graphical analysis techniques, including a frequency domain analysis method, were also developed and evaluated. They provide quantitative and qualitative results. Four thrust calculation methods were used to demonstrate and validate the test technique. Flight test applications on two high-performance aircraft confirmed the test methods as valid and accurate. These maneuvers and analysis techniques were easy to implement and use. Flight test results indicate the analysis techniques can identify the combined effects of model error and instrumentation response limitations on the calculated thrust value. The methods developed in this report provide an accurate approach for evaluating, validating, or comparing thrust calculation methods for dynamic flight applications.

Evaluating the compatibility of multi-functional and intensive urban land uses

NASA Astrophysics Data System (ADS)

Taleai, M.; Sharifi, A.; Sliuzas, R.; Mesgari, M.

2007-12-01

This research is aimed at developing a model for assessing land use compatibility in densely built-up urban areas. In this process, a new model was developed through the combination of a suite of existing methods and tools: geographical information system, Delphi methods and spatial decision support tools: namely multi-criteria evaluation analysis, analytical hierarchy process and ordered weighted average method. The developed model has the potential to calculate land use compatibility in both horizontal and vertical directions. Furthermore, the compatibility between the use of each floor in a building and its neighboring land uses can be evaluated. The method was tested in a built-up urban area located in Tehran, the capital city of Iran. The results show that the model is robust in clarifying different levels of physical compatibility between neighboring land uses. This paper describes the various steps and processes of developing the proposed land use compatibility evaluation model (CEM).

Evaluation and development plan of NRTA measurement methods for the Rokkasho Reprocessing Plant

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, T.K.; Hakkila, E.A.; Flosterbuer, S.F.

Near-real-time accounting (NRTA) has been proposed as a safeguards method at the Rokkasho Reprocessing Plant (RRP), a large-scale commercial boiling water and pressurized water reactors spent-fuel reprocessing facility. NRTA for RRP requires material balance closures every month. To develop a more effective and practical NRTA system for RRP, we have evaluated NRTA measurement techniques and systems that might be implemented in both the main process and the co-denitration process areas at RRP to analyze the concentrations of plutonium in solutions and mixed oxide powder. Based on the comparative evaluation, including performance, reliability, design criteria, operation methods, maintenance requirements, and estimatedmore » costs for each possible measurement method, recommendations for development were formulated. This paper discusses the evaluations and reports on the recommendation of the NRTA development plan for potential implementation at RRP.« less

Assessing and evaluating multidisciplinary translational teams: a mixed methods approach.

PubMed

Wooten, Kevin C; Rose, Robert M; Ostir, Glenn V; Calhoun, William J; Ameredes, Bill T; Brasier, Allan R

2014-03-01

A case report illustrates how multidisciplinary translational teams can be assessed using outcome, process, and developmental types of evaluation using a mixed-methods approach. Types of evaluation appropriate for teams are considered in relation to relevant research questions and assessment methods. Logic models are applied to scientific projects and team development to inform choices between methods within a mixed-methods design. Use of an expert panel is reviewed, culminating in consensus ratings of 11 multidisciplinary teams and a final evaluation within a team-type taxonomy. Based on team maturation and scientific progress, teams were designated as (a) early in development, (b) traditional, (c) process focused, or (d) exemplary. Lessons learned from data reduction, use of mixed methods, and use of expert panels are explored.

Evaluating an Intelligent Tutoring System for Design Patterns: The DEPTHS Experience

ERIC Educational Resources Information Center

Jeremic, Zoran; Jovanovic, Jelena; Gasevic, Dragan

2009-01-01

The evaluation of intelligent tutoring systems (ITSs) is an important though often neglected stage of ITS development. There are many evaluation methods available but literature does not provide clear guidelines for the selection of evaluation method(s) to be used in a particular context. This paper describes the evaluation study of DEPTHS, an…

A Web-based Alternative Non-animal Method Database for Safety Cosmetic Evaluations

PubMed Central

Kim, Seung Won; Kim, Bae-Hwan

2016-01-01

Animal testing was used traditionally in the cosmetics industry to confirm product safety, but has begun to be banned; alternative methods to replace animal experiments are either in development, or are being validated, worldwide. Research data related to test substances are critical for developing novel alternative tests. Moreover, safety information on cosmetic materials has neither been collected in a database nor shared among researchers. Therefore, it is imperative to build and share a database of safety information on toxicological mechanisms and pathways collected through in vivo, in vitro, and in silico methods. We developed the CAMSEC database (named after the research team; the Consortium of Alternative Methods for Safety Evaluation of Cosmetics) to fulfill this purpose. On the same website, our aim is to provide updates on current alternative research methods in Korea. The database will not be used directly to conduct safety evaluations, but researchers or regulatory individuals can use it to facilitate their work in formulating safety evaluations for cosmetic materials. We hope this database will help establish new alternative research methods to conduct efficient safety evaluations of cosmetic materials. PMID:27437094

A Web-based Alternative Non-animal Method Database for Safety Cosmetic Evaluations.

PubMed

Kim, Seung Won; Kim, Bae-Hwan

2016-07-01

Animal testing was used traditionally in the cosmetics industry to confirm product safety, but has begun to be banned; alternative methods to replace animal experiments are either in development, or are being validated, worldwide. Research data related to test substances are critical for developing novel alternative tests. Moreover, safety information on cosmetic materials has neither been collected in a database nor shared among researchers. Therefore, it is imperative to build and share a database of safety information on toxicological mechanisms and pathways collected through in vivo, in vitro, and in silico methods. We developed the CAMSEC database (named after the research team; the Consortium of Alternative Methods for Safety Evaluation of Cosmetics) to fulfill this purpose. On the same website, our aim is to provide updates on current alternative research methods in Korea. The database will not be used directly to conduct safety evaluations, but researchers or regulatory individuals can use it to facilitate their work in formulating safety evaluations for cosmetic materials. We hope this database will help establish new alternative research methods to conduct efficient safety evaluations of cosmetic materials.

Turbulent boundary layers over nonstationary plane boundaries

NASA Technical Reports Server (NTRS)

Roper, A. T.; Gentry, G. L., Jr.

1978-01-01

Methods of predicting integral parameters and skin friction coefficients of turbulent boundary layers developing over moving ground planes were evaluated. The three methods evaluated were: relative integral parameter method; relative power law method; and modified law of the wall method.

Method for technology-delivered healthcare measures.

PubMed

Kramer-Jackman, Kelli Lee; Popkess-Vawter, Sue

2011-12-01

Current healthcare literature lacks development and evaluation methods for research and practice measures administered by technology. Researchers with varying levels of informatics experience are developing technology-delivered measures because of the numerous advantages they offer. Hasty development of technology-delivered measures can present issues that negatively influence administration and psychometric properties. The Method for Technology-delivered Healthcare Measures is designed to systematically guide the development and evaluation of technology-delivered measures. The five-step Method for Technology-delivered Healthcare Measures includes establishment of content, e-Health literacy, technology delivery, expert usability, and participant usability. Background information and Method for Technology-delivered Healthcare Measures steps are detailed.

A methodology for evaluating the usability of audiovisual consumer electronic products.

PubMed

Kwahk, Jiyoung; Han, Sung H

2002-09-01

Usability evaluation is now considered an essential procedure in consumer product development. Many studies have been conducted to develop various techniques and methods of usability evaluation hoping to help the evaluators choose appropriate methods. However, planning and conducting usability evaluation requires considerations of a number of factors surrounding the evaluation process including the product, user, activity, and environmental characteristics. In this perspective, this study suggested a new methodology of usability evaluation through a simple, structured framework. The framework was outlined by three major components: the interface features of a product as design variables, the evaluation context consisting of user, product, activity, and environment as context variables, and the usability measures as dependent variables. Based on this framework, this study established methods to specify the product interface features, to define evaluation context, and to measure usability. The effectiveness of this methodology was demonstrated through case studies in which the usability of audiovisual products was evaluated by using the methods developed in this study. This study is expected to help the usability practitioners in consumer electronics industry in various ways. Most directly, it supports the evaluators' plan and conduct usability evaluation sessions in a systematic and structured manner. In addition, it can be applied to other categories of consumer products (such as appliances, automobiles, communication devices, etc.) with minor modifications as necessary.

Land management planning: a method of evaluating alternatives

Treesearch

Andres Weintraub; Richard Adams; Linda Yellin

1982-01-01

A method is described for developing and evaluating alternatives in land management planning. A structured set of 15 steps provides a framework for such an evaluation. when multiple objectives and uncertainty must be considered in the planning process. The method is consistent with other processes used in organizational evaluation, and allows for the interaction of...

Defining, illustrating and reflecting on logic analysis with an example from a professional development program.

PubMed

Tremblay, Marie-Claude; Brousselle, Astrid; Richard, Lucie; Beaudet, Nicole

2013-10-01

Program designers and evaluators should make a point of testing the validity of a program's intervention theory before investing either in implementation or in any type of evaluation. In this context, logic analysis can be a particularly useful option, since it can be used to test the plausibility of a program's intervention theory using scientific knowledge. Professional development in public health is one field among several that would truly benefit from logic analysis, as it appears to be generally lacking in theorization and evaluation. This article presents the application of this analysis method to an innovative public health professional development program, the Health Promotion Laboratory. More specifically, this paper aims to (1) define the logic analysis approach and differentiate it from similar evaluative methods; (2) illustrate the application of this method by a concrete example (logic analysis of a professional development program); and (3) reflect on the requirements of each phase of logic analysis, as well as on the advantages and disadvantages of such an evaluation method. Using logic analysis to evaluate the Health Promotion Laboratory showed that, generally speaking, the program's intervention theory appeared to have been well designed. By testing and critically discussing logic analysis, this article also contributes to further improving and clarifying the method. Copyright © 2013 Elsevier Ltd. All rights reserved.

Assessing and Evaluating Multidisciplinary Translational Teams: A Mixed Methods Approach

PubMed Central

Wooten, Kevin C.; Rose, Robert M.; Ostir, Glenn V.; Calhoun, William J.; Ameredes, Bill T.; Brasier, Allan R.

2014-01-01

A case report illustrates how multidisciplinary translational teams can be assessed using outcome, process, and developmental types of evaluation using a mixed methods approach. Types of evaluation appropriate for teams are considered in relation to relevant research questions and assessment methods. Logic models are applied to scientific projects and team development to inform choices between methods within a mixed methods design. Use of an expert panel is reviewed, culminating in consensus ratings of 11 multidisciplinary teams and a final evaluation within a team type taxonomy. Based on team maturation and scientific progress, teams were designated as: a) early in development, b) traditional, c) process focused, or d) exemplary. Lessons learned from data reduction, use of mixed methods, and use of expert panels are explored. PMID:24064432

[Coupling coordination evaluation method between eco-environment quality and economic development level in contiguous special poverty-stricken areas of China].

PubMed

Wang, Yan-hui; Li, Jing-yi

2015-05-01

It is one of the important strategies in the new period of national poverty alleviation and development to maintain the basic balance between the ecological environment and economic development, and to promote the coordinated sustainable development of economy and ecological environment. Taking six contiguous special poverty-stricken areas as the study areas, a coupling coordination evaluation method between eco-environment quality and economic development level in contiguous special poverty-stricken areas was explored in this paper. The region' s ecological poverty index system was proposed based on the natural attribute of ecological environment, and the ecological environment quality evaluation method was built up by using AHP weighting method, followed by the design of the coupling coordination evaluation method between the ecological environment indices and the county economic poverty comprehensive indices. The coupling coordination degrees were calculated and their spatial representation differentiations were analyzed respectively at district, province, city, and county scales. Results showed that approximately half of the counties in the study areas achieved the harmoniously coordinated development. However, the ecological environmental quality and the economic development in most counties could not be synchronized, where mountains, rivers and other geographic features existed roughly as a dividing line of the coordinated development types. The phenomena of dislocation between the ecological environment and economic development in state-level poor counties were more serious than those of local poor counties.

Towards standardized assessment of endoscope optical performance: geometric distortion

NASA Astrophysics Data System (ADS)

Wang, Quanzeng; Desai, Viraj N.; Ngo, Ying Z.; Cheng, Wei-Chung; Pfefer, Joshua

2013-12-01

Technological advances in endoscopes, such as capsule, ultrathin and disposable devices, promise significant improvements in safety, clinical effectiveness and patient acceptance. Unfortunately, the industry lacks test methods for preclinical evaluation of key optical performance characteristics (OPCs) of endoscopic devices that are quantitative, objective and well-validated. As a result, it is difficult for researchers and developers to compare image quality and evaluate equivalence to, or improvement upon, prior technologies. While endoscope OPCs include resolution, field of view, and depth of field, among others, our focus in this paper is geometric image distortion. We reviewed specific test methods for distortion and then developed an objective, quantitative test method based on well-defined experimental and data processing steps to evaluate radial distortion in the full field of view of an endoscopic imaging system. Our measurements and analyses showed that a second-degree polynomial equation could well describe the radial distortion curve of a traditional endoscope. The distortion evaluation method was effective for correcting the image and can be used to explain other widely accepted evaluation methods such as picture height distortion. Development of consensus standards based on promising test methods for image quality assessment, such as the method studied here, will facilitate clinical implementation of innovative endoscopic devices.

Constructive eHealth evaluation: lessons from evaluation of EHR development in 4 Danish hospitals.

PubMed

Høstgaard, Anna Marie Balling; Bertelsen, Pernille; Nøhr, Christian

2017-04-20

Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented. A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents. The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions. Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians' involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits. The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management. The method provides a framework that takes care of feedback and learning during eHealth development. It can thus support successful eHealth development in a broader context while building on a well-known success factor: end-user involvement in eHealth development.

Development of Methods of Evaluating Abilities to Make Plans in New Group Work

NASA Astrophysics Data System (ADS)

Kiriyama, Satoshi

The ability to evaluate something vague which is, for example, originality can be regarded as one of important elements which constitute the ability to make plans. The author has made use of cooperative activities in which every member undertakes each stage of a plan-do-check-cycle in order to develop training methods and evaluating methods of evaluating ability. The members of a CHECK team evaluated activities of a PLAN team and a DO team. The author tried to grasp the abilities of the members of a CHECK team by analyzing results of the evaluation. In addition, the author have made some teachers evaluate a sample in order to study the accuracy of criteria and extracted some challenges.

EPA METHODS FOR EVALUATING WETLAND CONDITION, WETLANDS CLASSIFICATION

EPA Science Inventory

In 1999, the U.S. Environmental Protection Agency (EPA) began work on this series of reports entitled Methods for Evaluating Wetland Condition. The purpose of these reports is to help States and Tribes develop methods to evaluate 1) the overall ecological condition of wetlands us...

Evaluating co-creation of knowledge: from quality criteria and indicators to methods

NASA Astrophysics Data System (ADS)

Schuck-Zöller, Susanne; Cortekar, Jörg; Jacob, Daniela

2017-11-01

Basic research in the natural sciences rests on a long tradition of evaluation. However, since the San Francisco Declaration on Research Assessment (DORA) came out in 2012, there has been intense discussion in the natural sciences, above all amongst researchers and funding agencies in the different fields of applied research and scientific service. This discussion was intensified when climate services and other fields, used to make users participate in research and development activities (co-creation), demanded new evaluation methods appropriate to this new research mode. This paper starts by describing a comprehensive and interdisciplinary literature overview of indicators to evaluate co-creation of knowledge, including the different fields of integrated knowledge production. Then the authors harmonize the different elements of evaluation from literature in an evaluation cascade that scales down from very general evaluation dimensions to tangible assessment methods. They describe evaluation indicators already being documented and include a mixture of different assessment methods for two exemplary criteria. It is shown what can be deduced from already existing methodology for climate services and envisaged how climate services can further to develop their specific evaluation method.

Evaluation of the disintegration time of rapidly disintegrating tablets via a novel method utilizing a CCD camera.

PubMed

Morita, Yutaka; Tsushima, Yuki; Yasui, Masanobu; Termoz, Ryoji; Ajioka, Junko; Takayama, Kozo

2002-09-01

Many kinds of rapidly disintegrating or oral disintegrating tablets (RDT) have been developed to improve the ease of tablet administration, especially for elderly and pediatric patients. In these cases, knowledge regarding disintegration behavior appears important with respect to the development of such a novel tablet. Ordinary disintegration testing, such as the Japanese Pharmacopoeia (JP) method, faces limitations with respect to the evaluation of rapid disintegration due to strong agitation. Therefore, we have developed a novel apparatus and method to determine the dissolution of the RDT. The novel device consists of a disintegrating bath and CCD camera interfaced with a personal computer equipped with motion capture and image analysis software. A newly developed RDT containing various types of binder was evaluated with this protocol. In this method, disintegration occurs in a mildly agitated medium, which allows differentiation of minor distinctions among RDTs of different formulations. Simultaneously, we were also able to detect qualitative information, i.e., morphological changes in the tablet during disintegration. This method is useful for the evaluation of the disintegration of RDT during pharmaceutical development, and also for quality control during production.

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

NASA Technical Reports Server (NTRS)

Simon, Donald L.

2010-01-01

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

Development and Validation of New Discriminative Dissolution Method for Carvedilol Tablets

PubMed Central

Raju, V.; Murthy, K. V. R.

2011-01-01

The objective of the present study was to develop and validate a discriminative dissolution method for evaluation of carvedilol tablets. Different conditions such as type of dissolution medium, volume of dissolution medium and rotation speed of paddle were evaluated. The best in vitro dissolution profile was obtained using Apparatus II (paddle), 50 rpm, 900 ml of pH 6.8 phosphate buffer as dissolution medium. The drug release was evaluated by high-performance liquid chromatographic method. The dissolution method was validated according to current ICH and FDA guidelines using parameters such as the specificity, accuracy, precision and stability were evaluated and obtained results were within the acceptable range. The comparison of the obtained dissolution profiles of three different products were investigated using ANOVA-based, model-dependent and model-independent methods, results showed that there is significant difference between the products. The dissolution test developed and validated was adequate for its higher discriminative capacity in differentiating the release characteristics of the products tested and could be applied for development and quality control of carvedilol tablets. PMID:22923865

Evaluation method based on the image correlation for laser jamming image

NASA Astrophysics Data System (ADS)

Che, Jinxi; Li, Zhongmin; Gao, Bo

2013-09-01

The jamming effectiveness evaluation of infrared imaging system is an important part of electro-optical countermeasure. The infrared imaging devices in the military are widely used in the searching, tracking and guidance and so many other fields. At the same time, with the continuous development of laser technology, research of laser interference and damage effect developed continuously, laser has been used to disturbing the infrared imaging device. Therefore, the effect evaluation of the infrared imaging system by laser has become a meaningful problem to be solved. The information that the infrared imaging system ultimately present to the user is an image, so the evaluation on jamming effect can be made from the point of assessment of image quality. The image contains two aspects of the information, the light amplitude and light phase, so the image correlation can accurately perform the difference between the original image and disturbed image. In the paper, the evaluation method of digital image correlation, the assessment method of image quality based on Fourier transform, the estimate method of image quality based on error statistic and the evaluation method of based on peak signal noise ratio are analysed. In addition, the advantages and disadvantages of these methods are analysed. Moreover, the infrared disturbing images of the experiment result, in which the thermal infrared imager was interfered by laser, were analysed by using these methods. The results show that the methods can better reflect the jamming effects of the infrared imaging system by laser. Furthermore, there is good consistence between evaluation results by using the methods and the results of subjective visual evaluation. And it also provides well repeatability and convenient quantitative analysis. The feasibility of the methods to evaluate the jamming effect was proved. It has some extent reference value for the studying and developing on electro-optical countermeasures equipments and effectiveness evaluation.

INTEGRATION OF SPATIAL DATA: METHODS EVALUATION WITH REGARD TO DATA ISSUES AND ASSESSMENT QUESTIONS

EPA Science Inventory

EPA's Regional Vulnerability Assessment (REVA) Program is developing and demonstrating approaches to assess current and future environmental vulnerabilities at a regional scale. An initial effort within this research program has been to develop and evaluate methods to synthesize ...

A Mixed Methods Approach to Understanding School Counseling Program Evaluation: High School Counselors' Methods and Perceptions

ERIC Educational Resources Information Center

Aucoin, Jennifer Mangrum

2013-01-01

The purpose of this mixed methods concurrent triangulation study was to examine the program evaluation practices of high school counselors. A total of 294 high school counselors in Texas were assessed using a mixed methods concurrent triangulation design. A researcher-developed survey, the School Counseling Program Evaluation Questionnaire…

Development of nondestructive methods for measurement of slab thickness and modulus of rupture in concrete pavements.

DOT National Transportation Integrated Search

2005-01-01

This report describes work to develop non-destructive testing methods for concrete pavements. Two methods, for pavement thickness and in-place strength estimation, respectively, were developed and evaluated. The thickness estimation method is based o...

Aeroelastic loads prediction for an arrow wing. Task 1: Evaluation of R. P. White's method

NASA Technical Reports Server (NTRS)

Borland, C. J.; Manro, M. E.

1983-01-01

The separated flow method is evaluated. This method was developed for moderately swept wings with multiple, constant strength vortex systems. The flow on the highly swept wing used in this evaluation is characterized by a single vortex system of continuously varying strength.

Evaluating Health Information Systems Using Ontologies

PubMed Central

Anderberg, Peter; Larsson, Tobias C; Fricker, Samuel A; Berglund, Johan

2016-01-01

Background There are several frameworks that attempt to address the challenges of evaluation of health information systems by offering models, methods, and guidelines about what to evaluate, how to evaluate, and how to report the evaluation results. Model-based evaluation frameworks usually suggest universally applicable evaluation aspects but do not consider case-specific aspects. On the other hand, evaluation frameworks that are case specific, by eliciting user requirements, limit their output to the evaluation aspects suggested by the users in the early phases of system development. In addition, these case-specific approaches extract different sets of evaluation aspects from each case, making it challenging to collectively compare, unify, or aggregate the evaluation of a set of heterogeneous health information systems. Objectives The aim of this paper is to find a method capable of suggesting evaluation aspects for a set of one or more health information systems—whether similar or heterogeneous—by organizing, unifying, and aggregating the quality attributes extracted from those systems and from an external evaluation framework. Methods On the basis of the available literature in semantic networks and ontologies, a method (called Unified eValuation using Ontology; UVON) was developed that can organize, unify, and aggregate the quality attributes of several health information systems into a tree-style ontology structure. The method was extended to integrate its generated ontology with the evaluation aspects suggested by model-based evaluation frameworks. An approach was developed to extract evaluation aspects from the ontology that also considers evaluation case practicalities such as the maximum number of evaluation aspects to be measured or their required degree of specificity. The method was applied and tested in Future Internet Social and Technological Alignment Research (FI-STAR), a project of 7 cloud-based eHealth applications that were developed and deployed across European Union countries. Results The relevance of the evaluation aspects created by the UVON method for the FI-STAR project was validated by the corresponding stakeholders of each case. These evaluation aspects were extracted from a UVON-generated ontology structure that reflects both the internally declared required quality attributes in the 7 eHealth applications of the FI-STAR project and the evaluation aspects recommended by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. The extracted evaluation aspects were used to create questionnaires (for the corresponding patients and health professionals) to evaluate each individual case and the whole of the FI-STAR project. Conclusions The UVON method can provide a relevant set of evaluation aspects for a heterogeneous set of health information systems by organizing, unifying, and aggregating the quality attributes through ontological structures. Those quality attributes can be either suggested by evaluation models or elicited from the stakeholders of those systems in the form of system requirements. The method continues to be systematic, context sensitive, and relevant across a heterogeneous set of health information systems. PMID:27311735

Ignitability test method

NASA Technical Reports Server (NTRS)

Bement, Laurence J.; Schimmel, Morry L.

1989-01-01

To overcome serious weaknesses in determining the performance of initiating devices, a novel 'ignitability test method', representing actual design interfaces and ignition materials, has been developed. Ignition device output consists of heat, light, gas an burning particles. Past research methods have evaluated these parameters individually. This paper describes the development and demonstration of an ignitability test method combining all these parameters, and the quantitative assessment of the ignition performance of two widely used percussion primers, the M42C1-PA101 and the M42C2-793. The ignition materials used for this evaluation were several powder, granule and pellet sizes of black powder and boron-potassium nitrate. This test method should be useful for performance evaluation of all initiator types, quality assurance, evaluation of ignition interfaces, and service life studies of initiators and ignition materials.

Grape colour phenotyping: development of a method based on the reflectance spectrum.

PubMed

Rustioni, Laura; Basilico, Roberto; Fiori, Simone; Leoni, Alessandra; Maghradze, David; Failla, Osvaldo

2013-01-01

The colour of fruit is an important quality factor for cultivar classification and phenotyping techniques. Besides the subjective visual evaluation, new instruments and techniques can be used. This work aims at developping an objective, fast, easy and non-destructive method as a useful support for evaluating grapes' colour under different cultural and environmental conditions, as well as for breeding process and germplasm evaluation, supporting the plant characterization and the biodiversity preservation. Colours of 120 grape varieties were studied using reflectance spectra. The classification was realized using cluster and discriminant analysis. Reflectance of the whole berries surface was also compared with absorption properties of single skin extracts. A phenotyping method based on the reflectance spectra was developed, producing reliable colour classifications. A cultivar-independent index for pigment content evaluation has also been obtained. This work allowed the classification of the berry colour using an objective method. Copyright © 2013 John Wiley & Sons, Ltd.

Unified method to integrate and blend several, potentially related, sources of information for genetic evaluation.

PubMed

Vandenplas, Jérémie; Colinet, Frederic G; Gengler, Nicolas

2014-09-30

A condition to predict unbiased estimated breeding values by best linear unbiased prediction is to use simultaneously all available data. However, this condition is not often fully met. For example, in dairy cattle, internal (i.e. local) populations lead to evaluations based only on internal records while widely used foreign sires have been selected using internally unavailable external records. In such cases, internal genetic evaluations may be less accurate and biased. Because external records are unavailable, methods were developed to combine external information that summarizes these records, i.e. external estimated breeding values and associated reliabilities, with internal records to improve accuracy of internal genetic evaluations. Two issues of these methods concern double-counting of contributions due to relationships and due to records. These issues could be worse if external information came from several evaluations, at least partially based on the same records, and combined into a single internal evaluation. Based on a Bayesian approach, the aim of this research was to develop a unified method to integrate and blend simultaneously several sources of information into an internal genetic evaluation by avoiding double-counting of contributions due to relationships and due to records. This research resulted in equations that integrate and blend simultaneously several sources of information and avoid double-counting of contributions due to relationships and due to records. The performance of the developed equations was evaluated using simulated and real datasets. The results showed that the developed equations integrated and blended several sources of information well into a genetic evaluation. The developed equations also avoided double-counting of contributions due to relationships and due to records. Furthermore, because all available external sources of information were correctly propagated, relatives of external animals benefited from the integrated information and, therefore, more reliable estimated breeding values were obtained. The proposed unified method integrated and blended several sources of information well into a genetic evaluation by avoiding double-counting of contributions due to relationships and due to records. The unified method can also be extended to other types of situations such as single-step genomic or multi-trait evaluations, combining information across different traits.

Participatory methods for Inuit public health promotion and programme evaluation in Nunatsiavut, Canada.

PubMed

Saini, Manpreet

2017-01-01

Engaging stakeholders is crucial for health promotion and programme evaluations; understanding how to best engage stakeholders is less clear, especially within Indigenous communities. The objectives of this thesis research were to use participatory methods to: (1) co-develop and evaluate a whiteboard video for use as a public health promotion tool in Rigolet, Nunatsiavut, and (2) develop and validate a framework for participatory evaluation of Inuit public health initiatives in Nunatsiavut, Labrador. Data collection tools included interactive workshops, community events, interviews, focus-group discussions and surveys. Results indicated the whiteboard video was an engaging and suitable medium for sharing public health messaging due to its contextually relevant elements. Participants identified 4 foundational evaluation framework components necessary to conduct appropriate evaluations, including: (1) community engagement, (2) collaborative evaluation development, (3) tailored evaluation data collection and (4) evaluation scope. This research illustrates stakeholder participation is critical to develop and evaluate contextually relevant public health initiatives in Nunatsiavut, Labrador and should be considered in other Indigenous communities.

Development of the local magnification method for quantitative evaluation of endoscope geometric distortion

NASA Astrophysics Data System (ADS)

Wang, Quanzeng; Cheng, Wei-Chung; Suresh, Nitin; Hua, Hong

2016-05-01

With improved diagnostic capabilities and complex optical designs, endoscopic technologies are advancing. As one of the several important optical performance characteristics, geometric distortion can negatively affect size estimation and feature identification related diagnosis. Therefore, a quantitative and simple distortion evaluation method is imperative for both the endoscopic industry and the medical device regulatory agent. However, no such method is available yet. While the image correction techniques are rather mature, they heavily depend on computational power to process multidimensional image data based on complex mathematical model, i.e., difficult to understand. Some commonly used distortion evaluation methods, such as the picture height distortion (DPH) or radial distortion (DRAD), are either too simple to accurately describe the distortion or subject to the error of deriving a reference image. We developed the basic local magnification (ML) method to evaluate endoscope distortion. Based on the method, we also developed ways to calculate DPH and DRAD. The method overcomes the aforementioned limitations, has clear physical meaning in the whole field of view, and can facilitate lesion size estimation during diagnosis. Most importantly, the method can facilitate endoscopic technology to market and potentially be adopted in an international endoscope standard.

Training Software Developers and Designers to Conduct Usability Evaluations

ERIC Educational Resources Information Center

Skov, Mikael Brasholt; Stage, Jan

2012-01-01

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

Methods for Evaluating Mammography Imaging Techniques

DTIC Science & Technology

1999-06-01

Distribution Unlimited 12b. DIS5TRIBUTION CODE 13. ABSTRACT (Maximum 200 words) This Department of Defense Breast Cancer Research Program Career...Development Award is enabling Dr. Rütter to develop bio’statistical methods for breast cancer research. Dr. Rutter is focusing on methods for...evaluating the accuracy of breast cancer screening. This four year program includes advanced training in the epidemiology of breast cancer , training in

Developing a Mind-Body Exercise Programme for Stressed Children

ERIC Educational Resources Information Center

Wang, Claudia; Seo, Dong-Chul; Geib, Roy W

2017-01-01

Objective: To describe the process of developing a Health Qigong programme for stressed children using a formative evaluation approach. Methods: A multi-step formative evaluation method was utilised. These steps included (1) identifying programme content and drafting the curriculum, (2) synthesising effective and age-appropriate pedagogies, (3)…

Development and Evaluation of an Ontology for Guiding Appropriate Antibiotic Prescribing

PubMed Central

Furuya, E. Yoko; Kuperman, Gilad J.; Cimino, James J.; Bakken, Suzanne

2011-01-01

Objectives To develop and apply formal ontology creation methods to the domain of antimicrobial prescribing and to formally evaluate the resulting ontology through intrinsic and extrinsic evaluation studies. Methods We extended existing ontology development methods to create the ontology and implemented the ontology using Protégé-OWL. Correctness of the ontology was assessed using a set of ontology design principles and domain expert review via the laddering technique. We created three artifacts to support the extrinsic evaluation (set of prescribing rules, alerts and an ontology-driven alert module, and a patient database) and evaluated the usefulness of the ontology for performing knowledge management tasks to maintain the ontology and for generating alerts to guide antibiotic prescribing. Results The ontology includes 199 classes, 10 properties, and 1,636 description logic restrictions. Twenty-three Semantic Web Rule Language rules were written to generate three prescribing alerts: 1) antibiotic-microorganism mismatch alert; 2) medication-allergy alert; and 3) non-recommended empiric antibiotic therapy alert. The evaluation studies confirmed the correctness of the ontology, usefulness of the ontology for representing and maintaining antimicrobial treatment knowledge rules, and usefulness of the ontology for generating alerts to provide feedback to clinicians during antibiotic prescribing. Conclusions This study contributes to the understanding of ontology development and evaluation methods and addresses one knowledge gap related to using ontologies as a clinical decision support system component—a need for formal ontology evaluation methods to measure their quality from the perspective of their intrinsic characteristics and their usefulness for specific tasks. PMID:22019377

A Multimodal Deep Log-Based User Experience (UX) Platform for UX Evaluation

PubMed Central

Ali Khan, Wajahat; Hur, Taeho; Muhammad Bilal, Hafiz Syed; Ul Hassan, Anees; Lee, Sungyoung

2018-01-01

The user experience (UX) is an emerging field in user research and design, and the development of UX evaluation methods presents a challenge for both researchers and practitioners. Different UX evaluation methods have been developed to extract accurate UX data. Among UX evaluation methods, the mixed-method approach of triangulation has gained importance. It provides more accurate and precise information about the user while interacting with the product. However, this approach requires skilled UX researchers and developers to integrate multiple devices, synchronize them, analyze the data, and ultimately produce an informed decision. In this paper, a method and system for measuring the overall UX over time using a triangulation method are proposed. The proposed platform incorporates observational and physiological measurements in addition to traditional ones. The platform reduces the subjective bias and validates the user’s perceptions, which are measured by different sensors through objectification of the subjective nature of the user in the UX assessment. The platform additionally offers plug-and-play support for different devices and powerful analytics for obtaining insight on the UX in terms of multiple participants. PMID:29783712

A Multimodal Deep Log-Based User Experience (UX) Platform for UX Evaluation.

PubMed

Hussain, Jamil; Khan, Wajahat Ali; Hur, Taeho; Bilal, Hafiz Syed Muhammad; Bang, Jaehun; Hassan, Anees Ul; Afzal, Muhammad; Lee, Sungyoung

2018-05-18

The user experience (UX) is an emerging field in user research and design, and the development of UX evaluation methods presents a challenge for both researchers and practitioners. Different UX evaluation methods have been developed to extract accurate UX data. Among UX evaluation methods, the mixed-method approach of triangulation has gained importance. It provides more accurate and precise information about the user while interacting with the product. However, this approach requires skilled UX researchers and developers to integrate multiple devices, synchronize them, analyze the data, and ultimately produce an informed decision. In this paper, a method and system for measuring the overall UX over time using a triangulation method are proposed. The proposed platform incorporates observational and physiological measurements in addition to traditional ones. The platform reduces the subjective bias and validates the user's perceptions, which are measured by different sensors through objectification of the subjective nature of the user in the UX assessment. The platform additionally offers plug-and-play support for different devices and powerful analytics for obtaining insight on the UX in terms of multiple participants.

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Ordinal preference elicitation methods in health economics and health services research: using discrete choice experiments and ranking methods.

PubMed

Ali, Shehzad; Ronaldson, Sarah

2012-09-01

The predominant method of economic evaluation is cost-utility analysis, which uses cardinal preference elicitation methods, including the standard gamble and time trade-off. However, such approach is not suitable for understanding trade-offs between process attributes, non-health outcomes and health outcomes to evaluate current practices, develop new programmes and predict demand for services and products. Ordinal preference elicitation methods including discrete choice experiments and ranking methods are therefore commonly used in health economics and health service research. Cardinal methods have been criticized on the grounds of cognitive complexity, difficulty of administration, contamination by risk and preference attitudes, and potential violation of underlying assumptions. Ordinal methods have gained popularity because of reduced cognitive burden, lower degree of abstract reasoning, reduced measurement error, ease of administration and ability to use both health and non-health outcomes. The underlying assumptions of ordinal methods may be violated when respondents use cognitive shortcuts, or cannot comprehend the ordinal task or interpret attributes and levels, or use 'irrational' choice behaviour or refuse to trade-off certain attributes. CURRENT USE AND GROWING AREAS: Ordinal methods are commonly used to evaluate preference for attributes of health services, products, practices, interventions, policies and, more recently, to estimate utility weights. AREAS FOR ON-GOING RESEARCH: There is growing research on developing optimal designs, evaluating the rationalization process, using qualitative tools for developing ordinal methods, evaluating consistency with utility theory, appropriate statistical methods for analysis, generalizability of results and comparing ordinal methods against each other and with cardinal measures.

Indicators and Metrics for Evaluating the Sustainability of Chemical Processes

EPA Science Inventory

A metric-based method, called GREENSCOPE, has been developed for evaluating process sustainability. Using lab-scale information and engineering assumptions the method evaluates full-scale epresentations of processes in environmental, efficiency, energy and economic areas. The m...

Evaluating the safety effects of signal improvements.

DOT National Transportation Integrated Search

2013-08-01

There is a need to evaluate the effectiveness of the traffic signal improvements through the development of Crash Modification Factors (CMFs). Recent research has shown that traditional safety evaluation methods have been inadequate in developing CMF...

Building clinical networks: a developmental evaluation framework.

PubMed

Carswell, Peter; Manning, Benjamin; Long, Janet; Braithwaite, Jeffrey

2014-05-01

Clinical networks have been designed as a cross-organisational mechanism to plan and deliver health services. With recent concerns about the effectiveness of these structures, it is timely to consider an evidence-informed approach for how they can be developed and evaluated. To document an evaluation framework for clinical networks by drawing on the network evaluation literature and a 5-year study of clinical networks. We searched literature in three domains: network evaluation, factors that aid or inhibit network development, and on robust methods to measure network characteristics. This material was used to build a framework required for effective developmental evaluation. The framework's architecture identifies three stages of clinical network development; partner selection, network design and network management. Within each stage is evidence about factors that act as facilitators and barriers to network growth. These factors can be used to measure progress via appropriate methods and tools. The framework can provide for network growth and support informed decisions about progress. For the first time in one place a framework incorporating rigorous methods and tools can identify factors known to affect the development of clinical networks. The target user group is internal stakeholders who need to conduct developmental evaluation to inform key decisions along their network's developmental pathway.

An Evaluation of Methods for Assessing Vulnerability of Army Installations toImpacts of Climate Change on Listed and At-Risk Species

DTIC Science & Technology

2017-07-01

ER D C/ CE RL T R- 17 -2 5 Army Environmental Quality Technology An Evaluation of Methods for Assessing Vulnerability of Army...Evaluation of Methods for Assessing Vulnerability of Army Installations to Impacts of Climate Change on Listed and At-Risk Species Matthew G. Hohmann...their suitability for informing BRAC-related evaluations. Three recently developed methods for assessing the vulnerability of Army installations to

A Tool for the Automated Design and Evaluation of Habitat Interior Layouts

NASA Technical Reports Server (NTRS)

Simon, Matthew A.; Wilhite, Alan W.

2013-01-01

The objective of space habitat design is to minimize mass and system size while providing adequate space for all necessary equipment and a functional layout that supports crew health and productivity. Unfortunately, development and evaluation of interior layouts is often ignored during conceptual design because of the subjectivity and long times required using current evaluation methods (e.g., human-in-the-loop mockup tests and in-depth CAD evaluations). Early, more objective assessment could prevent expensive design changes that may increase vehicle mass and compromise functionality. This paper describes a new interior design evaluation method to enable early, structured consideration of habitat interior layouts. This interior layout evaluation method features a comprehensive list of quantifiable habitat layout evaluation criteria, automatic methods to measure these criteria from a geometry model, and application of systems engineering tools and numerical methods to construct a multi-objective value function measuring the overall habitat layout performance. In addition to a detailed description of this method, a C++/OpenGL software tool which has been developed to implement this method is also discussed. This tool leverages geometry modeling coupled with collision detection techniques to identify favorable layouts subject to multiple constraints and objectives (e.g., minimize mass, maximize contiguous habitable volume, maximize task performance, and minimize crew safety risks). Finally, a few habitat layout evaluation examples are described to demonstrate the effectiveness of this method and tool to influence habitat design.

Evaluating Health Information Systems Using Ontologies.

PubMed

Eivazzadeh, Shahryar; Anderberg, Peter; Larsson, Tobias C; Fricker, Samuel A; Berglund, Johan

2016-06-16

There are several frameworks that attempt to address the challenges of evaluation of health information systems by offering models, methods, and guidelines about what to evaluate, how to evaluate, and how to report the evaluation results. Model-based evaluation frameworks usually suggest universally applicable evaluation aspects but do not consider case-specific aspects. On the other hand, evaluation frameworks that are case specific, by eliciting user requirements, limit their output to the evaluation aspects suggested by the users in the early phases of system development. In addition, these case-specific approaches extract different sets of evaluation aspects from each case, making it challenging to collectively compare, unify, or aggregate the evaluation of a set of heterogeneous health information systems. The aim of this paper is to find a method capable of suggesting evaluation aspects for a set of one or more health information systems-whether similar or heterogeneous-by organizing, unifying, and aggregating the quality attributes extracted from those systems and from an external evaluation framework. On the basis of the available literature in semantic networks and ontologies, a method (called Unified eValuation using Ontology; UVON) was developed that can organize, unify, and aggregate the quality attributes of several health information systems into a tree-style ontology structure. The method was extended to integrate its generated ontology with the evaluation aspects suggested by model-based evaluation frameworks. An approach was developed to extract evaluation aspects from the ontology that also considers evaluation case practicalities such as the maximum number of evaluation aspects to be measured or their required degree of specificity. The method was applied and tested in Future Internet Social and Technological Alignment Research (FI-STAR), a project of 7 cloud-based eHealth applications that were developed and deployed across European Union countries. The relevance of the evaluation aspects created by the UVON method for the FI-STAR project was validated by the corresponding stakeholders of each case. These evaluation aspects were extracted from a UVON-generated ontology structure that reflects both the internally declared required quality attributes in the 7 eHealth applications of the FI-STAR project and the evaluation aspects recommended by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. The extracted evaluation aspects were used to create questionnaires (for the corresponding patients and health professionals) to evaluate each individual case and the whole of the FI-STAR project. The UVON method can provide a relevant set of evaluation aspects for a heterogeneous set of health information systems by organizing, unifying, and aggregating the quality attributes through ontological structures. Those quality attributes can be either suggested by evaluation models or elicited from the stakeholders of those systems in the form of system requirements. The method continues to be systematic, context sensitive, and relevant across a heterogeneous set of health information systems.

Evaluation of evidence-based literature and formulation of recommendations for the clinical preventive guidelines for immigrants and refugees in Canada

PubMed Central

Tugwell, Peter; Pottie, Kevin; Welch, Vivian; Ueffing, Erin; Chambers, Andrea; Feightner, John

2011-01-01

Background: This article describes the evidence review and guideline development method developed for the Clinical Preventive Guidelines for Immigrants and Refugees in Canada by the Canadian Collaboration for Immigrant and Refugee Health Guideline Committee. Methods: The Appraisal of Guidelines for Research and Evaluation (AGREE) best-practice framework was combined with the recently developed Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to produce evidence-based clinical guidelines for immigrants and refugees in Canada. Results: A systematic approach was designed to produce the evidence reviews and apply the GRADE approach, including building on evidence from previous systematic reviews, searching for and comparing evidence between general and specific immigrant populations, and applying the GRADE criteria for making recommendations. This method was used for priority health conditions that had been selected by practitioners caring for immigrants and refugees in Canada. Interpretation: This article outlines the 14-step method that was defined to standardize the guideline development process for each priority health condition. PMID:20573711

Software Architecture Evaluation in Global Software Development Projects

NASA Astrophysics Data System (ADS)

Salger, Frank

Due to ever increasing system complexity, comprehensive methods for software architecture evaluation become more and more important. This is further stressed in global software development (GSD), where the software architecture acts as a central knowledge and coordination mechanism. However, existing methods for architecture evaluation do not take characteristics of GSD into account. In this paper we discuss what aspects are specific for architecture evaluations in GSD. Our experiences from GSD projects at Capgemini sd&m indicate, that architecture evaluations differ in how rigorously one has to assess modularization, architecturally relevant processes, knowledge transfer and process alignment. From our project experiences, we derive nine good practices, the compliance to which should be checked in architecture evaluations in GSD. As an example, we discuss how far the standard architecture evaluation method used at Capgemini sd&m already considers the GSD-specific good practices, and outline what extensions are necessary to achieve a comprehensive architecture evaluation framework for GSD.

FIELD VALIDATION OF SEDIMENT TOXCITY IDENTIFCATION AND EVALUATION METHODS

EPA Science Inventory

Sediment Toxicity Identification and Evaluation (TIE) methods have been developed for both porewaters and whole sediments. These relatively simple laboratory methods are designed to identify specific toxicants or classes of toxicants in sediments; however, the question of whethe...

The use of individualized contract plans as a method of performance evaluation for allied health faculty.

PubMed

Mitcham, M D; Vericella, B J

1985-11-01

Results from a two-year study of the individualized contract plan (ICP) approach to faculty evaluation indicate this is a workable method of performance evaluation for allied health faculty. The ICP was found to be individualized, systematic, flexible, and objective. Faculty members and department chairpersons differed in their perception of the effectiveness of the ICP, but both groups supported its continued use. Five major recommendations were made regarding the continued use of the ICP as a method of faculty performance evaluation: (1) separate evaluation and professional development aspects, (2) link results to the institutional reward structure, (3) administer the ICP uniformly among departments, (4) develop a monitoring mechanism, and (5) foster open communication among all participants in the system.

The development and validation of The Inquiry Science Observation Coding Sheet.

PubMed

Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M

2008-08-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.

Developments in purification methods for obtaining and evaluation of collagen derived endogenous angioinhibitors

PubMed Central

Gunda, Venugopal; Verma, Raj K.; Pawar, Smita C.; Sudhakar, Yakkanti A.

2013-01-01

Collagen constitutes one of the vital components of the basement membrane scaffolds. Non-collagenous domains (NC1) derived from collagens exhibit potent anti-angiogenic properties, thus attaining significance in regulation of angiogenesis promoted diseases. Individual NC1 domains essential for anti-angiogenic evaluations are generally obtained through purification of individual non-collagenous domains, which have undergone steady developments for enhancing the yields, purpose of biological evaluations and solubility based on the nature of different NC1 domains. This review focuses on the method developments in obtaining biologically active NC1 domains and for specific evaluations in different scenarios. PMID:24215863

Evaluation and comparison of predictive individual-level general surrogates.

PubMed

Gabriel, Erin E; Sachs, Michael C; Halloran, M Elizabeth

2018-07-01

An intermediate response measure that accurately predicts efficacy in a new setting at the individual level could be used both for prediction and personalized medical decisions. In this article, we define a predictive individual-level general surrogate (PIGS), which is an individual-level intermediate response that can be used to accurately predict individual efficacy in a new setting. While methods for evaluating trial-level general surrogates, which are predictors of trial-level efficacy, have been developed previously, few, if any, methods have been developed to evaluate individual-level general surrogates, and no methods have formalized the use of cross-validation to quantify the expected prediction error. Our proposed method uses existing methods of individual-level surrogate evaluation within a given clinical trial setting in combination with cross-validation over a set of clinical trials to evaluate surrogate quality and to estimate the absolute prediction error that is expected in a new trial setting when using a PIGS. Simulations show that our method performs well across a variety of scenarios. We use our method to evaluate and to compare candidate individual-level general surrogates over a set of multi-national trials of a pentavalent rotavirus vaccine.

Comprehensive evaluation on low-carbon development of coal enterprise groups.

PubMed

Wang, Bang-Jun; Wu, Yan-Fang; Zhao, Jia-Lu

2017-12-19

Scientifically evaluating the level of low-carbon development in terms of theoretical and practical significance is extremely important to coal enterprise groups for implementing national energy-related systems. This assessment can assist in building institutional mechanisms that are conducive for the economic development of coal business cycle and energy conservation as well as promoting the healthy development of coal enterprises to realize coal scientific development and resource utilization. First, by adopting systematic analysis method, this study builds low-carbon development evaluation index system for coal enterprise groups. Second, to determine the weight serving as guideline and criteria of the index, analytic hierarchy process (AHP) is applied using integrated linear weighted sum method to evaluate the level of low-carbon development of coal enterprise groups. Evaluation is also performed by coal enterprise groups, and the process comprises field analysis and evaluation. Finally, industrial policies are proposed regarding the development of low-carbon coal conglomerate strategies and measures. This study aims mainly to guide the low-carbon development of coal enterprise groups, solve the problem of coal mining and the destruction of ecological environment, support the conservation of raw materials and various resources, and achieve the sustainable development of the coal industry.

Monitoring and evaluation of patient involvement in clinical practice guideline development: lessons from the Multidisciplinary Guideline for Employment and Severe Mental Illness, the Netherlands.

PubMed

van der Ham, Alida J; van Erp, Nicole; Broerse, Jacqueline E W

2016-04-01

The aim of this study was to gain better insight into the quality of patient participation in the development of clinical practice guidelines and to contribute to approaches for the monitoring and evaluation of such initiatives. In addition, we explore the potential of a dialogue-based approach for reconciliation of preferences of patients and professionals in the guideline development processes. The development of the Multidisciplinary Guideline for Employment and Severe Mental Illness in the Netherlands served as a case study. Methods for patient involvement in guideline development included the following: four patient representatives in the development group and advisory committee, two focus group discussions with patients, a dialogue session and eight case studies. To evaluate the quality of patient involvement, we developed a monitoring and evaluation framework including both process and outcome criteria. Data collection included observations, document analysis and semi-structured interviews (n = 26). The quality of patient involvement was enhanced using different methods, reflection of patient input in the guideline text, a supportive attitude among professionals and attention to patient involvement throughout the process. The quality was lower with respect to representing the diversity of the target group, articulation of the patient perspective in the GDG, and clarity and transparency concerning methods of involvement. The monitoring and evaluation framework was useful in providing detailed insights into patient involvement in guideline development. Patient involvement was evaluated as being of good quality. The dialogue-based approach appears to be a promising method for obtaining integrated stakeholder input in a multidisciplinary setting. © 2015 John Wiley & Sons Ltd.

DEVELOPMENT OF CRITERIA AND METHODS FOR EVALUATING TRAINER AIRCRAFT EFFECTIVENESS.

ERIC Educational Resources Information Center

KUSEWITT, J.B.

THE PURPOSE OF THIS STUDY WAS TO DEVELOP A METHOD FOR DETERMINING OBJECTIVE MEASURES OF TRAINER AIRCRAFT EFFECTIVENESS TO EVALUATE PROGRAM ALTERNATIVES FOR TRAINING PILOTS FOR FLEET FIGHTER AND ATTACK-TYPE AIRCRAFT. THE TRAINING SYLLABUS WAS BASED ON AVERAGE STUDENT ABILITY. THE BASIC PROBLEM WAS TO ESTABLISH QUANTITATIVE TIME-DIFFICULTY…

Development of practical diagnostic methods for monitoring rice bacterial panicle blight disease and evaluation of rice germplasm for resistance

USDA-ARS?s Scientific Manuscript database

A study was initiated to understand Burkholderia glumae, the major causal agent for bacterial panicle blight disease of rice; to develop practical diagnostic methods for monitoring the disease; and to evaluate rice germplasm for resistance. Burkholderia glumae was frequently isolated from infected p...

Development of practical diagnostic methods for monitoring rice bacterial panicle blight disease and evaluation of rice germplasm for resistance

USDA-ARS?s Scientific Manuscript database

A study was initiated to understand Burkholderia glumae (major causal agent for bacterial panicle blight disease of rice) to develop practical diagnostic methods for monitoring the disease; and to evaluate rice germplasm for resistance. B. glumae was frequently isolated from symptomatic panicles on...

Acoustic evaluation of standing trees : recent research development

Treesearch

Xiping Wang; Robert J. Ross; Peter Carter

2005-01-01

This paper presents some research results from recent trial studies on measuring acoustic velocities on standing trees of five softwood species. The relationships between tree velocities measured by time of flight method and log velocities measured by resonance method were evaluated. Theoretical and empirical models were developed for adjusting observed tree velocity...

Method Development and Monitoring of Cyanotoxins in Water ...

EPA Pesticide Factsheets

This presentation describes method development of two ambient water LC/MS/MS methods for microcystins, cylindrospermopsin and anatoxin-a. Ruggedness of the methods will be demonstrated by evaluation of quality control samples derived from various water bodies across the country. Presentation at the Central Regional meeting of the American Chemical Society ambient water methods development for cyanotoxins

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

PubMed

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

Integrate Evaluation into the Planning Process.

ERIC Educational Resources Information Center

Camp, William

1985-01-01

In an attempt to correct for limitations in the Program Evaluation and Review Technique-Critical Path Method (PERT-CPM), the Graphical Evaluation and Review Technique (GERT) has been developed. This management tool allows for evaluation during the facilities' development process. Two figures and two references are provided. (DCS)

Multidisciplinary eHealth Survey Evaluation Methods

ERIC Educational Resources Information Center

Karras, Bryant T.; Tufano, James T.

2006-01-01

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

Study on the evaluation method for fault displacement based on characterized source model

NASA Astrophysics Data System (ADS)

Tonagi, M.; Takahama, T.; Matsumoto, Y.; Inoue, N.; Irikura, K.; Dalguer, L. A.

2016-12-01

In IAEA Specific Safety Guide (SSG) 9 describes that probabilistic methods for evaluating fault displacement should be used if no sufficient basis is provided to decide conclusively that the fault is not capable by using the deterministic methodology. In addition, International Seismic Safety Centre compiles as ANNEX to realize seismic hazard for nuclear facilities described in SSG-9 and shows the utility of the deterministic and probabilistic evaluation methods for fault displacement. In Japan, it is required that important nuclear facilities should be established on ground where fault displacement will not arise when earthquakes occur in the future. Under these situations, based on requirements, we need develop evaluation methods for fault displacement to enhance safety in nuclear facilities. We are studying deterministic and probabilistic methods with tentative analyses using observed records such as surface fault displacement and near-fault strong ground motions of inland crustal earthquake which fault displacements arose. In this study, we introduce the concept of evaluation methods for fault displacement. After that, we show parts of tentative analysis results for deterministic method as follows: (1) For the 1999 Chi-Chi earthquake, referring slip distribution estimated by waveform inversion, we construct a characterized source model (Miyake et al., 2003, BSSA) which can explain observed near-fault broad band strong ground motions. (2) Referring a characterized source model constructed in (1), we study an evaluation method for surface fault displacement using hybrid method, which combines particle method and distinct element method. At last, we suggest one of the deterministic method to evaluate fault displacement based on characterized source model. This research was part of the 2015 research project `Development of evaluating method for fault displacement` by the Secretariat of Nuclear Regulation Authority (S/NRA), Japan.

Method Development and Monitoring of Cyanotoxins in Water

EPA Science Inventory

This presentation describes method development of two ambient water LC/MS/MS methods for microcystins, cylindrospermopsin and anatoxin-a. Ruggedness of the methods will be demonstrated by evaluation of quality control samples derived from various water bodies across the country.

A new integrated evaluation method of heavy metals pollution control during melting and sintering of MSWI fly ash.

PubMed

Li, Rundong; Li, Yanlong; Yang, Tianhua; Wang, Lei; Wang, Weiyun

2015-05-30

Evaluations of technologies for heavy metal control mainly examine the residual and leaching rates of a single heavy metal, such that developed evaluation method have no coordination or uniqueness and are therefore unsuitable for hazard control effect evaluation. An overall pollution toxicity index (OPTI) was established in this paper, based on the developed index, an integrated evaluation method of heavy metal pollution control was established. Application of this method in the melting and sintering of fly ash revealed the following results: The integrated control efficiency of the melting process was higher in all instances than that of the sintering process. The lowest integrated control efficiency of melting was 56.2%, and the highest integrated control efficiency of sintering was 46.6%. Using the same technology, higher integrated control efficiency conditions were all achieved with lower temperatures and shorter times. This study demonstrated the unification and consistency of this method. Copyright © 2015 Elsevier B.V. All rights reserved.

3. Evaluation of unstable lands for interagency watershed analysis

Treesearch

Leslie M. Reid; Robert R. Ziemer; Mark E. Smith; Colin Close

1994-01-01

Abstract - Although methods for evaluating landslide rates and distributions are well developed, much less attention has been paid to evaluating the biological and physical role of landsliding. New directions in land management on Federal lands of the Pacific Northwest now require such evaluations for designing Riparian Reserves. Traditional analysis methods are no...

Quantitative method of medication system interface evaluation.

PubMed

Pingenot, Alleene Anne; Shanteau, James; Pingenot, James D F

2007-01-01

The objective of this study was to develop a quantitative method of evaluating the user interface for medication system software. A detailed task analysis provided a description of user goals and essential activity. A structural fault analysis was used to develop a detailed description of the system interface. Nurses experienced with use of the system under evaluation provided estimates of failure rates for each point in this simplified fault tree. Means of estimated failure rates provided quantitative data for fault analysis. Authors note that, although failures of steps in the program were frequent, participants reported numerous methods of working around these failures so that overall system failure was rare. However, frequent process failure can affect the time required for processing medications, making a system inefficient. This method of interface analysis, called Software Efficiency Evaluation and Fault Identification Method, provides quantitative information with which prototypes can be compared and problems within an interface identified.

Conserving biodiversity and ecosystem function through limited development: an empirical evaluation.

PubMed

Milder, Jeffrey C; Lassoie, James P; Bedford, Barbara L

2008-02-01

Suburban, exurban, and rural development in the United States consumes nearly 1 million hectares of land per year and is a leading threat to biodiversity. In response to this threat, conservation development has been advanced as a way to combine land development and land conservation while providing functional protection for natural resources. Yet, although conservation development techniques have been in use for decades, there have been few critical evaluations of their conservation effectiveness. We addressed this deficiency by assessing the conservation outcomes of one type of conservation development project: conservation and limited development projects (CLDPs). Conducted by land trusts, landowners, and developers, CLDPs use revenue from limited development to finance the protection of land and natural resources. We compared a sample of 10 CLDPs from the eastern United States with their respective baseline scenarios (conventional development) and with a sample of conservation subdivisions--a different conservation development technique characterized by higher-density development. To measure conservation success, we created an evaluation method containing eight indicators that quantify project impacts to terrestrial and aquatic ecosystems at the site and in the surrounding landscape. The CLDPs protected and managed threatened natural resources including rare species and ecological communities. In terms of conservation benefits, the CLDPs significantly outperformed their respective baseline scenarios and the conservation subdivisions. These results imply that CLDPs can offer a low-impact alternative to conventional development and a low-cost method for protecting land when conventional conservation techniques are too expensive. In addition, our evaluation method demonstrates how planners and developers can incorporate appropriate ecological considerations when designing, reviewing, and evaluating conservation development projects.

Do Toxicity Identification and Evaluation Laboratory-Based Methods Reflect Causes of Field Impairment?

EPA Science Inventory

Sediment Toxicity Identification and Evaluation (TIE) methods have been developed for both interstitial waters and whole sediments. These relatively simple laboratory methods are designed to identify specific toxicants or classes of toxicants in sediments; however, the question ...

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

NASA Astrophysics Data System (ADS)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will provide insight into how a mixed methods approach was used to provide stakeholders with important information about progress toward program goals. Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed approaches. Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. D. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Stern, E; Stame, N; Mayne, J; Forss, K; Davis, R & Befani, B (2012) Broadening the range of designs and methods for impact evaluation. Department for International Development.

User Experience Evaluation Methods in Product Development (UXEM'09)

NASA Astrophysics Data System (ADS)

Roto, Virpi; Väänänen-Vainio-Mattila, Kaisa; Law, Effie; Vermeeren, Arnold

High quality user experience (UX) has become a central competitive factor of product development in mature consumer markets [1]. Although the term UX originated from industry and is a widely used term also in academia, the tools for managing UX in product development are still inadequate. A prerequisite for designing delightful UX in an industrial setting is to understand both the requirements tied to the pragmatic level of functionality and interaction and the requirements pertaining to the hedonic level of personal human needs, which motivate product use [2]. Understanding these requirements helps managers set UX targets for product development. The next phase in a good user-centered design process is to iteratively design and evaluate prototypes [3]. Evaluation is critical for systematically improving UX. In many approaches to UX, evaluation basically needs to be postponed until the product is fully or at least almost fully functional. However, in an industrial setting, it is very expensive to find the UX failures only at this phase of product development. Thus, product development managers and developers have a strong need to conduct UX evaluation as early as possible, well before all the parts affecting the holistic experience are available. Different types of products require evaluation on different granularity and maturity levels of a prototype. For example, due to its multi-user characteristic, a community service or an enterprise resource planning system requires a broader scope of UX evaluation than a microwave oven or a word processor that is meant for a single user at a time. Before systematic UX evaluation can be taken into practice, practical, lightweight UX evaluation methods suitable for different types of products and different phases of product readiness are needed. A considerable amount of UX research is still about the conceptual frameworks and models for user experience [4]. Besides, applying existing usability evaluation methods (UEMs) without adaptation to evaluate UX may lead to some scoping issues. Consequently, there is a strong need to put UX evaluation from research into practice.

Development and evaluation of an off-the-slide genotyping technique for identifying Giardia cysts and Cryptosporidium oocysts directly from US EPA Method 1623 slides

EPA Science Inventory

ABSTRACT Aims This study developed and systematically evaluated performance and limit of detection of an off-the-slide genotyping procedure for both Cryptosporidium oocysts and Giardia cysts. Methods and Results Slide standards containing flow sorted (oo)cysts were used to e...

Providing a Science Base for the Evaluation of Tobacco Products

PubMed Central

Berman, Micah L.; Connolly, Greg; Cummings, K. Michael; Djordjevic, Mirjana V.; Hatsukami, Dorothy K.; Henningfield, Jack E.; Myers, Matthew; O'Connor, Richard J.; Parascandola, Mark; Rees, Vaughan; Rice, Jerry M.

2015-01-01

Objective Evidence-based tobacco regulation requires a comprehensive scientific framework to guide the evaluation of new tobacco products and health-related claims made by product manufacturers. Methods The Tobacco Product Assessment Consortium (TobPRAC) employed an iterative process involving consortia investigators, consultants, a workshop of independent scientists and public health experts, and written reviews in order to develop a conceptual framework for evaluating tobacco products. Results The consortium developed a four-phased framework for the scientific evaluation of tobacco products. The four phases addressed by the framework are: (1) pre-market evaluation, (2) pre-claims evaluation, (3) post-market activities, and (4) monitoring and re-evaluation. For each phase, the framework proposes the use of validated testing procedures that will evaluate potential harms at both the individual and population level. Conclusions While the validation of methods for evaluating tobacco products is an ongoing and necessary process, the proposed framework need not wait for fully validated methods to be used in guiding tobacco product regulation today. PMID:26665160

Recommendations for the evaluation of specimen stability for flow cytometric testing during drug development.

PubMed

Brown, Lynette; Green, Cherie L; Jones, Nicholas; Stewart, Jennifer J; Fraser, Stephanie; Howell, Kathy; Xu, Yuanxin; Hill, Carla G; Wiwi, Christopher A; White, Wendy I; O'Brien, Peter J; Litwin, Virginia

2015-03-01

The objective of this manuscript is to present an approach for evaluating specimen stability for flow cytometric methods used during drug development. While this approach specifically addresses stability assessment for assays to be used in clinical trials with centralized testing facilities, the concepts can be applied to any stability assessment for flow cytometric methods. The proposed approach is implemented during assay development and optimization, and includes suggestions for designing a stability assessment plan, data evaluation and acceptance criteria. Given that no single solution will be applicable in all scenarios, this manuscript offers the reader a roadmap for stability assessment and is intended to guide the investigator during both the method development phase and in the experimental design of the validation plan. Copyright © 2015 Elsevier B.V. All rights reserved.

A Guide for Monitoring District Implementation of Educator Evaluation Systems. REL 2015-069

ERIC Educational Resources Information Center

Cherasaro, Trudy; Yanoski, David; Swackhamer, Lyn

2015-01-01

This guide was developed to provide guidance to states or districts wishing to monitor implementation of educator evaluation systems. It describes a three-step process: develop state guidelines for educator evaluation systems; develop data collection methods; and determine adherence criteria and review data against criteria. The process was…

Development of a Double Glass Mounting Method Using Formaldehyde Alcohol Azocarmine Lactophenol (FAAL) and its Evaluation for Permanent Mounting of Small Nematodes

PubMed Central

ZAHABIUN, Farzaneh; SADJJADI, Seyed Mahmoud; ESFANDIARI, Farideh

2015-01-01

Background: Permanent slide preparation of nematodes especially small ones is time consuming, difficult and they become scarious margins. Regarding this problem, a modified double glass mounting method was developed and compared with classic method. Methods: A total of 209 nematode samples from human and animal origin were fixed and stained with Formaldehyde Alcohol Azocarmine Lactophenol (FAAL) followed by double glass mounting and classic dehydration method using Canada balsam as their mounting media. The slides were evaluated in different dates and times, more than four years. Different photos were made with different magnification during the evaluation time. Results: The double glass mounting method was stable during this time and comparable with classic method. There were no changes in morphologic structures of nematodes using double glass mounting method with well-defined and clear differentiation between different organs of nematodes in this method. Conclusion: Using this method is cost effective and fast for mounting of small nematodes comparing to classic method. PMID:26811729

Evaluating the effectiveness of case method instruction in technical communication

NASA Technical Reports Server (NTRS)

Feinberg, S. G.

1981-01-01

The effectiveness of the case method as an instructional technique in improving technical writing was evaluated. The development of a self-report instrument that attempts to measure changes in attitude toward technical communication and the presentation results change are the purpose of this paper. Standards for developing a case set forth by Goldstein and Couture, were used to design an evaluation instrument to measure the effect instruction on student attitude toward technical communication. This self-report instrument is based on model developed and tested by Daly and Miller who studied writer attitude and apprehension toward writing. It was the most important objective of any evaluation is to provide information for improving the program.

Development of delineator testing standard.

DOT National Transportation Integrated Search

2015-02-01

The objective of this project was to develop a new test method for evaluating the impact performance : of delineators for given applications. The researchers focused on developing a test method that was : reproducible and attempted to reproduce failu...

Performance of human fecal anaerobe-associated PCR-based assays in a multi-laboratory method evaluation study

EPA Science Inventory

A number of PCR-based methods for detecting human fecal material in environmental waters have been developed over the past decade, but these methods have rarely received independent comparative testing. Here, we evaluated ten of these methods (BacH, BacHum-UCD, B. thetaiotaomic...

A rapid method for soil cement design : Louisiana slope value method : part II : evaluation.

DOT National Transportation Integrated Search

1966-05-01

This report is an evaluation of the recently developed "Louisiana Slope Value Method". : The conclusion drawn are based on data from 637 separate samples representing nearly all major soil groups in Louisiana that are suitable for cement stabilizatio...

Rural school nurse perception of book studies as an effective method for professional development.

PubMed

Gray, Lorali

2014-05-01

School nurses who serve public school districts in rural Northwest Washington face barriers in accessing Continuing Education (CE) for professional development as they often practice in remote, isolated school communities. Acknowledging these barriers, the author discusses the inclusion of book studies within an existing training structure as an innovative method of providing professional development. By utilizing training that is already attended by rural school nurses, CE can be enhanced without incurring additional travel, cost, or training time. The school nurse's perception of the effectiveness of book studies as a CE method was examined per a descriptive, qualitative program evaluation. Over a period of 5 years, evaluation and feedback data from 12 rural school nurses were compiled from nine individual school nurse book study evaluations and one general satisfaction survey. Findings indicated overall school nurse satisfaction and belief that school nurse book studies are an effective and beneficial method for the delivery of professional development--a method that promotes collaborative learning and collegiality, informs practice, and provides insight into the broader health and social issues impacting today's students.

Criteria for evaluating the condition of a tropical cyclone warning system.

PubMed

Parker, D

1999-09-01

This paper evaluates the condition (i.e. health) of a tropical cyclone warning system (TCWS) during a 'quiet period' between infrequent intense cyclones. Capacity to make pre-disaster evaluations is important--disaster warning systems need to be in sound condition before, not after, disaster. The research--part of the UK's International Decade of Natural Disaster Reduction Flagship Programme--focuses upon an evaluatory method first used on flood warning systems. The Criteria-development Matrix comprises social, organisational and institutional criteria by which a TCWS may be assessed using a five-stage development scale. This method is used to evaluate Mauritius's TCWS using in-depth interview data. Ways to enhance the method and apply it to other disaster warning systems are discussed. The TCWS in Mauritius is a relatively sound one from which others can learn. Weaknesses requiring attention for Mauritius's TCWS to progress to an advanced level of development are identified.

A Method to Calculate and Analyze Residents' Evaluations by Using a Microcomputer Data-Base Management System.

ERIC Educational Resources Information Center

Mills, Myron L.

1988-01-01

A system developed for more efficient evaluation of graduate medical students' progress uses numerical scoring and a microcomputer database management system as an alternative to manual methods to produce accurate, objective, and meaningful summaries of resident evaluations. (Author/MSE)

Summarizing Expository Texts

ERIC Educational Resources Information Center

Westby, Carol; Culatta, Barbara; Lawrence, Barbara; Hall-Kenyon, Kendra

2010-01-01

Purpose: This article reviews the literature on students' developing skills in summarizing expository texts and describes strategies for evaluating students' expository summaries. Evaluation outcomes are presented for a professional development project aimed at helping teachers develop new techniques for teaching summarization. Methods: Strategies…

Development and evaluation of an ontology for guiding appropriate antibiotic prescribing.

PubMed

Bright, Tiffani J; Yoko Furuya, E; Kuperman, Gilad J; Cimino, James J; Bakken, Suzanne

2012-02-01

To develop and apply formal ontology creation methods to the domain of antimicrobial prescribing and to formally evaluate the resulting ontology through intrinsic and extrinsic evaluation studies. We extended existing ontology development methods to create the ontology and implemented the ontology using Protégé-OWL. Correctness of the ontology was assessed using a set of ontology design principles and domain expert review via the laddering technique. We created three artifacts to support the extrinsic evaluation (set of prescribing rules, alerts and an ontology-driven alert module, and a patient database) and evaluated the usefulness of the ontology for performing knowledge management tasks to maintain the ontology and for generating alerts to guide antibiotic prescribing. The ontology includes 199 classes, 10 properties, and 1636 description logic restrictions. Twenty-three Semantic Web Rule Language rules were written to generate three prescribing alerts: (1) antibiotic-microorganism mismatch alert; (2) medication-allergy alert; and (3) non-recommended empiric antibiotic therapy alert. The evaluation studies confirmed the correctness of the ontology, usefulness of the ontology for representing and maintaining antimicrobial treatment knowledge rules, and usefulness of the ontology for generating alerts to provide feedback to clinicians during antibiotic prescribing. This study contributes to the understanding of ontology development and evaluation methods and addresses one knowledge gap related to using ontologies as a clinical decision support system component-a need for formal ontology evaluation methods to measure their quality from the perspective of their intrinsic characteristics and their usefulness for specific tasks. Copyright © 2011 Elsevier Inc. All rights reserved.

Development of a benchtop baking method for chemically leavened crackers. II. Validation of the method

USDA-ARS?s Scientific Manuscript database

A benchtop baking method has been developed to predict the contribution of gluten functionality to overall flour performance for chemically leavened crackers. Using a diagnostic formula and procedure, dough rheology was analyzed to evaluate the extent of gluten development during mixing and machinin...

The Evaluation of HRD: A Critical Study with Applications

ERIC Educational Resources Information Center

Tome, Eduardo

2009-01-01

Purpose: The purpose of this paper is to analyze critically the most important methods that are used in the evaluation of human resource development (HRD). Design/methodology/approach: The approach is to ask two questions: What are the methods available to define the impact of HRD in the economy? How can we evaluate the evaluations that have been…

Evaluating core technology capacity based on an improved catastrophe progression method: the case of automotive industry

NASA Astrophysics Data System (ADS)

Zhao, Shijia; Liu, Zongwei; Wang, Yue; Zhao, Fuquan

2017-01-01

Subjectivity usually causes large fluctuations in evaluation results. Many scholars attempt to establish new mathematical methods to make evaluation results consistent with actual objective situations. An improved catastrophe progression method (ICPM) is constructed to overcome the defects of the original method. The improved method combines the merits of the principal component analysis' information coherence and the catastrophe progression method's none index weight and has the advantage of highly objective comprehensive evaluation. Through the systematic analysis of the influencing factors of the automotive industry's core technology capacity, the comprehensive evaluation model is established according to the different roles that different indices play in evaluating the overall goal with a hierarchical structure. Moreover, ICPM is developed for evaluating the automotive industry's core technology capacity for the typical seven countries in the world, which demonstrates the effectiveness of the method.

Development of a Double Glass Mounting Method Using Formaldehyde Alcohol Azocarmine Lactophenol (FAAL) and its Evaluation for Permanent Mounting of Small Nematodes.

PubMed

Zahabiun, Farzaneh; Sadjjadi, Seyed Mahmoud; Esfandiari, Farideh

2015-01-01

Permanent slide preparation of nematodes especially small ones is time consuming, difficult and they become scarious margins. Regarding this problem, a modified double glass mounting method was developed and compared with classic method. A total of 209 nematode samples from human and animal origin were fixed and stained with Formaldehyde Alcohol Azocarmine Lactophenol (FAAL) followed by double glass mounting and classic dehydration method using Canada balsam as their mounting media. The slides were evaluated in different dates and times, more than four years. Different photos were made with different magnification during the evaluation time. The double glass mounting method was stable during this time and comparable with classic method. There were no changes in morphologic structures of nematodes using double glass mounting method with well-defined and clear differentiation between different organs of nematodes in this method. Using this method is cost effective and fast for mounting of small nematodes comparing to classic method.

Effective Practices for Evaluating Education and Public Outreach Programs

NASA Astrophysics Data System (ADS)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

Evaluation about the performance of E-government based on interval-valued intuitionistic fuzzy set.

PubMed

Zhang, Shuai; Yu, Dejian; Wang, Yan; Zhang, Wenyu

2014-01-01

The evaluation is an important approach to promote the development of the E-Government. Since the rapid development of E-Government in the world, the E-Government performance evaluation has become a hot issue in the academia. In this paper, we develop a new evaluation method for the development of the E-Government based on the interval-valued intuitionistic fuzzy set which is a powerful technique in expressing the uncertainty of the real situation. First, we extend the geometric Heronian mean (GHM) operator to interval-valued intuitionistic fuzzy environment and proposed the interval-valued intuitionistic fuzzy GHM (IIFGHM) operator. Then, we investigate the relationships between the IIFGHM operator and some existing ones, such as generalized interval-valued intuitionistic fuzzy HM (GIIFHM) and interval-valued intuitionistic fuzzy weighted Bonferoni mean operator. Furthermore, we validate the effectiveness of the proposed method using a real case about the E-Government evaluation in Hangzhou City, China.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools

PubMed Central

Foster, Margaret J

2011-01-01

Objective: The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. Methods: The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Results: Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. Conclusions: As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed. PMID:21753917

Development of a method to assess compliance with ergonomic posture in dental students

PubMed Central

Garcia, Patrícia Petromilli Nordi Sasso; Wajngarten, Danielle; Campos, Juliana Alvares Duarte Bonini

2018-01-01

CONTEXT: The ergonomic posture protocol is extremely important for the maintenance of occupational health in dentistry. The lack of compliance with this protocol results in a high risk of developing musculoskeletal disorders. AIMS: This study developed a direct observation method for the evaluation of dental student compliance with ergonomic posture protocol. SUBJECTS AND METHODS: The method is named compliance assessment of dental ergonomic posture requirements (CADEP). During the development of the method, 14 items were elaborated considering the theory of dental ergonomics. Each item should be classified as appropriate, partially appropriate, or inappropriate. After evaluation, all item values should be added, and the final score expressed as the percent of compliance with correct postures, with a score range of 0%–100%. STATISTICAL ANALYSIS USED: The reliability of CADEP was assessed through intra- and interobserver reproducibility. For the CADEP application, 73 senior year students from the undergraduate course in dentistry were evaluated. The intra- and interexaminer concordance was estimated using the intraclass correlation coefficient (ρ). A descriptive statistical analysis was performed. RESULTS: The reproducibility of evaluator 1 (ρ =0.90; confidence interval [CI] 95%: 0.83–0.94), evaluator 2 (ρ = 0.83; CI 95%: 0.70–0.90), the interexaminer in the first evaluation (ρ = 0.81; CI 95%:0.67–0.89), and in the second one (ρ = 0.76; CI 95%: 0.59–0.87) was classified as good. In the analysis of the compliance, it was verified that moderate compliance was the most prevalent among the evaluated students (65.6%, CI 95%: 60.3%–70.7%). CONCLUSIONS: CADEP was valid and reliable for the assessment of dentistry students’ compliance regarding ergonomic posture requirements. PMID:29693025

Evaluating the Effects of Chemicals on Nervous System Development

EPA Pesticide Factsheets

There are thousands of chemicals that lack data on their potential effects on neurodevelopment. EPA is developing New Approach Methods to evaluate these chemicals for developmental neurotoxicity hazard.

Development and preliminary evaluation of a new anatomically based prosthetic alignment method for below-knee prosthesis.

PubMed

Tafti, Nahid; Karimlou, Masoud; Mardani, Mohammad Ali; Jafarpisheh, Amir Salar; Aminian, Gholam Reza; Safari, Reza

2018-04-20

The objectives of current study were to a) assess similarities and relationships between anatomical landmark-based angles and distances of lower limbs in unilateral transtibial amputees and b) develop and evaluate a new anatomically based static prosthetic alignment method. First sub-study assessed the anthropometrical differences and relationships between the lower limbs in the photographs taken from amputees. Data were analysed via paired t-test and regression analysis. Results show no significant differences in frontal and transverse planes. In the sagittal plane, the anthropometric parameters of the amputated limb were significantly correlated to the corresponding variables of the sound limb. The results served as bases for the development of a new prosthetic alignment method. The method was evaluated on a single subject study. Prosthetic alignment carried out by an experienced prosthetist was compared with such alignment adjusted by an inexperienced prosthetist but with the use of the developed method. In sagittal and frontal planes, the socket angle was tuned with respect to the shin angle, and the position of the prosthetic foot was tuned in relation to the pelvic landmarks. Further study is needed to assess the proposed method on a larger sample of amputees and prosthetists.

Evaluating Teachers' Professional Development Initiatives: Towards an Extended Evaluative Framework

ERIC Educational Resources Information Center

Merchie, Emmelien; Tuytens, Melissa; Devos, Geert; Vanderlinde, Ruben

2018-01-01

Evaluating teachers' professional development initiatives (PDI) is one of the main challenges for the teacher professionalisation field. Although different studies have focused on the effectiveness of PDI, the obtained effects and evaluative methods have been found to be widely divergent. By means of a narrative review, this study provides an…

Effective Evaluation of Training and Development in Higher Education.

ERIC Educational Resources Information Center

Thackwray, Bob

This book examines approaches, techniques, and instruments that relate to the evaluation of training and development in the context of higher education in the United Kingdom (UK), focusing on the importance of identifying the purpose of the evaluation as an initial step. Some financial evaluation methods are also considered. It is suggested that…

Evaluation and Development of Administrators. AAHE-ERIC/Higher Education Research Report No. 6, 1979.

ERIC Educational Resources Information Center

Nordvall, Robert C.

Needs and methods for the evaluation and development of higher education administrators are reviewed in this monograph. Three major reasons for evaluation are cited: external and internal pressure, improvement of performance of individual administrators, and improvement of performance of the institution. Different approaches to evaluation are…

MRI EVALUATION OF KNEE CARTILAGE

PubMed Central

Rodrigues, Marcelo Bordalo; Camanho, Gilberto Luís

2015-01-01

Through the ability of magnetic resonance imaging (MRI) to characterize soft tissue noninvasively, it has become an excellent method for evaluating cartilage. The development of new and faster methods allowed increased resolution and contrast in evaluating chondral structure, with greater diagnostic accuracy. In addition, physiological techniques for cartilage assessment that can detect early changes before the appearance of cracks and erosion have been developed. In this updating article, the various techniques for chondral assessment using knee MRI will be discussed and demonstrated. PMID:27022562

DEVELOPMENT OF DIOXIN TOXICITY EVALUATION METHOD IN HUMAN MILK BY ENZYME-LINKED IMMUNOSORBENT ASSAY-ASSAY VALIDATION FOR HUMAN MILK. (R825433)

EPA Science Inventory

In this study, the development of a toxicity evaluation method for dioxins in human milk by enzyme-linked immunosorbent assay (ELISA) was reported. A total of 17 human milk samples were tested by ELISA and by gas chromatography/mass spectrometry (GC/MS) to assess whether the E...

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

Improvement of screening methods for silicon planar semiconductor devices

NASA Technical Reports Server (NTRS)

Berger, W. M.

1972-01-01

The results of the program for the development of a more sensitive method for selecting silicon planar semiconductor devices for long life applications are reported. The manufacturing technologies (MOS and Bipolar) are discussed along with the screening procedures developed as a result of the tests and evaluations, and the effectiveness of the MOS and Bilayer screening procedures are evaluated.

FE-ANN based modeling of 3D Simple Reinforced Concrete Girders for Objective Structural Health Evaluation : Tech Transfer Summary

DOT National Transportation Integrated Search

2017-06-01

The objective of this study was to develop an objective, quantitative method for evaluating damage to bridge girders by using artificial neural networks (ANNs). This evaluation method, which is a supplement to visual inspection, requires only the res...

Evaluation of Training Programs for Rural Development

ERIC Educational Resources Information Center

Indira, A.

2008-01-01

An Evaluation of the "Impact Assessment of the Training Programs" of a National Level Training Institution in India was conducted using the Kirkpatrick Method (KP Method). The studied Institution takes up research, provides training, offers consultancy and initiates action in the rural sector of India. The evaluation study used a…

Black Ink and Red Ink (BIRI) Testing: A Testing Method to Evaluate Both Recall and Recognition Learning in Accelerated Adult-Learning Courses

ERIC Educational Resources Information Center

Rodgers, Joseph Lee; Rodgers, Jacci L.

2011-01-01

We propose, develop, and evaluate the black ink-red ink (BIRI) method of testing. This approach uses two different methods within the same test administration setting, one that matches recognition learning and the other that matches recall learning. Students purposively define their own tradeoff between the two approaches. Evaluation of the method…

Evaluation, Sustainable Development, and the Environment in the South Pacific

ERIC Educational Resources Information Center

Turvey, Rosario

2007-01-01

This article outlines the Results-Based Evaluation (RBE) framework proposed for the ex-post assessment of the National Environmental Management Strategies (NEMS) in 12 small-island developing states (SIDS) in the South Pacific. It gives an overview of the methods and basis of developing an evaluation framework in the context of SIDS in the region.…

The Development Evaluation of Economic Zones in China.

PubMed

Liu, Wei; Shi, Hong-Bo; Zhang, Zhe; Tsai, Sang-Bing; Zhai, Yuming; Chen, Quan; Wang, Jiangtao

2018-01-02

After the Chinese reform and opening up, the construction of economic zones, such as Special Economic Zones, Hi-tech Zones and Bonded Zones, has played an irreplaceable role in China's economic development. Currently, against the background of Chinese economic transition, research on development evaluation of economic zones has become popular and necessary. Similar research usually focuses on one specific field, and the methods that are used to evaluate it are simple. This research aims to analyse the development evaluation of zones by synthesis. A new hybrid multiple criteria decision making (MCDM) model that combines the DEMATEL technique and the DANP method is proposed. After establishing the evaluation criterion system and acquiring data, the influential weights of dimensions and criteria can be calculated, which will be a guide for forming measures of development. Shandong Peninsula Blue Economic Zone is used in the empirical case analysis. The results show that Transportation Conditions, Industrial Structure and Business Climate are the main influencing criteria and measures based on these criteria are proposed.

The Development Evaluation of Economic Zones in China

PubMed Central

Shi, Hong-Bo; Zhang, Zhe; Zhai, Yuming; Chen, Quan; Wang, Jiangtao

2018-01-01

After the Chinese reform and opening up, the construction of economic zones, such as Special Economic Zones, Hi-tech Zones and Bonded Zones, has played an irreplaceable role in China’s economic development. Currently, against the background of Chinese economic transition, research on development evaluation of economic zones has become popular and necessary. Similar research usually focuses on one specific field, and the methods that are used to evaluate it are simple. This research aims to analyse the development evaluation of zones by synthesis. A new hybrid multiple criteria decision making (MCDM) model that combines the DEMATEL technique and the DANP method is proposed. After establishing the evaluation criterion system and acquiring data, the influential weights of dimensions and criteria can be calculated, which will be a guide for forming measures of development. Shandong Peninsula Blue Economic Zone is used in the empirical case analysis. The results show that Transportation Conditions, Industrial Structure and Business Climate are the main influencing criteria and measures based on these criteria are proposed. PMID:29301304

On Lack of Robustness in Hydrological Model Development Due to Absence of Guidelines for Selecting Calibration and Evaluation Data: Demonstration for Data-Driven Models

NASA Astrophysics Data System (ADS)

Zheng, Feifei; Maier, Holger R.; Wu, Wenyan; Dandy, Graeme C.; Gupta, Hoshin V.; Zhang, Tuqiao

2018-02-01

Hydrological models are used for a wide variety of engineering purposes, including streamflow forecasting and flood-risk estimation. To develop such models, it is common to allocate the available data to calibration and evaluation data subsets. Surprisingly, the issue of how this allocation can affect model evaluation performance has been largely ignored in the research literature. This paper discusses the evaluation performance bias that can arise from how available data are allocated to calibration and evaluation subsets. As a first step to assessing this issue in a statistically rigorous fashion, we present a comprehensive investigation of the influence of data allocation on the development of data-driven artificial neural network (ANN) models of streamflow. Four well-known formal data splitting methods are applied to 754 catchments from Australia and the U.S. to develop 902,483 ANN models. Results clearly show that the choice of the method used for data allocation has a significant impact on model performance, particularly for runoff data that are more highly skewed, highlighting the importance of considering the impact of data splitting when developing hydrological models. The statistical behavior of the data splitting methods investigated is discussed and guidance is offered on the selection of the most appropriate data splitting methods to achieve representative evaluation performance for streamflow data with different statistical properties. Although our results are obtained for data-driven models, they highlight the fact that this issue is likely to have a significant impact on all types of hydrological models, especially conceptual rainfall-runoff models.

Contraceptive Evaluation.

ERIC Educational Resources Information Center

Hulka, Barbara S.; And Others

The objective of research in contraceptive evaluation is to improve the ability of individuals to choose contraceptive methods best suited to their needs and circumstances and to provide information that will lead to the development of safer and more effective methods. There are usually three considerations in judging the importance of a method of…

INTEGRATION OF SPATIAL DATA: EVALUATION OF METHODS BASED ON DATA ISSUES AND ASSESSMENT QUESTIONS

EPA Science Inventory

EPA's Regional Vulnerability Assessment (ReVA) Program has focused initially on the synthesis of existing data. We have used the same set of spatial data and synthesized these data using a total of 11 existing and newly developed integration methods. These methods were evaluated ...

Reduction of bias and variance for evaluation of computer-aided diagnostic schemes.

PubMed

Li, Qiang; Doi, Kunio

2006-04-01

Computer-aided diagnostic (CAD) schemes have been developed to assist radiologists in detecting various lesions in medical images. In addition to the development, an equally important problem is the reliable evaluation of the performance levels of various CAD schemes. It is good to see that more and more investigators are employing more reliable evaluation methods such as leave-one-out and cross validation, instead of less reliable methods such as resubstitution, for assessing their CAD schemes. However, the common applications of leave-one-out and cross-validation evaluation methods do not necessarily imply that the estimated performance levels are accurate and precise. Pitfalls often occur in the use of leave-one-out and cross-validation evaluation methods, and they lead to unreliable estimation of performance levels. In this study, we first identified a number of typical pitfalls for the evaluation of CAD schemes, and conducted a Monte Carlo simulation experiment for each of the pitfalls to demonstrate quantitatively the extent of bias and/or variance caused by the pitfall. Our experimental results indicate that considerable bias and variance may exist in the estimated performance levels of CAD schemes if one employs various flawed leave-one-out and cross-validation evaluation methods. In addition, for promoting and utilizing a high standard for reliable evaluation of CAD schemes, we attempt to make recommendations, whenever possible, for overcoming these pitfalls. We believe that, with the recommended evaluation methods, we can considerably reduce the bias and variance in the estimated performance levels of CAD schemes.

Validation of the ULCEAT methodology by applying it in retrospect to the Roboticbed.

PubMed

Nakamura, Mio; Suzurikawa, Jun; Tsukada, Shohei; Kume, Yohei; Kawakami, Hideo; Inoue, Kaoru; Inoue, Takenobu

2015-01-01

In answer to the increasing demand for care by the Japanese oldest portion of the population, an extensive programme of life support robots is under development, advocated by the Japanese government. Roboticbed^® (RB) is developed to facilitate patients in their daily life in making independent transfers from and to the bed. The bed is intended both for elderly and persons with a disability. The purpose of this study is to examine the validity of the user and user's life centred clinical evaluation of assistive technology (ULCEAT) methodology. To support user centred development of life support robots the ULCEAT method was developed. By means of the ULCEAT method the target users and the use environment were re-established in an earlier study. The validity of the method is tested by re-evaluating the development of RB in retrospect. Six participants used the first prototype of RB (RB1) and eight participants used the second prototype of RB (RB2). The results indicated that the functionality was improved owing to the end-user evaluations. Therefore, we confirmed the content validity of the proposed ULCEAT method. In this study we confirmed the validation of the ULCEAT methodology by applying it in retrospect to RB using development process. This method will be used for the development of Life-support robots and prototype assistive technologies.

Bridging the qualitative-quantitative divide: Experiences from conducting a mixed methods evaluation in the RUCAS programme.

PubMed

Makrakis, Vassilios; Kostoulas-Makrakis, Nelly

2016-02-01

Quantitative and qualitative approaches to planning and evaluation in education for sustainable development have often been treated by practitioners from a single research paradigm. This paper discusses the utility of mixed method evaluation designs which integrate qualitative and quantitative data through a sequential transformative process. Sequential mixed method data collection strategies involve collecting data in an iterative process whereby data collected in one phase contribute to data collected in the next. This is done through examples from a programme addressing the 'Reorientation of University Curricula to Address Sustainability (RUCAS): A European Commission Tempus-funded Programme'. It is argued that the two approaches are complementary and that there are significant gains from combining both. Using methods from both research paradigms does not, however, mean that the inherent differences among epistemologies and methodologies should be neglected. Based on this experience, it is recommended that using a sequential transformative mixed method evaluation can produce more robust results than could be accomplished using a single approach in programme planning and evaluation focussed on education for sustainable development. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Framework for the Development of Automatic DFA Method to Minimize the Number of Components and Assembly Reorientations

NASA Astrophysics Data System (ADS)

Alfadhlani; Samadhi, T. M. A. Ari; Ma’ruf, Anas; Setiasyah Toha, Isa

2018-03-01

Assembly is a part of manufacturing processes that must be considered at the product design stage. Design for Assembly (DFA) is a method to evaluate product design in order to make it simpler, easier and quicker to assemble, so that assembly cost is reduced. This article discusses a framework for developing a computer-based DFA method. The method is expected to aid product designer to extract data, evaluate assembly process, and provide recommendation for the product design improvement. These three things are desirable to be performed without interactive process or user intervention, so product design evaluation process could be done automatically. Input for the proposed framework is a 3D solid engineering drawing. Product design evaluation is performed by: minimizing the number of components; generating assembly sequence alternatives; selecting the best assembly sequence based on the minimum number of assembly reorientations; and providing suggestion for design improvement.

Mobile Applications for Patient-centered Care Coordination: A Review of Human Factors Methods Applied to their Design, Development, and Evaluation

PubMed Central

Westbrook, J. I.

2015-01-01

Summary Objectives To examine if human factors methods were applied in the design, development, and evaluation of mobile applications developed to facilitate aspects of patient-centered care coordination. Methods We searched MEDLINE and EMBASE (2013-2014) for studies describing the design or the evaluation of a mobile health application that aimed to support patients’ active involvement in the coordination of their care. Results 34 papers met the inclusion criteria. Applications ranged from tools that supported self-management of specific conditions (e.g. asthma) to tools that provided coaching or education. Twelve of the 15 papers describing the design or development of an app reported the use of a human factors approach. The most frequently used methods were interviews and surveys, which often included an exploration of participants’ current use of information technology. Sixteen papers described the evaluation of a patient application in practice. All of them adopted a human factors approach, typically an examination of the use of app features and/or surveys or interviews which enquired about patients’ views of the effects of using the app on their behaviors (e.g. medication adherence), knowledge, and relationships with healthcare providers. No study in our review assessed the impact of mobile applications on health outcomes. Conclusion The potential of mobile health applications to assist patients to more actively engage in the management of their care has resulted in a large number of applications being developed. Our review showed that human factors approaches are nearly always adopted to some extent in the design, development, and evaluation of mobile applications. PMID:26293851

A fuzzy linguistic model for the prediction of carpal tunnel syndrome risks in an occupational environment.

PubMed

Bell, P M; Crumpton, L

1997-08-01

This research presents the development and evaluation of a fuzzy linguistic model designated to predict the risk of carpal tunnel syndrome (CTS) in an occupational setting. CTS has become one of the largest problems facing ergonomists and the medical community because it is developing in epidemic proportions within the occupational environment. In addition, practitioners are interested in identifying accurate methods for evaluating the risk of CTS in an occupational setting. It is hypothesized that many factors impact an individual's likelihood of developing CTS and the eventual development of CTS. This disparity in the occurrence of CTS for workers with similar backgrounds and work activities has confused researchers and has been a stumbling block in the development of a model for widespread use in evaluating the development of CTS. Thus this research is an attempt to develop a method that can be used to predict the likelihood of CTS risk in a variety of environments. The intent is that this model will be applied eventually in an occupational setting, thus model development was focused on a method that provided a usable interface and the desired system inputs can also be obtained without the benefit of a medical practitioner. The methodology involves knowledge acquisition to identify and categorize a holistic set of risk factors that include task-related, personal, and organizational categories. The determination of relative factor importance was accomplished using analytic hierarchy processing (AHP) analysis. Finally a mathematical representation of the CTS risk was accomplished by utilizing fuzzy set theory in order to quantify linguistic input parameters. An evaluation of the model including determination of sensitivity and specificity is conducted and the results of the model indicate that the results are fairly accurate and this method has the potential for widespread use. A significant aspect of this research is the comparison of this technique to other methods for assessing presence of CTS. The results of this evaluation technique are compared with more traditional methods for assessing the presence of CTS.

A Methodology for Anatomic Ultrasound Image Diagnostic Quality Assessment.

PubMed

Hemmsen, Martin Christian; Lange, Theis; Brandt, Andreas Hjelm; Nielsen, Michael Bachmann; Jensen, Jorgen Arendt

2017-01-01

This paper discusses the methods for the assessment of ultrasound image quality based on our experiences with evaluating new methods for anatomic imaging. It presents a methodology to ensure a fair assessment between competing imaging methods using clinically relevant evaluations. The methodology is valuable in the continuing process of method optimization and guided development of new imaging methods. It includes a three phased study plan covering from initial prototype development to clinical assessment. Recommendations to the clinical assessment protocol, software, and statistical analysis are presented. Earlier uses of the methodology has shown that it ensures validity of the assessment, as it separates the influences between developer, investigator, and assessor once a research protocol has been established. This separation reduces confounding influences on the result from the developer to properly reveal the clinical value. This paper exemplifies the methodology using recent studies of synthetic aperture sequential beamforming tissue harmonic imaging.

Development of a Self-Report Tool to Evaluate Hearing Aid Outcomes among Chinese Speakers

ERIC Educational Resources Information Center

Wong, Lena L. N.; Hang, Na

2014-01-01

Purpose: This article reports on the development of a self-report tool--the Chinese Hearing Aid Outcomes Questionnaire (CHAOQ)--to evaluate hearing aid outcomes among Chinese speakers. Method: There were 4 phases to construct the CHAOQ and evaluate its psychometric properties. First, items were selected to evaluate a range of culturally relevant…

Research on the evaluation method of rural hollowing based on RS and GIS technology: a case study of the Ningxia Hui autonomous region in China

NASA Astrophysics Data System (ADS)

Yin, Kai; Wen, MeiPing; Zhang, FeiFei; Yuan, Chao; Chen, Qiang; Zhang, Xiupeng

2016-10-01

With the acceleration of urbanization in China, most rural areas formed a widespread phenomenon, i.e., destitute village, labor population loss, land abandonment and rural hollowing. And it formed a unique hollow village problem in China finally. The governance of hollow village was the objective need of the development of economic and social development in rural area for Chinese government, and the research on the evaluation method of rural hollowing was the premise and basis of the hollow village governance. In this paper, several evaluation methods were used to evaluate the rural hollowing based on the survey data, land use data, social and economic development data. And these evaluation indexes were the transition of homesteads, the development intensity of rural residential areas, the per capita housing construction area, the residential population proportion in rural area, and the average annual electricity consumption, which can reflect the rural hollowing degree from the land, population, and economy point of view, respectively. After that, spatial analysis method of GIS was used to analyze the evaluation result for each index. Based on spatial raster data generated by Kriging interpolation, we carried out re-classification of all the results. Using the fuzzy clustering method, the rural hollowing degree in Ningxia area was reclassified based on the two spatial scales of county and village. The results showed that the rural hollowing pattern in the Ningxia Hui Autonomous Region had a spatial distribution characteristics that the rural hollowing degree was obvious high in the middle of the study area but was low around the study area. On a county scale, the specific performances of the serious rural hollowing were the higher degree of extensive land use, and the lower level of rural economic development and population transfer concentration. On a village scale, the main performances of the rural hollowing were the rural population loss and idle land. The evaluation method of rural hollowing constructed in this paper can effectively carry out a comprehensive degree zoning of rural hollowing, which can make orderly decision support plans of hollow village governance for the government.

Analytical method for promoting process capability of shock absorption steel.

PubMed

Sung, Wen-Pei; Shih, Ming-Hsiang; Chen, Kuen-Suan

2003-01-01

Mechanical properties and low cycle fatigue are two factors that must be considered in developing new type steel for shock absorption. Process capability and process control are significant factors in achieving the purpose of research and development programs. Often-used evaluation methods failed to measure process yield and process centering; so this paper uses Taguchi loss function as basis to establish an evaluation method and the steps for assessing the quality of mechanical properties and process control of an iron and steel manufacturer. The establishment of this method can serve the research and development and manufacturing industry and lay a foundation in enhancing its process control ability to select better manufacturing processes that are more reliable than decision making by using the other commonly used methods.

Health state evaluation of shield tunnel SHM using fuzzy cluster method

NASA Astrophysics Data System (ADS)

Zhou, Fa; Zhang, Wei; Sun, Ke; Shi, Bin

2015-04-01

Shield tunnel SHM is in the path of rapid development currently while massive monitoring data processing and quantitative health grading remain a real challenge, since multiple sensors belonging to different types are employed in SHM system. This paper addressed the fuzzy cluster method based on fuzzy equivalence relationship for the health evaluation of shield tunnel SHM. The method was optimized by exporting the FSV map to automatically generate the threshold value. A new holistic health score(HHS) was proposed and its effectiveness was validated by conducting a pilot test. A case study on Nanjing Yangtze River Tunnel was presented to apply this method. Three types of indicators, namely soil pressure, pore pressure and steel strain, were used to develop the evaluation set U. The clustering results were verified by analyzing the engineering geological conditions; the applicability and validity of the proposed method was also demonstrated. Besides, the advantage of multi-factor evaluation over single-factor model was discussed by using the proposed HHS. This investigation indicated the fuzzy cluster method and HHS is capable of characterizing the fuzziness of tunnel health, and it is beneficial to clarify the tunnel health evaluation uncertainties.

A Proposed Methodology for Contextualised Evaluation in Higher Education

ERIC Educational Resources Information Center

Nygaard, Claus; Belluigi, Dina Zoe

2011-01-01

This paper aims to inspire stakeholders working with quality of higher education (such as members of study boards, study programme directors, curriculum developers and teachers) to critically consider their evaluation methods in relation to a focus on student learning. We argue that many of the existing methods of evaluation in higher education…

A Method for Evaluating Competency in Assessment and Management of Suicide Risk

ERIC Educational Resources Information Center

Hung, Erick K.; Binder, Renee L.; Fordwood, Samantha R.; Hall, Stephen E.; Cramer, Robert J.; McNiel, Dale E.

2012-01-01

Objective: Although health professionals increasingly are expected to be able to assess and manage patients' risk for suicide, few methods are available to evaluate this competency. This report describes development of a competency-assessment instrument for suicide risk-assessment (CAI-S), and evaluates its use in an objective structured clinical…

Investigating Choice Experiments for Preferences of Older People (ICEPOP): evaluative spaces in health economics.

PubMed

Coast, Joanna; Flynn, Terry; Sutton, Eileen; Al-Janabi, Hareth; Vosper, Jane; Lavender, Sarita; Louviere, Jordan; Peters, Tim

2008-10-01

This paper deals with three concerns about the evaluative framework that is currently dominant within health economics. These concerns are: that the evaluative framework is concerned entirely with health; that the evaluative framework has an individualistic focus on patients alone; and that the methods used to estimate 'health' within the current evaluative framework could be improved both in terms of the generation of descriptive systems and in using valuation methods that rely less on people's ability to express their preferences on a cardinal scale. In exploring these issues the Investigating Choice Experiments for Preferences of Older People (ICEPOP) programme has explicitly focused on both the topic of older people and the methods of discrete choice experiments. A capability index has been developed and attributes for an economic measure of end-of-life care are currently being generated, providing the possibility of extending the evaluative framework beyond health alone. A measure of carer's experience and a framework for extending measurement in end-of-life care to loved ones are both also in development, thus extending the evaluative framework beyond the patient alone. Rigorous qualitative methods employing an iterative approach have been developed for use in constructing attributes, and best-worst scaling has been utilized to reduce task complexity and provide insights into heterogeneity. There are a number of avenues for further research in all these areas, but in particular there is need for greater attention to be paid to the theory underlying the evaluative framework within health economics.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

Quantitative nondestructive evaluation of ceramic matrix composite by the resonance method

DOE Office of Scientific and Technical Information (OSTI.GOV)

Watanabe, T.; Aizawa, T.; Kihara, J.

The resonance method was developed to make quantitative nondestructive evaluation on the mechanical properties without any troublesome procedure. Since the present method is indifferent to the geometry of specimen, both monolithic and ceramic matrix composite materials in process can be evaluated in the nondestructive manner. Al{sub 2}O{sub 3}, Si{sub 3}N{sub 4}, SiC/Si{sub 3}N{sub 4}, and various C/C composite materials are employed to demonstrate the validity and effectiveness of the present method.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools.

PubMed

Shurtz, Suzanne; Foster, Margaret J

2011-07-01

The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed.

Erosion control study : final report : Part II : roadside channels.

DOT National Transportation Integrated Search

1971-04-01

The objective of the study were: : 1) To evaluate present methods and develop new methods for establishing a permanent vegetative cover. : 2) To develop erosion control practices for existing highway drains and ditches. : 3) To develop highway bank s...

METHOD DEVELOPMENT FOR THE DETERMINATION OF FORMALDEHYDE IN SAMPLES OF ENVIRONMENTAL ORIGIN

EPA Science Inventory

An analytical method was developed for the determination of formaldehyde in samples of environmental origin. After a review of the current literature, five candidate methods involving chemical derivatization were chosen for evaluation. The five derivatization reagents studied wer...

Recommendations following a multi-laboratory comparison of microbial source tracking methods

EPA Science Inventory

Microbial source tracking (MST) methods are under development to provide resource managers with tools to identify sources of fecal contamination in water. Some of the most promising methods currently under development were recently evaluated in the Source Identification Protocol ...

Conducting an Efficient Proactive Risk Assessment Prior to CPOE Implementation in an Intensive Care Unit

PubMed Central

Hundt, Ann Schoofs; Adams, Jean A.; Schmid, J. Andrew; Musser, Linda M.; Walker, James M.; Wetterneck, Tosha B; Douglas, Stephen V.; Paris, Bonnie L.; Carayon, Pascale

2012-01-01

Purpose To develop, conduct, and evaluate a proactive risk assessment (PRA) of the design and implementation of CPOE in an ICU. Methods We developed a PRA method based on issues identified from documented experience with conventional PRA methods and the constraints of an organization about to implement CPOE in an intensive care unit. The PRA method consists of three phases: planning (three months), team (one five-hour meeting), and evaluation (short- and long-term). Results Sixteen unique relevant vulnerabilities were identified as a result of the PRA team’s efforts. Negative consequences resulting from the vulnerabilities included potential patient safety and quality of care issues, non-compliance with regulatory requirements, increases in cognitive burden on CPOE users, and/or worker inconvenience or distress. Actions taken to address the vulnerabilities included redesign of the technology, process (workflow) redesign, user training, and/or ongoing monitoring. Verbal and written evaluation by the team members indicated that the PRA method was useful and that participants were willing to participate in future PRAs. Long-term evaluation was accomplished by monitoring an ongoing “issues list” of CPOE problems identified by or reported to IT staff. Vulnerabilities identified by the team were either resolved prior to CPOE implementation (n = 7) or shortly thereafter (n = 9). No other issues were identified beside those identified by the team. Conclusions Generally positive results from the various evaluations including a long-term evaluation demonstrate the value of developing an efficient PRA method that meets organizational and contextual requirements and constraints. PMID:22608242

The application of generalized, cyclic, and modified numerical integration algorithms to problems of satellite orbit computation

NASA Technical Reports Server (NTRS)

Chesler, L.; Pierce, S.

1971-01-01

Generalized, cyclic, and modified multistep numerical integration methods are developed and evaluated for application to problems of satellite orbit computation. Generalized methods are compared with the presently utilized Cowell methods; new cyclic methods are developed for special second-order differential equations; and several modified methods are developed and applied to orbit computation problems. Special computer programs were written to generate coefficients for these methods, and subroutines were written which allow use of these methods with NASA's GEOSTAR computer program.

A Technical Evaluation of the First Stage of the Mediterranean Regional Project.

ERIC Educational Resources Information Center

Hollister, Robinson

Objectives of this technical evaluation concerning the transfer of experience in the development of human resources were to develop educational plans based upon comprehensive estimates of manpower requirements and to evaluate the methods used in estimating manpower requirements for educational planning. The methodology involved estimates of the…

CLT and AE methods of in-situ load testing : comparison and development of evaluation criteria : in-situ evaluation of post-tensioned parking garage, Kansas City, Missouri

DOT National Transportation Integrated Search

2008-02-01

The objective of the proposed research project is to compare the results of two recently introduced nondestructive load test methods to the existing 24-hour load test method described in Chapter 20 of ACI 318-05. The two new methods of nondestructive...

Paediatric health economic evaluations: a world view.

PubMed

Ungar, Wendy J

2007-01-01

As economic evaluation methods evolve, their applicability to special populations, such as children, has received increased scrutiny. The objective was to review paediatric health economic evaluations published over the last quarter century, comment on trends, discuss gaps between developed and developing nations, and point to future directions for research. Data compiled for the Paediatric Economic Database Evaluation (PEDE) project to 2003 were used to describe temporal and geographic trends and evaluate the frequency of intervention categories and conditions studied. The volume of paediatric health economic evaluations rose rapidly since 1980. Studies of infective/parasitic diseases, congenital anomalies and complications of pregnancy accounted for the majority. Prevention rather than treatment was emphasized. Most evaluations performed since 1998 (78%) were cost-effectiveness analyses. Cost-utility analyses were rare. The US produced half of all publications, with the U.K. contributing 12%. Economic evaluations from developing countries were uncommon, despite an urgent need for evidence-based decision-making in these regions. The interventions studied reflected local health priorities; HIV and malaria prevention were more commonly studied in developing nations, whereas treatments for asthma and birth malformations were more often evaluated in developed nations. Despite global initiatives to combat disease, developing nations rely on foreign research to inform implementation of local health programs. There is a need for better methods for data transfer and extrapolation. Future research must focus on paediatric models of costs and consequences and the development of tools to measure long-term effects.

Center for Nondestructive Evaluation - Center for Nondestructive Evaluation

Science.gov Websites

available for the full range of inspection methods, housed in a 52,000 sq. ft. facility with over $5M in - 1990): Development of NDE methods for application to DOE energy and weapons programs, including multi for enhanced frequency bandwidth and improved flaw reconstruction, and novel methods for poling

Pavement, bridge, and safety cost evaluation tool for overweight truck corridors serving coastal port regions and border ports of entry

DOT National Transportation Integrated Search

2017-08-01

To address the need for a rational but fast method to determine costs and a proposed permit fee, the research team developed the Stage 1 Expedient Analysis Method. The method was used to evaluate potential oversize/overweight (OS/OW) freight corridor...

Evaluation of micro-colorimetric lipid determination method with samples prepared using sonication and accelerated solvent extraction methods

EPA Science Inventory

Two common laboratory extraction techniques were evaluated for routine use with the micro-colorimetric lipid determination method developed by Van Handel (1985) [E. Van Handel, J. Am. Mosq. Control Assoc. 1(1985) 302] and recently validated for small samples by Inouye and Lotufo ...

77 FR 8258 - Availability of ICCVAM Evaluation Report and Recommendations on the Usefulness and Limitations of...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-14

... development of BG1Luc ER TA test method performance standards. ICCVAM assigned the activities a high priority... Vitro Test Methods for Detecting Potential Endocrine Disruptors. Research Triangle Park, NC: National...Final.pdf . ICCVAM. 2003a. ICCVAM Evaluation of In Vitro Test Methods For Detecting Potential Endocrine...

A small-bolt method for screening tree protectants against bark beetles (coleoptera: curculionidae)

Treesearch

B.L. Strom; L.M. Roton

2009-01-01

A simple, small-bolt method was developed and refi ned for evaluating and screening treatments being considered as prophylactics against bark beetles (Coleoptera: Curculionidae: Scolytinae). Using this method, 4 insecticide products (3 active ingredients) were evaluated against the southern pine beetle, Dendroctonus frontalis Zimmermann, intermittently during a period...

A heuristic method for simulating open-data of arbitrary complexity that can be used to compare and evaluate machine learning methods.

PubMed

Moore, Jason H; Shestov, Maksim; Schmitt, Peter; Olson, Randal S

2018-01-01

A central challenge of developing and evaluating artificial intelligence and machine learning methods for regression and classification is access to data that illuminates the strengths and weaknesses of different methods. Open data plays an important role in this process by making it easy for computational researchers to easily access real data for this purpose. Genomics has in some examples taken a leading role in the open data effort starting with DNA microarrays. While real data from experimental and observational studies is necessary for developing computational methods it is not sufficient. This is because it is not possible to know what the ground truth is in real data. This must be accompanied by simulated data where that balance between signal and noise is known and can be directly evaluated. Unfortunately, there is a lack of methods and software for simulating data with the kind of complexity found in real biological and biomedical systems. We present here the Heuristic Identification of Biological Architectures for simulating Complex Hierarchical Interactions (HIBACHI) method and prototype software for simulating complex biological and biomedical data. Further, we introduce new methods for developing simulation models that generate data that specifically allows discrimination between different machine learning methods.

Method of Evaluating the Life Cycle Cost of Small Earth Dams Considering the Risk of Heavy Rainfall and Selection Method of the Optimum Countermeasure

NASA Astrophysics Data System (ADS)

Hori, Toshikazu; Mohri, Yoshiyuki; Matsushima, Kenichi; Ariyoshi, Mitsuru

In recent years the increase in the number of heavy rainfall occurrences such as through unpredictable cloudbursts have resulted in the safety of the embankments of small earth dams needing to be improved. However, the severe financial condition of the government and local autonomous bodies necessitate the cost of improving them to be reduced. This study concerns the development of a method of evaluating the life cycle cost of small earth dams considered to pose a risk and in order to improve the safety of the downstream areas of small earth dams at minimal cost. Use of a safety evaluation method that is based on a combination of runoff analysis, saturated and unsaturated seepage analysis, and slope stability analysis enables the probability of a dam breach and its life cycle cost with the risk of heavy rainfall taken into account to be calculated. Moreover, use of the life cycle cost evaluation method will lead to the development of a technique for selecting the method of the optimal improvement or countermeasures against heavy rainfall.

Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation.

PubMed

Reeves, Anthony P; Xie, Yiting; Liu, Shuang

2017-04-01

With the advent of fully automated image analysis and modern machine learning methods, there is a need for very large image datasets having documented segmentations for both computer algorithm training and evaluation. This paper presents a method and implementation for facilitating such datasets that addresses the critical issue of size scaling for algorithm validation and evaluation; current evaluation methods that are usually used in academic studies do not scale to large datasets. This method includes protocols for the documentation of many regions in very large image datasets; the documentation may be incrementally updated by new image data and by improved algorithm outcomes. This method has been used for 5 years in the context of chest health biomarkers from low-dose chest CT images that are now being used with increasing frequency in lung cancer screening practice. The lung scans are segmented into over 100 different anatomical regions, and the method has been applied to a dataset of over 20,000 chest CT images. Using this framework, the computer algorithms have been developed to achieve over 90% acceptable image segmentation on the complete dataset.

A conversation-based process tracing method for use with naturalistic decisions: an evaluation study.

PubMed

Williamson, J; Ranyard, R; Cuthbert, L

2000-05-01

This study is an evaluation of a process tracing method developed for naturalistic decisions, in this case a consumer choice task. The method is based on Huber et al.'s (1997) Active Information Search (AIS) technique, but develops it by providing spoken rather than written answers to respondents' questions, and by including think aloud instructions. The technique is used within a conversation-based situation, rather than the respondent thinking aloud 'into an empty space', as is conventionally the case in think aloud techniques. The method results in a concurrent verbal protocol as respondents make their decisions, and a retrospective report in the form of a post-decision summary. The method was found to be virtually non-reactive in relation to think aloud, although the variable of Preliminary Attribute Elicitation showed some evidence of reactivity. This was a methodological evaluation, and as such the data reported are essentially descriptive. Nevertheless, the data obtained indicate that the method is capable of producing information about decision processes which could have theoretical importance in terms of evaluating models of decision-making.

Selection of Suitable DNA Extraction Methods for Genetically Modified Maize 3272, and Development and Evaluation of an Event-Specific Quantitative PCR Method for 3272.

PubMed

Takabatake, Reona; Masubuchi, Tomoko; Futo, Satoshi; Minegishi, Yasutaka; Noguchi, Akio; Kondo, Kazunari; Teshima, Reiko; Kurashima, Takeyo; Mano, Junichi; Kitta, Kazumi

2016-01-01

A novel real-time PCR-based analytical method was developed for the event-specific quantification of a genetically modified (GM) maize, 3272. We first attempted to obtain genome DNA from this maize using a DNeasy Plant Maxi kit and a DNeasy Plant Mini kit, which have been widely utilized in our previous studies, but DNA extraction yields from 3272 were markedly lower than those from non-GM maize seeds. However, lowering of DNA extraction yields was not observed with GM quicker or Genomic-tip 20/G. We chose GM quicker for evaluation of the quantitative method. We prepared a standard plasmid for 3272 quantification. The conversion factor (Cf), which is required to calculate the amount of a genetically modified organism (GMO), was experimentally determined for two real-time PCR instruments, the Applied Biosystems 7900HT (the ABI 7900) and the Applied Biosystems 7500 (the ABI7500). The determined Cf values were 0.60 and 0.59 for the ABI 7900 and the ABI 7500, respectively. To evaluate the developed method, a blind test was conducted as part of an interlaboratory study. The trueness and precision were evaluated as the bias and reproducibility of the relative standard deviation (RSDr). The determined values were similar to those in our previous validation studies. The limit of quantitation for the method was estimated to be 0.5% or less, and we concluded that the developed method would be suitable and practical for detection and quantification of 3272.

The Evolution of Nondestructive Evaluation Methods for the Space Shuttle External Tank Thermal Protection System

NASA Technical Reports Server (NTRS)

Walker, James L.; Richter, Joel D.

2006-01-01

Three nondestructive evaluation methods are being developed to identify defects in the foam thermal protection system (TPS) of the Space Shuttle External Tank (ET). Shearography is being developed to identify shallow delaminations, shallow voids and crush damage in the foam while terahertz imaging and backscatter radiography are being developed to identify voids and cracks in thick foam regions. The basic theory of operation along with factors affecting the results of these methods will be described. Also, the evolution of these methods from lab tools to implementation on the ET will be discussed. Results from both test panels and flight tank inspections will be provided to show the range in defect sizes and types that can be readily detected.

Factors influencing the results of faculty evaluation in Isfahan University of Medical Sciences

PubMed Central

Kamali, Farahnaz; Yamani, Nikoo; Changiz, Tahereh; Zoubin, Fatemeh

2018-01-01

OBJECTIVE: This study aimed to explore factors influencing the results of faculty member evaluation from the viewpoints of faculty members affiliated with Isfahan University of Medical Sciences, Isfahan, Iran. MATERIALS AND METHODS: This qualitative study was done using a conventional content analysis method. Participants were faculty members of Isfahan University of Medical Sciences who, considering maximum variation in sampling, were chosen with a purposive sampling method. Semi-structured interviews were held with 11 faculty members until data saturation was reached. The interviews were transcribed verbatim and analyzed with conventional content analysis method for theme development. Further, the MAXQDA software was used for data management. RESULTS: The data analysis led to the development of two main themes, namely, “characteristics of the educational system” and “characteristics of the faculty member evaluation system.” The first main theme consists of three categories, i.e. “characteristics of influential people in evaluation,” “features of the courses,” and “background characteristics.” The other theme has the following as its categories: “evaluation methods,” “evaluation tools,” “evaluation process,” and “application of evaluation results.” Each category will have its subcategories. CONCLUSIONS: Many factors affect the evaluation of faculty members that should be taken into account by educational policymakers for improving the quality of the educational process. In addition to the factors that directly influence the educational system, methodological problems in the evaluation system need special attention. PMID:29417073

Development of performance-based evaluation methods and specifications for roadside maintenance.

DOT National Transportation Integrated Search

2011-01-01

This report documents the work performed during Project 0-6387, Performance Based Roadside : Maintenance Specifications. Quality assurance methods and specifications for roadside performance-based : maintenance contracts (PBMCs) were developed ...

DDOT MXD+ method development report.

DOT National Transportation Integrated Search

2015-09-01

Mixed-use development has become increasingly common across the country, including Washington, D.C. : However, a straightforward and empirically validated method for evaluating the traffic impacts of such : projects is still needed. The data presente...

PM: RESEARCH METHODS FOR PM TOXIC COMPOUNDS - PARTICLE METHODS EVALUATION AND DEVELOPMENT

EPA Science Inventory

The Federal Reference Method (FRM) for Particulate Matter (PM) developed by EPA's National Exposure Research Laboratory (NERL) forms the backbone of the EPA's national monitoring strategy. It is the measurement that defines attainment of the National Ambient Air Quality Standard...

Recent Developments in Whole Sediment Toxicity Identification Evaluations: Innovations in Manipulations and Endpoints

EPA Science Inventory

Whole sediment Toxicity Identification Evaluation (TIE) methods were developed primarily in the late 1990s and early 2000s in research programs dedicated to developing manipulations and endpoints to characterize and identify causes of toxicity to benthic freshwater and marine org...

Testing and evaluation of tactical electro-optical sensors

NASA Astrophysics Data System (ADS)

Middlebrook, Christopher T.; Smith, John G.

2002-07-01

As integrated electro-optical sensor payloads (multi- sensors) comprised of infrared imagers, visible imagers, and lasers advance in performance, the tests and testing methods must also advance in order to fully evaluate them. Future operational requirements will require integrated sensor payloads to perform missions at further ranges and with increased targeting accuracy. In order to meet these requirements sensors will require advanced imaging algorithms, advanced tracking capability, high-powered lasers, and high-resolution imagers. To meet the U.S. Navy's testing requirements of such multi-sensors, the test and evaluation group in the Night Vision and Chemical Biological Warfare Department at NAVSEA Crane is developing automated testing methods, and improved tests to evaluate imaging algorithms, and procuring advanced testing hardware to measure high resolution imagers and line of sight stabilization of targeting systems. This paper addresses: descriptions of the multi-sensor payloads tested, testing methods used and under development, and the different types of testing hardware and specific payload tests that are being developed and used at NAVSEA Crane.

Malpractice and medical liability. European Guidelines on Methods of Ascertainment and Criteria of Evaluation.

PubMed

Ferrara, Santo Davide; Baccino, Eric; Bajanowski, Thomas; Boscolo-Berto, Rafael; Castellano, Maria; De Angel, Ricardo; Pauliukevičius, Alvydas; Ricci, Pietrantonio; Vanezis, Peter; Vieira, Duarte Nuno; Viel, Guido; Villanueva, Enrique

2013-05-01

The manuscript presents the European Guidelines on medico-legal Methods of Ascertainment and Criteria of Evaluation in cases of suspected subjective "Medical Responsibility and/or Liability" developed by an international working group under the patronage of the European Academy of Legal Medicine. It includes a step-by-step illustrated explanation of approved Flow Charts, articulated in 18 sequential steps and comprehensive of both Methods of Ascertainment and Evaluation Criteria.

Emergency medicine clerkship curriculum in a high-income developing country: methods for development and application.

PubMed

Cevik, Arif Alper; Cakal, Elif Dilek; Abu-Zidan, Fikri M

2018-06-07

The published recommendations for international emergency medicine curricula cover the content, but exclude teaching and learning methods, assessment, and evaluation. We aim to provide an overview on available emergency medicine clerkship curricula and report the development and application experience of our own curriculum. Our curriculum is an outcome-based education, enriched by e-learning and various up-to-date pedagogic principles. Teaching and learning methods, assessment, and evaluation are described. The theory behind our practice in the light of recent literature is discussed aiming to help other colleagues from developing countries to have a clear map for developing and tailoring their own curricula depending on their needs. The details of our emergency medicine clerkship will serve as an example for developing and developed countries having immature undergraduate emergency medicine clerkship curricula. However, these recommendations will differ in various settings depending on available resources. The main concept of curriculum development is to create a curriculum having learning outcomes and content relevant to the local context, and then align the teaching and learning activities, assessments, and evaluations to be in harmony. This may assure favorable educational outcome even in resource limited settings.

EVALUATION OF METHODS FOR CONCENTRATING HEPATITIS A VIRUS FROM DRINKING WATER

EPA Science Inventory

Using recently developed cultivation and assay systems, currently available methods for concentrating enteric viruses from drinking water by adsorption to and subsequent elution from microporous filters followed by organic flocculation, were evaluated for their ability to recover...

History of ozone injury monitoring methods and the development of a recommended protocol

Treesearch

Daniel Duriscoe; Kenneth Stolte; John Pronos

1996-01-01

The minimum requirement for long–term monitoring of air pollution effects on forest stands is to develop methods for observers to locate, evaluate, and re–evaluate individual trees at intervals of one or more years. Studies of this nature have used permanent quadrats or "plots" in which individual plants are tagged or mapped. Multiple levels of information...

Automated Analysis of Counselor Style and Effects: The Development and Evaluation of Methods and Materials to Assess the Stylistic Accuracy and Outcome Effectiveness of Counselor Verbal Behavior. Final Report.

ERIC Educational Resources Information Center

Pepyne, Edward W.

This project attempts to develop, evaluate and implement methods and materials for the automated analysis of the stylistic characteristics of counselor verbal behavior and its effects on client verbal behavior within the counseling interview. To achieve this purpose, the project designed a system of computer programs, the DISCOURSE ANALYSIS…

Evaluation about the Performance of E-Government Based on Interval-Valued Intuitionistic Fuzzy Set

PubMed Central

Zhang, Shuai; Wang, Yan

2014-01-01

The evaluation is an important approach to promote the development of the E-Government. Since the rapid development of E-Government in the world, the E-Government performance evaluation has become a hot issue in the academia. In this paper, we develop a new evaluation method for the development of the E-Government based on the interval-valued intuitionistic fuzzy set which is a powerful technique in expressing the uncertainty of the real situation. First, we extend the geometric Heronian mean (GHM) operator to interval-valued intuitionistic fuzzy environment and proposed the interval-valued intuitionistic fuzzy GHM (IIFGHM) operator. Then, we investigate the relationships between the IIFGHM operator and some existing ones, such as generalized interval-valued intuitionistic fuzzy HM (GIIFHM) and interval-valued intuitionistic fuzzy weighted Bonferoni mean operator. Furthermore, we validate the effectiveness of the proposed method using a real case about the E-Government evaluation in Hangzhou City, China. PMID:24707196

An Example of Learning about Plastics and Their Evaluation as a Contribution to Education for Sustainable Development in Secondary School Chemistry Teaching

ERIC Educational Resources Information Center

Burmeister, Mareike; Eilks, Ingo

2012-01-01

This paper describes the development and evaluation of a secondary school lesson plan for chemistry education on the topic Education for Sustainable Development (ESD). The lessons focus both on the chemistry of plastics and on learning about the societal evaluation of competing, chemistry-based industrial products. A specific teaching method was…

Proceedings of the Towards Competency Seminar. A Seminar on Curriculum Development and Evaluation in Vocational Education in New Zealand (Wellington, New Zealand, August 30-31, 1988).

ERIC Educational Resources Information Center

Wagner, Graham, Ed.

These proceedings begin with opening remarks that discuss seminar concerns and objectives. These remarks define two concerns: (1) evaluation of the methods of curriculum development and evaluation appropriate for vocational education in New Zealand; and (2) development of guidelines to assist educators to meet the requirements for competency-based…

Development and evaluation of a suppository formulation containing Lactobacillus and its application in vaginal diseases.

PubMed

Kale, Vinita V; Trivedi, Rashmi V; Wate, Sanjay P; Bhusari, Kishor P

2005-11-01

Lactobacillus has long been considered the protective flora in the vagina that displaces and kills vaginal pathogens. Lactic acid, H2O2, and antibacterial agents such as lactocin and bacitracin produced by Lactobacillus act against the vaginal pathogens. The first objective of this research was to develop a local application pharmaceutical formulation of a vaginal suppository containing lyophilized culture of Lactobacillus. The second objective was to establish its in vivo performance by developing in vitro methods of evaluation. Lyophilized culture of Lactobacillus sporogenes was selected for this study. Three formulations of the suppositories were prepared by the molding method. Formulations I, II, and III contained cocoa butter, glycerinated gelatin, and PEG 1000 base, respectively. The prepared suppositories were characterized for physical properties. Assembly to simulate the application site was designed. Methods to evaluate the viability, production of lactic acid, and H2O2 produced by the released Lactobacillus at the application site were developed and the antagonistic activity was demonstrated. From the physical characteristics of the suppository formulations, the glycerinated gelatin suppository (formulation II) containing lyophilized Lactobacillus was found to be satisfactory. The developed assembly was satisfactory in simulating the application site. The Lactobacillus released was viable and exhibited the production of lactic acid, hydrogen peroxide, and antagonistic activity against the uropathogen. The suppository formulation containing Lactobacillus and the methods of its evaluation were successfully developed in this research work and have several applications in the vaginal diseases of women.

["I dreamed that I dreamed": some notes on the clinical evaluation of therapist interventions, exemplified by Deserno's case study (session 290)].

PubMed

Berns, U; Hemprich, L

2001-01-01

In No. 8, 48th year, August 1998, of the journal "Psychotherapie--Psychosomatik--Medizinische Psychologie" the tape recorder transcription of the 290th session of a long-term analysis was studied by three methods (BIP, Frames, ZBKT). The paper presented here was stimulated by this publication. From the author's viewpoint substantial clinical aspects of evaluation could be added by applying a clinical evaluation method developed by R. Langs and his corresponding concept of interpretation. Clinical vignettes exemplify the possibility to resolve pathological countertransference by using this evaluation method. With the help of this method the presented transcription of the 290th session is evaluated partially.

Applying a Mixed Method Design to Evaluate Training Seminars within an Early Childhood Education Project

ERIC Educational Resources Information Center

Grammatikopoulos, Vasilis; Zachopoulou, Evridiki; Tsangaridou, Niki; Liukkonen, Jarmo; Pickup, Ian

2008-01-01

The body of research relating to assessment in education suggests that professional developers and seminar administrators have generally paid little attention to evaluation procedures. Scholars have also been critical of evaluations which use a single data source and have favoured the use of a multiple method design to generate a complete picture…

Noncontact evaluation for interface states by photocarrier counting

NASA Astrophysics Data System (ADS)

Furuta, Masaaki; Shimizu, Kojiro; Maeta, Takahiro; Miyashita, Moriya; Izunome, Koji; Kubota, Hiroshi

2018-03-01

We have developed a noncontact measurement method that enables in-line measurement and does not have any test element group (TEG) formation. In this method, the number of photocarriers excited from the interface states are counted which is called “photocarrier counting”, and then the energy distribution of the interface states density (D it) is evaluated by spectral light excitation. In our previous experiment, the method used was a preliminary contact measurement method at the oxide on top of the Si wafer. We developed, at this time, a D it measurement method as a noncontact measurement with a gap between the probes and the wafer. The shallow trench isolation (STI) sidewall has more localized interface states than the region under the gate electrode. We demonstrate the noncontact measurement of trapped carriers from interface states using wafers of three different crystal plane orientations. The demonstration will pave the way for evaluating STI sidewall interface states in future studies.

Applying operational research and data mining to performance based medical personnel motivation system.

PubMed

Niaksu, Olegas; Zaptorius, Jonas

2014-01-01

This paper presents the methodology suitable for creation of a performance related remuneration system in healthcare sector, which would meet requirements for efficiency and sustainable quality of healthcare services. Methodology for performance indicators selection, ranking and a posteriori evaluation has been proposed and discussed. Priority Distribution Method is applied for unbiased performance criteria weighting. Data mining methods are proposed to monitor and evaluate the results of motivation system.We developed a method for healthcare specific criteria selection consisting of 8 steps; proposed and demonstrated application of Priority Distribution Method for the selected criteria weighting. Moreover, a set of data mining methods for evaluation of the motivational system outcomes was proposed. The described methodology for calculating performance related payment needs practical approbation. We plan to develop semi-automated tools for institutional and personal performance indicators monitoring. The final step would be approbation of the methodology in a healthcare facility.

Development of new methodologies for evaluating the energy performance of new commercial buildings

NASA Astrophysics Data System (ADS)

Song, Suwon

The concept of Measurement and Verification (M&V) of a new building continues to become more important because efficient design alone is often not sufficient to deliver an efficient building. Simulation models that are calibrated to measured data can be used to evaluate the energy performance of new buildings if they are compared to energy baselines such as similar buildings, energy codes, and design standards. Unfortunately, there is a lack of detailed M&V methods and analysis methods to measure energy savings from new buildings that would have hypothetical energy baselines. Therefore, this study developed and demonstrated several new methodologies for evaluating the energy performance of new commercial buildings using a case-study building in Austin, Texas. First, three new M&V methods were developed to enhance the previous generic M&V framework for new buildings, including: (1) The development of a method to synthesize weather-normalized cooling energy use from a correlation of Motor Control Center (MCC) electricity use when chilled water use is unavailable, (2) The development of an improved method to analyze measured solar transmittance against incidence angle for sample glazing using different solar sensor types, including Eppley PSP and Li-Cor sensors, and (3) The development of an improved method to analyze chiller efficiency and operation at part-load conditions. Second, three new calibration methods were developed and analyzed, including: (1) A new percentile analysis added to the previous signature method for use with a DOE-2 calibration, (2) A new analysis to account for undocumented exhaust air in DOE-2 calibration, and (3) An analysis of the impact of synthesized direct normal solar radiation using the Erbs correlation on DOE-2 simulation. Third, an analysis of the actual energy savings compared to three different energy baselines was performed, including: (1) Energy Use Index (EUI) comparisons with sub-metered data, (2) New comparisons against Standards 90.1-1989 and 90.1-2001, and (3) A new evaluation of the performance of selected Energy Conservation Design Measures (ECDMs). Finally, potential energy savings were also simulated from selected improvements, including: minimum supply air flow, undocumented exhaust air, and daylighting.

Waste-to-energy: A review of life cycle assessment and its extension methods.

PubMed

Zhou, Zhaozhi; Tang, Yuanjun; Chi, Yong; Ni, Mingjiang; Buekens, Alfons

2018-01-01

This article proposes a comprehensive review of evaluation tools based on life cycle thinking, as applied to waste-to-energy. Habitually, life cycle assessment is adopted to assess environmental burdens associated with waste-to-energy initiatives. Based on this framework, several extension methods have been developed to focus on specific aspects: Exergetic life cycle assessment for reducing resource depletion, life cycle costing for evaluating its economic burden, and social life cycle assessment for recording its social impacts. Additionally, the environment-energy-economy model integrates both life cycle assessment and life cycle costing methods and judges simultaneously these three features for sustainable waste-to-energy conversion. Life cycle assessment is sufficiently developed on waste-to-energy with concrete data inventory and sensitivity analysis, although the data and model uncertainty are unavoidable. Compared with life cycle assessment, only a few evaluations are conducted to waste-to-energy techniques by using extension methods and its methodology and application need to be further developed. Finally, this article succinctly summarises some recommendations for further research.

Evaluating methods of inferring gene regulatory networks highlights their lack of performance for single cell gene expression data.

PubMed

Chen, Shuonan; Mar, Jessica C

2018-06-19

A fundamental fact in biology states that genes do not operate in isolation, and yet, methods that infer regulatory networks for single cell gene expression data have been slow to emerge. With single cell sequencing methods now becoming accessible, general network inference algorithms that were initially developed for data collected from bulk samples may not be suitable for single cells. Meanwhile, although methods that are specific for single cell data are now emerging, whether they have improved performance over general methods is unknown. In this study, we evaluate the applicability of five general methods and three single cell methods for inferring gene regulatory networks from both experimental single cell gene expression data and in silico simulated data. Standard evaluation metrics using ROC curves and Precision-Recall curves against reference sets sourced from the literature demonstrated that most of the methods performed poorly when they were applied to either experimental single cell data, or simulated single cell data, which demonstrates their lack of performance for this task. Using default settings, network methods were applied to the same datasets. Comparisons of the learned networks highlighted the uniqueness of some predicted edges for each method. The fact that different methods infer networks that vary substantially reflects the underlying mathematical rationale and assumptions that distinguish network methods from each other. This study provides a comprehensive evaluation of network modeling algorithms applied to experimental single cell gene expression data and in silico simulated datasets where the network structure is known. Comparisons demonstrate that most of these assessed network methods are not able to predict network structures from single cell expression data accurately, even if they are specifically developed for single cell methods. Also, single cell methods, which usually depend on more elaborative algorithms, in general have less similarity to each other in the sets of edges detected. The results from this study emphasize the importance for developing more accurate optimized network modeling methods that are compatible for single cell data. Newly-developed single cell methods may uniquely capture particular features of potential gene-gene relationships, and caution should be taken when we interpret these results.

AIM - Agile Instrumented Monitoring for Improving User Experience of Participation in HealthIT Development.

PubMed

Pitkänen, Janne; Nieminen, Marko

2017-01-01

Participation of healthcare professionals in information technology development has emerged as an important challenge. As end-users, the professionals are willing to participate in the development activities, but their experiences on the current methods of participation remain mostly negative. There is lack of applicable methods for meeting the needs of agile development approach and scaling up to the largest implementation projects, while maintaining the interest of the professional users to participate in development activities and keeping up their ability to continue working in a productive manner. In this paper, we describe the Agile Instrumented Monitoring as a methodology, based on the methods of instrumented usability evaluation, for improving user experience in HealthIT development. The contribution of the proposed methodology is analyzed in relation to activities of whole iteration cycle and chosen usability evaluation methods, while the user experience of participation is addressed regarding healthcare professionals. Prospective weak and strong market tests for AIM are discussed in the conclusions for future work.

Development, Evaluation, and Validation of Environmental Assessment Tools to Evaluate the College Nutrition Environment

ERIC Educational Resources Information Center

Freedman, Marjorie R.

2010-01-01

Objective: To develop, evaluate, and validate 2 nutrition environment assessment tools (surveys), for specific use in combating overweight on college/university campuses. Participants and Methods: Invitations to complete surveys were e-mailed to food service and health center directors at 47 universities, Winter 2008. Overall response rate was…

Circles of Care: Development and Initial Evaluation of a Peer Support Model for African Americans with Advanced Cancer

ERIC Educational Resources Information Center

Hanson, Laura C.; Armstrong, Tonya D.; Green, Melissa A.; Hayes, Michelle; Peacock, Stacie; Elliot-Bynum, Sharon; Goldmon, Moses V.; Corbie-Smith, Giselle; Earp, Jo Anne

2013-01-01

Peer support interventions extend care and health information to underserved populations yet rarely address serious illness. Investigators from a well-defined academic-community partnership developed and evaluated a peer support intervention for African Americans facing advanced cancer. Evaluation methods used the Reach, Efficacy, Adoption,…

Improving Human Services: Methods for Systematic Planning, Evaluation, and Staff Development.

ERIC Educational Resources Information Center

Jones, G. Brian; And Others

This monograph speaks to the basic problems confronting human services programs, and offers suggestions for improving guidance services. Specific concerns addressed are: (1) the need for more systematic program planning and evaluation; (2) an approach to effective planning and evaluation; (3) development of staff skills for use in the…

School Furniture Development: An Evaluation. Educational Studies and Documents No. 16.

ERIC Educational Resources Information Center

Scriven (F.B.) and Associates, London (England).

Unesco is playing an increasingly important role in helping developing countries adapt school furniture in line with educational methods and goals. This publication includes an independent evaluation of Unesco's school furniture projects in Sri Lanka and Tunisia. For purposes of comparison, evaluation of a furniture project carried out by the…

Understanding the workplace culture of a special care nursery.

PubMed

Wilson, Valerie J; McCormack, Brendan G; Ives, Glenice

2005-04-01

This paper presents findings from the first phase of a research study focusing on implementation and evaluation of emancipatory practice development strategies. Understanding the culture of practice is essential to undertaking effective developments in practice. Culture is a dominant feature of discussions about modernizing health care, yet few studies have been undertaken that systematically evaluate the development of effective practice cultures. The study intervention is that of emancipatory practice development with an integrated evaluation approach based on Realistic Evaluation. The aim of Realistic Evaluation is to evaluate relationships between Context (setting), Mechanism (process characteristics) and Outcome (arising from the context-mechanism configuration). This first phase of the study focuses on uncovering the context (in particular the culture) of the Special Care Nursery in order to evaluate the emancipatory practice development processes and outcomes. Data collection methods included survey, participant observation and interview. Cognitive mapping, constant comparative method and coding were used to analyse the data. Findings. Four key categories were identified: Teamwork, Learning in Practice, Inevitability of Change and Family-Centred Care and collectively these formed a central category of Core Values and Beliefs. A number of themes were identified in each category, and reflected tensions that existed between differing values and beliefs within the culture of the unit. Understanding values and beliefs is an important part of understanding a workplace culture. Whilst survey methods are capable of outlining espoused workplace characteristics, observation of staff interactions and perceptions gives an understanding of culture as a living entity manifested through interpersonal relationships. Attempts at changing workplace cultures should start from the clarification of values held among staff in that culture.

Development and evaluation of a hybrid averaged orbit generator

NASA Technical Reports Server (NTRS)

Mcclain, W. D.; Long, A. C.; Early, L. W.

1978-01-01

A rapid orbit generator based on a first-order application of the Generalized Method of Averaging has been developed for the Research and Development (R&D) version of the Goddard Trajectory Determination System (GTDS). The evaluation of the averaged equations of motion can use both numerically averaged and recursively evaluated, analytically averaged perturbation models. These equations are numerically integrated to obtain the secular and long-period motion. Factors affecting efficient orbit prediction are discussed and guidelines are presented for treatment of each major perturbation. Guidelines for obtaining initial mean elements compatible with the theory are presented. An overview of the orbit generator is presented and comparisons with high precision methods are given.

Factors influencing the results of faculty evaluation in Isfahan University of Medical Sciences.

PubMed

Kamali, Farahnaz; Yamani, Nikoo; Changiz, Tahereh; Zoubin, Fatemeh

2018-01-01

This study aimed to explore factors influencing the results of faculty member evaluation from the viewpoints of faculty members affiliated with Isfahan University of Medical Sciences, Isfahan, Iran. This qualitative study was done using a conventional content analysis method. Participants were faculty members of Isfahan University of Medical Sciences who, considering maximum variation in sampling, were chosen with a purposive sampling method. Semi-structured interviews were held with 11 faculty members until data saturation was reached. The interviews were transcribed verbatim and analyzed with conventional content analysis method for theme development. Further, the MAXQDA software was used for data management. The data analysis led to the development of two main themes, namely, "characteristics of the educational system" and "characteristics of the faculty member evaluation system." The first main theme consists of three categories, i.e. "characteristics of influential people in evaluation," "features of the courses," and "background characteristics." The other theme has the following as its categories: "evaluation methods," "evaluation tools," "evaluation process," and "application of evaluation results." Each category will have its subcategories. Many factors affect the evaluation of faculty members that should be taken into account by educational policymakers for improving the quality of the educational process. In addition to the factors that directly influence the educational system, methodological problems in the evaluation system need special attention.

Evaluation of design methods to determine scour depths for bridge structures : [technical summary].

DOT National Transportation Integrated Search

2013-01-01

Scour of bridge foundations is the most common cause of bridge failures. The Federal Highway Administration : (FHWA) has developed a design method, HEC-18, for the state Departments of Transportation (DOTs) to evaluate : the scour potential of existi...

EVALUATION OF TWO METHODS FOR PREDICTION OF BIOACCUMULATION FACTORS

EPA Science Inventory

Two methods for deriving bioaccumulation factors (BAFs) used by the U.S. Environmental Protection Agency (EPA) in development of water quality criteria were evaluated using polychlorinated biphenyls (PCB) data from the Hudson River and Green Bay ecosystems. Greater than 90% of th...

EVALUATION OF FUGITIVE EMISSIONS USING GROUND-BASED OPTICAL REMOTE SENSING TECHNOLOGY

EPA Science Inventory

EPA has developed and evaluated a method for characterizing fugitive emissions from large area sources. The method, known as radial plume mapping (RPM) uses multiple-beam, scanning, optical remote sensing (ORS) instrumentation such as open-path Fourier transform infrared spectro...

CHARACTERIZATION AND ISOLATION OF ORGANIC TOXICANTS IN WHOLE SEDIMENT TOXICITY INDENTIFICATION EVALUATIONS (TIES)

EPA Science Inventory

Development of whole sediment toxicity identification and evaluation (TIEs) methods has been under way for approximately four years. These methods are necessary to define cause and effect relationships in toxic sediments during ecological risk assessments, remediation and disposa...

METHODS FOR EVALUATING THE SUSTAINABILITY OF GREEN PROCESSES

EPA Science Inventory

A methodology, called GREENSCOPE (Gauging Reaction Effectiveness for the ENvironmental Sustainability of Chemistries with a multi-Objective Process Evaluator), has been developed in the U.S. EPA's Office of Research and Development to directly compare the sustainability of proces...

Hazardous Waste Test Methods / SW-846

EPA Pesticide Factsheets

The Resource Conservation and Recovery Act Test Methods for Evaluating Solid Waste: Physical/Chemical Methods (SW-846) provide guidance to analytical scientists, enforcement officers and method developers across a variety of sectors.

The Development of Evaluation Model for Internal Quality Assurance System of Dramatic Arts College of Bunditpattanasilpa Institute

ERIC Educational Resources Information Center

Sinthukhot, Kittisak; Srihamongkol, Yannapat; Luanganggoon, Nuchwana; Suwannoi, Paisan

2013-01-01

The research purpose was to develop an evaluation model for the internal quality assurance system of the dramatic arts College of Bunditpattanasilpa Institute. The Research and Development method was used as research methodology which was divided into three phases; "developing the model and its guideline", "trying out the actual…

The Development and Evaluation of Training Methods for Group IV Personnel. 1. Orientation and Implementation of the Training Methods Development School (TMDS).

ERIC Educational Resources Information Center

Steinemann, John H.

The investigation is part of continuing Navy research on the Trainability of Group IV (low ability) personnel intended to maximize the utilization and integration of marginal personnel in the fleet. An experimental Training Methods Development School (TMDS) was initiated to provide an experimental training program, with research controls, for…

Developing Sustainable Life Support System Concepts

NASA Technical Reports Server (NTRS)

Thomas, Evan A.

2010-01-01

Sustainable spacecraft life support concepts may allow the development of more reliable technologies for long duration space missions. Currently, life support technologies at different levels of development are not well evaluated against each other, and evaluation methods do not account for long term reliability and sustainability of the hardware. This paper presents point-of-departure sustainability evaluation criteria for life support systems, that may allow more robust technology development, testing and comparison. An example sustainable water recovery system concept is presented.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses.

PubMed

Flemming, Kate; Booth, Andrew; Hannes, Karin; Cargo, Margaret; Noyes, Jane

2018-05-01

To outline contemporary and novel developments for the presentation and reporting of syntheses of qualitative, implementation, and process evaluation evidence and provide recommendations for the use of reporting guidelines. An overview of reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses drawing on current international literature and the collective expert knowledge of the Cochrane Qualitative and Implementation Methods Group. Several reporting guidelines exist that can be used or adapted to report syntheses of qualitative, implementation, and process evaluation evidence. Methods to develop individual guidance varied. The use of a relevant reporting guideline can enhance the transparency, consistency, and quality of reporting. Guidelines that exist are generic, method specific, and for particular aspects of the reviewing process, searching. Caution is expressed over the potential for reporting guidelines to produce a mechanistic approach moving the focus away from the content and toward the procedural aspects of the review. The use of a reporting guideline is recommended and a five-step decision flowchart to guide the choice of reporting guideline is provided. Gaps remain in method-specific reporting guidelines such as mixed-study, implementation, and process evaluation evidence syntheses. Copyright © 2017 Elsevier Inc. All rights reserved.

Dynamic Chest Image Analysis: Evaluation of Model-Based Pulmonary Perfusion Analysis With Pyramid Images

DTIC Science & Technology

2001-10-25

Image Analysis aims to develop model-based computer analysis and visualization methods for showing focal and general abnormalities of lung ventilation and perfusion based on a sequence of digital chest fluoroscopy frames collected with the Dynamic Pulmonary Imaging technique 18,5,17,6. We have proposed and evaluated a multiresolutional method with an explicit ventilation model based on pyramid images for ventilation analysis. We have further extended the method for ventilation analysis to pulmonary perfusion. This paper focuses on the clinical evaluation of our method for

Regenerated cellulose capsules for controlled drug delivery: Part III. Developing a fabrication method and evaluating extemporaneous utility for controlled-release.

PubMed

Bhatt, Bhavik; Kumar, Vijay

2016-08-25

In this article, we describe a method to utilize cellulose dissolved in dimethyl sulfoxide and paraformaldehyde solvent system to fabricate two-piece regenerated cellulose hard shell capsules for their potential use as an oral controlled drug delivery a priori vehicle. A systematic evaluation of solution rheology as well as resulting capsule mechanical, visual and thermal analysis was performed to develop a suitable method to repeatedly fabricate RC hard shell capsule halves. Because of the viscoelastic nature of the cellulose solution, a combination of dip-coating and casting method, herein referred to as dip-casting method, was developed. The dip-casting method was formalized by utilizing two-stage 2(2) full factorial design approach in order to determine a suitable approach to fabricate capsules with minimal variability. Thermal annealing is responsible for imparting shape rigidity of the capsules. Proof-of-concept analysis for the utility of these capsules in controlled drug delivery was performed by evaluating the release of KCl from them as well as from commercially available USP equivalent formulations. Release of KCl from cellulose capsules was comparable to extended release capsule formulation. Copyright © 2016 Elsevier B.V. All rights reserved.

Emlen funnel experiments revisited: methods update for studying compass orientation in songbirds.

PubMed

Bianco, Giuseppe; Ilieva, Mihaela; Veibäck, Clas; Öfjäll, Kristoffer; Gadomska, Alicja; Hendeby, Gustaf; Felsberg, Michael; Gustafsson, Fredrik; Åkesson, Susanne

2016-10-01

Migratory songbirds carry an inherited capacity to migrate several thousand kilometers each year crossing continental landmasses and barriers between distant breeding sites and wintering areas. How individual songbirds manage with extreme precision to find their way is still largely unknown. The functional characteristics of biological compasses used by songbird migrants has mainly been investigated by recording the birds directed migratory activity in circular cages, so-called Emlen funnels. This method is 50 years old and has not received major updates over the past decades. The aim of this work was to compare the results from newly developed digital methods with the established manual methods to evaluate songbird migratory activity and orientation in circular cages.We performed orientation experiments using the European robin ( Erithacus rubecula ) using modified Emlen funnels equipped with thermal paper and simultaneously recorded the songbird movements from above. We evaluated and compared the results obtained with five different methods. Two methods have been commonly used in songbirds' orientation experiments; the other three methods were developed for this study and were based either on evaluation of the thermal paper using automated image analysis, or on the analysis of videos recorded during the experiment.The methods used to evaluate scratches produced by the claws of birds on the thermal papers presented some differences compared with the video analyses. These differences were caused mainly by differences in scatter, as any movement of the bird along the sloping walls of the funnel was recorded on the thermal paper, whereas video evaluations allowed us to detect single takeoff attempts by the birds and to consider only this behavior in the orientation analyses. Using computer vision, we were also able to identify and separately evaluate different behaviors that were impossible to record by the thermal paper.The traditional Emlen funnel is still the most used method to investigate compass orientation in songbirds under controlled conditions. However, new numerical image analysis techniques provide a much higher level of detail of songbirds' migratory behavior and will provide an increasing number of possibilities to evaluate and quantify specific behaviors as new algorithms will be developed.

Recent Advances in Resonance Region Nuclear Data Measurements and Analyses for Supporting Nuclear Energy Applications

NASA Astrophysics Data System (ADS)

Dunn, Michael

2008-10-01

For over 30 years, the Oak Ridge National Laboratory (ORNL) has performed research and development to provide more accurate nuclear cross-section data in the resonance region. The ORNL Nuclear Data (ND) Program consists of four complementary areas of research: (1) cross-section measurements at the Oak Ridge Electron Linear Accelerator; (2) resonance analysis methods development with the SAMMY R-matrix analysis software; (3) cross-section evaluation development; and (4) cross-section processing methods development with the AMPX software system. The ND Program is tightly coupled with nuclear fuel cycle analyses and radiation transport methods development efforts at ORNL. Thus, nuclear data work is performed in concert with nuclear science and technology needs and requirements. Recent advances in each component of the ORNL ND Program have led to improvements in resonance region measurements, R-matrix analyses, cross-section evaluations, and processing capabilities that directly support radiation transport research and development. Of particular importance are the improvements in cross-section covariance data evaluation and processing capabilities. The benefit of these advances to nuclear science and technology research and development will be discussed during the symposium on Nuclear Physics Research Connections to Nuclear Energy.

RESEARCH TOWARDS DEVELOPING METHODS FOR SELECTED PHARMACEUTICAL AND PERSONAL CARE PRODUCTS (PPCPS) ADAPTED FOR BIOSOLIDS

EPA Science Inventory

Development, standardization, and validation of analytical methods provides state-of-the-science

techniques to evaluate the presence, or absence, of select PPCPs in biosolids. This research

provides the approaches, methods, and tools to assess the exposures and redu...

DEVELOPMENT OF THE EPA RELATIVE MOLDINESS INDEX© AND ITS RELATIONSHIP TO HEALTH

EPA Science Inventory

This study compared two binary classification methods to evaluate the mold condition in 271 homes of infants, 144 of which later developed symptoms of respiratory illness. A method using on-site visual mold inspection was compared to another method using a quantitative index of ...

[Development of a program theory as a basis for the evaluation of a dementia special care unit].

PubMed

Adlbrecht, Laura; Bartholomeyczik, Sabine; Mayer, Hanna

2018-06-01

Background: An existing dementia special care unit should be evaluated. In order to build a sound foundation of the evaluation a deep theoretical understanding of the implemented intervention is needed, which has not been explicated yet. One possibility to achieve this is the development of a program theory. Aim: The aim is to present a method to develop a program theory for the existing living and care concept of the dementia special care unit, which is used in a larger project to evaluate the concept theory-drivenly. Method: The evaluation is embedded in the framework of van Belle et al. (2010) and an action model and a change model (Chen, 2015) is created. For the specification of the change model the contribution analysis (Mayne, 2011) is applied. Data were collected in workshops with the developers and the nurses of the dementia special care unit and a literature research concerning interventions and outcomes was carried out. The results were synthesized in a consens workshop. Results: The action model describes the interventions of the dementia special care unit, the implementers, the organization and the context. The change model compromises the mechanisms through which interventions achieve outcomes. Conclusions: The results of the program theory can be employed to choose data collection methods and instruments for the evaluation. On the basis of the results of the evaluation the program theory can be refined and adapted.

Nondestructive Techniques to Evaluate the Characteristics and Development of Engineered Cartilage

PubMed Central

Mansour, Joseph M.; Lee, Zhenghong; Welter, Jean F.

2016-01-01

In this review, methods for evaluating the properties of tissue engineered (TE) cartilage are described. Many of these have been developed for evaluating properties of native and osteoarthritic articular cartilage. However, with the increasing interest in engineering cartilage, specialized methods are needed for nondestructive evaluation of tissue while it is developing and after it is implanted. Such methods are needed, in part, due to the large inter- and intra-donor variability in the performance of the cellular component of the tissue, which remains a barrier to delivering reliable TE cartilage for implantation. Using conventional destructive tests, such variability makes it near-impossible to predict the timing and outcome of the tissue engineering process at the level of a specific piece of engineered tissue and also makes it difficult to assess the impact of changing tissue engineering regimens. While it is clear that the true test of engineered cartilage is its performance after it is implanted, correlation of pre and post implantation properties determined non-destructively in vitro and/or in vivo with performance should lead to predictive methods to improve quality-control and to minimize the chances of implanting inferior tissue. PMID:26817458

Solid lubricants: A survey

NASA Technical Reports Server (NTRS)

Campbell, M. E.

1972-01-01

A survey is presented of the most recent developments and trends in the field of solid lubrication. Topics discussed include: a history of solid lubrication, lubricating solids, bonded lubricants, new developments, methods of evaluation, environmental effects, application methods, novel materials, and designs for the use of solid lubricants. Excerpts of solid lubricant specifications and a discussion of contact stresses imposed on specimens in three types of test machines used for the evaluation of solid lubricants are presented.

The biospeckle method for the investigation of agricultural crops: A review

NASA Astrophysics Data System (ADS)

Zdunek, Artur; Adamiak, Anna; Pieczywek, Piotr M.; Kurenda, Andrzej

2014-01-01

Biospeckle is a nondestructive method for the evaluation of living objects. It has been applied to medicine, agriculture and microbiology for monitoring processes related to the movement of material particles. Recently, this method is extensively used for evaluation of quality of agricultural crops. In the case of botanical materials, the sources of apparent biospeckle activity are the Brownian motions and biological processes such as cyclosis, growth, transport, etc. Several different applications have been shown to monitor aging and maturation of samples, organ development and the detection and development of defects and diseases. This review will focus on three aspects: on the image analysis and mathematical methods for biospeckle activity evaluation, on published applications to botanical samples, with special attention to agricultural crops, and on interpretation of the phenomena from a biological point of view.

[Development of ICP-OES, ICP-MS and GF-AAS Methods for Simultaneous Quantification of Lead, Total Arsenic and Cadmium in Soft Drinks].

PubMed

Kataoka, Yohei; Watanabe, Takahiro; Hayashi, Tomoko; Teshima, Reiko; Matsuda, Rieko

2015-01-01

In this study, we developed methods to quantify lead, total arsenic and cadmium contained in various kinds of soft drinks, and we evaluated their performance. The samples were digested by common methods to prepare solutions for measurement by ICP-OES, ICP-MS and graphite furnace atomic absorption spectrometry (GF-AAS). After digestion, internal standard was added to the digestion solutions for measurements by ICP-OES and ICP-MS. For measurement by GF-AAS, additional purification of the digestion solution was conducted by back-extraction of the three metals into nitric acid solution after extraction into an organic solvent with ammonium pyrrolidine dithiocarbamate. Performance of the developed methods were evaluated for eight kinds of soft drinks.

Development and Evaluation of the Method with an Affective Interface for Promoting Employees' Morale

NASA Astrophysics Data System (ADS)

Fujino, Hidenori; Ishii, Hirotake; Shimoda, Hiroshi; Yoshikawa, Hidekazu

For the sustainable society, organization management not based on the mass production and mass consumption but having the flexibility to meet to various social needs precisely is required. For realizing such management, the emploees' work morale is required. Recently, however, the emploees' work morale is tend to decrease. Therefore, in this study, the authors developed the model of the method for promoting and keeping employees' work morale effectively and efficiently. Especially the authors thought “work morale” of “attitude to the work”. Based on this idea, it could be considered that the theory of the persuasion psychology and various persuasion techniques. Therefore, the model of the method applying the character agent was developed based on the forced compliance which is one of persuasion techniques based on the theory of the cognitive dissonance. By the evaluation experiment using human subjects, it was confirmed that developed method could improve workers' work morle effectively.

Development of test methods for textile composites

NASA Technical Reports Server (NTRS)

Masters, John E.; Ifju, Peter G.; Fedro, Mark J.

1993-01-01

NASA's Advanced Composite Technology (ACT) Program was initiated in 1990 with the purpose of developing less costly composite aircraft structures. A number of innovative materials and processes were evaluated as a part of this effort. Chief among them are composite materials reinforced with textile preforms. These new forms of composite materials bring with them potential testing problems. Methods currently in practice were developed over the years for composite materials made from prepreg tape or simple 2-D woven fabrics. A wide variety of 2-D and 3-D braided, woven, stitched, and knit preforms were suggested for application in the ACT program. The applicability of existing test methods to the wide range of emerging materials bears investigation. The overriding concern is that the values measured are accurate representations of the true material response. The ultimate objective of this work is to establish a set of test methods to evaluate the textile composites developed for the ACT Program.

Predicting moisture-induced damage to asphaltic concrete : field evaluation phase, interim report.

DOT National Transportation Integrated Search

1977-01-01

Virginia is one of seven state and federal agencies participating in a field evaluation of a stripping test method developed under NCHRP Project 4-8 (3), "Predicting Moisture- Induced Damage to Asphaltic Concrete." The test method is being used to ev...

Methods of assessing structural integrity for space shuttle vehicles

NASA Technical Reports Server (NTRS)

Anderson, R. E.; Stuckenberg, F. H.

1971-01-01

A detailed description and evaluation of nondestructive evaluation (NDE) methods are given which have application to space shuttle vehicles. Appropriate NDE design data is presented in twelve specifications in an appendix. Recommendations for NDE development work for the space shuttle program are presented.

TACCDAS Testbed Human Factors Evaluation Methodology,

DTIC Science & Technology

1980-03-01

3 TEST METHOD Development of performance criteria................... 8 Test participant identification ...................... 8 Control of...major milestones involved in the evaluation process leading up to the evaluation of the complete testbed in the field are identified. Test methods and...inevitably will be different in several ways from the intended system as foreseen by the system designers. The system users provide insights into these

Evaluation of Low-Voltage Distribution Network Index Based on Improved Principal Component Analysis

NASA Astrophysics Data System (ADS)

Fan, Hanlu; Gao, Suzhou; Fan, Wenjie; Zhong, Yinfeng; Zhu, Lei

2018-01-01

In order to evaluate the development level of the low-voltage distribution network objectively and scientifically, chromatography analysis method is utilized to construct evaluation index model of low-voltage distribution network. Based on the analysis of principal component and the characteristic of logarithmic distribution of the index data, a logarithmic centralization method is adopted to improve the principal component analysis algorithm. The algorithm can decorrelate and reduce the dimensions of the evaluation model and the comprehensive score has a better dispersion degree. The clustering method is adopted to analyse the comprehensive score because the comprehensive score of the courts is concentrated. Then the stratification evaluation of the courts is realized. An example is given to verify the objectivity and scientificity of the evaluation method.

Evaluation of Electromagnetic Near-Field Measurement Technique as Non-Destructive Testing for Composite Structures

NASA Astrophysics Data System (ADS)

Raad Hussein, Alaa; Badri Albarody, Thar M.; Megat Yusoff, Puteri Sri Melor Bt

2018-05-01

Nowadays there is no viable non-destructive method that could detect flaws in complex composite products. Such a method could provide unique tools to allow engineers to minimize time consumption and cost during the evaluation of various product parameters without disturbing production. The latest research and development on propagation waves introduce micro, radio and millimetre waves as new potential non-destructive test methods for evaluation of mechanical flaws and prediction of failure in a product during production. This paper focuses on recent developments, usage, classification of electromagnetic waves under the range of radio frequency, millimetre and micro-waves. In addition, this paper reviews the application of propagation wave and proposed a new health monitoring technique based on Doppler Effect for vibration measurement in complex composite structures. Doppler Effect is influenced by dynamic behaviour of the composite structures and both are effect by flaws occurred inside the structure. Composite manufacturers, especially Aerospace industry are demanding these methods comprehensively inspect and evaluate the damages and defects in their products.

Computation of Anisotropic Bi-Material Interfacial Fracture Parameters and Delamination Creteria

NASA Technical Reports Server (NTRS)

Chow, W-T.; Wang, L.; Atluri, S. N.

1998-01-01

This report documents the recent developments in methodologies for the evaluation of the integrity and durability of composite structures, including i) the establishment of a stress-intensity-factor based fracture criterion for bimaterial interfacial cracks in anisotropic materials (see Sec. 2); ii) the development of a virtual crack closure integral method for the evaluation of the mixed-mode stress intensity factors for a bimaterial interfacial crack (see Sec. 3). Analytical and numerical results show that the proposed fracture criterion is a better fracture criterion than the total energy release rate criterion in the characterization of the bimaterial interfacial cracks. The proposed virtual crack closure integral method is an efficient and accurate numerical method for the evaluation of mixed-mode stress intensity factors.

Spatio-Temporal Dynamic Analysis of Sustainable Development in China Based on the Footprint Family.

PubMed

Zhao, Jing; Ma, Caihong; Zhao, Xiangui; Wang, Xiaoyu

2018-02-01

The existing index systems on sustainable evaluation are mostly based on a multi index comprehensive evaluation method. The main disadvantage of this approach is that the selection and assignment of evaluation indexes are greatly influenced by subjective factors, which can result in poor comparability of results. By contrast, the Footprint Family (including ecological footprint, carbon footprint, and water footprint) is not affected by subjective factors. The Footprint Family also covers the basic tenets of sustainable development. This paper proposes use of a sustainable development evaluation index system based on the principle of the Footprint Family, and including the ecological pressure index ( EPI ), the ecological occupancy index ( EOI ), the ecological economic coordination index ( EECI ), the GHG (Greenhouse Gas) emission index ( CEI ), the water resources stress index ( WSI ), and the sustainable development index ( SDI ). Furthermore, a standard for grading the evaluated results based on global benchmarks is formulated. The results of an empirical study in China were the following. The development situation deteriorated from 1990 to 2015. The results showed that the SDI decreased from a medium level (grade 5) to a lower-medium level (grade 4). The results of this empirical study also showed that the method of evaluation can avoid the influence of subjective factors and can be used in the evaluation of sustainable development for various temporal and spatial conditions.

Spatio-Temporal Dynamic Analysis of Sustainable Development in China Based on the Footprint Family

PubMed Central

Ma, Caihong; Zhao, Xiangui; Wang, Xiaoyu

2018-01-01

The existing index systems on sustainable evaluation are mostly based on a multi index comprehensive evaluation method. The main disadvantage of this approach is that the selection and assignment of evaluation indexes are greatly influenced by subjective factors, which can result in poor comparability of results. By contrast, the Footprint Family (including ecological footprint, carbon footprint, and water footprint) is not affected by subjective factors. The Footprint Family also covers the basic tenets of sustainable development. This paper proposes use of a sustainable development evaluation index system based on the principle of the Footprint Family, and including the ecological pressure index (EPI), the ecological occupancy index (EOI), the ecological economic coordination index (EECI), the GHG (Greenhouse Gas) emission index (CEI), the water resources stress index (WSI), and the sustainable development index (SDI). Furthermore, a standard for grading the evaluated results based on global benchmarks is formulated. The results of an empirical study in China were the following. The development situation deteriorated from 1990 to 2015. The results showed that the SDI decreased from a medium level (grade 5) to a lower-medium level (grade 4). The results of this empirical study also showed that the method of evaluation can avoid the influence of subjective factors and can be used in the evaluation of sustainable development for various temporal and spatial conditions. PMID:29389886

Evaluation of flaws in carbon steel piping. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zahoor, A.; Gamble, R.M.; Mehta, H.S.

1986-10-01

The objective of this program was to develop flaw evaluation procedures and allowable flaw sizes for ferritic piping used in light water reactor (LWR) power generation facilities. The program results provide relevant ASME Code groups with the information necessary to define flaw evaluation procedures, allowable flaw sizes, and their associated bases for Section XI of the code. Because there are several possible flaw-related failure modes for ferritic piping over the LWR operating temperature range, three analysis methods were employed to develop the evaluation procedures. These include limit load analysis for plastic collapse, elastic plastic fracture mechanics (EPFM) analysis for ductilemore » tearing, and linear elastic fracture mechanics (LEFM) analysis for non ductile crack extension. To ensure the appropriate analysis method is used in an evaluation, a step by step procedure also is provided to identify the relevant acceptance standard or procedure on a case by case basis. The tensile strength and toughness properties required to complete the flaw evaluation for any of the three analysis methods are included in the evaluation procedure. The flaw evaluation standards are provided in tabular form for the plastic collapse and ductile tearing modes, where the allowable part through flaw depth is defined as a function of load and flaw length. For non ductile crack extension, linear elastic fracture mechanics analysis methods, similar to those in Appendix A of Section XI, are defined. Evaluation flaw sizes and procedures are developed for both longitudinal and circumferential flaw orientations and normal/upset and emergency/faulted operating conditions. The tables are based on margins on load of 2.77 and 1.39 for circumferential flaws and 3.0 and 1.5 for longitudinal flaws for normal/upset and emergency/faulted conditions, respectively.« less

Development and validation of an event-specific quantitative PCR method for genetically modified maize MIR162.

PubMed

Takabatake, Reona; Masubuchi, Tomoko; Futo, Satoshi; Minegishi, Yasutaka; Noguchi, Akio; Kondo, Kazunari; Teshima, Reiko; Kurashima, Takeyo; Mano, Junichi; Kitta, Kazumi

2014-01-01

A novel real-time PCR-based analytical method was developed for the event-specific quantification of a genetically modified (GM) maize event, MIR162. We first prepared a standard plasmid for MIR162 quantification. The conversion factor (Cf) required to calculate the genetically modified organism (GMO) amount was empirically determined for two real-time PCR instruments, the Applied Biosystems 7900HT (ABI7900) and the Applied Biosystems 7500 (ABI7500) for which the determined Cf values were 0.697 and 0.635, respectively. To validate the developed method, a blind test was carried out in an interlaboratory study. The trueness and precision were evaluated as the bias and reproducibility of relative standard deviation (RSDr). The determined biases were less than 25% and the RSDr values were less than 20% at all evaluated concentrations. These results suggested that the limit of quantitation of the method was 0.5%, and that the developed method would thus be suitable for practical analyses for the detection and quantification of MIR162.

Proposal of a framework for evaluating military surveillance systems for early detection of outbreaks on duty areas

PubMed Central

Meynard, Jean-Baptiste; Chaudet, Herve; Green, Andrew D; Jefferson, Henry L; Texier, Gaetan; Webber, Daniel; Dupuy, Bruce; Boutin, Jean-Paul

2008-01-01

Background In recent years a wide variety of epidemiological surveillance systems have been developed to provide early identification of outbreaks of infectious disease. Each system has had its own strengths and weaknesses. In 2002 a Working Group of the Centers for Disease Control and Prevention (CDC) produced a framework for evaluation, which proved suitable for many public health surveillance systems. However this did not easily adapt to the military setting, where by necessity a variety of different parameters are assessed, different constraints placed on the systems, and different objectives required. This paper describes a proposed framework for evaluation of military syndromic surveillance systems designed to detect outbreaks of disease on operational deployments. Methods The new framework described in this paper was developed from the cumulative experience of British and French military syndromic surveillance systems. The methods included a general assessment framework (CDC), followed by more specific methods of conducting evaluation. These included Knowledge/Attitude/Practice surveys (KAP surveys), technical audits, ergonomic studies, simulations and multi-national exercises. A variety of military constraints required integration into the evaluation. Examples of these include the variability of geographical conditions in the field, deployment to areas without prior knowledge of naturally-occurring disease patterns, the differences in field sanitation between locations and over the length of deployment, the mobility of military forces, turnover of personnel, continuity of surveillance across different locations, integration with surveillance systems from other nations working alongside each other, compatibility with non-medical information systems, and security. Results A framework for evaluation has been developed that can be used for military surveillance systems in a staged manner consisting of initial, intermediate and final evaluations. For each stage of the process parameters for assessment have been defined and methods identified. Conclusion The combined experiences of French and British syndromic surveillance systems developed for use in deployed military forces has allowed the development of a specific evaluation framework. The tool is suitable for use by all nations who wish to evaluate syndromic surveillance in their own military forces. It could also be useful for civilian mobile systems or for national security surveillance systems. PMID:18447944

Signal analysis techniques for incipient failure detection in turbomachinery

NASA Technical Reports Server (NTRS)

Coffin, T.

1985-01-01

Signal analysis techniques for the detection and classification of incipient mechanical failures in turbomachinery were developed, implemented and evaluated. Signal analysis techniques available to describe dynamic measurement characteristics are reviewed. Time domain and spectral methods are described, and statistical classification in terms of moments is discussed. Several of these waveform analysis techniques were implemented on a computer and applied to dynamic signals. A laboratory evaluation of the methods with respect to signal detection capability is described. Plans for further technique evaluation and data base development to characterize turbopump incipient failure modes from Space Shuttle main engine (SSME) hot firing measurements are outlined.

Life cycle cost assessment of future low heat rejection engines

NASA Technical Reports Server (NTRS)

Petersen, D. R.

1986-01-01

The Adiabatic Diesel Engine Component Development (ADECD) represents a project which has the objective to accelerate the development of highway truck engines with advanced technology aimed at reduced fuel consumption. The project comprises three steps, including the synthesis of a number of engine candidate designs, the coupling of each with a number of systems for utilizing exhaust gas energy, and the evaluation of each combination in terms of desirability. Particular attention is given to the employed evaluation method and the development of this method. The objective of Life Cycle Cost (LCC) evaluation in the ADECD program was to select the best from among 42 different low heat rejection engine (LHRE)/exhaust energy recovery system configurations. The LCC model is discussed along with a maintenance cost model, the evaluation strategy, the selection of parameter ranges, and a full factorial analysis.

Selection and Evaluation of Priority Domains in Global Energy Internet Standard Development Based on Technology Foresight

NASA Astrophysics Data System (ADS)

Jin, Yang; Ciwei, Gao; Jing, Zhang; Min, Sun; Jie, Yu

2017-05-01

The selection and evaluation of priority domains in Global Energy Internet standard development will help to break through limits of national investment, thus priority will be given to standardizing technical areas with highest urgency and feasibility. Therefore, in this paper, the process of Delphi survey based on technology foresight is put forward, the evaluation index system of priority domains is established, and the index calculation method is determined. Afterwards, statistical method is used to evaluate the alternative domains. Finally the top four priority domains are determined as follows: Interconnected Network Planning and Simulation Analysis, Interconnected Network Safety Control and Protection, Intelligent Power Transmission and Transformation, and Internet of Things.

A software technology evaluation program

NASA Technical Reports Server (NTRS)

Novaes-Card, David N.

1985-01-01

A set of quantitative approaches is presented for evaluating software development methods and tools. The basic idea is to generate a set of goals which are refined into quantifiable questions which specify metrics to be collected on the software development and maintenance process and product. These metrics can be used to characterize, evaluate, predict, and motivate. They can be used in an active as well as passive way by learning form analyzing the data and improving the methods and tools based upon what is learned from that analysis. Several examples were given representing each of the different approaches to evaluation. The cost of the approaches varied inversely with the level of confidence in the interpretation of the results.

The Development and Evaluation of Speaking Learning Model by Cooperative Approach

ERIC Educational Resources Information Center

Darmuki, Agus; Andayani; Nurkamto, Joko; Saddhono, Kundharu

2018-01-01

A cooperative approach-based Speaking Learning Model (SLM) has been developed to improve speaking skill of Higher Education students. This research aimed at evaluating the effectiveness of cooperative-based SLM viewed from the development of student's speaking ability and its effectiveness on speaking activity. This mixed method study combined…

Ada training evaluation and recommendations from the Gamma Ray Observatory Ada Development Team

NASA Technical Reports Server (NTRS)

1985-01-01

The Ada training experiences of the Gamma Ray Observatory Ada development team are related, and recommendations are made concerning future Ada training for software developers. Training methods are evaluated, deficiencies in the training program are noted, and a recommended approach, including course outline, time allocation, and reference materials, is offered.

Introduction of Sustainable Development in Engineers' Curricula: Problematic and Evaluation Methods

ERIC Educational Resources Information Center

Lourdel, N.; Gondran, N.; Laforest, V.; Brodhag, C.

2005-01-01

Purpose: Owing to its complexity, sustainable development cannot be simply integrated as a supplementary course within the engineers' curricula. The first point of this paper aims to focalise on how to reflect pedagogically. After dealing with these questions, a tool that can evaluate the student's understanding of sustainable development concepts…

Multiple-Methods Needs Assessment of California 4-H Science Education Programming

ERIC Educational Resources Information Center

Worker, Steven M.; Schmitt-McQuitty, Lynn; Ambrose, Andrea; Brian, Kelley; Schoenfelder, Emily; Smith, Martin H.

2017-01-01

The California 4-H Science Leadership Team conducted a statewide assessment to evaluate the needs of county-based 4-H programs related to the key areas of the 4-H Science Initiative: program development and design, professional development, curricula, evaluation, partnerships, and fund development. The use of multiple qualitative data sources…

Dextroamphetamine: a pharmacologic countermeasure for space motion sickness and orthostatic dysfunction

NASA Technical Reports Server (NTRS)

Snow, L. Dale

1996-01-01

Dextroamphetamine has potential as a pharmacologic agent for the alleviation of two common health effects associated with microgravity. As an adjuvant to Space Motion Sickness (SMS) medication, dextroamphetamine can enhance treatment efficacy by reducing undesirable Central Nervous System (CNS) side effects of SMS medications. Secondly, dextroamphetamine may be useful for the prevention of symptoms of post-mission orthostatic intolerance caused by cardiovascular deconditioning during spaceflight. There is interest in developing an intranasal delivery form of dextroamphetanmine for use as a countermeasure in microgravity conditions. Development of this dosage form will require an analytical detection method with sensitivity in the low ng range (1 to 100 ng/mL). During the 1995 Summer Faculty Fellowship Program, two analytical methods were developed and evaluated for their suitability as quantitative procedures for dextroamphetamine in studies of product stability, bioavailability assessment, and pharmacokinetic evaluation. In developing some of the analytical methods, beta-phenylethylamine, a primary amine structurally similar to dextroamphetamine, was used. The first analytical procedure to be evaluated involved hexane extraction and subsequent fluorescamine labeling of beta-phenylethylamine. The second analytical procedure to be evaluated involved quantitation of dextroamphetamine by an Enzyme-Linked ImmunoSorbent Assay (ELISA).

Usability in telemedicine systems-A literature survey.

PubMed

Klaassen, B; van Beijnum, B J F; Hermens, H J

2016-09-01

The rapid development of sensors and communication technologies enable the growth of new innovative services in healthcare, such as Telemedicine. An essential ingredient in the development of a telemedicine system and its final acceptance by end users are usability studies. The principles of usability engineering, evaluations and telemedicine are well established, and it may contribute to the adoption and eventually deployment of such systems and services. An in-depth usability analysis, including performance and attitude measures, requires knowledge about available usability techniques, and is depending on the amount of resources. Therefore it is worth investigating how usability methods are applied in developing telemedicine systems. Our hypothesis is: with increasing research and development of telemedicine systems, we expect that various usability methods are more equally employed for different end-user groups and applications. A literature survey was conducted to find telemedicine systems that have been evaluated for usability or ease of use. The elements of the PICO framework were used as a basis for the selection criteria in the literature search. The search was not limited by year. Two independent reviewers screened all search results first by title, and then by abstract for inclusion. Articles were included up to May 2015. In total, 127 publications were included in this survey. The number of publications on telemedicine systems significantly increased after 2008. Older adults and end-users with cardiovascular conditions were among largest target end-user groups. Remote monitoring systems were found the most, in 90 publications. Questionnaires are the most common means for evaluating telemedicine systems, and were found in 88 publications. Questionnaires are used frequently in studies focusing on cardiovascular diseases, Parkinson's disease and older adult conditions. Interviews are found the most in publications related to stroke. In total 71% of the publications were trial-orientated and the remaining process orientated. An increase in telemedicine research, development and applications is found worldwide, with the majority of publications conducted in America. Monitoring patients in their homes can lead to better healthcare at lower costs which implies an increased demand of new healthcare strategies like telemedicine. We expected that with the increase in telemedicine research and development, a greater range of usability methods would also be employed in the included publications. This is not the case. Researchers employed questionnaires as a preferred usability method for each type of telemedicine system and most end-users. However, in process-orientated studies a greater range of usability evaluations were applied, with fewer differences found in the amount of publications for each evaluation method. Questionnaires enable researchers to evaluate a system quickly on end users, as it requires less expertise on the evaluation method compared to the other methods. They are easily distributed and are customizable. The use of questionnaires is therefore an evaluation method of choice for a variety of telemedicine systems and end-users. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Development, validation and evaluation of an analytical method for the determination of monomeric and oligomeric procyanidins in apple extracts.

PubMed

Hollands, Wendy J; Voorspoels, Stefan; Jacobs, Griet; Aaby, Kjersti; Meisland, Ane; Garcia-Villalba, Rocio; Tomas-Barberan, Francisco; Piskula, Mariusz K; Mawson, Deborah; Vovk, Irena; Needs, Paul W; Kroon, Paul A

2017-04-28

There is a lack of data for individual oligomeric procyanidins in apples and apple extracts. Our aim was to develop, validate and evaluate an analytical method for the separation, identification and quantification of monomeric and oligomeric flavanols in apple extracts. To achieve this, we prepared two types of flavanol extracts from freeze-dried apples; one was an epicatechin-rich extract containing ∼30% (w/w) monomeric (-)-epicatechin which also contained oligomeric procyanidins (Extract A), the second was an oligomeric procyanidin-rich extract depleted of epicatechin (Extract B). The parameters considered for method optimisation were HPLC columns and conditions, sample heating, mass of extract and dilution volumes. The performance characteristics considered for method validation included standard linearity, method sensitivity, precision and trueness. Eight laboratories participated in the method evaluation. Chromatographic separation of the analytes was best achieved utilizing a Hilic column with a binary mobile phase consisting of acidic acetonitrile and acidic aqueous methanol. The final method showed linearity for epicatechin in the range 5-100μg/mL with a correlation co-efficient >0.999. Intra-day and inter-day precision of the analytes ranged from 2 to 6% and 2 to 13% respectively. Up to dp3, trueness of the method was >95% but decreased with increasing dp. Within laboratory precision showed RSD values <5 and 10% for monomers and oligomers, respectively. Between laboratory precision was 4 and 15% (Extract A) and 7 and 30% (Extract B) for monomers and oligomers, respectively. An analytical method for the separation, identification and quantification of procyanidins in an apple extract was developed, validated and assessed. The results of the inter-laboratory evaluation indicate that the method is reliable and reproducible. Copyright © 2017. Published by Elsevier B.V.

Staffing effectiveness evaluation: a best kept secret for educational needs assessment.

PubMed

Hanna, Lee Ann

2005-01-01

Staff development educators use many sources of information to conduct educational needs assessments to improve existing educational programs and to develop new ones. Staffing effectiveness evaluation information targets patient care and staffing outcomes. The overall objective of this article is to familiarize staff development educators with the staffing effectiveness evaluation process, events that have led to organizational efforts to measure it, Joint Commission on Accreditation of Healthcare Organizations' (JCAHO) expectations, methods for assessing variation and relationships of indicators, and implications for staff development educators.

Methods for comparative evaluation of propulsion system designs for supersonic aircraft

NASA Technical Reports Server (NTRS)

Tyson, R. M.; Mairs, R. Y.; Halferty, F. D., Jr.; Moore, B. E.; Chaloff, D.; Knudsen, A. W.

1976-01-01

The propulsion system comparative evaluation study was conducted to define a rapid, approximate method for evaluating the effects of propulsion system changes for an advanced supersonic cruise airplane, and to verify the approximate method by comparing its mission performance results with those from a more detailed analysis. A table look up computer program was developed to determine nacelle drag increments for a range of parametric nacelle shapes and sizes. Aircraft sensitivities to propulsion parameters were defined. Nacelle shapes, installed weights, and installed performance was determined for four study engines selected from the NASA supersonic cruise aircraft research (SCAR) engine studies program. Both rapid evaluation method (using sensitivities) and traditional preliminary design methods were then used to assess the four engines. The method was found to compare well with the more detailed analyses.

Development of method to characterize emissions from spray polyurethane foam insulation

EPA Science Inventory

This presentation updates symposium participants re EPA progress towards development of SPF insulation emissions characterization methods. The presentation highlights evaluation of experiments investigating emissions after application of SPF to substrates in micro chambers and i...

A simple way of evaluating the healthiness of ready-to-eat foods and developing healthy foods in the food industry.

PubMed

Outila, Terhi A; Simulainen, Helena; Laukkanen, Tuula H A; Maarit Kyyrö, A

2006-01-01

In this study we have developed a new way of evaluating the healthiness of ready-to-eat foods. In the developed method, ready-to-eat foods were classified into specific product categories, and the nutritional quality of classified foods was analysed using the national dietary recommendations and the national dietary survey as a basis for the dietary calculations. The method was tested with the products of 'Saarioinen', which is the leading brand in the Finnish ready-to-eat food market. Results indicate that this low-cost method can easily be used in the food industry as a tool in product development and marketing in order to develop healthy foods. The method could also be applied to the restaurant and catering trade, as well as to other public institutions serving food. By using this model, nutritional researchers and the food industry could work together to prevent nutrition-related health problems.

Issues in Selecting Methods of Evaluating Clinical Competence in the Health Professions: Implications for Athletic Training Education

ERIC Educational Resources Information Center

Middlemas, David A.; Hensal, Carleton

2009-01-01

Objectives: To examine methods used to evaluate the clinical competence and proficiency of students in medicine and allied health professions. To identify factors that would be valuable to educators in athletic training and other medical and allied health professions in the development and use of clinical assessment methods. Data Sources: We…

An Evaluation of an Elementary Science Methods Course with Respect to Preservice Teacher's Pedagogical Development

ERIC Educational Resources Information Center

Lee, Carole Kwan-Ping

2012-01-01

The science methods course is a requirement for the Bachelor of Science degree in elementary education licensure program in a mid-west state university in the U.S.A. In one semester, the author decided to evaluate the effectiveness of the science methods course in pedagogical content knowledge areas such as theory, planning and implementation.…

A novel knowledge-based potential for RNA 3D structure evaluation

NASA Astrophysics Data System (ADS)

Yang, Yi; Gu, Qi; Zhang, Ben-Gong; Shi, Ya-Zhou; Shao, Zhi-Gang

2018-03-01

Ribonucleic acids (RNAs) play a vital role in biology, and knowledge of their three-dimensional (3D) structure is required to understand their biological functions. Recently structural prediction methods have been developed to address this issue, but a series of RNA 3D structures are generally predicted by most existing methods. Therefore, the evaluation of the predicted structures is generally indispensable. Although several methods have been proposed to assess RNA 3D structures, the existing methods are not precise enough. In this work, a new all-atom knowledge-based potential is developed for more accurately evaluating RNA 3D structures. The potential not only includes local and nonlocal interactions but also fully considers the specificity of each RNA by introducing a retraining mechanism. Based on extensive test sets generated from independent methods, the proposed potential correctly distinguished the native state and ranked near-native conformations to effectively select the best. Furthermore, the proposed potential precisely captured RNA structural features such as base-stacking and base-pairing. Comparisons with existing potential methods show that the proposed potential is very reliable and accurate in RNA 3D structure evaluation. Project supported by the National Science Foundation of China (Grants Nos. 11605125, 11105054, 11274124, and 11401448).

Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation

PubMed Central

Reeves, Anthony P.; Xie, Yiting; Liu, Shuang

2017-01-01

Abstract. With the advent of fully automated image analysis and modern machine learning methods, there is a need for very large image datasets having documented segmentations for both computer algorithm training and evaluation. This paper presents a method and implementation for facilitating such datasets that addresses the critical issue of size scaling for algorithm validation and evaluation; current evaluation methods that are usually used in academic studies do not scale to large datasets. This method includes protocols for the documentation of many regions in very large image datasets; the documentation may be incrementally updated by new image data and by improved algorithm outcomes. This method has been used for 5 years in the context of chest health biomarkers from low-dose chest CT images that are now being used with increasing frequency in lung cancer screening practice. The lung scans are segmented into over 100 different anatomical regions, and the method has been applied to a dataset of over 20,000 chest CT images. Using this framework, the computer algorithms have been developed to achieve over 90% acceptable image segmentation on the complete dataset. PMID:28612037

The fragmented testis method: development and its advantages of a new quantitative evaluation technique for detection of testis-ova in male fish.

PubMed

Lin, Bin-Le; Hagino, Satoshi; Kagoshima, Michio; Iwamatsu, Takashi

2009-02-01

A new quantitative evaluation technique, termed the fragmented testis method, has been developed for the detection of testis-ova in genotypic male fish using the medaka (Oryzias latipes). The routine traditional histological method for detection of testis-ova in male fish exposed to estrogens or suspected endocrine-disrupting chemicals has several disadvantages, including possible oversight of testis-ova due to limited sampling of selected tissue sections. The method we have developed here allows for the accurate determination of the developmental stages and the number and the size of testis-ova in a whole testis. Each testis was removed from the fish specimen, fixed with 10% buffered formalin solution, and then divided into small fragments on a glass slide with a dissecting needle or scalpel and aciform forceps in glycerin solution containing a small amount of methylene blue or toluidine blue. If present, all developing testis-ova of various sizes in fragmented testicular tissues were clearly stained and were observable under a dissecting microscope. Testis-ova occurred in controls were ascertained, while spermatozoa were also distinguishable using this method. This proved to be a convenient and cost-effective method for quantitatively evaluating testis-ova appearance in fish, and it may help to clarify the mechanism of testis-ova formation and the biological significance of testis-ova in future studies of endocrine disruption.

Review on Rapid Seismic Vulnerability Assessment for Bulk of Buildings

NASA Astrophysics Data System (ADS)

Nanda, R. P.; Majhi, D. R.

2013-09-01

This paper provides a brief overview of rapid visual screening (RVS) procedures available in different countries with a comparison among all the methods. Seismic evaluation guidelines from, USA, Canada, Japan, New Zealand, India, Europe, Italy, UNDP, with other methods are reviewed from the perspective of their applicability to developing countries. The review shows clearly that some of the RVS procedures are unsuited for potential use in developing countries. It is expected that this comparative assessment of various evaluation schemes will help to identify the most essential components of such a procedure for use in India and other developing countries, which is not only robust, reliable but also easy to use with available resources. It appears that Federal Emergency Management Agency (FEMA) 154 and New Zealand Draft Code approaches can be suitably combined to develop a transparent, reasonably rigorous and generalized procedure for seismic evaluation of buildings in developing countries.

METHODS FOR EVALUATING THE SUSTAINABILITY OF GREEN PROCESSES

EPA Science Inventory

Methods for Evaluating the Sustainability of Green Processes

By Raymond L. Smith and Michael A. Gonzalez
U.S. Environmental Protection Agency
Office of Research and Development
26 W. Martin Luther King Dr.
Cincinnati, OH 45268 USA

Theme: New Challenges...

Future Issues and Perspectives in the Evaluation of Social Development.

ERIC Educational Resources Information Center

Marsden, David; Oakley, Peter

1991-01-01

An instrumental/technocratic approach to evaluation of social development relies on primarily quantitative methods. An interpretive approach resists claims to legitimacy and authority of "experts" and questions existing interpretations. The latter approach is characterized by cultural relativism and subjectivity. (SK)

Improved Vehicle Occupancy Data Collection Methods

DOT National Transportation Integrated Search

1997-04-14

This report evaluates current and emerging vehicle occupancy data collection : methodologies. Five primary methods for collecting vehicle occupancy data were : identified: the traditional roadside/windshield observation method, a recently : developed...

Reliability and validity of a quantitative color scale to evaluate masticatory performance using color-changeable chewing gum.

PubMed

Hama, Yohei; Kanazawa, Manabu; Minakuchi, Shunsuke; Uchida, Tatsuro; Sasaki, Yoshiyuki

2014-03-19

In the present study, we developed a novel color scale for visual assessment, conforming to theoretical color changes of a gum, to evaluate masticatoryperformance; moreover, we investigated the reliability and validity of this evaluation method using the color scale. Ten participants (aged 26.30 years) with natural dentition chewed the gum at several chewing strokes. Changes in color were measured using a colorimeter, and then, linearregression expressions that represented changes in gum color were derived. The color scale was developed using these regression expressions. Thirty-two chewed gums were evaluated using colorimeter and were assessed three times using the color scale by six dentists aged 25.27 (mean, 25.8) years, six preclinical dental students aged 21.23 (mean, 22.2) years, and six elderly individuals aged 68.84 (mean, 74.0) years. The intrarater and interrater reliability of evaluations was assessed using intraclass correlation coefficients. Validity of the method compared with a colorimeter was assessed using Spearman's rank correlation coefficient. All intraclass correlation coefficients were > 0.90, and Spearman's rank-correlation coefficients were > 0.95 in all groups. These results indicated that the evaluation method of the color-changeable chewing gum using the newly developed color scale is reliable and valid.

Applications of hyperspectral imaging in chicken meat safety and quality detection and evaluation: a review.

PubMed

Xiong, Zhenjie; Xie, Anguo; Sun, Da-Wen; Zeng, Xin-An; Liu, Dan

2015-01-01

Currently, the issue of food safety and quality is a great public concern. In order to satisfy the demands of consumers and obtain superior food qualities, non-destructive and fast methods are required for quality evaluation. As one of these methods, hyperspectral imaging (HSI) technique has emerged as a smart and promising analytical tool for quality evaluation purposes and has attracted much interest in non-destructive analysis of different food products. With the main advantage of combining both spectroscopy technique and imaging technique, HSI technique shows a convinced attitude to detect and evaluate chicken meat quality objectively. Moreover, developing a quality evaluation system based on HSI technology would bring economic benefits to the chicken meat industry. Therefore, in recent years, many studies have been conducted on using HSI technology for the safety and quality detection and evaluation of chicken meat. The aim of this review is thus to give a detailed overview about HSI and focus on the recently developed methods exerted in HSI technology developed for microbiological spoilage detection and quality classification of chicken meat. Moreover, the usefulness of HSI technique for detecting fecal contamination and bone fragments of chicken carcasses are presented. Finally, some viewpoints on its future research and applicability in the modern poultry industry are proposed.

Computerized quantitative evaluation of mammographic accreditation phantom images

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lee, Yongbum; Tsai, Du-Yih; Shinohara, Norimitsu

2010-12-15

Purpose: The objective was to develop and investigate an automated scoring scheme of the American College of Radiology (ACR) mammographic accreditation phantom (RMI 156, Middleton, WI) images. Methods: The developed method consisted of background subtraction, determination of region of interest, classification of fiber and mass objects by Mahalanobis distance, detection of specks by template matching, and rule-based scoring. Fifty-one phantom images were collected from 51 facilities for this study (one facility provided one image). A medical physicist and two radiologic technologists also scored the images. The human and computerized scores were compared. Results: In terms of meeting the ACR's criteria,more » the accuracies of the developed method for computerized evaluation of fiber, mass, and speck were 90%, 80%, and 98%, respectively. Contingency table analysis revealed significant association between observer and computer scores for microcalcifications (p<5%) but not for masses and fibers. Conclusions: The developed method may achieve a stable assessment of visibility for test objects in mammographic accreditation phantom image in whether the phantom image meets the ACR's criteria in the evaluation test, although there is room left for improvement in the approach for fiber and mass objects.« less

Diabetic retinopathy: retina-specific methods for maintenance of diabetic rodents and evaluation of vascular histopathology and molecular abnormalities

PubMed Central

Veenstra, Alexander; Liu, Haitao; Lee, Chieh Allen; Du, Yunpeng; Tang, Jie; Kern, Timothy S.

2015-01-01

Diabetic retinopathy is a major cause of visual impairment, which continues to increase in prevalence as more and more people develop diabetes. Despite the importance of vision, the retina is one of the smallest tissues in the body, and specialized techniques to study the retinopathy have been developed. This chapter will summarize several methods used to (i) induce diabetes, (ii) maintain the diabetic animals throughout the months required for the development of typical vascular histopathology, (iii) evaluate vascular histopathology of diabetic retinopathy, and (iv) quantitate abnormalities implicated in the development of the retinopathy. PMID:26331759

Planning and evaluating mental health services in low- and middle-income countries using theory of change

PubMed Central

Breuer, Erica; De Silva, Mary J.; Shidaye, Rahul; Petersen, Inge; Nakku, Juliet; Jordans, Mark J. D.; Fekadu, Abebaw; Lund, Crick

2016-01-01

Background There is little practical guidance on how contextually relevant mental healthcare plans (MHCPs) can be developed in low-resource settings. Aims To describe how theory of change (ToC) was used to plan the development and evaluation of MHCPs as part of the PRogramme for Improving Mental health carE (PRIME). Method ToC development occurred in three stages: (a) development of a cross-country ToC by 15 PRIME consortium members; (b) development of country-specific ToCs in 13 workshops with a median of 15 (interquartile range 13–22) stakeholders per workshop; and (c) review and refinement of the cross-country ToC by 18 PRIME consortium members. Results One cross-country and five district ToCs were developed that outlined the steps required to improve outcomes for people with mental disorders in PRIME districts. Conclusions ToC is a valuable participatory method that can be used to develop MHCPs and plan their evaluation. PMID:26447178

Fault tolerant testbed evaluation, phase 1

NASA Technical Reports Server (NTRS)

Caluori, V., Jr.; Newberry, T.

1993-01-01

In recent years, avionics systems development costs have become the driving factor in the development of space systems, military aircraft, and commercial aircraft. A method of reducing avionics development costs is to utilize state-of-the-art software application generator (autocode) tools and methods. The recent maturity of application generator technology has the potential to dramatically reduce development costs by eliminating software development steps that have historically introduced errors and the need for re-work. Application generator tools have been demonstrated to be an effective method for autocoding non-redundant, relatively low-rate input/output (I/O) applications on the Space Station Freedom (SSF) program; however, they have not been demonstrated for fault tolerant, high-rate I/O, flight critical environments. This contract will evaluate the use of application generators in these harsh environments. Using Boeing's quad-redundant avionics system controller as the target system, Space Shuttle Guidance, Navigation, and Control (GN&C) software will be autocoded, tested, and evaluated in the Johnson (Space Center) Avionics Engineering Laboratory (JAEL). The response of the autocoded system will be shown to match the response of the existing Shuttle General Purpose Computers (GPC's), thereby demonstrating the viability of using autocode techniques in the development of future avionics systems.

The acoustical design of vehicles-a challenge for qualitative evaluation

NASA Astrophysics Data System (ADS)

Schulte-Fortkamp, Brigitte; Genuit, Klaus; Fiebig, Andre

2005-09-01

Whenever the acoustical design of vehicles is explored, the crucial question about the appropriate method of evaluation arises. Research shows that not only acoustic but also non-acoustic parameters have a major influence on the way sounds are evaluated. Therefore, new methods of evaluation have to be implemented. Methods are needed which give the opportunity to test the quality of the given ambience and to register the effects and evaluations in their functional interdependence as well as the influence of personal and contextual factors. Moreover, new methods have to give insight into processes of evaluation and their contextual parameters. In other words, the task of evaluating acoustical ambiences consists of designating a set of social, psychological, and cultural conditions which are important to determine particular individual and collective behavior, attitudes, and also emotions relative to the given ambience. However, no specific recommendations exist yet which comprise particular descriptions of how to assess those specific sound effects. That is why there is a need to develop alternative methods of evaluation with whose help effects of acoustical ambiences can be better predicted. A method of evaluation will be presented which incorporates a new sensitive approach for the evaluation of vehicle sounds.

Development and testing of controller performance evaluation methodology for multi-input/multi-output digital control systems

NASA Technical Reports Server (NTRS)

Pototzky, Anthony; Wieseman, Carol; Hoadley, Sherwood Tiffany; Mukhopadhyay, Vivek

1991-01-01

Described here is the development and implementation of on-line, near real time controller performance evaluation (CPE) methods capability. Briefly discussed are the structure of data flow, the signal processing methods used to process the data, and the software developed to generate the transfer functions. This methodology is generic in nature and can be used in any type of multi-input/multi-output (MIMO) digital controller application, including digital flight control systems, digitally controlled spacecraft structures, and actively controlled wind tunnel models. Results of applying the CPE methodology to evaluate (in near real time) MIMO digital flutter suppression systems being tested on the Rockwell Active Flexible Wing (AFW) wind tunnel model are presented to demonstrate the CPE capability.

A Sample of NASA Langley Unsteady Pressure Experiments for Computational Aerodynamics Code Evaluation

NASA Technical Reports Server (NTRS)

Schuster, David M.; Scott, Robert C.; Bartels, Robert E.; Edwards, John W.; Bennett, Robert M.

2000-01-01

As computational fluid dynamics methods mature, code development is rapidly transitioning from prediction of steady flowfields to unsteady flows. This change in emphasis offers a number of new challenges to the research community, not the least of which is obtaining detailed, accurate unsteady experimental data with which to evaluate new methods. Researchers at NASA Langley Research Center (LaRC) have been actively measuring unsteady pressure distributions for nearly 40 years. Over the last 20 years, these measurements have focused on developing high-quality datasets for use in code evaluation. This paper provides a sample of unsteady pressure measurements obtained by LaRC and available for government, university, and industry researchers to evaluate new and existing unsteady aerodynamic analysis methods. A number of cases are highlighted and discussed with attention focused on the unique character of the individual datasets and their perceived usefulness for code evaluation. Ongoing LaRC research in this area is also presented.

Ohio's Abandoned Mine Lands Reclamation Program: a Study of Data Collection and Evaluation Techniques

NASA Technical Reports Server (NTRS)

Sperry, S. L.

1982-01-01

The planning process for a statewide reclamation plan of Ohio abandoned minelands in response to the Federal Surface Mining Control and Reclamation Act of 1977 included: (1) the development of a screening and ranking methodology; (2) the establishment of a statewide review of major watersheds affected by mining; (3) the development of an immediate action process; and (4) a prototypical study of a priority watershed demonstrating the data collection, analysis, display and evaluation to be used for the remaining state watersheds. Historical methods for satisfying map information analysis and evaluation, as well as current methodologies being used were discussed. Various computer mapping and analysis programs were examined for their usability in evaluating the priority reclamation sites. Hand methods were chosen over automated procedures; intuitive evaluation was the primary reason.

Correspondence: In support of the IES method of evaluating light source colour rendition

DOE PAGES

Ashdown, I.; Aviles, G.; Bennett, L.; ...

2015-11-20

In this editorial, written as an open letter to the lighting community, we stand in support of widespread adoption of TM-30-15: The IES Method of Evaluating Light Source Color Rendition. We introduce important considerations related to light source color rendition, define the need for a new method of evaluation, provide a high-level overview of the IES method, discuss some of the practical considerations related to the development of the IES method and the consensus process, and conclude by inviting you to join us in support of the new measures and graphics described in TM-30-15.

Pharmaceutical and analytical evaluation of triphalaguggulkalpa tablets

PubMed Central

Savarikar, Shreeram S.; Barbhind, Maneesha M.; Halde, Umakant K.; Kulkarni, Alpana P.

2011-01-01

Aim of the Study: Development of standardized, synergistic, safe and effective traditional herbal formulations with robust scientific evidence can offer faster and more economical alternatives for the treatment of disease. The main objective was to develop a method of preparation of guggulkalpa tablets so that the tablets meet the criteria of efficacy, stability, and safety. Materials and Methods: Triphalaguggulkalpa tablet, described in sharangdharsanhita and containing guggul and triphala powder, was used as a model drug. Preliminary experiments on marketed triphalaguggulkalpa tablets exhibited delayed in vitro disintegration that indicated probable delayed in vivo disintegration. The study involved preparation of triphalaguggulkalpa tablets by Ayurvedic text methods and by wet granulation, dry granulation, and direct compression method. The tablets were evaluated for loss on drying, volatile oil content, % solubility, and steroidal content. The tablets were evaluated for performance tests like weight variation, disintegration, and hardness. Results: It was observed that triphalaguggulkalpa tablets, prepared by direct compression method, complied with the hardness and disintegration tests, whereas tablets prepared by Ayurvedic text methods failed. Conclusion: Direct compression is the best method of preparing triphalaguggulkalpa tablets. PMID:21731383

Knowledge-based system verification and validation

NASA Technical Reports Server (NTRS)

Johnson, Sally C.

1990-01-01

The objective of this task is to develop and evaluate a methodology for verification and validation (V&V) of knowledge-based systems (KBS) for space station applications with high reliability requirements. The approach consists of three interrelated tasks. The first task is to evaluate the effectiveness of various validation methods for space station applications. The second task is to recommend requirements for KBS V&V for Space Station Freedom (SSF). The third task is to recommend modifications to the SSF to support the development of KBS using effectiveness software engineering and validation techniques. To accomplish the first task, three complementary techniques will be evaluated: (1) Sensitivity Analysis (Worchester Polytechnic Institute); (2) Formal Verification of Safety Properties (SRI International); and (3) Consistency and Completeness Checking (Lockheed AI Center). During FY89 and FY90, each contractor will independently demonstrate the user of his technique on the fault detection, isolation, and reconfiguration (FDIR) KBS or the manned maneuvering unit (MMU), a rule-based system implemented in LISP. During FY91, the application of each of the techniques to other knowledge representations and KBS architectures will be addressed. After evaluation of the results of the first task and examination of Space Station Freedom V&V requirements for conventional software, a comprehensive KBS V&V methodology will be developed and documented. Development of highly reliable KBS's cannot be accomplished without effective software engineering methods. Using the results of current in-house research to develop and assess software engineering methods for KBS's as well as assessment of techniques being developed elsewhere, an effective software engineering methodology for space station KBS's will be developed, and modification of the SSF to support these tools and methods will be addressed.

A Program Evaluation of the Basic Supervisory Development Seminar

DTIC Science & Technology

1985-08-01

evaluation. - Hoyle , English, and Steffy (1985) describe various methods that can be used to accomplisn the appropriate objectives of the evaluation...Maynihan Figure 2 Alternative Methods of Assessing Student and Program Effectiveness ( Hoyle , English, and Steffy, 1985) 21 CHAPTER III METHODCLOGY S Design...Fiedler, Fred E. "Responses to Sergiovanni." Educational Leadership (March 1979), 394-96. Fiedler, Fred E., and Martin M. Chemers. Leadership and

Enhancement in Evaluating Small Group Work in Courses with Large Number of Students. Machine Theory at Industrial Engineering Degrees

ERIC Educational Resources Information Center

Jordi Nebot, Lluïsa; Pàmies-Vilà, Rosa; Català Calderon, Pau; Puig-Ortiz, Joan

2013-01-01

This article examines new tutoring evaluation methods to be adopted in the course, Machine Theory, in the Escola Tècnica Superior d'Enginyeria Industrial de Barcelona (ETSEIB, Universitat Politècnica de Catalunya). These new methods have been developed in order to facilitate teaching staff work and include students in the evaluation process.…

Evaluation systems for clinical governance development: a comparative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Lack of scientific and confirmed researches and expert knowledge about evaluation systems for clinical governance development in Iran have made studies on different evaluation systems for clinical governance development a necessity. These studies must provide applied strategies to design criteria of implementing clinical governance for hospital's accreditation. This is a descriptive and comparative study on development of clinical governance models all over the world. Data have been gathered by reviewing related articles. Models have been studied in comprehensive review method. The evaluated models of clinical governance development were Australian, NHS, SPOCK and OPTIGOV. The final aspects extracted from these models were Responsiveness, Policies and Strategies, Organizational Structure, Allocating Resources, Education and Occupational Development, Performance Evaluation, External Evaluation, Patient Oriented Approach, Risk Management, Personnel's Participation, Information Technology, Human Resources, Research and Development, Evidence Based Medicine, Clinical Audit, Health Technology Assessment and Quality. These results are applicable for completing the present criteria which evaluating clinical governance application and provide practical framework to evaluate country's hospital on the basis of clinical governance elements.

A new quantitative evaluation method for age-related changes of individual pigmented spots in facial skin.

PubMed

Kikuchi, K; Masuda, Y; Yamashita, T; Sato, K; Katagiri, C; Hirao, T; Mizokami, Y; Yaguchi, H

2016-08-01

Facial skin pigmentation is one of the most prominent visible features of skin aging and often affects perception of health and beauty. To date, facial pigmentation has been evaluated using various image analysis methods developed for the cosmetic and esthetic fields. However, existing methods cannot provide precise information on pigmented spots, such as variations in size, color shade, and distribution pattern. The purpose of this study is the development of image evaluation methods to analyze individual pigmented spots and acquire detailed information on their age-related changes. To characterize the individual pigmented spots within a cheek image, we established a simple object-counting algorithm. First, we captured cheek images using an original imaging system equipped with an illumination unit and a high-resolution digital camera. The acquired images were converted into melanin concentration images using compensation formulae. Next, the melanin images were converted into binary images. The binary images were then subjected to noise reduction. Finally, we calculated parameters such as the melanin concentration, quantity, and size of individual pigmented spots using a connected-components labeling algorithm, which assigns a unique label to each separate group of connected pixels. The cheek image analysis was evaluated on 643 female Japanese subjects. We confirmed that the proposed method was sufficiently sensitive to measure the melanin concentration, and the numbers and sizes of individual pigmented spots through manual evaluation of the cheek images. The image analysis results for the 643 Japanese women indicated clear relationships between age and the changes in the pigmented spots. We developed a new quantitative evaluation method for individual pigmented spots in facial skin. This method facilitates the analysis of the characteristics of various pigmented facial spots and is directly applicable to the fields of dermatology, pharmacology, and esthetic cosmetology. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Expert opinions on the acceptance of alternative methods in food safety evaluations: Formulating recommendations to increase acceptance of non-animal methods for kinetics.

PubMed

Punt, Ans; Bouwmeester, Hans; Schiffelers, Marie-Jeanne W A; Peijnenburg, Ad A C M

2018-02-01

Inclusion of alternative methods that replace, reduce, or refine (3R) animal testing within regulatory safety evaluations of chemicals generally faces many hurdles. The goal of the current work is to i) collect responses from key stakeholders involved in food safety evaluations on what they consider the most relevant factors that influence the acceptance and use of 3R methods and to ii) use these responses to formulate activities needed to increase the acceptance and use of 3R methods, particularly for kinetics. The stakeholders were contacted by e-mail for their opinions, asking the respondents to write down three barriers and/or drivers and scoring these by distributing 5 points over the three factors. The main barriers that obtained the highest aggregated scores were i) uncertain predictability 3R methods/lack of validation, ii) insufficient guidance regulators/industry and iii) insufficient harmonization of legislation. The major driver identified was the possibility of 3R methods to provide more mechanistic information. Based on the results, recommendations are given to enhance the acceptance and application of 3R toxicokinetic methods in food safety evaluations. These include steering of regulatory data requirements as well as creating (funding) opportunities for development and validation of alternative methods for kinetics and development of guidances. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Methods for assessing reliability and validity for a measurement tool: a case study and critique using the WHO haemoglobin colour scale.

PubMed

White, Sarah A; van den Broek, Nynke R

2004-05-30

Before introducing a new measurement tool it is necessary to evaluate its performance. Several statistical methods have been developed, or used, to evaluate the reliability and validity of a new assessment method in such circumstances. In this paper we review some commonly used methods. Data from a study that was conducted to evaluate the usefulness of a specific measurement tool (the WHO Colour Scale) is then used to illustrate the application of these methods. The WHO Colour Scale was developed under the auspices of the WHO to provide a simple portable and reliable method of detecting anaemia. This Colour Scale is a discrete interval scale, whereas the actual haemoglobin values it is used to estimate are on a continuous interval scale and can be measured accurately using electrical laboratory equipment. The methods we consider are: linear regression, correlation coefficients, paired t-tests plotting differences against mean values and deriving limits of agreement; kappa and weighted kappa statistics, sensitivity and specificity, an intraclass correlation coefficient and the repeatability coefficient. We note that although the definition and properties of each of these methods is well established inappropriate methods continue to be used in medical literature for assessing reliability and validity, as evidenced in the context of the evaluation of the WHO Colour Scale. Copyright 2004 John Wiley & Sons, Ltd.

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study

PubMed Central

Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-01-01

Background To improve workers’ health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. Objective The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Methods Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Results Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. Conclusions Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users’ characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees’ mental models; practicability; resources; and skills required of experts and users. PMID:29592846

ANALYZING THE SUSTAINABILITY OF GREEN PROCESSES: METHODS FOR EVALUATING THE FOUR E'S

EPA Science Inventory

Analyzing the Sustainability of Green Processes: Methods for Evaluating the Four E's

By Raymond L. Smith and Michael A. Gonzalez

A considerable amount of research is being performed under the banners of "sustainable" and/or "green." The development of chemistries...

Improving Mandatory Tutoring: A Mixed-Methods Program Evaluation

ERIC Educational Resources Information Center

Baggett, Brooks

2009-01-01

In recent years, the local school leadership in a suburban southern U.S. high school adopted innovative academic intervention programs to assist underperforming students but did not develop formal methods to evaluate program effectiveness. This gap in the professional practice continued with the inception of mandatory tutoring (MT), an…

DEVELOPMENT OF GUIDELINES FOR CALIBRATING, VALIDATING, AND EVALUATING HYDROLOGIC AND WATER QUALITY MODELS: ASABE ENGINEERING PRACTICE 621

USDA-ARS?s Scientific Manuscript database

Information to support application of hydrologic and water quality (H/WQ) models abounds, yet modelers commonly use arbitrary, ad hoc methods to conduct, document, and report model calibration, validation, and evaluation. Consistent methods are needed to improve model calibration, validation, and e...

Edge gradients evaluation for 2D hybrid finite volume method model

USDA-ARS?s Scientific Manuscript database

In this study, a two-dimensional depth-integrated hydrodynamic model was developed using FVM on a hybrid unstructured collocated mesh system. To alleviate the negative effects of mesh irregularity and non-uniformity, a conservative evaluation method for edge gradients based on the second-order Tayl...

Performance of forty-one microbial source tracking methods: A twenty-seven lab evaluation study

EPA Science Inventory

The last decade has seen development of numerous new microbial source tracking (MST) methodologies, but many of these have been tested in just a few laboratories with a limited number of fecal samples. This method evaluation study examined the specificity and sensitivity of 43 ...

EVALUATION OF A TEST METHOD FOR MEASURING INDOOR AIR EMISSIONS FROM DRY-PROCESS PHOTOCOPIERS

EPA Science Inventory

A large chamber test method for measuring indoor air emissions from office equipment was developed, evaluated, and revised based on the initial testing of four dry-process photocopiers. Because all chambers may not necessarily produce similar results (e.g., due to differences in ...

Research on evaluation methods for water regulation ability of dams in the Huai River Basin

NASA Astrophysics Data System (ADS)

Shan, G. H.; Lv, S. F.; Ma, K.

2016-08-01

Water environment protection is a global and urgent problem that requires correct and precise evaluation. Evaluation methods have been studied for many years; however, there is a lack of research on the methods of assessing the water regulation ability of dams. Currently, evaluating the ability of dams has become a practical and significant research orientation because of the global water crisis, and the lack of effective ways to manage a dam's regulation ability has only compounded this. This paper firstly constructs seven evaluation factors and then develops two evaluation approaches to implement the factors according to the features of the problem. Dams of the Yin Shang ecological control section in the Huai He River basin are selected as an example to demonstrate the method. The results show that the evaluation approaches can produce better and more practical suggestions for dam managers.

Evaluation of Visualization Software

NASA Technical Reports Server (NTRS)

Globus, Al; Uselton, Sam

1995-01-01

Visualization software is widely used in scientific and engineering research. But computed visualizations can be very misleading, and the errors are easy to miss. We feel that the software producing the visualizations must be thoroughly evaluated and the evaluation process as well as the results must be made available. Testing and evaluation of visualization software is not a trivial problem. Several methods used in testing other software are helpful, but these methods are (apparently) often not used. When they are used, the description and results are generally not available to the end user. Additional evaluation methods specific to visualization must also be developed. We present several useful approaches to evaluation, ranging from numerical analysis of mathematical portions of algorithms to measurement of human performance while using visualization systems. Along with this brief survey, we present arguments for the importance of evaluations and discussions of appropriate use of some methods.

Development of Monitoring and Diagnostic Methods for Robots Used In Remediation of Waste Sites - Final Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Martin, M.

2000-04-01

This project is the first evaluation of model-based diagnostics to hydraulic robot systems. A greater understanding of fault detection for hydraulic robots has been gained, and a new theoretical fault detection model developed and evaluated.

Development of sensing techniques for weaponry health monitoring

NASA Astrophysics Data System (ADS)

Edwards, Eugene; Ruffin, Paul B.; Walker, Ebonee A.; Brantley, Christina L.

2013-04-01

Due to the costliness of destructive evaluation methods for assessing the aging and shelf-life of missile and rocket components, the identification of nondestructive evaluation methods has become increasingly important to the Army. Verifying that there is a sufficient concentration of stabilizer is a dependable indicator that the missile's double-based solid propellant is viable. The research outlined in this paper summarizes the Army Aviation and Missile Research, Development, and Engineering Center's (AMRDEC's) comparative use of nanoporous membranes, carbon nanotubes, and optical spectroscopic configured sensing techniques for detecting degradation in rocket motor propellant. The first sensing technique utilizes a gas collecting chamber consisting of nanoporous structures that trap the smaller solid propellant particles for measurement by a gas analysis device. In collaboration with NASA-Ames, sensing methods are developed that utilize functionalized single-walled carbon nanotubes as the key sensing element. The optical spectroscopic sensing method is based on a unique light collecting optical fiber system designed to detect the concentration of the propellant stabilizer. Experimental setups, laboratory results, and overall effectiveness of each technique are presented in this paper. Expectations are for the three sensing mechanisms to provide nondestructive evaluation methods that will offer cost-savings and improved weaponry health monitoring.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

A Model and Method of Evaluative Accounts: Development Impact of the National Literacy Mission (NLM of India).

ERIC Educational Resources Information Center

Bhola, H. S.

2002-01-01

Studied the developmental impact of the National Literacy Mission of India, providing an evaluative account based on 97 evaluation studies. Compared findings with those from a 27-study synthesis of studies of effects of adult literacy efforts in Africa. Findings show the impact of literacy on the development of nations. (SLD)

SETs: stand evaluation tools: I. an individual-tree approach to making stand evaluations

Treesearch

Paul S. DeBald; Joseph J. Mendel

1976-01-01

The authors outline a stand-evaluation method that stresses individuality by (1) making on-the-ground projections of individual tree development; (2) summarizing stand values in terms of the individual trees in the stand and their potential development; and (3) tailoring several management possibilities to an individual stand so the owner can choose among them.

Development of Innovative Nondestructive Evaluation Technologies for the Inspection of Cracking and Corrosion Under Coatings

NASA Astrophysics Data System (ADS)

Lipetzky, Kirsten G.; Novack, Michele R.; Perez, Ignacio; Davis, William R.

2001-11-01

Three different innovative nondestructive evaluation technologies were developed and evaluated for the ability to detect fatigue cracks and corrosion hidden under painted aluminum panels. The three technologies included real-time ultrasound imaging, thermal imaging, and near-field microwave imaging. With each of these nondestructive inspection methods, subtasks were performed in order to optimize each methodology.

Evaluation of the Cross-Cultural Traits Influence on the Behavior of Russian and Chinese Students on the Higher Education Products Market

ERIC Educational Resources Information Center

Romanova, Irina M.; Noskova, Elena V.; Trotsenko, Anastasiya N.

2016-01-01

Development of academic mobility of students from different countries requires evaluating the influence of their cultural traits on the behavior on the educational products market. The subject of present study is the development of methodic approach towards evaluating the cross-cultural traits influence on students' behavior on the higher…

Evaluation of biologic occupational risk control practices: quality indicators development and validation.

PubMed

Takahashi, Renata Ferreira; Gryschek, Anna Luíza F P L; Izumi Nichiata, Lúcia Yasuko; Lacerda, Rúbia Aparecida; Ciosak, Suely Itsuko; Gir, Elucir; Padoveze, Maria Clara

2010-05-01

There is growing demand for the adoption of qualification systems for health care practices. This study is aimed at describing the development and validation of indicators for evaluation of biologic occupational risk control programs. The study involved 3 stages: (1) setting up a research team, (2) development of indicators, and (3) validation of the indicators by a team of specialists recruited to validate each attribute of the developed indicators. The content validation method was used for the validation, and a psychometric scale was developed for the specialists' assessment. A consensus technique was used, and every attribute that obtained a Content Validity Index of at least 0.75 was approved. Eight indicators were developed for the evaluation of the biologic occupational risk prevention program, with emphasis on accidents caused by sharp instruments and occupational tuberculosis prevention. The indicators included evaluation of the structure, process, and results at the prevention and biologic risk control levels. The majority of indicators achieved a favorable consensus regarding all validated attributes. The developed indicators were considered validated, and the method used for construction and validation proved to be effective. Copyright (c) 2010 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

Neurobehavioral Development of Common Marmoset Monkeys

PubMed Central

Schultz-Darken, Nancy; Braun, Katarina M.; Emborg, Marina E.

2016-01-01

Common marmoset (Callithrix jacchus) monkeys are a resource for biomedical research and their use is predicted to increase due to the suitability of this species for transgenic approaches. Identification of abnormal neurodevelopment due to genetic modification relies upon the comparison with validated patterns of normal behavior defined by unbiased methods. As scientists unfamiliar with nonhuman primate development are interested to apply genomic editing techniques in marmosets, it would be beneficial to the field that the investigators use validated methods of postnatal evaluation that are age and species appropriate. This review aims to analyze current available data on marmoset physical and behavioral postnatal development, describe the methods used and discuss next steps to better understand and evaluate marmoset normal and abnormal postnatal neurodevelopment PMID:26502294

Evaluation of a CFD Method for Aerodynamic Database Development using the Hyper-X Stack Configuration

NASA Technical Reports Server (NTRS)

Parikh, Paresh; Engelund, Walter; Armand, Sasan; Bittner, Robert

2004-01-01

A computational fluid dynamic (CFD) study is performed on the Hyper-X (X-43A) Launch Vehicle stack configuration in support of the aerodynamic database generation in the transonic to hypersonic flow regime. The main aim of the study is the evaluation of a CFD method that can be used to support aerodynamic database development for similar future configurations. The CFD method uses the NASA Langley Research Center developed TetrUSS software, which is based on tetrahedral, unstructured grids. The Navier-Stokes computational method is first evaluated against a set of wind tunnel test data to gain confidence in the code s application to hypersonic Mach number flows. The evaluation includes comparison of the longitudinal stability derivatives on the complete stack configuration (which includes the X-43A/Hyper-X Research Vehicle, the launch vehicle and an adapter connecting the two), detailed surface pressure distributions at selected locations on the stack body and component (rudder, elevons) forces and moments. The CFD method is further used to predict the stack aerodynamic performance at flow conditions where no experimental data is available as well as for component loads for mechanical design and aero-elastic analyses. An excellent match between the computed and the test data over a range of flow conditions provides a computational tool that may be used for future similar hypersonic configurations with confidence.

Performance evaluation of infrared imaging system in field test

NASA Astrophysics Data System (ADS)

Wang, Chensheng; Guo, Xiaodong; Ren, Tingting; Zhang, Zhi-jie

2014-11-01

Infrared imaging system has been applied widely in both military and civilian fields. Since the infrared imager has various types and different parameters, for system manufacturers and customers, there is great demand for evaluating the performance of IR imaging systems with a standard tool or platform. Since the first generation IR imager was developed, the standard method to assess the performance has been the MRTD or related improved methods which are not perfect adaptable for current linear scanning imager or 2D staring imager based on FPA detector. For this problem, this paper describes an evaluation method based on the triangular orientation discrimination metric which is considered as the effective and emerging method to evaluate the synthesis performance of EO system. To realize the evaluation in field test, an experiment instrument is developed. And considering the importance of operational environment, the field test is carried in practical atmospheric environment. The test imagers include panoramic imaging system and staring imaging systems with different optics and detectors parameters (both cooled and uncooled). After showing the instrument and experiment setup, the experiment results are shown. The target range performance is analyzed and discussed. In data analysis part, the article gives the range prediction values obtained from TOD method, MRTD method and practical experiment, and shows the analysis and results discussion. The experimental results prove the effectiveness of this evaluation tool, and it can be taken as a platform to give the uniform performance prediction reference.

Rapid calculation of genomic evaluations for new animals

USDA-ARS?s Scientific Manuscript database

A method was developed to calculate preliminary genomic evaluations daily or weekly before the release of official monthly evaluations by processing only newly genotyped animals using estimates of SNP effects from the previous official evaluation. To minimize computing time, reliabilities and genomi...

Some Methods for Evaluating Program Implementation.

ERIC Educational Resources Information Center

Hardy, Roy A.

An approach to evaluating program implementation is described. This approach includes the development of a project description which includes a structure matrix, sampling from the structure matrix, and preparing an implementation evaluation plan. The implementation evaluation plan should include: (1) verification of implementation of planned…

Evaluation Methods Sourcebook.

ERIC Educational Resources Information Center

Love, Arnold J., Ed.

The chapters commissioned for this book describe key aspects of evaluation methodology as they are practiced in a Canadian context, providing representative illustrations of recent developments in evaluation methodology as it is currently applied. The following chapters are included: (1) "Program Evaluation with Limited Fiscal and Human…

Physical interpretation and development of ultrasonic nondestructive evaluation techniques applied to the quantitative characterization of textile composite materials

NASA Technical Reports Server (NTRS)

Miller, James G.

1993-01-01

In this Progress Report, we describe our current research activities concerning the development and implementation of advanced ultrasonic nondestructive evaluation methods applied to the characterization of stitched composite materials and bonded aluminum plate specimens. One purpose of this investigation is to identify and characterize specific features of polar backscatter interrogation which enhance the ability of ultrasound to detect flaws in a stitched composite laminate. Another focus is to explore the feasibility of implementing medical linear array imaging technology as a viable ultrasonic-based nondestructive evaluation method to inspect and characterize bonded aluminum lap joints. As an approach to implementing quantitative ultrasonic inspection methods to both of these materials, we focus on the physics that underlies the detection of flaws in such materials.

Recommendations for a mixed methods approach to evaluating the patient-centered medical home.

PubMed

Goldman, Roberta E; Parker, Donna R; Brown, Joanna; Walker, Judith; Eaton, Charles B; Borkan, Jeffrey M

2015-03-01

There is a strong push in the United States to evaluate whether the patient-centered medical home (PCMH) model produces desired results. The explanatory and contextually based questions of how and why PCMH succeeds in different practice settings are often neglected. We report the development of a comprehensive, mixed qualitative-quantitative evaluation set for researchers, policy makers, and clinician groups. To develop an evaluation set, the Brown Primary Care Transformation Initiative convened a multidisciplinary group of PCMH experts, reviewed the PCMH literature and evaluation strategies, developed key domains for evaluation, and selected or created methods and measures for inclusion. The measures and methods in the evaluation set (survey instruments, PCMH meta-measures, patient outcomes, quality measures, qualitative interviews, participant observation, and process evaluation) are meant to be used together. PCMH evaluation must be sufficiently comprehensive to assess and explain both the context of transformation in different primary care practices and the experiences of diverse stakeholders. In addition to commonly assessed patient outcomes, quality, and cost, it is critical to include PCMH components integral to practice culture transformation: patient and family centeredness, authentic patient activation, mutual trust among practice employees and patients, and transparency, joy, and collaboration in delivering and receiving care in a changing environment. This evaluation set offers a comprehensive methodology to enable understanding of how PCMH transformation occurs in different practice settings. This approach can foster insights about how transformation affects critical outcomes to achieve meaningful, patient-centered, high-quality, and cost-effective sustainable change among diverse primary care practices. © 2015 Annals of Family Medicine, Inc.

Making Social Work Count: A Curriculum Innovation to Teach Quantitative Research Methods and Statistical Analysis to Undergraduate Social Work Students in the United Kingdom

ERIC Educational Resources Information Center

Teater, Barbra; Roy, Jessica; Carpenter, John; Forrester, Donald; Devaney, John; Scourfield, Jonathan

2017-01-01

Students in the United Kingdom (UK) are found to lack knowledge and skills in quantitative research methods. To address this gap, a quantitative research method and statistical analysis curriculum comprising 10 individual lessons was developed, piloted, and evaluated at two universities The evaluation found that BSW students' (N = 81)…

Adding a Time-Series Design Element to the Success Case Method to Improve Methodological Rigor: An Application for Nonprofit Program Evaluation

ERIC Educational Resources Information Center

Coryn, Chris L. S.; Schroter, Daniela C.; Hanssen, Carl E.

2009-01-01

Brinkerhoff's Success Case Method (SCM) was developed with the specific purpose of assessing the impact of organizational interventions (e.g., training and coaching) on business goals by analyzing extreme groups using case study techniques and storytelling. As an efficient and cost-effective method of evaluative inquiry, SCM is attractive in other…

Proceedings, Seminar on Probabilistic Methods in Geotechnical Engineering

NASA Astrophysics Data System (ADS)

Hynes-Griffin, M. E.; Buege, L. L.

1983-09-01

Contents: Applications of Probabilistic Methods in Geotechnical Engineering; Probabilistic Seismic and Geotechnical Evaluation at a Dam Site; Probabilistic Slope Stability Methodology; Probability of Liquefaction in a 3-D Soil Deposit; Probabilistic Design of Flood Levees; Probabilistic and Statistical Methods for Determining Rock Mass Deformability Beneath Foundations: An Overview; Simple Statistical Methodology for Evaluating Rock Mechanics Exploration Data; New Developments in Statistical Techniques for Analyzing Rock Slope Stability.

Probabilistic classifiers with high-dimensional data

PubMed Central

Kim, Kyung In; Simon, Richard

2011-01-01

For medical classification problems, it is often desirable to have a probability associated with each class. Probabilistic classifiers have received relatively little attention for small n large p classification problems despite of their importance in medical decision making. In this paper, we introduce 2 criteria for assessment of probabilistic classifiers: well-calibratedness and refinement and develop corresponding evaluation measures. We evaluated several published high-dimensional probabilistic classifiers and developed 2 extensions of the Bayesian compound covariate classifier. Based on simulation studies and analysis of gene expression microarray data, we found that proper probabilistic classification is more difficult than deterministic classification. It is important to ensure that a probabilistic classifier is well calibrated or at least not “anticonservative” using the methods developed here. We provide this evaluation for several probabilistic classifiers and also evaluate their refinement as a function of sample size under weak and strong signal conditions. We also present a cross-validation method for evaluating the calibration and refinement of any probabilistic classifier on any data set. PMID:21087946

Using Active Learning for Speeding up Calibration in Simulation Models

PubMed Central

Cevik, Mucahit; Ali Ergun, Mehmet; Stout, Natasha K.; Trentham-Dietz, Amy; Craven, Mark; Alagoz, Oguzhan

2015-01-01

Background Most cancer simulation models include unobservable parameters that determine the disease onset and tumor growth. These parameters play an important role in matching key outcomes such as cancer incidence and mortality and their values are typically estimated via lengthy calibration procedure, which involves evaluating large number of combinations of parameter values via simulation. The objective of this study is to demonstrate how machine learning approaches can be used to accelerate the calibration process by reducing the number of parameter combinations that are actually evaluated. Methods Active learning is a popular machine learning method that enables a learning algorithm such as artificial neural networks to interactively choose which parameter combinations to evaluate. We develop an active learning algorithm to expedite the calibration process. Our algorithm determines the parameter combinations that are more likely to produce desired outputs, therefore reduces the number of simulation runs performed during calibration. We demonstrate our method using previously developed University of Wisconsin Breast Cancer Simulation Model (UWBCS). Results In a recent study, calibration of the UWBCS required the evaluation of 378,000 input parameter combinations to build a race-specific model and only 69 of these combinations produced results that closely matched observed data. By using the active learning algorithm in conjunction with standard calibration methods, we identify all 69 parameter combinations by evaluating only 5620 of the 378,000 combinations. Conclusion Machine learning methods hold potential in guiding model developers in the selection of more promising parameter combinations and hence speeding up the calibration process. Applying our machine learning algorithm to one model shows that evaluating only 1.49% of all parameter combinations would be sufficient for the calibration. PMID:26471190

Developing, implementing, and evaluating a handbook for parents of pediatric hematology/oncology patients.

PubMed

Heiney, S P; Wells, L M

1995-07-01

This article details the development of a parent handbook for pediatric hematology and oncology patients. The planning and content development are discussed. Adult learning principles were incorporated throughout the handbook. Use of the handbook in a pediatric cancer center is described. Both subjective and objective methods were used to evaluate the handbook. Results from the evaluation verify the value of the handbook to parents and give direction for future revisions of the handbook.

Guiding principles for the implementation of non-animal safety assessment approaches for cosmetics: skin sensitisation.

PubMed

Goebel, Carsten; Aeby, Pierre; Ade, Nadège; Alépée, Nathalie; Aptula, Aynur; Araki, Daisuke; Dufour, Eric; Gilmour, Nicola; Hibatallah, Jalila; Keller, Detlef; Kern, Petra; Kirst, Annette; Marrec-Fairley, Monique; Maxwell, Gavin; Rowland, Joanna; Safford, Bob; Schellauf, Florian; Schepky, Andreas; Seaman, Chris; Teichert, Thomas; Tessier, Nicolas; Teissier, Silvia; Weltzien, Hans Ulrich; Winkler, Petra; Scheel, Julia

2012-06-01

Characterisation of skin sensitisation potential is a key endpoint for the safety assessment of cosmetic ingredients especially when significant dermal exposure to an ingredient is expected. At present the mouse local lymph node assay (LLNA) remains the 'gold standard' test method for this purpose however non-animal test methods are under development that aim to replace the need for new animal test data. COLIPA (the European Cosmetics Association) funds an extensive programme of skin sensitisation research, method development and method evaluation and helped coordinate the early evaluation of the three test methods currently undergoing pre-validation. In May 2010, a COLIPA scientific meeting was held to analyse to what extent skin sensitisation safety assessments for cosmetic ingredients can be made in the absence of animal data. In order to propose guiding principles for the application and further development of non-animal safety assessment strategies it was evaluated how and when non-animal test methods, predictions based on physico-chemical properties (including in silico tools), threshold concepts and weight-of-evidence based hazard characterisation could be used to enable safety decisions. Generation and assessment of potency information from alternative tools which at present is predominantly derived from the LLNA is considered the future key research area. Copyright © 2012 Elsevier Inc. All rights reserved.

The challenges of including impacts on biodiversity in agricultural life cycle assessments.

PubMed

Gabel, Vanessa M; Meier, Matthias S; Köpke, Ulrich; Stolze, Matthias

2016-10-01

Agriculture is considered to be one of the main drivers for worldwide biodiversity loss but the impacts of agricultural production on biodiversity have not been extensively considered in Life Cycle Assessments (LCAs). Recent realisation that biodiversity impact should be included in comprehensive LCAs has led to attempts to develop and implement methods for biodiversity impact assessment. In this review, twenty-two different biodiversity impact assessment methods have been analysed to identify their strengths and weaknesses in terms of their comprehensiveness in the evaluation of agricultural products. Different criteria, which had to meet the specific requirements of biodiversity research, life cycle assessment methodology, and the evaluation of agricultural products, were selected to investigate the identified methods. Very few of the methods were developed with the specific intention of being used for agricultural LCAs. Furthermore, none of the methods can be applied globally while at the same time being able to differentiate between various agricultural intensities. Global value chains and the increasing awareness of different biodiversity impacts of agricultural production systems demand the development of evaluation methods that are able to overcome these shortcomings. Despite the progress that has already been achieved, there are still unresolved difficulties which need further research and improvement. Copyright © 2016 Elsevier Ltd. All rights reserved.

Optimized anion exchange column isolation of zirconium-89 ( 89 Zr) from yttrium cyclotron target: Method development and implementation on an automated fluidic platform

DOE Office of Scientific and Technical Information (OSTI.GOV)

O’Hara, Matthew J.; Murray, Nathaniel J.; Carter, Jennifer C.

Zirconium-89 (89Zr), produced by the (p,n) reaction from naturally monoisotopic yttrium (natY), is a promising positron emitting isotope for immunoPET imaging. Its long half-life of 78.4 h is sufficient for evaluating slow physiological processes. A prototype automated fluidic system, coupled to on-line and in-line detectors, has been constructed to facilitate development of new 89Zr purification methodologies. The highly reproducible reagent delivery platform and near-real time monitoring of column effluents allows for efficient method optimization. The separation of Zr from dissolved Y metal targets was evaluated using several anion exchange resins. Each resin was evaluated against its ability to quantitatively capturemore » Zr from a load solution that is high in dissolved Y. The most appropriate anion exchange resin for this application was identified, and the separation method was optimized. The method is capable of a high Y decontamination factor (>105) and has been shown to separate Fe, an abundant contaminant in Y foils, from the 89Zr elution fraction. Finally, the performance of the method was evaluated using cyclotron bombarded Y foil targets. The separation method was shown to achieve >95% recovery of the 89Zr present in the foils. The 89Zr eluent, however, was in a chemical matrix not immediately conducive to labeling onto proteins. The main intent of this study was to develop a tandem column 89Zr purification process, wherein the anion exchange column method described here is the first separation in a dual-column purification process.« less

DEVELOPMENT AND IMPROVEMENT OF TEMPORAL ALLOCATION FACTOR FILES

EPA Science Inventory

The report gives results of a project to: (1) evaluate the quality and completeness of data and methods being used for temporal allocation of emissions data, (2) identify and prioritize needed improvements to current methods for developing temporal allocation factors (TAFs), and ...

Novel MC/BZY Proton Conductor: Materials Development, Device Evaluation, and Theoretical Exploration using CI and DFT Methods

DTIC Science & Technology

2017-09-05

Report: Novel MC/BZY Proton Conductor: Materials Development, Device Evaluation, and Theoretical Exploration using CI and DFT Methods The views...policy or decision, unless so designated by other documentation. 9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS (ES) U.S. Army Research Office P.O...Box 12211 Research Triangle Park, NC 27709-2211 REPORT DOCUMENTATION PAGE 11. SPONSOR/MONITOR’S REPORT NUMBER(S) 10. SPONSOR/MONITOR’S ACRONYM(S

Development of an Adaptable Display and Diagnostic System for the Evaluation of Tropical Cyclone Forecasts

NASA Astrophysics Data System (ADS)

Kucera, P. A.; Burek, T.; Halley-Gotway, J.

2015-12-01

NCAR's Joint Numerical Testbed Program (JNTP) focuses on the evaluation of experimental forecasts of tropical cyclones (TCs) with the goal of developing new research tools and diagnostic evaluation methods that can be transitioned to operations. Recent activities include the development of new TC forecast verification methods and the development of an adaptable TC display and diagnostic system. The next generation display and diagnostic system is being developed to support evaluation needs of the U.S. National Hurricane Center (NHC) and broader TC research community. The new hurricane display and diagnostic capabilities allow forecasters and research scientists to more deeply examine the performance of operational and experimental models. The system is built upon modern and flexible technology that includes OpenLayers Mapping tools that are platform independent. The forecast track and intensity along with associated observed track information are stored in an efficient MySQL database. The system provides easy-to-use interactive display system, and provides diagnostic tools to examine forecast track stratified by intensity. Consensus forecasts can be computed and displayed interactively. The system is designed to display information for both real-time and for historical TC cyclones. The display configurations are easily adaptable to meet the needs of the end-user preferences. Ongoing enhancements include improving capabilities for stratification and evaluation of historical best tracks, development and implementation of additional methods to stratify and compute consensus hurricane track and intensity forecasts, and improved graphical display tools. The display is also being enhanced to incorporate gridded forecast, satellite, and sea surface temperature fields. The presentation will provide an overview of the display and diagnostic system development and demonstration of the current capabilities.

Methodology Evaluation Framework for Component-Based System Development.

ERIC Educational Resources Information Center

Dahanayake, Ajantha; Sol, Henk; Stojanovic, Zoran

2003-01-01

Explains component-based development (CBD) for distributed information systems and presents an evaluation framework, which highlights the extent to which a methodology is component oriented. Compares prominent CBD methods, discusses ways of modeling, and suggests that this is a first step towards a components-oriented systems development…

42 CFR 51c.204 - Grant evaluation and award.

Code of Federal Regulations, 2014 CFR

2014-10-01

... the project for development of new and effective methods for health services delivery and management... Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS GRANTS FOR COMMUNITY HEALTH SERVICES Grants for Planning and Developing Community Health Centers § 51c.204 Grant evaluation...

42 CFR 51c.204 - Grant evaluation and award.

Code of Federal Regulations, 2013 CFR

2013-10-01

... the project for development of new and effective methods for health services delivery and management... Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS GRANTS FOR COMMUNITY HEALTH SERVICES Grants for Planning and Developing Community Health Centers § 51c.204 Grant evaluation...

42 CFR 51c.204 - Grant evaluation and award.

Code of Federal Regulations, 2012 CFR

2012-10-01

... the project for development of new and effective methods for health services delivery and management... Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS GRANTS FOR COMMUNITY HEALTH SERVICES Grants for Planning and Developing Community Health Centers § 51c.204 Grant evaluation...

FIELD ANALYTICAL METHODS: ADVANCED FIELD MONITORING METHODS DEVELOPMENT AND EVALUATION OF NEW AND INNOVATIVE TECHNOLOGIES THAT SUPPORT THE SITE CHARACTERIZATION AND MONITORING REQUIREMENTS OF THE SUPERFUND PROGRAM.

EPA Science Inventory

The overall goal of this task is to help reduce the uncertainties in the assessment of environmental health and human exposure by better characterizing hazardous wastes through cost-effective analytical methods. Research projects are directed towards the applied development and ...

Development and validation of methods for man-made machine interface evaluation. [for shuttles and shuttle payloads

NASA Technical Reports Server (NTRS)

Malone, T. B.; Micocci, A.

1975-01-01

The alternate methods of conducting a man-machine interface evaluation are classified as static and dynamic, and are evaluated. A dynamic evaluation tool is presented to provide for a determination of the effectiveness of the man-machine interface in terms of the sequence of operations (task and task sequences) and in terms of the physical characteristics of the interface. This dynamic checklist approach is recommended for shuttle and shuttle payload man-machine interface evaluations based on reduced preparation time, reduced data, and increased sensitivity of critical problems.

Valid methods: the quality assurance of test method development, validation, approval, and transfer for veterinary testing laboratories.

PubMed

Wiegers, Ann L

2003-07-01

Third-party accreditation is a valuable tool to demonstrate a laboratory's competence to conduct testing. Accreditation, internationally and in the United States, has been discussed previously. However, accreditation is only I part of establishing data credibility. A validated test method is the first component of a valid measurement system. Validation is defined as confirmation by examination and the provision of objective evidence that the particular requirements for a specific intended use are fulfilled. The international and national standard ISO/IEC 17025 recognizes the importance of validated methods and requires that laboratory-developed methods or methods adopted by the laboratory be appropriate for the intended use. Validated methods are therefore required and their use agreed to by the client (i.e., end users of the test results such as veterinarians, animal health programs, and owners). ISO/IEC 17025 also requires that the introduction of methods developed by the laboratory for its own use be a planned activity conducted by qualified personnel with adequate resources. This article discusses considerations and recommendations for the conduct of veterinary diagnostic test method development, validation, evaluation, approval, and transfer to the user laboratory in the ISO/IEC 17025 environment. These recommendations are based on those of nationally and internationally accepted standards and guidelines, as well as those of reputable and experienced technical bodies. They are also based on the author's experience in the evaluation of method development and transfer projects, validation data, and the implementation of quality management systems in the area of method development.

Job and Work Evaluation: A Literature Review.

ERIC Educational Resources Information Center

Heneman, Robert L.

2003-01-01

Describes advantages and disadvantages of work evaluation methods: ranking, market pricing, banding, classification, single-factor, competency, point-factor, and factor comparison. Compares work evaluation perspectives: traditional, realist, market advocate, strategist, organizational development, social reality, contingency theory, competency,…

A phasing and imputation method for pedigreed populations that results in a single-stage genomic evaluation

PubMed Central

2012-01-01

Background Efficient, robust, and accurate genotype imputation algorithms make large-scale application of genomic selection cost effective. An algorithm that imputes alleles or allele probabilities for all animals in the pedigree and for all genotyped single nucleotide polymorphisms (SNP) provides a framework to combine all pedigree, genomic, and phenotypic information into a single-stage genomic evaluation. Methods An algorithm was developed for imputation of genotypes in pedigreed populations that allows imputation for completely ungenotyped animals and for low-density genotyped animals, accommodates a wide variety of pedigree structures for genotyped animals, imputes unmapped SNP, and works for large datasets. The method involves simple phasing rules, long-range phasing and haplotype library imputation and segregation analysis. Results Imputation accuracy was high and computational cost was feasible for datasets with pedigrees of up to 25 000 animals. The resulting single-stage genomic evaluation increased the accuracy of estimated genomic breeding values compared to a scenario in which phenotypes on relatives that were not genotyped were ignored. Conclusions The developed imputation algorithm and software and the resulting single-stage genomic evaluation method provide powerful new ways to exploit imputation and to obtain more accurate genetic evaluations. PMID:22462519

Objective evaluation of interior noise booming in a passenger car based on sound metrics and artificial neural networks.

PubMed

Lee, Hyun-Ho; Lee, Sang-Kwon

2009-09-01

Booming sound is one of the important sounds in a passenger car. The aim of the paper is to develop the objective evaluation method of interior booming sound. The development method is based on the sound metrics and ANN (artificial neural network). The developed method is called the booming index. Previous work maintained that booming sound quality is related to loudness and sharpness--the sound metrics used in psychoacoustics--and that the booming index is developed by using the loudness and sharpness for a signal within whole frequency between 20 Hz and 20 kHz. In the present paper, the booming sound quality was found to be effectively related to the loudness at frequencies below 200 Hz; thus the booming index is updated by using the loudness of the signal filtered by the low pass filter at frequency under 200 Hz. The relationship between the booming index and sound metric is identified by an ANN. The updated booming index has been successfully applied to the objective evaluation of the booming sound quality of mass-produced passenger cars.

Development of the Digital Arthritis Index, a Novel Metric to Measure Disease Parameters in a Rat Model of Rheumatoid Arthritis.

PubMed

Lim, Maria A; Louie, Brenton; Ford, Daniel; Heath, Kyle; Cha, Paulyn; Betts-Lacroix, Joe; Lum, Pek Yee; Robertson, Timothy L; Schaevitz, Laura

2017-01-01

Despite a broad spectrum of anti-arthritic drugs currently on the market, there is a constant demand to develop improved therapeutic agents. Efficient compound screening and rapid evaluation of treatment efficacy in animal models of rheumatoid arthritis (RA) can accelerate the development of clinical candidates. Compound screening by evaluation of disease phenotypes in animal models facilitates preclinical research by enhancing understanding of human pathophysiology; however, there is still a continuous need to improve methods for evaluating disease. Current clinical assessment methods are challenged by the subjective nature of scoring-based methods, time-consuming longitudinal experiments, and the requirement for better functional readouts with relevance to human disease. To address these needs, we developed a low-touch, digital platform for phenotyping preclinical rodent models of disease. As a proof-of-concept, we utilized the rat collagen-induced arthritis (CIA) model of RA and developed the Digital Arthritis Index (DAI), an objective and automated behavioral metric that does not require human-animal interaction during the measurement and calculation of disease parameters. The DAI detected the development of arthritis similar to standard in vivo methods, including ankle joint measurements and arthritis scores, as well as demonstrated a positive correlation to ankle joint histopathology. The DAI also determined responses to multiple standard-of-care (SOC) treatments and nine repurposed compounds predicted by the SMarTR TM Engine to have varying degrees of impact on RA. The disease profiles generated by the DAI complemented those generated by standard methods. The DAI is a highly reproducible and automated approach that can be used in-conjunction with standard methods for detecting RA disease progression and conducting phenotypic drug screens.

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process.

Why so many "rigorous" evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute.

PubMed

Bamberger, Michael; Tarsilla, Michele; Hesse-Biber, Sharlene

2016-04-01

Many widely-used impact evaluation designs, including randomized control trials (RCTs) and quasi-experimental designs (QEDs), frequently fail to detect what are often quite serious unintended consequences of development programs. This seems surprising as experienced planners and evaluators are well aware that unintended consequences frequently occur. Most evaluation designs are intended to determine whether there is credible evidence (statistical, theory-based or narrative) that programs have achieved their intended objectives and the logic of many evaluation designs, even those that are considered the most "rigorous," does not permit the identification of outcomes that were not specified in the program design. We take the example of RCTs as they are considered by many to be the most rigorous evaluation designs. We present a numbers of cases to illustrate how infusing RCTs with a mixed-methods approach (sometimes called an "RCT+" design) can strengthen the credibility of these designs and can also capture important unintended consequences. We provide a Mixed Methods Evaluation Framework that identifies 9 ways in which UCs can occur, and we apply this framework to two of the case studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation Framework for NASA's Educational Outreach Programs

NASA Technical Reports Server (NTRS)

Berg, Rick; Booker, Angela; Linde, Charlotte; Preston, Connie

1999-01-01

The objective of the proposed work is to develop an evaluation framework for NASA's educational outreach efforts. We focus on public (rather than technical or scientific) dissemination efforts, specifically on Internet-based outreach sites for children.The outcome of this work is to propose both methods and criteria for evaluation, which would enable NASA to do a more analytic evaluation of its outreach efforts. The proposed framework is based on IRL's ethnographic and video-based observational methods, which allow us to analyze how these sites are actually used.

Screening of the key volatile organic compounds of Tuber melanosporum fermentation by aroma sensory evaluation combination with principle component analysis

PubMed Central

Liu, Rui-Sang; Jin, Guang-Huai; Xiao, Deng-Rong; Li, Hong-Mei; Bai, Feng-Wu; Tang, Ya-Jie

2015-01-01

Aroma results from the interplay of volatile organic compounds (VOCs) and the attributes of microbial-producing aromas are significantly affected by fermentation conditions. Among the VOCs, only a few of them contribute to aroma. Thus, screening and identification of the key VOCs is critical for microbial-producing aroma. The traditional method is based on gas chromatography-olfactometry (GC-O), which is time-consuming and laborious. Considering the Tuber melanosporum fermentation system as an example, a new method to screen and identify the key VOCs by combining the aroma evaluation method with principle component analysis (PCA) was developed in this work. First, an aroma sensory evaluation method was developed to screen 34 potential favorite aroma samples from 504 fermentation samples. Second, PCA was employed to screen nine common key VOCs from these 34 samples. Third, seven key VOCs were identified by the traditional method. Finally, all of the seven key VOCs identified by the traditional method were also identified, along with four others, by the new strategy. These results indicate the reliability of the new method and demonstrate it to be a viable alternative to the traditional method. PMID:26655663

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

Information technology model for evaluating emergency medicine teaching

NASA Astrophysics Data System (ADS)

Vorbach, James; Ryan, James

1996-02-01

This paper describes work in progress to develop an Information Technology (IT) model and supporting information system for the evaluation of clinical teaching in the Emergency Medicine (EM) Department of North Shore University Hospital. In the academic hospital setting student physicians, i.e. residents, and faculty function daily in their dual roles as teachers and students respectively, and as health care providers. Databases exist that are used to evaluate both groups in either academic or clinical performance, but rarely has this information been integrated to analyze the relationship between academic performance and the ability to care for patients. The goal of the IT model is to improve the quality of teaching of EM physicians by enabling the development of integrable metrics for faculty and resident evaluation. The IT model will include (1) methods for tracking residents in order to develop experimental databases; (2) methods to integrate lecture evaluation, clinical performance, resident evaluation, and quality assurance databases; and (3) a patient flow system to monitor patient rooms and the waiting area in the Emergency Medicine Department, to record and display status of medical orders, and to collect data for analyses.

[Development of non-invasive clinical examination methods for the anterior segment of the eye and their clinical significance].

PubMed

Sawa, Mitsuru

2011-03-01

1. Slit-lamp microscopy is a principal ophthalmic clinical method, because it provides microscopic findings of the anterior segment of the eye noninvasively. Its findings, however, are qualitative and there are large inter-observer variations in their evaluation. Furthermore, slit-lamp microscopy provides morphological findings, but a functional evaluation is difficult. We developed two novel methods that establish a qualitative methodology of the slit-lamp microscope and the pathophysiology of the anterior segment of the eye. One is the flare-cell photometer to evaluate flare and cells in the aqueous humor of the eye and the other is an immunohistochemical examination method using tear fluid to evaluate ocular surface disorders. The comprehensive evaluation of these studies is herein overviewed. 2. INNOVATION OF THE FLARE-CELL PHOTOMETER AND ITS CLINICAL SIGNIFICANCE: The breakdown of the blood-aqueous barrier (BAB) causes an increase in protein (flare) and leakage of blood cells (cell) into the aqueous humor of the eye and the severity of BAB breakdown has a positive correlation with the intensity of flare and cells. The flare and cells in the aqueous can be observed qualitatively by slit-lamp microscopy. These findings are primarily distinguished in optics by light scattering. Therefore, detection of the intensity of light scattering due to flare and cells can evaluate the BAB function. The flare-cell photometer comprises 3 novel components: a laser beam system as an incident light, a photomultiplier to detect scattered light intensity and a computer-assisted system to operate the whole system and analyze detected scattered light signals due to flare and cells. The instrument enables us to quantitatively analyze the flare and cells non-invasively and accurately with a wide dynamic measurement range, resulting in a repeated examination of each individual case. It also enables the evaluation of inflammation in the aqueous not only postoperatively but also in endogenous uveitis, evaluation of the effects of anti-inflammatory drugs on BAB and evaluation of aqueous humor dynamics. Furthermore, repeating the examination can minimize inter-individual variations and reduce the number of animals in animal experiments. 3. Sampling of tears can be performed noninvasively, but the obtainable volume is limited. Therefore, a determination of targeting biomarkers and a development of their micro-volume analysis methods play a crucial role in pathophysiological studies of the ocular surface. Targeting biomarkers should be determined according to the various specified bioactive substances such as eosinophil cationic protein (ECP), cytokines and others. A number of microvolume analysis methods, such as chemiluminescent enzyme immunoassay, immunochromatography, micro-array system and polymerase chain reaction method are used. Objective disorders in the studies include allergic conjunctivitis and infectious diseases such as herpetic keratitis. Quantitative evaluation methods for ECP concentration, antigen-specific secretory IgA in allergic diseases and herpetic keratitis, herpes simplex virus-DNA and cytokine and chemokine profile in tear fluid sampled by filter paper method were investigated. We developed a clinically applicable quantitative immunochemical method for ECP concentration in tear fluid. The results revealed that tear fluid analysis using the above mentioned methods is a clinically useful to investigate the pathophysiology of the ocular surface. 4. Laser flare-cell photometer and tear fluid analysis are potent clinical quantitative methods to investigate the pathophysiology of the anterior segment of the eye.

Mixed Methods Research in the Development and Evaluation of Complex Interventions in Palliative and End-of-Life Care: Report on the MORECare Consensus Exercise

PubMed Central

Preston, Nancy; Evans, Catherine J.; Grande, Gunn; Short, Vicky; Benalia, Hamid; Higginson, Irene J.; Todd, on behalf of MORECare, Chris

2013-01-01

Abstract Background: Complex interventions are common in palliative and end-of-life care. Mixed methods approaches sit well within the multiphase model of complex intervention development and evaluation. Generic mixed methods guidance is useful but additional challenges in the research design and operationalization within palliative and end-of-life care may have an impact on the use of mixed methods. Objective: The objective of the study was to develop guidance on the best methods for combining quantitative and qualitative methods for health and social care intervention development and evaluation in palliative and end-of-life care. Methods: A one-day workshop was held where experts participated in facilitated groups using Transparent Expert Consultation to generate items for potential recommendations. Agreement and consensus were then sought on nine draft recommendations (DRs) in a follow-up exercise. Results: There was at least moderate agreement with most of the DRs, although consensus was low. Strongest agreement was with DR1 (usefulness of mixed methods to palliative and end-of-life care) and DR5 (importance of attention to respondent burden), and least agreement was with DR2 (use of theoretical perspectives) and DR6 (therapeutic effects of research interviews). Narrative comments enabled recommendation refinement. Two fully endorsed, five partially endorsed, and two refined DRs emerged. The relationship of these nine to six key challenges of palliative and end-of-life care research was analyzed. Conclusions: There is a need for further discussion of these recommendations and their contribution to methodology. The recommendations should be considered when designing and operationalizing mixed methods studies of complex interventions in palliative care, and because they may have wider relevance, should be considered for other applications. PMID:24195755

Comprehensive evaluation of global energy interconnection development index

NASA Astrophysics Data System (ADS)

Liu, Lin; Zhang, Yi

2018-04-01

Under the background of building global energy interconnection and realizing green and low-carbon development, this article constructed the global energy interconnection development index system which based on the current situation of global energy interconnection development. Through using the entropy method for the weight analysis of global energy interconnection development index, and then using gray correlation method to analyze the selected countries, this article got the global energy interconnection development index ranking and level classification.

Develop a new testing and evaluation protocol to assess flexbase performance using strength of soil binder.

DOT National Transportation Integrated Search

2008-01-01

This research involved a detailed laboratory study of a new test method for evaluating road base materials based on : the strength of the soil binder. In this test method, small test specimens (5.0in length and 0.75in square cross : section) of binde...

Empirical research in service engineering based on AHP and fuzzy methods

NASA Astrophysics Data System (ADS)

Zhang, Yanrui; Cao, Wenfu; Zhang, Lina

2015-12-01

Recent years, management consulting industry has been rapidly developing worldwide. Taking a big management consulting company as research object, this paper established an index system of service quality of consulting, based on customer satisfaction survey, evaluated service quality of the consulting company by AHP and fuzzy comprehensive evaluation methods.

Multi-laboratory evaluations of the performance of Catellicoccus marimammalium PCR assays developed to target gull fecal sources

EPA Science Inventory

Here we report results from a multi-laboratory (n=11) evaluation of four different PCR methods targeting the 16S rRNA gene of Catellicoccus marimammalium used to detect fecal contamination from birds in coastal environments. The methods included conventional end-point PCR, a SYBR...

Administrators' Perceptions of Physical Education Teacher Evaluation

ERIC Educational Resources Information Center

Norris, Jason M.; van der Mars, Hans; Kulinna, Pamela; Amrein-Beardsley, Audrey

2017-01-01

Purpose: Using a mixed methods approach, this study aimed to develop a better understanding of school administrators' perceptions of teacher evaluation systems, specific to physical education (PE). Method: This study used two sources of data collection: (a) a survey sent to administrators (n = 19) in one urban school district and (b) a formal…

HEASD PM RESEARCH METHODS: PARTICLE METHODS EVALUATION AND DEVELOPMENT

EPA Science Inventory

The FRM developed by NERL forms the backbone of the EPA's national monitoring strategy. It is the measurement that defines attainment of the new standard. However, the agency has numerous other needs in assessing the physical and chemical characteristics of ambient fine particl...

Development of new test procedures for measuring fine and coarse aggregates specific gravity.

DOT National Transportation Integrated Search

2009-09-01

The objective of the research is to develop and evaluate new test methods at determining the specific gravity and absorption of both fine and coarse aggregates. Current methods at determining the specific gravity and absorption of fine and coarse agg...

Aging curve of neuromotor function by pronation and supination of forearms using three-dimensional wireless acceleration and angular velocity sensors.

PubMed

Kaneko, M; Okui, H; Hirakawa, G; Ishinishi, H; Katayama, Y; Iramina, K

2012-01-01

We have developed an evaluation system for pronation and supination of forearms. The motion of pronation and supination of the forearm is used as a diagnosis method of developmental disability, etc. However, this diagnosis method has a demerit in which diagnosis results between doctors are not consistent. It is hoped that a more quantitative and simple evaluation method is established. Moreover it is hoped a diagnostic criteria obtained from healthy subjects can be established to diagnose developmental disorder patients. We developed a simple and portable evaluation system for pronation and supination of forearms. Three-dimensional wireless acceleration and angular velocity sensors are used for this system. In this study, pronation and supination of forearms of 570 subjects (subjects aged 6-12, 21-100) were examined. We could obtain aging curves in the neuromotor function of pronation and supination. These aging curves obtained by our developed system, has the potential to become diagnostic criteria for a developmental disability, etc.

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Automatic and user-centric approaches to video summary evaluation

NASA Astrophysics Data System (ADS)

Taskiran, Cuneyt M.; Bentley, Frank

2007-01-01

Automatic video summarization has become an active research topic in content-based video processing. However, not much emphasis has been placed on developing rigorous summary evaluation methods and developing summarization systems based on a clear understanding of user needs, obtained through user centered design. In this paper we address these two topics and propose an automatic video summary evaluation algorithm adapted from teh text summarization domain.

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. OBJECTIVE: This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. METHODS: With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. RESULTS AND CONCLUSIONS: Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process. PMID:28035943

The method of selecting an integrated development territory for the high-rise unique constructions

NASA Astrophysics Data System (ADS)

Sheina, Svetlana; Shevtsova, Elina; Sukhinin, Alexander; Priss, Elena

2018-03-01

On the basis of data provided by the Department of architecture and urban planning of the city of Rostov-on-don, the problem of the choice of the territory for complex development that will be in priority for the construction of high-rise and unique buildings is solved. The objective of the study was the development of a methodology for selection of the area and the implementation of the proposed method on the example of evaluation of four-territories complex development. The developed method along with standard indicators of complex evaluation considers additional indicators that assess the territory from the position of high-rise unique building. The final result of the study is the rankings of the functional priority areas that takes into account the construction of both residential and public and business objects of unique high-rise construction. The use of the developed methodology will allow investors and customers to assess the investment attractiveness of the future unique construction project on the proposed site.

Empirical Distributional Semantics: Methods and Biomedical Applications

PubMed Central

Cohen, Trevor; Widdows, Dominic

2009-01-01

Over the past fifteen years, a range of methods have been developed that are able to learn human-like estimates of the semantic relatedness between terms from the way in which these terms are distributed in a corpus of unannotated natural language text. These methods have also been evaluated in a number of applications in the cognitive science, computational linguistics and the information retrieval literatures. In this paper, we review the available methodologies for derivation of semantic relatedness from free text, as well as their evaluation in a variety of biomedical and other applications. Recent methodological developments, and their applicability to several existing applications are also discussed. PMID:19232399

In vitro methods for evaluating skin hydration under diapers and incontinence products.

PubMed

Tate, M L; Wright, A S

2017-11-01

Excessive skin hydration from wearing wet undergarments, such as infant diapers and adult incontinence products, has been historically problematic. Skin damage occurs from wetness (urine) and limited product breathability. Evaporative water loss has been measured on adult arms (armband method) or infant torsos (on-baby method), after wearing a saline-insulted diaper product. The current study developed a reliable in vitro method of evaluating diaper and incontinence products for improvements in skin dryness. A simulated skin substrate was applied to a heated mechanical arm or baby torso. A disposable diaper or incontinence product was wrapped around the arm or baby torso, and loaded with saline. Hydration of the simulated skin was measured by evaporimetry and compared with clinical data from adult armband evaluations. The heated mechanical arm and baby torso accurately distinguished products for skin dryness. Eight diaper products were evaluated and compared to human test results. The torso in vitro and mechanical arm evaluations demonstrated strong correlations to human epidermal water loss evaluations, with repeatable results. Additionally, the bench test has been used for adult incontinence products, and it proved to differentiate those products as well as infant products. A rapid and reliable means of evaluation has been developed, and it is predictive of human subject testing. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

In vitro steroid profiling system for the evaluation of endocrine disruptors.

PubMed

Nakano, Yosuke; Yamashita, Toshiyuki; Okuno, Masashi; Fukusaki, Eiichiro; Bamba, Takeshi

2016-09-01

Endocrine disruptors (ED) are chemicals that affect various aspects of the endocrine system, often leading to the inhibition of steroidogenesis. Current chemical safety policies that restrict human exposure to such chemicals describe often time-consuming and costly methods for the evaluation of ED effects. We aimed to develop an effective tool for accurate phenotypic chemical toxicology studies. We developed an in vitro ED evaluation system using gas chromatography/mass spectrometry (GC/MS/MS) methods for metabolomic analysis of multi-marker profiles. Accounting for sample preparation and GC/MS/MS conditions, we established a screening method that allowed the simultaneous analysis of 17 steroids with good reproducibility and a linear calibration curve. Moreover, we applied the developed system to H295R human adrenocortical cells exposed to forskolin and prochloraz in accordance with the Organization for Economic Cooperation and Development (OECD) guidelines and observed dose-dependent variations in steroid profiles. While the OECD guidelines include only testosterone and 17β-estradiol, our system enabled a comprehensive and highly sensitive analysis of steroid profile alteration due to ED exposure. The application of our ED evaluation screen could be economical and provide novel insights into the hazards of ED exposure to the endocrine system. Copyright © 2016 The Society for Biotechnology, Japan. Published by Elsevier B.V. All rights reserved.

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study.

PubMed

de Korte, Elsbeth Marieke; Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-03-28

To improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users' characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees' mental models; practicability; resources; and skills required of experts and users. ©Elsbeth Marieke de Korte, Noortje Wiezer, Joris H Janssen, Peter Vink, Wessel Kraaij. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 28.03.2018.

System and algorithm for evaluation of human auditory analyzer state

NASA Astrophysics Data System (ADS)

Bachynskiy, Mykhaylo V.; Azarkhov, Oleksandr Yu.; Shtofel, Dmytro Kh.; Horbatiuk, Svitlana M.; Ławicki, Tomasz; Kalizhanova, Aliya; Smailova, Saule; Askarova, Nursanat

2017-08-01

The paper discusses questions of human auditory state evaluation with technical means. It considers the disadvantages of existing clinical audiometry methods and systems. It is proposed to use method for evaluating of auditory analyzer state by means of pulsometry to get the medical study more objective and efficient. It provides for use of two optoelectronic sensors located on the carotid artery and ear lobe, Using this method the biotechnical system for evaluation and stimulation of human auditory analyzer stare wad developed. Its hardware and software were substantiated. Different modes of simulation in the designed system were tested and the influence of the procedure on a patient was studied.

Evaluation of Different Scoring Rules for a Noncognitive Test in Development. Research Report. ETS RR-16-03

ERIC Educational Resources Information Center

Guo, Hongwen; Zu, Jiyun; Kyllonen, Patrick; Schmitt, Neal

2016-01-01

In this report, systematic applications of statistical and psychometric methods are used to develop and evaluate scoring rules in terms of test reliability. Data collected from a situational judgment test are used to facilitate the comparison. For a well-developed item with appropriate keys (i.e., the correct answers), agreement among various…

Design, Development, and Formative Evaluation of a Smartphone Application for Recording and Monitoring Physical Activity Levels: The 10,000 Steps "iStepLog"

ERIC Educational Resources Information Center

Kirwan, Morwenna; Duncan, Mitch J.; Vandelanotte, Corneel; Mummery, W. Kerry

2013-01-01

Objectives: Limited research exists addressing the development of health-related smartphone apps, a new and potentially effective health promotion delivery strategy. This article describes the development and formative evaluation of a smartphone app associated with a physical activity promotion website. Methods: A combination of qualitative and…

Decision support systems for ecosystem management: An evaluation of existing systems

Treesearch

H. Todd Mowrer; Klaus Barber; Joe Campbell; Nick Crookston; Cathy Dahms; John Day; Jim Laacke; Jim Merzenich; Steve Mighton; Mike Rauscher; Rick Sojda; Joyce Thompson; Peter Trenchi; Mark Twery

1997-01-01

This report evaluated 24 computer-aided decision support systems (DSS) that can support management decision-making in forest ecosystems. It compares the scope of each system, spatial capabilities, computational methods, development status, input and output requirements, user support availability, and system performance. Questionnaire responses from the DSS developers (...

Development and Evaluation of the School Cafeteria Nutrition Assessment Measures

ERIC Educational Resources Information Center

Krukowski, Rebecca A.; Philyaw Perez, Amanda G.; Bursac, Zoran; Goodell, Melanie; Raczynski, James M.; Smith West, Delia; Phillips, Martha M.

2011-01-01

Background: Foods provided in schools represent a substantial portion of US children's dietary intake; however, the school food environment has proven difficult to describe due to the lack of comprehensive, standardized, and validated measures. Methods: As part of the Arkansas Act 1220 evaluation project, we developed the School Cafeteria…

[Discussion on development of four diagnostic information scale for clinical re-evaluation of postmarketing herbs].

PubMed

He, Wei; Xie, Yanming; Wang, Yongyan

2011-12-01

Post-marketing re-evaluation of Chinese herbs can well reflect Chinese medicine characteristics, which is the most easily overlooked the clinical re-evaluation content. Since little attention has been paid to this, study on the clinical trial design method was lost. It is difficult to improving the effectiveness and safety of traditional Chinese medicine. Therefore, more attention should be paid on re-evaluation of the clinical trial design method point about tcm syndrome such as the type of research program design, the study of Chinese medical information collection scale and statistical analysis methods, so as to improve the clinical trial design method study about tcm syndrome of Chinese herbs postmarketing re-evalutation status.

Using Work Action Analysis to Identify Web-Portal Requirements for a Professional Development Program

ERIC Educational Resources Information Center

Nickles, George

2007-01-01

This article describes using Work Action Analysis (WAA) as a method for identifying requirements for a web-based portal that supports a professional development program. WAA is a cognitive systems engineering method for modeling multi-agent systems to support design and evaluation. A WAA model of the professional development program of the…

Model correlation and damage location for large space truss structures: Secant method development and evaluation

NASA Technical Reports Server (NTRS)

Smith, Suzanne Weaver; Beattie, Christopher A.

1991-01-01

On-orbit testing of a large space structure will be required to complete the certification of any mathematical model for the structure dynamic response. The process of establishing a mathematical model that matches measured structure response is referred to as model correlation. Most model correlation approaches have an identification technique to determine structural characteristics from the measurements of the structure response. This problem is approached with one particular class of identification techniques - matrix adjustment methods - which use measured data to produce an optimal update of the structure property matrix, often the stiffness matrix. New methods were developed for identification to handle problems of the size and complexity expected for large space structures. Further development and refinement of these secant-method identification algorithms were undertaken. Also, evaluation of these techniques is an approach for model correlation and damage location was initiated.

Evaluation as institution: a contractarian argument for needs-based economic evaluation.

PubMed

Rogowski, Wolf H

2018-06-13

There is a gap between health economic evaluation methods and the value judgments of coverage decision makers, at least in Germany. Measuring preference satisfaction has been claimed to be inappropriate for allocating health care resources, e.g. because it disregards medical need. The existing methods oriented at medical need have been claimed to disregard non-consequentialist fairness concerns. The aim of this article is to propose a new, contractarian argument for justifying needs-based economic evaluation. It is based on consent rather than maximization of some impersonal unit of value to accommodate the fairness concerns. This conceptual paper draws upon contractarian ethics and constitution economics to show how economic evaluation can be viewed as an institution to overcome societal conflicts in the allocation of scarce health care resources. For this, the problem of allocating scarce health care resources in a society is reconstructed as a social dilemma. Both disadvantaged patients and affluent healthy individuals can be argued to share interests in a societal contract to provide technologies which ameliorate medical need, based on progressive funding. The use of needs-based economic evaluation methods for coverage determination can be interpreted as institutions for conflict resolution as far as they use consented criteria to ensure the social contract's sustainability and avoid implicit rationing or unaffordable contribution rates. This justifies the use of needs-based evaluation methods by Pareto-superiority and consent (rather than by some needs-based value function per se). The view of economic evaluation presented here may help account for fairness concerns in the further development of evaluation methods. This is because it directs the attention away from determining some unit of value to be maximized towards determining those persons who are most likely not to consent and meeting their concerns. Following this direction in methods development is likely to increase the acceptability of health economic evaluation by decision makers.

48 CFR 715.305 - Proposal evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

....305 Section 715.305 Federal Acquisition Regulations System AGENCY FOR INTERNATIONAL DEVELOPMENT CONTRACTING METHODS AND CONTRACT TYPES CONTRACTING BY NEGOTIATION Source Selection 715.305 Proposal evaluation... Contractor Performance System to evaluate past performance. (Access to the system by USAID contracting office...

DATA ATTRIBUTE RATING SYSTEM

EPA Science Inventory

The paper discusses a data attribute rating system (DARS), developed by EPA to assist in evaluating data associated with emission inventories. he paper presents DARS for evaluation by the potential user community. ARS was originally conceived as a method for evaluating country-sp...

Quantifying the quality of medical x-ray images: An evaluation based on normal anatomy for lumbar spine and chest radiography

NASA Astrophysics Data System (ADS)

Tingberg, Anders Martin

Optimisation in diagnostic radiology requires accurate methods for determination of patient absorbed dose and clinical image quality. Simple methods for evaluation of clinical image quality are at present scarce and this project aims at developing such methods. Two methods are used and further developed; fulfillment of image criteria (IC) and visual grading analysis (VGA). Clinical image quality descriptors are defined based on these two methods: image criteria score (ICS) and visual grading analysis score (VGAS), respectively. For both methods the basis is the Image Criteria of the ``European Guidelines on Quality Criteria for Diagnostic Radiographic Images''. Both methods have proved to be useful for evaluation of clinical image quality. The two methods complement each other: IC is an absolute method, which means that the quality of images of different patients and produced with different radiographic techniques can be compared with each other. The separating power of IC is, however, weaker than that of VGA. VGA is the best method for comparing images produced with different radiographic techniques and has strong separating power, but the results are relative, since the quality of an image is compared to the quality of a reference image. The usefulness of the two methods has been verified by comparing the results from both of them with results from a generally accepted method for evaluation of clinical image quality, receiver operating characteristics (ROC). The results of the comparison between the two methods based on visibility of anatomical structures and the method based on detection of pathological structures (free-response forced error) indicate that the former two methods can be used for evaluation of clinical image quality as efficiently as the method based on ROC. More studies are, however, needed for us to be able to draw a general conclusion, including studies of other organs, using other radiographic techniques, etc. The results of the experimental evaluation of clinical image quality are compared with physical quantities calculated with a theoretical model based on a voxel phantom, and correlations are found. The results demonstrate that the computer model can be a useful toot in planning further experimental studies.

Methodology of ETV Formative Evaluation.

ERIC Educational Resources Information Center

Duby, Aliza

Formative evaluation is discussed as it relates to educational television (ETV). Formative evaluation, used to improve a project during its development, is especially valuable in the production of television programs. Methods useful in the formative evaluation of ETV are: (1) try-out studies; (2) learner verification and revision; (3)…

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Evaluating the evaluation of cancer driver genes

PubMed Central

Tokheim, Collin J.; Papadopoulos, Nickolas; Kinzler, Kenneth W.; Vogelstein, Bert; Karchin, Rachel

2016-01-01

Sequencing has identified millions of somatic mutations in human cancers, but distinguishing cancer driver genes remains a major challenge. Numerous methods have been developed to identify driver genes, but evaluation of the performance of these methods is hindered by the lack of a gold standard, that is, bona fide driver gene mutations. Here, we establish an evaluation framework that can be applied to driver gene prediction methods. We used this framework to compare the performance of eight such methods. One of these methods, described here, incorporated a machine-learning–based ratiometric approach. We show that the driver genes predicted by each of the eight methods vary widely. Moreover, the P values reported by several of the methods were inconsistent with the uniform values expected, thus calling into question the assumptions that were used to generate them. Finally, we evaluated the potential effects of unexplained variability in mutation rates on false-positive driver gene predictions. Our analysis points to the strengths and weaknesses of each of the currently available methods and offers guidance for improving them in the future. PMID:27911828

A method to improve the nutritional quality of foods and beverages based on dietary recommendations.

PubMed

Nijman, C A J; Zijp, I M; Sierksma, A; Roodenburg, A J C; Leenen, R; van den Kerkhoff, C; Weststrate, J A; Meijer, G W

2007-04-01

The increasing consumer interest in health prompted Unilever to develop a globally applicable method (Nutrition Score) to evaluate and improve the nutritional composition of its foods and beverages portfolio. Based on (inter)national dietary recommendations, generic benchmarks were developed to evaluate foods and beverages on their content of trans fatty acids, saturated fatty acids, sodium and sugars. High intakes of these key nutrients are associated with undesirable health effects. In principle, the developed generic benchmarks can be applied globally for any food and beverage product. Product category-specific benchmarks were developed when it was not feasible to meet generic benchmarks because of technological and/or taste factors. The whole Unilever global foods and beverages portfolio has been evaluated and actions have been taken to improve the nutritional quality. The advantages of this method over other initiatives to assess the nutritional quality of foods are that it is based on the latest nutritional scientific insights and its global applicability. The Nutrition Score is the first simple, transparent and straightforward method that can be applied globally and across all food and beverage categories to evaluate the nutritional composition. It can help food manufacturers to improve the nutritional value of their products. In addition, the Nutrition Score can be a starting point for a powerful health indicator front-of-pack. This can have a significant positive impact on public health, especially when implemented by all food manufacturers.

Evaluating Change in Medical School Curricula: How Did We Know Where We Were Going?

ERIC Educational Resources Information Center

Mahaffy, John; Gerrity, Martha S.

1998-01-01

Compares and contrasts the primary outcomes and methods used to evaluate curricular changes at eight medical schools participating in a large-scale medical curriculum development project. Describes how the evaluative data, both quantitative and qualitative, were collected, and how evaluation drove curricular change. Although the evaluations were…

A Need for a Framework for Curriculum Evaluation in Oman

ERIC Educational Resources Information Center

Al-Jardani, Khalid Salim; Siraj, Saedah; Abedalaziz, Nabeel

2012-01-01

The field of curriculum evaluation is a key part of the educational process. This means that this area needs to be developed continuously and requires ongoing research. This paper highlights curriculum evaluation in Oman, different evaluation procedures and methods and instruments used. The need for a framework for curriculum evaluation is a vital…

Validation of a pulsed electric field process to pasteurize strawberry puree

USDA-ARS?s Scientific Manuscript database

An inexpensive data acquisition method was developed to validate the exact number and shape of the pulses applied during pulsed electric fields (PEF) processing. The novel validation method was evaluated in conjunction with developing a pasteurization PEF process for strawberry puree. Both buffered...

REGIONAL VULNERABILITY ASSESSMENT OF THE MID-ATLANTIC REGION: EVALUATION OF INTEGRATION METHODS AND ASSESSMENTS RESULTS

EPA Science Inventory

This report describes methods for quantitative regional assessment developed by the Regional Vulnerability Assessment (ReVA) program. The goal of ReVA is to develop regional-scale assessments of the magnitude, extent, distribution, and uncertainty of current and anticipated envir...

EVALUATION OF AN ENZYME-LINKED IMMUNOSORBENT ASSAY FOR BIOLOGICAL MONITORING OF 3-PHENOXYBENZOIC ACID IN URINE

EPA Science Inventory

Abstract describes the development of an enzyme-linked immunosorbent assay (ELISA) method for monitoring 2,4-dichlorophenoxyacetic acid (2,4-D exposures). The ELISA is compared with a gas chromatograhy/mass spectrometry procedure. ELISA method development steps and comparative ...

MATERIALS SUPPORTING THE NEW RECREATIONAL ...

EPA Pesticide Factsheets

EPA is developing new, rapid methods for monitoring water quality at beaches to determine adequacy of water quality for swimming. The methods being developed rely upon quantitive polymerase chain reaction technology. They will permit real time decisions regarding beach closures. The methods are supported by a series of epidemiology studies evaluating the rate of GI illness resulting from swimming events. Implementation of BEACH Act amendments

Estimating Durability of Reinforced Concrete

NASA Astrophysics Data System (ADS)

Varlamov, A. A.; Shapovalov, E. L.; Gavrilov, V. B.

2017-11-01

In this article we propose to use the methods of fracture mechanics to evaluate concrete durability. To evaluate concrete crack resistance characteristics of concrete directly in the structure in order to implement the methods of fracture mechanics, we have developed special methods. Various experimental studies have been carried out to determine the crack resistance characteristics and the concrete modulus of elasticity during its operating. A comparison was carried out for the results obtained with the use of the proposed methods and those obtained with the standard methods for determining the concrete crack resistance characteristics.

Analysis and development of adjoint-based h-adaptive direct discontinuous Galerkin method for the compressible Navier-Stokes equations

NASA Astrophysics Data System (ADS)

Cheng, Jian; Yue, Huiqiang; Yu, Shengjiao; Liu, Tiegang

2018-06-01

In this paper, an adjoint-based high-order h-adaptive direct discontinuous Galerkin method is developed and analyzed for the two dimensional steady state compressible Navier-Stokes equations. Particular emphasis is devoted to the analysis of the adjoint consistency for three different direct discontinuous Galerkin discretizations: including the original direct discontinuous Galerkin method (DDG), the direct discontinuous Galerkin method with interface correction (DDG(IC)) and the symmetric direct discontinuous Galerkin method (SDDG). Theoretical analysis shows the extra interface correction term adopted in the DDG(IC) method and the SDDG method plays a key role in preserving the adjoint consistency. To be specific, for the model problem considered in this work, we prove that the original DDG method is not adjoint consistent, while the DDG(IC) method and the SDDG method can be adjoint consistent with appropriate treatment of boundary conditions and correct modifications towards the underlying output functionals. The performance of those three DDG methods is carefully investigated and evaluated through typical test cases. Based on the theoretical analysis, an adjoint-based h-adaptive DDG(IC) method is further developed and evaluated, numerical experiment shows its potential in the applications of adjoint-based adaptation for simulating compressible flows.

Optimized anion exchange column isolation of zirconium-89 ( 89Zr) from yttrium cyclotron target: Method development and implementation on an automated fluidic platform

DOE Office of Scientific and Technical Information (OSTI.GOV)

O’Hara, Matthew J.; Murray, Nathaniel J.; Carter, Jennifer C.

Zirconium-89 ( 89Zr), produced by the (p, n) reaction from naturally monoisotopic yttrium ( natY), is a promising positron emitting isotope for immunoPET imaging. Its long half-life of 78.4 h is sufficient for evaluating slow physiological processes. A prototype automated fluidic system, coupled to on-line and in-line detectors, has been constructed to facilitate development of new 89Zr purification methodologies. The highly reproducible reagent delivery platform and near-real time monitoring of column effluents allows for efficient method optimization. The separation of Zr from dissolved Y metal targets was evaluated using several anion exchange resins. Each resin was evaluated against its abilitymore » to quantitatively capture Zr from a load solution high in dissolved Y. The most appropriate anion exchange resin for this application was identified, and the separation method was optimized. The method is capable of a high Y decontamination factor (>10 5) and has been shown to remove Fe, an abundant contaminant in Y foils, from the 89Zr elution fraction. Finally, the method was evaluated using cyclotron bombarded Y foil targets; the method was shown to achieve >95% recovery of the 89Zr present in the foils. The anion exchange column method described here is intended to be the first 89Zr isolation stage in a dual-column purification process.« less

Optimized anion exchange column isolation of zirconium-89 ( 89Zr) from yttrium cyclotron target: Method development and implementation on an automated fluidic platform

DOE PAGES

O’Hara, Matthew J.; Murray, Nathaniel J.; Carter, Jennifer C.; ...

2018-02-24

Zirconium-89 ( 89Zr), produced by the (p, n) reaction from naturally monoisotopic yttrium ( natY), is a promising positron emitting isotope for immunoPET imaging. Its long half-life of 78.4 h is sufficient for evaluating slow physiological processes. A prototype automated fluidic system, coupled to on-line and in-line detectors, has been constructed to facilitate development of new 89Zr purification methodologies. The highly reproducible reagent delivery platform and near-real time monitoring of column effluents allows for efficient method optimization. The separation of Zr from dissolved Y metal targets was evaluated using several anion exchange resins. Each resin was evaluated against its abilitymore » to quantitatively capture Zr from a load solution high in dissolved Y. The most appropriate anion exchange resin for this application was identified, and the separation method was optimized. The method is capable of a high Y decontamination factor (>10 5) and has been shown to remove Fe, an abundant contaminant in Y foils, from the 89Zr elution fraction. Finally, the method was evaluated using cyclotron bombarded Y foil targets; the method was shown to achieve >95% recovery of the 89Zr present in the foils. The anion exchange column method described here is intended to be the first 89Zr isolation stage in a dual-column purification process.« less

STATISTICAL ANALYSIS OF SNAP 10A THERMOELECTRIC CONVERTER ELEMENT PROCESS DEVELOPMENT VARIABLES

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fitch, S.H.; Morris, J.W.

1962-12-15

Statistical analysis, primarily analysis of variance, was applied to evaluate several factors involved in the development of suitable fabrication and processing techniques for the production of lead telluride thermoelectric elements for the SNAP 10A energy conversion system. The analysis methods are described as to their application for determining the effects of various processing steps, estabIishing the value of individual operations, and evaluating the significance of test results. The elimination of unnecessary or detrimental processing steps was accomplished and the number of required tests was substantially reduced by application of these statistical methods to the SNAP 10A production development effort. (auth)

Real-Time Tracking of Knee Adduction Moment in Patients with Knee Osteoarthritis

PubMed Central

Kang, Sang Hoon; Lee, Song Joo; Zhang, Li-Qun

2014-01-01

Background The external knee adduction moment (EKAM) is closely associated with the presence, progression, and severity of knee osteoarthritis (OA). However, there is a lack of convenient and practical method to estimate and track in real-time the EKAM of patients with knee OA for clinical evaluation and gait training, especially outside of gait laboratories. New Method A real-time EKAM estimation method was developed and applied to track and investigate the EKAM and other knee moments during stepping on an elliptical trainer in both healthy subjects and a patient with knee OA. Results Substantial changes were observed in the EKAM and other knee moments during stepping in the patient with knee OA. Comparison with Existing Method(s) This is the first study to develop and test feasibility of real-time tracking method of the EKAM on patients with knee OA using 3-D inverse dynamics. Conclusions The study provides us an accurate and practical method to evaluate in real-time the critical EKAM associated with knee OA, which is expected to help us to diagnose and evaluate patients with knee OA and provide the patients with real-time EKAM feedback rehabilitation training. PMID:24361759

Building Leadership Talent through Performance Evaluation

ERIC Educational Resources Information Center

Clifford, Matthew

2015-01-01

Most states and districts scramble to provide professional development to support principals, but "principal evaluation" is often lost amid competing priorities. Evaluation is an important method for supporting principal growth, communicating performance expectations to principals, and improving leadership practice. It provides leaders…

A Holistic Approach to Evaluating Vocational Education: Traditional Chinese Physicians (TCP) Model.

ERIC Educational Resources Information Center

Lee, Lung-Sheng; Chang, Liang-Te

Conventional approaches to evaluating vocational education have often been criticized for failing to deal holistically with the institution or program being evaluated. Integrated quantitative and qualitative evaluation methods have documented benefits; therefore, it would be useful to consider possibility of developing a model for evaluating…

Developing Methodologies for Evaluating the Earthquake Safety of Existing Buildings.

ERIC Educational Resources Information Center

Bresler, B.; And Others

This report contains four papers written during an investigation of methods for evaluating the safety of existing school buildings under Research Applied to National Needs (RANN) grants. In "Evaluation of Earthquake Safety of Existing Buildings," by B. Bresler, preliminary ideas on the evaluation of the earthquake safety of existing…

Usage-Based Collection Evaluation with a Curricular Focus

ERIC Educational Resources Information Center

Kohn, Karen C.

2013-01-01

Systematic evaluation of a library's collection can be a useful tool for collection development. After reviewing three evaluation methods and their usefulness for our small academic library, I undertook a usage-based evaluation, focusing on narrow segments of our collection that served specific undergraduate courses. For each section, I collected…

Mixed methods research in the development and evaluation of complex interventions in palliative and end-of-life care: report on the MORECare consensus exercise.

PubMed

Farquhar, Morag; Preston, Nancy; Evans, Catherine J; Grande, Gunn; Short, Vicky; Benalia, Hamid; Higginson, Irene J; Todd, Chris

2013-12-01

Complex interventions are common in palliative and end-of-life care. Mixed methods approaches sit well within the multiphase model of complex intervention development and evaluation. Generic mixed methods guidance is useful but additional challenges in the research design and operationalization within palliative and end-of-life care may have an impact on the use of mixed methods. The objective of the study was to develop guidance on the best methods for combining quantitative and qualitative methods for health and social care intervention development and evaluation in palliative and end-of-life care. A one-day workshop was held where experts participated in facilitated groups using Transparent Expert Consultation to generate items for potential recommendations. Agreement and consensus were then sought on nine draft recommendations (DRs) in a follow-up exercise. There was at least moderate agreement with most of the DRs, although consensus was low. Strongest agreement was with DR1 (usefulness of mixed methods to palliative and end-of-life care) and DR5 (importance of attention to respondent burden), and least agreement was with DR2 (use of theoretical perspectives) and DR6 (therapeutic effects of research interviews). Narrative comments enabled recommendation refinement. Two fully endorsed, five partially endorsed, and two refined DRs emerged. The relationship of these nine to six key challenges of palliative and end-of-life care research was analyzed. There is a need for further discussion of these recommendations and their contribution to methodology. The recommendations should be considered when designing and operationalizing mixed methods studies of complex interventions in palliative care, and because they may have wider relevance, should be considered for other applications.

Development And Evaluation Of Stable Isotope And Fluorescent Labeling And Detection Methodologies For Tracking Injected Bacteria During In Situ Bioremediation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mark E. Fuller; Tullis C. Onstott

2003-12-17

This report summarizes the results of a research project conducted to develop new methods to label bacterial cells so that they could be tracked and enumerated as they move in the subsurface after they are introduced into the groundwater (i.e., during bioaugmentation). Labeling methods based on stable isotopes of carbon (13C) and vital fluorescent stains were developed. Both approaches proved successful with regards to the ability to effectively label bacterial cells. Several methods for enumeration of fluorescently-labeled cells were developed and validated, including near-real time microplate spectrofluorometry that could be performed in the field. However, the development of a novelmore » enumeration method for the 13C-enriched cells, chemical reaction interface/mass spectrometry (CRIMS), was not successful due to difficulties with the proposed instrumentation. Both labeling methodologies were successfully evaluated and validated during laboratory- and field-scale bacterial transport experiments. The methods developed during this research should be useful for future bacterial transport work as well as other microbial ecology research in a variety of environments. A full bibliography of research articles and meeting presentations related to this project is included (including web links to abstracts and full text reprints).« less

Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth.

PubMed

Jha, Abhinav K; Song, Na; Caffo, Brian; Frey, Eric C

2015-04-13

Quantitative single-photon emission computed tomography (SPECT) imaging is emerging as an important tool in clinical studies and biomedical research. There is thus a need for optimization and evaluation of systems and algorithms that are being developed for quantitative SPECT imaging. An appropriate objective method to evaluate these systems is by comparing their performance in the end task that is required in quantitative SPECT imaging, such as estimating the mean activity concentration in a volume of interest (VOI) in a patient image. This objective evaluation can be performed if the true value of the estimated parameter is known, i.e. we have a gold standard. However, very rarely is this gold standard known in human studies. Thus, no-gold-standard techniques to optimize and evaluate systems and algorithms in the absence of gold standard are required. In this work, we developed a no-gold-standard technique to objectively evaluate reconstruction methods used in quantitative SPECT when the parameter to be estimated is the mean activity concentration in a VOI. We studied the performance of the technique with realistic simulated image data generated from an object database consisting of five phantom anatomies with all possible combinations of five sets of organ uptakes, where each anatomy consisted of eight different organ VOIs. Results indicate that the method provided accurate ranking of the reconstruction methods. We also demonstrated the application of consistency checks to test the no-gold-standard output.

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

A comprehensive method for the fracability evaluation of shale combined with brittleness and stress sensitivity

NASA Astrophysics Data System (ADS)

Wang, Xiaoqiong; Ge, Hongkui; Wang, Daobing; Wang, Jianbo; Chen, Hao

2017-12-01

An effective fracability evaluation on the fracture network is key to the whole process of shale gas exploitation. At present, neither a standard criteria nor a generally accepted evaluation method exist. Well log and laboratory results have shown that the commonly used brittleness index calculated from the mineralogy composition is not entirely consistent with that obtained from the elastic modulus of the rock, and is sometimes even contradictory. The brittle mineral reflects the brittleness of the rock matrix, and the stress sensitivity of the wave velocity reflects the development degree of the natural fracture system. They are both key factors in controlling the propagating fracture morphology. Thus, in this study, a novel fracability evaluation method of shale was developed combining brittleness and stress sensitivity. Based on this method, the fracability of three shale gas plays were evaluated. The cored cylindrical samples were loaded under uniaxial stress up to 30 MPa and the compressional wave velocities were obtained along the axis stress direction at each MPa stress. From the stress velocity evolution, the stress sensitivity coefficients could be obtained. Our results showed that the fracability of Niutitang shale is better than that of Lujiaping shale, and the fracability of Lujiaping shale is better than Longmaxi shale. This result is in good agreement with acoustic emission activity measurements. The new fracability evaluation method enables a comprehensive reflection of the characteristics of rock matrix brittleness and the natural fracture system. This work is valuable for the evaluation of hydraulic fracturing effects in unconventional oil and gas reservoirs in the future.

Validation of a two-dimensional liquid chromatography method for quality control testing of pharmaceutical materials.

PubMed

Yang, Samuel H; Wang, Jenny; Zhang, Kelly

2017-04-07

Despite the advantages of 2D-LC, there is currently little to no work in demonstrating the suitability of these 2D-LC methods for use in a quality control (QC) environment for good manufacturing practice (GMP) tests. This lack of information becomes more critical as the availability of commercial 2D-LC instrumentation has significantly increased, and more testing facilities begin to acquire these 2D-LC capabilities. It is increasingly important that the transferability of developed 2D-LC methods be assessed in terms of reproducibility, robustness and performance across different laboratories worldwide. The work presented here focuses on the evaluation of a heart-cutting 2D-LC method used for the analysis of a pharmaceutical material, where a key, co-eluting impurity in the first dimension ( 1 D) is resolved from the main peak and analyzed in the second dimension ( 2 D). A design-of-experiments (DOE) approach was taken in the collection of the data, and the results were then modeled in order to evaluate method robustness using statistical modeling software. This quality by design (QBD) approach gives a deeper understanding of the impact of these 2D-LC critical method attributes (CMAs) and how they affect overall method performance. Although there are multiple parameters that may be critical from method development point of view, a special focus of this work is devoted towards evaluation of unique 2D-LC critical method attributes from method validation perspective that transcend conventional method development and validation. The 2D-LC method attributes are evaluated for their recovery, peak shape, and resolution of the two co-eluting compounds in question on the 2 D. In the method, linearity, accuracy, precision, repeatability, and sensitivity are assessed along with day-to-day, analyst-to-analyst, and lab-to-lab (instrument-to-instrument) assessments. The results of this validation study demonstrate that the 2D-LC method is accurate, sensitive, and robust and is ultimately suitable for QC testing with good method transferability. Copyright © 2017 Elsevier B.V. All rights reserved.

A high-performance liquid chromatography-electronic circular dichroism online method for assessing the absolute enantiomeric excess and conversion ratio of asymmetric reactions

NASA Astrophysics Data System (ADS)

Zhang, Xiang; Wang, Mingchao; Li, Li; Yin, Dali

2017-03-01

Asymmetric reactions often need to be evaluated during the synthesis of chiral compounds. However, traditional evaluation methods require the isolation of the individual enantiomer, which is tedious and time-consuming. Thus, it is desirable to develop simple, practical online detection methods. We developed a method based on high-performance liquid chromatography-electronic circular dichroism (HPLC-ECD) that simultaneously analyzes the material conversion ratio and absolute optical purity of each enantiomer. In particular, only a reverse-phase C18 column instead of a chiral column is required in our method because the ECD measurement provides a g-factor that describes the ratio of each enantiomer in the mixtures. We used our method to analyze the asymmetric hydrosilylation of β-enamino esters, and we discussed the advantage, feasibility, and effectiveness of this new methodology.

Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

ERIC Educational Resources Information Center

Grant, Kelly J.

2016-01-01

The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

Faculty Development and the Community College LRC.

ERIC Educational Resources Information Center

Kazlauskas, Edward John; Maxwell, William

1990-01-01

Urges community college libraries to provide and expand services in faculty development. Considers trends toward an increasing emphasis on faculty development, the professional development needs of community college faculty, faculty development methods, consulting services, reward structures for faculty development, and program evaluation. (DMM)

A New Approach to Aircraft Robust Performance Analysis

NASA Technical Reports Server (NTRS)

Gregory, Irene M.; Tierno, Jorge E.

2004-01-01

A recently developed algorithm for nonlinear system performance analysis has been applied to an F16 aircraft to begin evaluating the suitability of the method for aerospace problems. The algorithm has a potential to be much more efficient than the current methods in performance analysis for aircraft. This paper is the initial step in evaluating this potential.

The Bookmark Procedure for Setting Cut-Scores and Finalizing Performance Standards: Strengths and Weaknesses

ERIC Educational Resources Information Center

Lin, Jie

2006-01-01

The Bookmark standard-setting procedure was developed to address the perceived problems with the most popular method for setting cut-scores: the Angoff procedure (Angoff, 1971). The purposes of this article are to review the Bookmark procedure and evaluate it in terms of Berk's (1986) criteria for evaluating cut-score setting methods. The…

Implementing a Service Learning Model for Teaching Research Methods and Program Evaluation

ERIC Educational Resources Information Center

Shannon, Patrick; Kim, Wooksoo; Robinson, Adjoa

2012-01-01

In an effort to teach students the basic knowledge of research methods and the realities of conducting research in the context of agencies in the community, faculty developed and implemented a service learning model for teaching research and program evaluation to foundation-year MSW students. A year-long foundation course was designed in which one…

Creating and Evaluating a Hypertext System of Documenting Analytical Test Methods in a Chemical Plant Quality Assurance Laboratory.

ERIC Educational Resources Information Center

White, Charles E., Jr.

The purpose of this study was to develop and implement a hypertext documentation system in an industrial laboratory and to evaluate its usefulness by participative observation and a questionnaire. Existing word-processing test method documentation was converted directly into a hypertext format or "hyperdocument." The hyperdocument was designed and…

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

ERIC Educational Resources Information Center

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-01-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of…

Physical Education Teacher Perceptions of Teacher Evaluation

ERIC Educational Resources Information Center

Norris, Jason; van der Mars, Hans; Kulinna, Pamela; Amrein-Beardsley, Audrey; Kwon, Jayoun; Hodges, Michael

2017-01-01

Purpose: The purpose of this study was to develop a better understanding of current PE teachers' perceptions of teacher evaluation systems. Method: A mixed methods approach was used and two sources of data collection were used: (a) a short survey of PE teachers (n = 22) in one urban school district and (b) a formal semistructured interview with 10…

Third molar development in a contemporary Danish 13-25year old population.

PubMed

Arge, Sara; Boldsen, Jesper Lier; Wenzel, Ann; Holmstrup, Palle; Jensen, Niels Dyrgaard; Lynnerup, Niels

2018-05-16

We present a reference database for third molar development based on a contemporary Danish population. A total of 1302 digital panoramic images were evaluated. The images were taken at a known chronological age, ranging from 13 to 25years. Third molar development was scored according to the Köhler modification of the 10-stage method of Gleiser and Hunt. We found that third molar development was generally advanced in the maxilla compared to the mandible and in males compared to females; in addition, the mandibular third molar mesial roots were generally more advanced in development than were the distal roots. There was no difference in third molar development between the left and right side of the jaws. Establishing global and robust databases on dental development is crucial for further development of forensic methods to evaluate age. Copyright © 2018. Published by Elsevier B.V.

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

Uncertainty-based Optimization Algorithms in Designing Fractionated Spacecraft

PubMed Central

Ning, Xin; Yuan, Jianping; Yue, Xiaokui

2016-01-01

A fractionated spacecraft is an innovative application of a distributive space system. To fully understand the impact of various uncertainties on its development, launch and in-orbit operation, we use the stochastic missioncycle cost to comprehensively evaluate the survivability, flexibility, reliability and economy of the ways of dividing the various modules of the different configurations of fractionated spacecraft. We systematically describe its concept and then analyze its evaluation and optimal design method that exists during recent years and propose the stochastic missioncycle cost for comprehensive evaluation. We also establish the models of the costs such as module development, launch and deployment and the impacts of their uncertainties respectively. Finally, we carry out the Monte Carlo simulation of the complete missioncycle costs of various configurations of the fractionated spacecraft under various uncertainties and give and compare the probability density distribution and statistical characteristics of its stochastic missioncycle cost, using the two strategies of timing module replacement and non-timing module replacement. The simulation results verify the effectiveness of the comprehensive evaluation method and show that our evaluation method can comprehensively evaluate the adaptability of the fractionated spacecraft under different technical and mission conditions. PMID:26964755

Balanced scorecard-based performance evaluation of Chinese county hospitals in underdeveloped areas.

PubMed

Gao, Hongda; Chen, He; Feng, Jun; Qin, Xianjing; Wang, Xuan; Liang, Shenglin; Zhao, Jinmin; Feng, Qiming

2018-05-01

Objective Since the Guangxi government implemented public county hospital reform in 2009, there have been no studies of county hospitals in this underdeveloped area of China. This study aimed to establish an evaluation indicator system for Guangxi county hospitals and to generate recommendations for hospital development and policymaking. Methods A performance evaluation indicator system was developed based on balanced scorecard theory. Opinions were elicited from 25 experts from administrative units, universities and hospitals and the Delphi method was used to modify the performance indicators. The indicator system and the Topsis method were used to evaluate the performance of five county hospitals randomly selected from the same batch of 2015 Guangxi reform pilots. Results There were 4 first-level indicators, 9 second-level indicators and 36 third-level indicators in the final performance evaluation indicator system that showed good consistency, validity and reliability. The performance rank of the hospitals was B > E > A > C > D. Conclusions The performance evaluation indicator system established using the balanced scorecard is practical and scientific. Analysis of the results based on this indicator system identified several factors affecting hospital performance, such as resource utilisation efficiency, medical service price, personnel structure and doctor-patient relationships.

A sensitometric evaluation of a dental radiographic developer additive.

PubMed

Price, C

1982-04-01

The efficacy of a commercially available developer additive was investigated by a sensitometric method. The effects of the additive on two different manual developing solutions were evaluated immediately after mixing and at intervals of 5, 10, and 15 weeks. An automatic film processor was used to process control radiographs. Under the conditions of this investigation, no advantages were demonstrated following the use of the additive.

The current status of theory evaluation in nursing.

PubMed

Im, Eun-Ok

2015-10-01

To identify the current status of theory evaluation in nursing and provide directions for theory evaluation for future development of theoretical bases of nursing discipline. Theory evaluation is an essential component in development of nursing knowledge, which is a critical element in development of nursing discipline. Despite earlier significant efforts for theory evaluation in nursing, a recent decline in the number of theory evaluation articles was noted and there have been few updates on theory evaluation in nursing. Discussion paper. A total of 58 articles published from 2003-2014 were retrieved through searches using the PUBMED, PsyInfo and CINAHL. The articles were sorted by the area of evaluation and analysed to identify themes reflecting the theory evaluation process. Diverse ways of theory evaluation need to be continuously used in future theory evaluation efforts. Six themes reflecting the theory evaluation process were identified: (a) rarely using existing theory evaluation criteria; (b) evaluating specifics; (c) using various statistical analysis methods; (d) developing instruments; (e) adopting in practice and education; and (f) evaluating mainly middle-range theories and situation-specific theories. © 2015 John Wiley & Sons Ltd.

The Alzheimer's Disease Knowledge Scale: Development and Psychometric Properties

ERIC Educational Resources Information Center

Carpenter, Brian D.; Balsis, Steve; Otilingam, Poorni G.; Hanson, Priya K.; Gatz, Margaret

2009-01-01

Purpose: This study provides preliminary evidence for the acceptability, reliability, and validity of the new Alzheimer's Disease Knowledge Scale (ADKS), a content and psychometric update to the Alzheimer's Disease Knowledge Test. Design and Methods: Traditional scale development methods were used to generate items and evaluate their psychometric…

Evaluation of 309 environmental chemicals using a mouse embryonic stem cell adherent cell differentiation and cytotoxicity assay

EPA Science Inventory

The vast landscape of environmental chemicals has motivated the need for alternative methods to traditional whole-animal bioassays in toxicity testing. Embryonic stem (ES) cells provide an in vitro model of embryonic development and an alternative method for assessing development...

Development of a research method to measure insoluble and soluble starch in sugarcane factory and refinery products

USDA-ARS?s Scientific Manuscript database

A rapid, quantitative research method using microwave-assisted probe ultrasonication was developed to facilitate the determination of total insoluble, and soluble starch in various sugar factory and refinery products. Several variables that affect starch solubilization were evaluated: 1) conductiv...

Development of an analytical method to measure insoluble and soluble starch in sugarcane and sweet sorghum products

USDA-ARS?s Scientific Manuscript database

A rapid, quantitative research method using microwave-assisted probe ultrasonication was developed to facilitate the determination of total insoluble, and soluble starch in various sugar crop products. Several variables that affect starch solubilization were evaluated, 1) conductive boiling time, 2...

A Professional Development Program for Dental Medical Educators in Kuwait: Needs Assessment, Program Design and Formative Evaluation

ERIC Educational Resources Information Center

Alyaseen, Haneen

2017-01-01

New innovative methods of teaching and learning adopted from mainstream research and development in educational theory and practice are being adapted to serve the unique needs of the medical professions. The success of these methods requires careful planning and establishment of faculty development programs. The purpose of this study is to perform…

Guidelines for Analysis of Communicable Disease Control Planning in Developing Countries. Volume 1: Communicable Diseases Control Planning. International Health Planning Methods Series.

ERIC Educational Resources Information Center

Chin, James

Intended to assist Agency for International Development (AID) officers, advisors, and health officials in incorporating health planning into national plans for economic development, this first of ten manuals in the International Health Planning Methods Series deals with planning and evaluation of communicable disease control programs. The first…

Guidelines for Analysis of Environmental Health Planning in Developing Countries. Volume 2: Environmental Health Planning. International Health Planning Methods Series.

ERIC Educational Resources Information Center

Fraser, Renee White; Shani, Hadasa

Intended to assist Agency for International Development (AID) officers, advisors, and health officials in incorporating health planning into national plans for economic development, this second of ten manuals in the International Health Planning Methods Series deals with assessment, planning, and evaluation in the field of environmental health.…

[Cultural anthropology of traditional Chinese medicine].

PubMed

Wan, Xia; Liu, Jian-ping; Ai, Yan-ke; Li, Liu-ji

2008-07-01

Biological, psychological and sociological model of medicine substantializes the old model lacking the social humane attributes. The new medical model makes people take medical anthropology into research and highly evaluate traditional medical system. Cultural anthropology of traditional Chinese medicine (TCM) is part of medical anthropology with three major characteristics: wide research scope, specificity, and integration. It has developed its own research methods, such as field investigation, comprehensive inspection and comparison study. Cultural anthropology provides an efficient research method for TCM, and its application would further develop TCM theory and form comprehensive evaluation on TCM effects.

Diabetes Training for Community Health Workers.

PubMed

Aponte, Judith

2015-12-01

A 2.5-month diabetes education training for community health workers (CHWs) was developed, implemented, and evaluated. Training methods used included case studies, role-playing, and lectures. Exams were used throughout the training for its evaluation. Teaching was delivered by different ways: a one day American Diabetes Association (ADA) course; a five day Diabetes Self-Management Program (DSMP); Conversation Maps; and a series of seven National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) diabetes education booklets. Qualitative and quantitative evaluative methods were used during and after the training. The CHWs' diabetes knowledge was evaluated by a pre- and post-test Diabetes Knowledge Questionnaire (DKQ). The post-test was conducted one week after completing the training. The findings showed that the diabetes knowledge of the CHWs increased. Diabetes competencies and evaluative tools need to be developed specific for CHWs as a way to standardize all CHW diabetes trainings.

Evaluation of critical nuclear power plant electrical cable response to severe thermal fire conditions

NASA Astrophysics Data System (ADS)

Taylor, Gabriel James

The failure of electrical cables exposed to severe thermal fire conditions are a safety concern for operating commercial nuclear power plants (NPPs). The Nuclear Regulatory Commission (NRC) has promoted the use of risk-informed and performance-based methods for fire protection which resulted in a need to develop realistic methods to quantify the risk of fire to NPP safety. Recent electrical cable testing has been conducted to provide empirical data on the failure modes and likelihood of fire-induced damage. This thesis evaluated numerous aspects of the data. Circuit characteristics affecting fire-induced electrical cable failure modes have been evaluated. In addition, thermal failure temperatures corresponding to cable functional failures have been evaluated to develop realistic single point thermal failure thresholds and probability distributions for specific cable insulation types. Finally, the data was used to evaluate the prediction capabilities of a one-dimension conductive heat transfer model used to predict cable failure.

Taux: A System for Evaluating Sound Feedback in Navigational Tasks

ERIC Educational Resources Information Center

Lutz, Robert J.

2008-01-01

This thesis presents the design and development of an evaluation system for generating audio displays that provide feedback to persons performing navigation tasks. It first develops the need for such a system by describing existing wayfinding solutions, investigating new electronic location-based methods that have the potential of changing these…

A Text-Computer Assisted Instruction Program as a Viable Alternative for Continuing Education in Laboratory Medicine.

ERIC Educational Resources Information Center

Bruce, A. Wayne

1986-01-01

Describes reasons for developing combined text and computer assisted instruction (CAI) teaching programs for delivery of continuing education to laboratory professionals, and mechanisms used for developing a CAI program on method evaluation in the clinical laboratory. Results of an evaluation of the software's cost effectiveness and instructional…

49 CFR 611.303 - Small Starts project justification criteria.

Code of Federal Regulations, 2014 CFR

2014-10-01

... and assign ratings for project justification, FTA will evaluate information developed locally through the planning, NEPA and project development processes. (1) The method used by FTA to evaluate and rate... ratings for each of the criteria in § 611.303(b)(1) through (6) will be expressed in terms of descriptive...

49 CFR 611.303 - Small Starts project justification criteria.

Code of Federal Regulations, 2013 CFR

2013-10-01

... and assign ratings for project justification, FTA will evaluate information developed locally through the planning, NEPA and project development processes. (1) The method used by FTA to evaluate and rate... ratings for each of the criteria in § 611.303(b)(1) through (6) will be expressed in terms of descriptive...

DEVELOPMENT OF BIOAVAILABILITY AND BIOKINETICS DETERMINATION METHODS FOR ORGANIC POLLUTANTS IN SOIL TO ENHANCE IN-SITU AND ON-SITE BIOREMEDIATION

EPA Science Inventory

Determination of biodegradation rates of organics in soil slurry and compacted soil systems is essential for evaluating the efficacy of bioremediation for treatment of contaminated soils. In this paper, a systematic protocol has been developed for evaluating bioknetic and transp...

Development and evaluation of the photoload sampling technique

Treesearch

Robert E. Keane; Laura J. Dickinson

2007-01-01

Wildland fire managers need better estimates of fuel loading so they can accurately predict potential fire behavior and effects of alternative fuel and ecosystem restoration treatments. This report presents the development and evaluation of a new fuel sampling method, called the photoload sampling technique, to quickly and accurately estimate loadings for six common...

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2012-01-01

Background Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. Conclusions Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice. PMID:23241168

HPLC-Based Method to Evaluate Kinetics of Glucosinolate Hydrolysis by Sinapis alba Myrosinase1

PubMed Central

Vastenhout, Kayla J.; Tornberg, Ruthellen H.; Johnson, Amanda L.; Amolins, Michael W.; Mays, Jared R.

2014-01-01

Isothiocyanates (ITCs) are one of several hydrolysis products of glucosinolates, plant secondary metabolites which are substrates for the thioglucohydrolase myrosinase. Recent pursuits toward the development of synthetic, non-natural ITCs have consequently led to an exploration of generating these compounds from non-natural glucosinolate precursors. Evaluation of the myrosinase-dependent conversion of select non-natural glucosinolates to non-natural ITCs cannot be accomplished using established UV-Vis spectroscopic methods. To overcome this limitation, an alternative HPLC-based analytical approach was developed where initial reaction velocities were generated from non-linear reaction progress curves. Validation of this HPLC method was accomplished through parallel evaluation of three glucosinolates with UV-Vis methodology. The results of this study demonstrate that kinetic data is consistent between both analytical methods and that the tested glucosinolates respond similarly to both Michaelis–Menten and specific activity analyses. Consequently, this work resulted in the complete kinetic characterization of three glucosinolates with Sinapis alba myrosinase, with results that were consistent with previous reports. PMID:25068719

Radiation-Tolerance Assessment of a Redundant Wireless Device

NASA Astrophysics Data System (ADS)

Huang, Q.; Jiang, J.

2018-01-01

This paper presents a method to evaluate radiation-tolerance without physical tests for a commercial off-the-shelf (COTS)-based monitoring device for high level radiation fields, such as those found in post-accident conditions in a nuclear power plant (NPP). This paper specifically describes the analysis of radiation environment in a severe accident, radiation damages in electronics, and the redundant solution used to prolong the life of the system, as well as the evaluation method for radiation protection and the analysis method of system reliability. As a case study, a wireless monitoring device with redundant and diversified channels is evaluated by using the developed method. The study results and system assessment data show that, under the given radiation condition, performance of the redundant device is more reliable and more robust than those non-redundant devices. The developed redundant wireless monitoring device is therefore able to apply in those conditions (up to 10 M Rad (Si)) during a severe accident in a NPP.

Preparation for an online asynchronous university doctoral course. Lessons learned.

PubMed

Milstead, J A; Nelson, R

1998-01-01

This article addresses the development of the initial course in the first completely online doctoral program in nursing. Synchronous and asynchronous methods of distance education were assessed. Planning focused at the university, school, and course levels. University planning involved the technical infrastructure, registration, student services, and library services. School planning examined administrative commitment and faculty commitment and willingness. Course planning focused on marketing, precourse information, time frame, modular design, planned interaction, and professor availability and support. Implementation issues centered on getting students connected, learning the software, changing instructional methods, and managing chats. Traditional methods of evaluating student learning and course evaluation were supplemented with the development of qualitative and quantitative tools to gather data for making administrative decisions. The Dean and faculty agreed that the internet was an effective method of delivering content in the initial Health Policy course. The Dean and faculty agreed to continue the PhD program online for one cohort and continue to evaluate student progress and faculty and student satisfaction.

[Development and validation of event-specific quantitative PCR method for genetically modified maize LY038].

PubMed

Mano, Junichi; Masubuchi, Tomoko; Hatano, Shuko; Futo, Satoshi; Koiwa, Tomohiro; Minegishi, Yasutaka; Noguchi, Akio; Kondo, Kazunari; Akiyama, Hiroshi; Teshima, Reiko; Kurashima, Takeyo; Takabatake, Reona; Kitta, Kazumi

2013-01-01

In this article, we report a novel real-time PCR-based analytical method for quantitation of the GM maize event LY038. We designed LY038-specific and maize endogenous reference DNA-specific PCR amplifications. After confirming the specificity and linearity of the LY038-specific PCR amplification, we determined the conversion factor required to calculate the weight-based content of GM organism (GMO) in a multilaboratory evaluation. Finally, in order to validate the developed method, an interlaboratory collaborative trial according to the internationally harmonized guidelines was performed with blind DNA samples containing LY038 at the mixing levels of 0, 0.5, 1.0, 5.0 and 10.0%. The precision of the method was evaluated as the RSD of reproducibility (RSDR), and the values obtained were all less than 25%. The limit of quantitation of the method was judged to be 0.5% based on the definition of ISO 24276 guideline. The results from the collaborative trial suggested that the developed quantitative method would be suitable for practical testing of LY038 maize.

Application of ALOS and Envisat Data in Improving Multi-Temporal InSAR Methods for Monitoring Damavand Volcano and Landslide Deformation in the Center of Alborz Mountains, North Iran

NASA Astrophysics Data System (ADS)

Vajedian, S.; Motagh, M.; Nilfouroushan, F.

2013-09-01

InSAR capacity to detect slow deformation over terrain areas is limited by temporal and geometric decorrelations. Multitemporal InSAR techniques involving Persistent Scatterer (Ps-InSAR) and Small Baseline (SBAS) are recently developed to compensate the decorrelation problems. Geometric decorrelation in mountainous areas especially for Envisat images makes phase unwrapping process difficult. To improve this unwrapping problem, we first modified phase filtering to make the wrapped phase image as smooth as possible. In addition, in order to improve unwrapping results, a modified unwrapping method has been developed. This method includes removing possible orbital and tropospheric effects. Topographic correction is done within three-dimensional unwrapping, Orbital and tropospheric corrections are done after unwrapping process. To evaluate the effectiveness of our improved method we tested the proposed algorithm by Envisat and ALOS dataset and compared our results with recently developed PS software (StaMAPS). In addition we used GPS observations for evaluating the modified method. The results indicate that our method improves the estimated deformation significantly.

Development and validation of a discriminating in vitro dissolution method for a poorly soluble drug, olmesartan medoxomil: comparison between commercial tablets.

PubMed

Bajerski, Lisiane; Rossi, Rochele Cassanta; Dias, Carolina Lupi; Bergold, Ana Maria; Fröehlich, Pedro Eduardo

2010-06-01

A dissolution test for tablets containing 40 mg of olmesartan medoxomil (OLM) was developed and validated using both LC-UV and UV methods. After evaluation of the sink condition, dissolution medium, and stability of the drug, the method was validated using USP apparatus 2, 50 rpm rotation speed, and 900 ml of deaerated H(2)O + 0.5% sodium lauryl sulfate (w/v) at pH 6.8 (adjusted with 18% phosphoric acid) as the dissolution medium. The model-independent method using difference factor (f(1)) and similarity factor (f(2)), model-dependent method, and dissolution efficiency were employed to compare dissolution profiles. The kinetic parameters of drug release were also investigated. The obtained results provided adequate dissolution profiles. The developed dissolution test was validated according to international guidelines. Since there is no monograph for this drug in tablets, the dissolution method presented here can be used as a quality control test for OLM in this dosage form, especially in a batch to batch evaluation.

Measuring Health Information Dissemination and Identifying Target Interest Communities on Twitter: Methods Development and Case Study of the @SafetyMD Network.

PubMed

Kandadai, Venk; Yang, Haodong; Jiang, Ling; Yang, Christopher C; Fleisher, Linda; Winston, Flaura Koplin

2016-05-05

Little is known about the ability of individual stakeholder groups to achieve health information dissemination goals through Twitter. This study aimed to develop and apply methods for the systematic evaluation and optimization of health information dissemination by stakeholders through Twitter. Tweet content from 1790 followers of @SafetyMD (July-November 2012) was examined. User emphasis, a new indicator of Twitter information dissemination, was defined and applied to retweets across two levels of retweeters originating from @SafetyMD. User interest clusters were identified based on principal component analysis (PCA) and hierarchical cluster analysis (HCA) of a random sample of 170 followers. User emphasis of keywords remained across levels but decreased by 9.5 percentage points. PCA and HCA identified 12 statistically unique clusters of followers within the @SafetyMD Twitter network. This study is one of the first to develop methods for use by stakeholders to evaluate and optimize their use of Twitter to disseminate health information. Our new methods provide preliminary evidence that individual stakeholders can evaluate the effectiveness of health information dissemination and create content-specific clusters for more specific targeted messaging.

An expert systems approach to automated fault management in a regenerative life support subsystem

NASA Technical Reports Server (NTRS)

Malin, J. T.; Lance, N., Jr.

1986-01-01

This paper describes FIXER, a prototype expert system for automated fault management in a regenerative life support subsystem typical of Space Station applications. The development project provided an evaluation of the use of expert systems technology to enhance controller functions in space subsystems. The software development approach permitted evaluation of the effectiveness of direct involvement of the expert in design and development. The approach also permitted intensive observation of the knowledge and methods of the expert. This paper describes the development of the prototype expert system and presents results of the evaluation.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

EPA Science Inventory

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Evaluation of Computer Simulations for Teaching Apparel Merchandising Concepts.

ERIC Educational Resources Information Center

Jolly, Laura D.; Sisler, Grovalynn

1988-01-01

The study developed and evaluated computer simulations for teaching apparel merchandising concepts. Evaluation results indicated that teaching method (computer simulation versus case study) does not significantly affect cognitive learning. Student attitudes varied, however, according to topic (profitable merchandising analysis versus retailing…

Evaluation of comprehensive environmental effect about coastal zone development activities in Liaoning Province and management advice.

PubMed

Wang, Wei-Wei; Cai, Yue-Yin; Sun, Yong-Guang; Ma, Hong-Wei

2015-07-01

Using spatial analysis function of Arcgis software, the present study investigated the building environment impact evaluation index system of coastal development in Liaoning Province. The factors of it included of current state of environmental quality, environmental impact of marine development and marine environmental disaster. Weighted factor analysis and comprehensive index method were utilized. At the end, comprehensive environment effect of coastal development in Liaoning Province were evaluated successfully. The result showed that the environmental effect of development activity were most serious, along the Zhao Jiatun coast in north of Zhimao bay and coast of Mianhua island in Dalian bay.

Global chemical profiling based quality evaluation approach of rhubarb using ultra performance liquid chromatography with tandem quadrupole time-of-flight mass spectrometry.

PubMed

Zhang, Li; Liu, Haiyu; Qin, Lingling; Zhang, Zhixin; Wang, Qing; Zhang, Qingqing; Lu, Zhiwei; Wei, Shengli; Gao, Xiaoyan; Tu, Pengfei

2015-02-01

A global chemical profiling based quality evaluation approach using ultra performance liquid chromatography with tandem quadrupole time-of-flight mass spectrometry was developed for the quality evaluation of three rhubarb species, including Rheum palmatum L., Rheum tanguticum Maxim. ex Balf., and Rheum officinale Baill. Considering that comprehensive detection of chemical components is crucial for the global profile, a systemic column performance evaluation method was developed. Based on this, a Cortecs column was used to acquire the chemical profile, and Chempattern software was employed to conduct similarity evaluation and hierarchical cluster analysis. The results showed R. tanguticum could be differentiated from R. palmatum and R. officinale at the similarity value 0.65, but R. palmatum and R. officinale could not be distinguished effectively. Therefore, a common pattern based on three rhubarb species was developed to conduct the quality evaluation, and the similarity value 0.50 was set as an appropriate threshold to control the quality of rhubarb. A total of 88 common peaks were identified by their accurate mass and fragmentation, and partially verified by reference standards. Through the verification, the newly developed method could be successfully used for evaluating the holistic quality of rhubarb. It would provide a reference for the quality control of other herbal medicines. © 2014 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Models for evaluating the performability of degradable computing systems

NASA Technical Reports Server (NTRS)

Wu, L. T.

1982-01-01

Recent advances in multiprocessor technology established the need for unified methods to evaluate computing systems performance and reliability. In response to this modeling need, a general modeling framework that permits the modeling, analysis and evaluation of degradable computing systems is considered. Within this framework, several user oriented performance variables are identified and shown to be proper generalizations of the traditional notions of system performance and reliability. Furthermore, a time varying version of the model is developed to generalize the traditional fault tree reliability evaluation methods of phased missions.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Constructing Benchmark Databases and Protocols for Medical Image Analysis: Diabetic Retinopathy

PubMed Central

Kauppi, Tomi; Kämäräinen, Joni-Kristian; Kalesnykiene, Valentina; Sorri, Iiris; Uusitalo, Hannu; Kälviäinen, Heikki

2013-01-01

We address the performance evaluation practices for developing medical image analysis methods, in particular, how to establish and share databases of medical images with verified ground truth and solid evaluation protocols. Such databases support the development of better algorithms, execution of profound method comparisons, and, consequently, technology transfer from research laboratories to clinical practice. For this purpose, we propose a framework consisting of reusable methods and tools for the laborious task of constructing a benchmark database. We provide a software tool for medical image annotation helping to collect class label, spatial span, and expert's confidence on lesions and a method to appropriately combine the manual segmentations from multiple experts. The tool and all necessary functionality for method evaluation are provided as public software packages. As a case study, we utilized the framework and tools to establish the DiaRetDB1 V2.1 database for benchmarking diabetic retinopathy detection algorithms. The database contains a set of retinal images, ground truth based on information from multiple experts, and a baseline algorithm for the detection of retinopathy lesions. PMID:23956787

Evaluation of nearest-neighbor methods for detection of chimeric small-subunit rRNA sequences

NASA Technical Reports Server (NTRS)

Robison-Cox, J. F.; Bateson, M. M.; Ward, D. M.

1995-01-01

Detection of chimeric artifacts formed when PCR is used to retrieve naturally occurring small-subunit (SSU) rRNA sequences may rely on demonstrating that different sequence domains have different phylogenetic affiliations. We evaluated the CHECK_CHIMERA method of the Ribosomal Database Project and another method which we developed, both based on determining nearest neighbors of different sequence domains, for their ability to discern artificially generated SSU rRNA chimeras from authentic Ribosomal Database Project sequences. The reliability of both methods decreases when the parental sequences which contribute to chimera formation are more than 82 to 84% similar. Detection is also complicated by the occurrence of authentic SSU rRNA sequences that behave like chimeras. We developed a naive statistical test based on CHECK_CHIMERA output and used it to evaluate previously reported SSU rRNA chimeras. Application of this test also suggests that chimeras might be formed by retrieving SSU rRNAs as cDNA. The amount of uncertainty associated with nearest-neighbor analyses indicates that such tests alone are insufficient and that better methods are needed.

In Vivo Evaluation of Magnetic Targeting in Mice Colon Tumors with Ultra-Magnetic Liposomes Monitored by MRI.

PubMed

Thébault, Caroline J; Ramniceanu, Grégory; Michel, Aude; Beauvineau, Claire; Girard, Christian; Seguin, Johanne; Mignet, Nathalie; Ménager, Christine; Doan, Bich-Thuy

2018-06-25

The development of theranostic nanocarriers as an innovative therapy against cancer has been improved by targeting properties in order to optimize the drug delivery to safely achieve its desired therapeutic effect. The aim of this paper is to evaluate the magnetic targeting (MT) efficiency of ultra-magnetic liposomes (UML) into CT26 murine colon tumor by magnetic resonance imaging (MRI). Dynamic susceptibility contrast MRI was applied to assess the bloodstream circulation time. A novel semi-quantitative method called %I 0.25 , based on the intensity distribution in T 2 * -weighted MRI images was developed to compare the accumulation of T 2 contrast agent in tumors with or without MT. To evaluate the efficiency of magnetic targeting, the percentage of pixels under the intensity value I 0.25 (I 0.25  = 0.25(I max  - I min )) was calculated on the intensity distribution histogram. This innovative method of processing MRI images showed the MT efficiency by a %I 0.25 that was significantly higher in tumors using MT compared to passive accumulation, from 15.3 to 28.6 %. This methodology was validated by ex vivo methods with an iron concentration that is 3-fold higher in tumors using MT. We have developed a method that allows a semi-quantitative evaluation of targeting efficiency in tumors, which could be applied to different T 2 contrast agents.

Emergy-based comparative analysis on industrial clusters: economic and technological development zone of Shenyang area, China.

PubMed

Liu, Zhe; Geng, Yong; Zhang, Pan; Dong, Huijuan; Liu, Zuoxi

2014-09-01

In China, local governments of many areas prefer to give priority to the development of heavy industrial clusters in pursuit of high value of gross domestic production (GDP) growth to get political achievements, which usually results in higher costs from ecological degradation and environmental pollution. Therefore, effective methods and reasonable evaluation system are urgently needed to evaluate the overall efficiency of industrial clusters. Emergy methods links economic and ecological systems together, which can evaluate the contribution of ecological products and services as well as the load placed on environmental systems. This method has been successfully applied in many case studies of ecosystem but seldom in industrial clusters. This study applied the methodology of emergy analysis to perform the efficiency of industrial clusters through a series of emergy-based indices as well as the proposed indicators. A case study of Shenyang Economic Technological Development Area (SETDA) was investigated to show the emergy method's practical potential to evaluate industrial clusters to inform environmental policy making. The results of our study showed that the industrial cluster of electric equipment and electronic manufacturing produced the most economic value and had the highest efficiency of energy utilization among the four industrial clusters. However, the sustainability index of the industrial cluster of food and beverage processing was better than the other industrial clusters.

Comparative evaluation of ultrasound scanner accuracy in distance measurement

NASA Astrophysics Data System (ADS)

Branca, F. P.; Sciuto, S. A.; Scorza, A.

2012-10-01

The aim of the present study is to develop and compare two different automatic methods for accuracy evaluation in ultrasound phantom measurements on B-mode images: both of them give as a result the relative error e between measured distances, performed by 14 brand new ultrasound medical scanners, and nominal distances, among nylon wires embedded in a reference test object. The first method is based on a least squares estimation, while the second one applies the mean value of the same distance evaluated at different locations in ultrasound image (same distance method). Results for both of them are proposed and explained.

Evaluating hospital design from an operations management perspective.

PubMed

Vos, Leti; Groothuis, Siebren; van Merode, Godefridus G

2007-12-01

This paper describes an evaluation method for the assessment of hospital building design from the viewpoint of operations management to assure that the building design supports the efficient and effective operating of care processes now and in the future. The different steps of the method are illustrated by a case study. In the case study an experimental design is applied to assess the effect of used logistical concepts, patient mix and technologies. The study shows that the evaluation method provides a valuable tool for the assessment of both functionality and the ability to meet future developments in operational control of a building design.

Benchmarking Data Sets for the Evaluation of Virtual Ligand Screening Methods: Review and Perspectives.

PubMed

Lagarde, Nathalie; Zagury, Jean-François; Montes, Matthieu

2015-07-27

Virtual screening methods are commonly used nowadays in drug discovery processes. However, to ensure their reliability, they have to be carefully evaluated. The evaluation of these methods is often realized in a retrospective way, notably by studying the enrichment of benchmarking data sets. To this purpose, numerous benchmarking data sets were developed over the years, and the resulting improvements led to the availability of high quality benchmarking data sets. However, some points still have to be considered in the selection of the active compounds, decoys, and protein structures to obtain optimal benchmarking data sets.

The evaluation of basin water resources utilization efficiency based on Chaos projection mode

NASA Astrophysics Data System (ADS)

Guan, X.; Liang, S.; Meng, Y.; Wang, H.

2017-12-01

To promote the coordinated development of a healthy economy, society, and environment, and the sustainable development of water resources comprehensive utilization efficiency (WRCUE), this study investigated appropriate indicators using the trapezoidal fuzzy number method, and constructed an evaluation index system for WRCUE. A WRCUE evaluation model is applied to the areas in the Yellow River Basin in China using a genetic projection pursuit method. The comprehensive evaluation index system of water use efficiency includes 6 indicators: Water consumption per unit industrial value added, water consumption per unit GDP, eliminate the climate effect on agricultural water use efficiency, irrigation water consumption per unit area, domestic water use per capita and industrial water ratio. Then, multiple indexes in the index system are transformed to a comprehensive index by the combined model, which is used to represent the total water resources utilization efficiency. Results show that the WRCUE in Yellow River basin and the provinces have a great distance. WRCUE is well developed in Shanxi, Shandong, and Henan provinces, moderately developed in Shaanxi, Inner Mongolia, and Sichuan provinces, and poorly developed in the Ningxia Autonomous Region, Gansu Province, and Qinghai Province. According to the capacities of provinces, related measures are proposed.

Detecting and evaluating communities in complex human and biological networks

NASA Astrophysics Data System (ADS)

Morrison, Greg; Mahadevan, L.

2012-02-01

We develop a simple method for detecting the community structure in a network can by utilizing a measure of closeness between nodes. This approach readily leads to a method of coarse graining the network, which allows the detection of the natural hierarchy (or hierarchies) of community structure without appealing to an unknown resolution parameter. The closeness measure can also be used to evaluate the robustness of an individual node's assignment to its community (rather than evaluating only the quality of the global structure). Each of these methods in community detection and evaluation are illustrated using a variety of real world networks of either biological or sociological importance and illustrate the power and flexibility of the approach.

DEVELOPMENT AND EVALUATION OF AN ENZYME-LINKED IMMUNOASSAY (ELISA) METHOD FOR THE MEASUREMENT OF 2,4-DICHLOROPHENOXYACETIC ACID IN HUMAN URINE

EPA Science Inventory

This paper describes the development of a 96-microwell high sample capacity ELISA method for measuring 2,4-D in urine; the analysis of 2,4-D in real-world urine samples by both ELISA and GC/MS methods; and compares the ELISA and GC/MS results in several key areas: accuracy, preci...

DO TIE LABORATORY BASED METHODS REALLY REFLECT FIELD CONDITIONS

EPA Science Inventory

Sediment Toxicity Identification and Evaluation (TIE) methods have been developed for both interstitial waters and whole sediments. These relatively simple laboratory methods are designed to identify specific toxicants or classes of toxicants in sediments; however, the question ...

Optimal sixteenth order convergent method based on quasi-Hermite interpolation for computing roots.

PubMed

Zafar, Fiza; Hussain, Nawab; Fatimah, Zirwah; Kharal, Athar

2014-01-01

We have given a four-step, multipoint iterative method without memory for solving nonlinear equations. The method is constructed by using quasi-Hermite interpolation and has order of convergence sixteen. As this method requires four function evaluations and one derivative evaluation at each step, it is optimal in the sense of the Kung and Traub conjecture. The comparisons are given with some other newly developed sixteenth-order methods. Interval Newton's method is also used for finding the enough accurate initial approximations. Some figures show the enclosure of finitely many zeroes of nonlinear equations in an interval. Basins of attractions show the effectiveness of the method.

Evaluation of axial pile bearing capacity based on pile driving analyzer (PDA) test using Neural Network

NASA Astrophysics Data System (ADS)

Maizir, H.; Suryanita, R.

2018-01-01

A few decades, many methods have been developed to predict and evaluate the bearing capacity of driven piles. The problem of the predicting and assessing the bearing capacity of the pile is very complicated and not yet established, different soil testing and evaluation produce a widely different solution. However, the most important thing is to determine methods used to predict and evaluate the bearing capacity of the pile to the required degree of accuracy and consistency value. Accurate prediction and evaluation of axial bearing capacity depend on some variables, such as the type of soil, diameter, and length of pile, etc. The aims of the study of Artificial Neural Networks (ANNs) are utilized to obtain more accurate and consistent axial bearing capacity of a driven pile. ANNs can be described as mapping an input to the target output data. The method using the ANN model developed to predict and evaluate the axial bearing capacity of the pile based on the pile driving analyzer (PDA) test data for more than 200 selected data. The results of the predictions obtained by the ANN model and the PDA test were then compared. This research as the neural network models give a right prediction and evaluation of the axial bearing capacity of piles using neural networks.

Assessment of Intralaminar Progressive Damage and Failure Analysis Using an Efficient Evaluation Framework

NASA Technical Reports Server (NTRS)

Hyder, Imran; Schaefer, Joseph; Justusson, Brian; Wanthal, Steve; Leone, Frank; Rose, Cheryl

2017-01-01

Reducing the timeline for development and certification for composite structures has been a long standing objective of the aerospace industry. This timeline can be further exacerbated when attempting to integrate new fiber-reinforced composite materials due to the large number of testing required at every level of design. computational progressive damage and failure analysis (PDFA) attempts to mitigate this effect; however, new PDFA methods have been slow to be adopted in industry since material model evaluation techniques have not been fully defined. This study presents an efficient evaluation framework which uses a piecewise verification and validation (V&V) approach for PDFA methods. Specifically, the framework is applied to evaluate PDFA research codes within the context of intralaminar damage. Methods are incrementally taken through various V&V exercises specifically tailored to study PDFA intralaminar damage modeling capability. Finally, methods are evaluated against a defined set of success criteria to highlight successes and limitations.

Advancing Resident Assessment in Graduate Medical Education

PubMed Central

Swing, Susan R.; Clyman, Stephen G.; Holmboe, Eric S.; Williams, Reed G.

2009-01-01

Background The Outcome Project requires high-quality assessment approaches to provide reliable and valid judgments of the attainment of competencies deemed important for physician practice. Intervention The Accreditation Council for Graduate Medical Education (ACGME) convened the Advisory Committee on Educational Outcome Assessment in 2007–2008 to identify high-quality assessment methods. The assessments selected by this body would form a core set that could be used by all programs in a specialty to assess resident performance and enable initial steps toward establishing national specialty databases of program performance. The committee identified a small set of methods for provisional use and further evaluation. It also developed frameworks and processes to support the ongoing evaluation of methods and the longer-term enhancement of assessment in graduate medical education. Outcome The committee constructed a set of standards, a methodology for applying the standards, and grading rules for their review of assessment method quality. It developed a simple report card for displaying grades on each standard and an overall grade for each method reviewed. It also described an assessment system of factors that influence assessment quality. The committee proposed a coordinated, national-level infrastructure to support enhancements to assessment, including method development and assessor training. It recommended the establishment of a new assessment review group to continue its work of evaluating assessment methods. The committee delivered a report summarizing its activities and 5 related recommendations for implementation to the ACGME Board in September 2008. PMID:21975993

77 FR 38071 - Council on Graduate Medical Education; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-26

... graduate medical education, evaluation of teaching programs especially in terms of meeting community needs...' development of performance measures and methods of longitudinal evaluation specific to the training programs...

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

PubMed

Hawkes, Claire; Foxcroft, David R; Yerrell, Paul

2010-09-01

This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.

Nurse manager succession planning: synthesis of the evidence.

PubMed

Titzer, Jennifer; Phillips, Tracy; Tooley, Stephanie; Hall, Norma; Shirey, Maria

2013-10-01

The literature supporting nurse manager succession planning is reviewed and synthesised to discover best practice for identifying and developing future nurse managers. Healthcare succession planning practices are lacking. Nurse managers are historically selected based on clinical skills and lack formal leadership preparation. A systematic literature search appraises and summarises the current literature supporting nurse manager succession planning. Multiple reviewers were used to increase the reliability and validity of article selection and analysis. New nurse managers require months to adapt to their positions. Deliberate nurse manager succession planning should be integrated in the organisation's strategic plan and provide a proactive method for identifying and developing potential leaders. Organisations that identify and develop internal human capital can improve role transition, reduce nurse manager turnover rates and decrease replacement costs. Despite the clear benefits of succession planning, studies show that resource allocation for proactive, deliberate development of current and future nurse leaders is lacking. Additionally, systematic evaluation of succession planning is limited. Deliberate succession planning efforts and appropriate resource allocation require strategic planning and evaluation methods. Detailed evaluation methods demonstrating a positive return on investment utilising a cost-benefit analysis and empirical outcomes are necessary. © 2013 John Wiley & Sons Ltd.

Beyond Description in Interpersonal Construct Validation: Methodological Advances in the Circumplex Structural Summary Approach.

PubMed

Zimmermann, Johannes; Wright, Aidan G C

2017-01-01

The interpersonal circumplex is a well-established structural model that organizes interpersonal functioning within the two-dimensional space marked by dominance and affiliation. The structural summary method (SSM) was developed to evaluate the interpersonal nature of other constructs and measures outside the interpersonal circumplex. To date, this method has been primarily descriptive, providing no way to draw inferences when comparing SSM parameters across constructs or groups. We describe a newly developed resampling-based method for deriving confidence intervals, which allows for SSM parameter comparisons. In a series of five studies, we evaluated the accuracy of the approach across a wide range of possible sample sizes and parameter values, and demonstrated its utility for posing theoretical questions on the interpersonal nature of relevant constructs (e.g., personality disorders) using real-world data. As a result, the SSM is strengthened for its intended purpose of construct evaluation and theory building. © The Author(s) 2015.

Evaluation of capillary electrophoresis for in-flight ionic contaminant monitoring of SSF potable water

NASA Technical Reports Server (NTRS)

Mudgett, Paul D.; Schultz, John R.; Sauer, Richard L.

1992-01-01

Until 1989, ion chromatography (IC) was the baseline technology selected for the Specific Ion Analyzer, an in-flight inorganic water quality monitor being designed for Space Station Freedom. Recent developments in capillary electrophoresis (CE) may offer significant savings of consumables, power consumption, and weight/volume allocation, relative to IC technology. A thorough evaluation of CE's analytical capability, however, is necessary before one of the two techniques is chosen. Unfortunately, analytical methods currently available for inorganic CE are unproven for NASA's target list of anions and cations. Thus, CE electrolyte chemistry and methods to measure the target contaminants must be first identified and optimized. This paper reports the status of a study to evaluate CE's capability with regard to inorganic and carboxylate anions, alkali and alkaline earth cations, and transition metal cations. Preliminary results indicate that CE has an impressive selectivity and trace sensitivity, although considerable methods development remains to be performed.

Evaluation on Collaborative Satisfaction for Project Management Team in Integrated Project Delivery Mode

NASA Astrophysics Data System (ADS)

Zhang, L.; Li, Y.; Wu, Q.

2013-05-01

Integrated Project Delivery (IPD) is a newly-developed project delivery approach for construction projects, and the level of collaboration of project management team is crucial to the success of its implementation. Existing research has shown that collaborative satisfaction is one of the key indicators of team collaboration. By reviewing the literature on team collaborative satisfaction and taking into consideration the characteristics of IPD projects, this paper summarizes the factors that influence collaborative satisfaction of IPD project management team. Based on these factors, this research develops a fuzzy linguistic method to effectively evaluate the level of team collaborative satisfaction, in which the authors adopted the 2-tuple linguistic variables and 2-tuple linguistic hybrid average operators to enhance the objectivity and accuracy of the evaluation. The paper demonstrates the practicality and effectiveness of the method through carrying out a case study with the method.

Evaluation of traditional classroom teaching methods versus course delivery via the World Wide Web.

PubMed

Ryan, M; Carlton, K H; Ali, N S

1999-09-01

Higher education is moving with deliberate speed to an electronic classroom. Much has been published on faculty experiences with World Wide Web (WWW) course delivery. However, little research exists on the evaluation of these methods. The purpose of this study was to evaluate students' perceptions of two approaches to teaching: classroom and WWW modules. Classroom methods were rated significantly higher in relation to content, interaction, participation, faculty preparation, and communication. Technical skills were rated higher for WWW modules. Critical thinking and time allotted for assignments were not significantly different between classroom and WWW instruction. Open-ended comments were rich and supported both positive and negative aspects of classroom and WWW-based modules. Implications call for creativity in course development, course redesign and orientation, active communication with students, support for technical problems, faculty development, and university-wide planning through partnerships.

The Evaluation of Physical Learning Environments: A Critical Review of the Literature

ERIC Educational Resources Information Center

Cleveland, Benjamin; Fisher, Kenn

2014-01-01

This article critically reviews the methodologies and methods that have been used for the evaluation of physical learning environments. To contextualize discussion about the evaluation of learning spaces, we initially chart the development of post-occupancy evaluation (POE) for non-domestic buildings. We then discuss the recent evolution of POE…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

State of the Art Methodology for the Design and Analysis of Future Large Scale Evaluations: A Selective Examination.

ERIC Educational Resources Information Center

Burstein, Leigh

Two specific methods of analysis in large-scale evaluations are considered: structural equation modeling and selection modeling/analysis of non-equivalent control group designs. Their utility in large-scale educational program evaluation is discussed. The examination of these methodological developments indicates how people (evaluators,…

Using Active Learning for Speeding up Calibration in Simulation Models.

PubMed

Cevik, Mucahit; Ergun, Mehmet Ali; Stout, Natasha K; Trentham-Dietz, Amy; Craven, Mark; Alagoz, Oguzhan

2016-07-01

Most cancer simulation models include unobservable parameters that determine disease onset and tumor growth. These parameters play an important role in matching key outcomes such as cancer incidence and mortality, and their values are typically estimated via a lengthy calibration procedure, which involves evaluating a large number of combinations of parameter values via simulation. The objective of this study is to demonstrate how machine learning approaches can be used to accelerate the calibration process by reducing the number of parameter combinations that are actually evaluated. Active learning is a popular machine learning method that enables a learning algorithm such as artificial neural networks to interactively choose which parameter combinations to evaluate. We developed an active learning algorithm to expedite the calibration process. Our algorithm determines the parameter combinations that are more likely to produce desired outputs and therefore reduces the number of simulation runs performed during calibration. We demonstrate our method using the previously developed University of Wisconsin breast cancer simulation model (UWBCS). In a recent study, calibration of the UWBCS required the evaluation of 378 000 input parameter combinations to build a race-specific model, and only 69 of these combinations produced results that closely matched observed data. By using the active learning algorithm in conjunction with standard calibration methods, we identify all 69 parameter combinations by evaluating only 5620 of the 378 000 combinations. Machine learning methods hold potential in guiding model developers in the selection of more promising parameter combinations and hence speeding up the calibration process. Applying our machine learning algorithm to one model shows that evaluating only 1.49% of all parameter combinations would be sufficient for the calibration. © The Author(s) 2015.

Testing and refining the Science in Risk Assessment and Policy (SciRAP) web-based platform for evaluating the reliability and relevance of in vivo toxicity studies.

PubMed

Beronius, Anna; Molander, Linda; Zilliacus, Johanna; Rudén, Christina; Hanberg, Annika

2018-05-28

The Science in Risk Assessment and Policy (SciRAP) web-based platform was developed to promote and facilitate structure and transparency in the evaluation of ecotoxicity and toxicity studies for hazard and risk assessment of chemicals. The platform includes sets of criteria and a colour-coding tool for evaluating the reliability and relevance of individual studies. The SciRAP method for evaluating in vivo toxicity studies was first published in 2014 and the aim of the work presented here was to evaluate and develop that method further. Toxicologists and risk assessors from different sectors and geographical areas were invited to test the SciRAP criteria and tool on a specific set of in vivo toxicity studies and to provide feedback concerning the scientific soundness and user-friendliness of the SciRAP approach. The results of this expert assessment were used to refine and improve both the evaluation criteria and the colour-coding tool. It is expected that the SciRAP web-based platform will continue to be developed and enhanced to keep up to date with the needs of end-users. Copyright © 2018 John Wiley & Sons, Ltd.

Development and field testing of a decision support tool to facilitate shared decision making in contraceptive counseling.

PubMed

Dehlendorf, Christine; Fitzpatrick, Judith; Steinauer, Jody; Swiader, Lawrence; Grumbach, Kevin; Hall, Cara; Kuppermann, Miriam

2017-07-01

We developed and formatively evaluated a tablet-based decision support tool for use by women prior to a contraceptive counseling visit to help them engage in shared decision making regarding method selection. Drawing upon formative work around women's preferences for contraceptive counseling and conceptual understanding of health care decision making, we iteratively developed a storyboard and then digital prototypes, based on best practices for decision support tool development. Pilot testing using both quantitative and qualitative data and cognitive testing was conducted. We obtained feedback from patient and provider advisory groups throughout the development process. Ninety-six percent of women who used the tool in pilot testing reported that it helped them choose a method, and qualitative interviews indicated acceptability of the tool's content and presentation. Compared to the control group, women who used the tool demonstrated trends toward increased likelihood of complete satisfaction with their method. Participant responses to cognitive testing were used in tool refinement. Our decision support tool appears acceptable to women in the family planning setting. Formative evaluation of the tool supports its utility among patients making contraceptive decisions, which can be further evaluated in a randomized controlled trial. Copyright © 2017 Elsevier B.V. All rights reserved.

Development of a Nationally Coordinated Evaluation Plan for the Ghana National Strategy for Key Populations

PubMed Central

Reynolds, Heidi W; Atuahene, Kyeremeh; Sutherland, Elizabeth; Amenyah, Richard; Kwao, Isaiah Doe; Larbi, Emmanuel Tettey

2015-01-01

Objective Just as HIV prevention programs need to be tailored to the local epidemic, so should evaluations be country-owned and country-led to ensure use of those results in decision making and policy. The objective of this paper is to describe the process undertaken in Ghana to develop a national evaluation plan for the Ghana national strategy for key populations. Methods This was a participatory process that involved meetings between the Ghana AIDS Commission (GAC), other partners in Ghana working to prevent HIV among key populations, and MEASURE Evaluation. The process included three two-day, highly structured yet participatory meetings over the course of 12 months during which participants shared information about on-going and planned data and identified research questions and methods. Results An evaluation plan was prepared to inform stakeholders about which data collection activities need to be prioritized for funding, who would implement the study, the timing of data collection, the research question the data will help answer, and the analysis methods. The plan discusses various methods that can be used including the recommendation for the study design using multiple data sources. It has an evaluation conceptual model, proposed analyses, proposed definition of independent variables, estimated costs for filling data gaps, roles and responsibilities of stakeholders to carry out the plan, and considerations for ethics, data sharing and authorship. Conclusion The experience demonstrates that it is possible to design an evaluation responsive to national strategies and priorities with country leadership, regardless of stakeholders' experiences with evaluations. This process may be replicable elsewhere, where stakeholders want to plan and implement an evaluation of a large-scale program at the national or subnational level that is responsive to national priorities and part of a comprehensive monitoring and evaluation system. PMID:26120495

PROOF OF CONCEPT FOR A HUMAN RELIABILITY ANALYSIS METHOD FOR HEURISTIC USABILITY EVALUATION OF SOFTWARE

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; David I. Gertman; Jeffrey C. Joe

2005-09-01

An ongoing issue within human-computer interaction (HCI) is the need for simplified or “discount” methods. The current economic slowdown has necessitated innovative methods that are results driven and cost effective. The myriad methods of design and usability are currently being cost-justified, and new techniques are actively being explored that meet current budgets and needs. Recent efforts in human reliability analysis (HRA) are highlighted by the ten-year development of the Standardized Plant Analysis Risk HRA (SPAR-H) method. The SPAR-H method has been used primarily for determining humancentered risk at nuclear power plants. The SPAR-H method, however, shares task analysis underpinnings withmore » HCI. Despite this methodological overlap, there is currently no HRA approach deployed in heuristic usability evaluation. This paper presents an extension of the existing SPAR-H method to be used as part of heuristic usability evaluation in HCI.« less

REVIEW OF RAPID METHODS FOR ASSESSING WETLAND CONDITION

EPA Science Inventory

We evaluated over 40 wetland rapid assessment methods developed for a variety of purposes for their use in the assessment of ecological integrity or ecosystem condition. Four criteria were used to screen methods: 1) the method can be used to measure condition, 2) it is truly rap...

Development of a Benchtop Baking Method for Chemically Leavened Crackers

USDA-ARS?s Scientific Manuscript database

Traditionally, the baking performance of soft wheat flours has been evaluated by well-established benchtop cookie-baking methods. In contrast, a benchtop cracker-baking method has not been widely explored or implemented as an official method, due to hurdles including the difficulty in finding ideal...

Unintended outcomes evaluation approach: A plausible way to evaluate unintended outcomes of social development programmes.

PubMed

Jabeen, Sumera

2018-06-01

Social development programmes are deliberate attempts to bring about change and unintended outcomes can be considered as inherent to any such intervention. There is now a solid consensus among the international evaluation community regarding the need to consider unintended outcomes as a key aspect in any evaluative study. However, this concern often equates to nothing more than false piety. Exiting evaluation theory suffers from overlap of terminology, inadequate categorisation of unintended outcomes and lack of guidance on how to study them. To advance the knowledge of evaluation theory, methods and practice, the author has developed an evaluation approach to study unintended effects using a theory building, testing and refinement process. A comprehensive classification of unintended outcomes on the basis of knowability, value, distribution and temporality helped specify various type of unintended outcomes for programme evaluation. Corresponding to this classification, a three-step evaluation process was proposed including a) outlining programme intentions b) forecasting likely unintended effects c) mapping the anticipated and understanding unanticipated unintended outcomes. This unintended outcomes evaluation approach (UOEA) was then trialled by undertaking a multi-site and multi-method case study of a poverty alleviation programme in Pakistan and refinements were made to the approach.The case study revealed that this programme was producing a number of unintended effects, mostly negative, affecting those already disadvantaged such as the poorest, women and children. The trialling process demonstrated the effectiveness of the UOEA and suggests that this can serve as a useful guide for future evaluation practice. It also provides the discipline of evaluation with an empirically-based reference point for further theoretical developments in the study of unintended outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Collection Evaluation for Interdisciplinary Fields: A Comprehensive Approach.

ERIC Educational Resources Information Center

Dobson, Cynthia; And Others

1996-01-01

Collection development for interdisciplinary areas is more complex than for traditionally well-defined disciplines, so new evaluation methods are needed. This article identifies variables in interdisciplinary fields and presents a model of their typical information components. Traditional use-centered and materials-centered evaluation methods…

Development and evaluation of a digital dental modeling method based on grating projection and reverse engineering software.

PubMed

Zhou, Qin; Wang, Zhenzhen; Chen, Jun; Song, Jun; Chen, Lu; Lu, Yi

2016-01-01

For reasons of convenience and economy, attempts have been made to transform traditional dental gypsum casts into 3-dimensional (3D) digital casts. Different scanning devices have been developed to generate digital casts; however, each has its own limitations and disadvantages. The purpose of this study was to develop an advanced method for the 3D reproduction of dental casts by using a high-speed grating projection system and noncontact reverse engineering (RE) software and to evaluate the accuracy of the method. The methods consisted of 3 main steps: the scanning and acquisition of 3D dental cast data with a high-resolution grating projection system, the reconstruction and measurement of digital casts with RE software, and the evaluation of the accuracy of this method using 20 dental gypsum casts. The common anatomic landmarks were measured directly on the gypsum casts with a Vernier caliper and on the 3D digital casts with the Geomagic software measurement tool. Data were statistically assessed with the t test. The grating projection system had a rapid scanning speed, and smooth 3D dental casts were obtained. The mean differences between the gypsum and 3D measurements were approximately 0.05 mm, and no statistically significant differences were found between the 2 methods (P>.05), except for the measurements of the incisor tooth width and maxillary arch length. A method for the 3D reconstruction of dental casts was developed by using a grating projection system and RE software. The accuracy of the casts generated using the grating projection system was comparable with that of the gypsum casts. Copyright © 2016 Editorial Council for the Journal of Prosthetic Dentistry. Published by Elsevier Inc. All rights reserved.

Image analyzing method to evaluate in situ bioluminescence from an obligate anaerobe cultivated under various dissolved oxygen concentrations.

PubMed

Ninomiya, Kazuaki; Yamada, Ryuji; Matsumoto, Masami; Fukiya, Satoru; Katayama, Takane; Ogino, Chiaki; Shimizu, Nobuaki

2013-02-01

An image analyzing method was developed to evaluate in situ bioluminescence expression, without exposing the culture sample to the ambient oxygen atmosphere. Using this method, we investigated the effect of dissolved oxygen concentration on bioluminescence from an obligate anaerobe Bifidobacterium longum expressing bacterial luciferase which catalyzes an oxygen-requiring bioluminescent reaction. Copyright © 2012 The Society for Biotechnology, Japan. Published by Elsevier B.V. All rights reserved.

Construction of an evaluation and selection system of emergency treatment technology based on dynamic fuzzy GRA method for phenol spill

NASA Astrophysics Data System (ADS)

Zhao, Jingjing; Yu, Lean; Li, Lian

2017-05-01

There is often a great deal of complexity, fuzziness and uncertainties of the chemical contingency spills. In order to obtain the optimum emergency disposal technology schemes as soon as the chemical pollution accident occurs, the technique evaluation system was developed based on dynamic fuzzy GRA method, and the feasibility of the proposed methods has been tested by using a emergency phenol spill accidence occurred in highway.

The use of concept mapping in measurement development and evaluation: Application and future directions.

PubMed

Rosas, Scott R; Ridings, John W

2017-02-01

The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Quantitative Evaluation of Management Courses: Part 1

ERIC Educational Resources Information Center

Cunningham, Cyril

1973-01-01

The author describes how he developed a method of evaluating and comparing management courses of different types and lengths by applying an ordinal system of relative values using a process of transmutation. (MS)

Northwest Montana/North Idaho transmission corridor study: a computer-assisted corridor location and impact evaluation assessment

Treesearch

Timothy J. Murray; Daniel J. Bisenius; Jay G. Marcotte

1979-01-01

A computer-assisted method was used to locate and evaluate approximately 1,200 miles of alternative corridors within an 8,000 square mile study region. The method involved in-depth impact analyses for nine major location criteria or determinant models. Regional "experts" from the Rocky Mountain area participated with BPA in developing model structure....

Laboratory Study of Polychlorinated Biphenyl (PCB) Contamination and Mitigation in Buildings -- Part 4. Evaluation of the Activated Metal Treatment System (AMTS) for On-site Destruction of PCBs

EPA Science Inventory

This is the fourth, also the last, report of the report series entitled “Laboratory Study of Polychlorinated Biphenyl (PCB) Contamination and Mitigation in Buildings.” This report evaluates the performance of an on-site PCB destruction method, known as the AMTS method, developed ...

Materials testing protocol for small joint prostheses.

PubMed

Savory, K M; Hutchinson, D T; Bloebaum, R

1994-10-01

In this article, a protocol for the evaluation of new materials for small joint prostheses is introduced. The testing methods employed in the protocol were developed by reviewing reported clinical failure modes and conditions found in vivo. The methods developed quantitatively evaluates the fatigue, fatigue crack propagation, and wear resistance properties of materials. For this study, a silicone elastomer similar to Dow Corning Silastic HP100, a radiation stable polypropylene, and a copolymer of polypropylene and ethylene propylene-diene monomer (EPDM) are evaluated. None of the materials tested demonstrated the ideal properties that are sought in a self-hinging joint prostheses. The silicone elastomer had excellent wear properties; however, cracks quickly propagated, causing catastrophic failure when fatigued. Conversely, the copolymer showed excellent fatigue crack propagation resistance and less than favorable wear properties. The polypropylene did not perform well in any evaluation.

Research and development of a field-ready protocol for sampling of phosgene from stationary source emissions: Diethylamine reagent studies. Research report, 11 July 1995--30 September 1996

DOE Office of Scientific and Technical Information (OSTI.GOV)

Steger, J.L.; Bursey, J.T.; Merrill, R.G.

1999-03-01

This report presents the results of laboratory studies to develop and evaluate a method for the sampling and analysis of phosgene from stationary sources of air emissions using diethylamine (DEA) in toluene as the collection media. The method extracts stack gas from emission sources and stabilizes the reactive gas for subsequent analysis. DEA was evaluated both in a benchtop study and in a laboratory train spiking study. This report includes results for both the benchtop study and the train spiking study. Benchtop studies to evaluate the suitability of DEA for collecting and analyzing phosgene investigated five variables: storage time, DEAmore » concentration, moisture/pH, phosgene concentration, and sample storage temperature. Prototype sampling train studies were performed to determine if the benchtop chemical studies were transferable to a Modified Method 5 sampling train collecting phosgene in the presence of clean air mixed with typical stack gas components. Four conditions, which varied the moisture and phosgene spike were evaluated in triplicate. In addition to research results, the report includes a detailed draft method for sampling and analysis of phosgene from stationary source emissions.« less

Applied Cognitive Task Analysis (ACTA) Methodology

DTIC Science & Technology

1997-11-01

experienced based cognitive skills. The primary goal of this project was to develop streamlined methods of Cognitive Task Analysis that would fill this need...We have made important progression this direction. We have developed streamlined methods of Cognitive Task Analysis . Our evaluation study indicates...developed a CD-based stand alone instructional package, which will make the Applied Cognitive Task Analysis (ACTA) tools widely accessible. A survey of the

DO TIE LABORATORY BASED ASSESSMENT METHODS REALLY PREDICT FIELD EFFECTS?

EPA Science Inventory

Sediment Toxicity Identification and Evaluation (TIE) methods have been developed for both porewaters and whole sediments. These relatively simple laboratory methods are designed to identify specific toxicants or classes of toxicants in sediments; however, the question of whethe...

Analysis of the methods for assessing socio-economic development level of urban areas

NASA Astrophysics Data System (ADS)

Popova, Olga; Bogacheva, Elena

2017-01-01

The present paper provides a targeted analysis of current approaches (ratings) in the assessment of socio-economic development of urban areas. The survey focuses on identifying standardized methodologies to area assessment techniques formation that will result in developing the system of intelligent monitoring, dispatching, building management, scheduling and effective management of an administrative-territorial unit. This system is characterized by complex hierarchical structure, including tangible and intangible properties (parameters, attributes). Investigating the abovementioned methods should increase the administrative-territorial unit's attractiveness for investors and residence. The research aims at studying methods for evaluating socio-economic development level of the Russian Federation territories. Experimental and theoretical territory estimating methods were revealed. Complex analysis of the characteristics of the areas was carried out and evaluation parameters were determined. Integral indicators (resulting rating criteria values) as well as the overall rankings (parameters, characteristics) were analyzed. The inventory of the most widely used partial indicators (parameters, characteristics) of urban areas was revealed. The resulting criteria of rating values homogeneity were verified and confirmed by determining the root mean square deviation, i.e. divergence of indices. The principal shortcomings of assessment methodologies were revealed. The assessment methods with enhanced effectiveness and homogeneity were proposed.

[Research progresses on ergonomics assessment and measurement methods for push-pull behavior].

PubMed

Zhao, Yan; Li, Dongxu; Guo, Shengpeng

2011-10-01

Pushing and pulling (P&P) is a common operating mode of operator's physical works, and plays an important role in evaluation of human behavior health and operation performance. At present, there are many research methods of P&P, and this article is a state-of-art review of the classification of P&P research methods, the various impact factors in P&P program, technical details of internal/external P&P force measurement and evaluation, the limitation of current research methods and the future developments in the ergonomics field.

Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi

PubMed Central

Gooding, Kate; Makwinja, Regina; Nyirenda, Deborah; Vincent, Robin; Sambakunsi, Rodrick

2018-01-01

Background: Evaluation of community and public engagement in research is important to deepen understanding of how engagement works and to enhance its effectiveness. Theories of change have been recommended for evaluating community engagement, for their ability to make explicit intended outcomes and understandings of how engagement activities contribute to these outcomes. However, there are few documented examples of using theories of change for evaluation of engagement. This article reports experience of using theories of change to develop a framework for evaluating community engagement in research at a clinical research organisation in Malawi. We describe the steps used to develop theories of change, and the way theories of change were used to design data collection plans. Based on our experience, we reflect on the advantages and challenges of the theory of change approach. Methods: The theories of change and evaluation framework were developed through a series of workshops and meetings between engagement practitioners, monitoring and evaluation staff, and researchers. We first identified goals for engagement, then used ‘so that’ chains to clarify pathways and intermediate outcomes between engagement activities and goals. Further meetings were held to refine initial theories of change, identify priority information needs, and define feasible evaluation methods. Results: The theory of change approach had several benefits. In particular, it helped to construct an evaluation framework focused on relevant outcomes and not just activities. The process of reflecting on intended goals and pathways also helped staff to review the design of engagement activities. Challenges included practical considerations around time to consider evaluation plans among practitioners (a challenge for evaluation more generally regardless of method), and more fundamental difficulties related to identifying feasible and agreed outcomes. Conclusions: These experiences from Malawi provide lessons for other research organisations considering use of theories of change to support evaluation of community engagement. PMID:29560418

Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi.

PubMed

Gooding, Kate; Makwinja, Regina; Nyirenda, Deborah; Vincent, Robin; Sambakunsi, Rodrick

2018-01-01

Background: Evaluation of community and public engagement in research is important to deepen understanding of how engagement works and to enhance its effectiveness. Theories of change have been recommended for evaluating community engagement, for their ability to make explicit intended outcomes and understandings of how engagement activities contribute to these outcomes. However, there are few documented examples of using theories of change for evaluation of engagement. This article reports experience of using theories of change to develop a framework for evaluating community engagement in research at a clinical research organisation in Malawi. We describe the steps used to develop theories of change, and the way theories of change were used to design data collection plans. Based on our experience, we reflect on the advantages and challenges of the theory of change approach. Methods: The theories of change and evaluation framework were developed through a series of workshops and meetings between engagement practitioners, monitoring and evaluation staff, and researchers. We first identified goals for engagement, then used 'so that' chains to clarify pathways and intermediate outcomes between engagement activities and goals. Further meetings were held to refine initial theories of change, identify priority information needs, and define feasible evaluation methods. Results: The theory of change approach had several benefits. In particular, it helped to construct an evaluation framework focused on relevant outcomes and not just activities. The process of reflecting on intended goals and pathways also helped staff to review the design of engagement activities. Challenges included practical considerations around time to consider evaluation plans among practitioners (a challenge for evaluation more generally regardless of method), and more fundamental difficulties related to identifying feasible and agreed outcomes. Conclusions: These experiences from Malawi provide lessons for other research organisations considering use of theories of change to support evaluation of community engagement.

Development of an Interactive Social Media Tool for Parents with Concerns about Vaccines

ERIC Educational Resources Information Center

Shoup, Jo Ann; Wagner, Nicole M.; Kraus, Courtney R.; Narwaney, Komal J.; Goddard, Kristin S.; Glanz, Jason M.

2015-01-01

Objective: Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method: We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results:…

COMPARISON OF IN VIVO AND IN VITRO CHEMICAL SCREENING ASSAYS FOR ESTROGEN-RESPONSIVE PROTEIN BIOMARKER EXPRESSION IN THE SHEEPSHEAD MINNOW (CYPRINODON VARIEGATUS)

EPA Science Inventory

Animal welfare concerns and the high cost associated with in vivo chemical screening methods have prompted efforts to develop highly specific and sensitive in vitro techniques to evaluate chemicals for endocrine activity. Diagnostic biomarkers developed using in vitro methods sho...

Method Development and Application to Determine Potential Plant Uptake of Antibiotics and Other Drugs in Irrigated Crop Production Systems

EPA Science Inventory

Recent studies have shown the detection of pharmaceuticals in surface waters across the United States. The objective of this study was to develop methods, and apply them, to evaluate the potential for food chain transfer when pharmaceutical containing wastewaters are used for cr...

Focus Group Meets Nominal Group Technique: An Effective Combination for Student Evaluation?

ERIC Educational Resources Information Center

Varga-Atkins, Tünde; McIsaac, Jaye; Willis, Ian

2017-01-01

In Higher Education Focus Groups and Nominal Group Technique are two well-established methods for obtaining student feedback about their learning experience. These methods are regularly used for the enhancement and quality assurance. Based on small-scale research of educational developers' practice in curriculum development, this study presents…

Comparing the performance of biomedical clustering methods.

PubMed

Wiwie, Christian; Baumbach, Jan; Röttger, Richard

2015-11-01

Identifying groups of similar objects is a popular first step in biomedical data analysis, but it is error-prone and impossible to perform manually. Many computational methods have been developed to tackle this problem. Here we assessed 13 well-known methods using 24 data sets ranging from gene expression to protein domains. Performance was judged on the basis of 13 common cluster validity indices. We developed a clustering analysis platform, ClustEval (http://clusteval.mpi-inf.mpg.de), to promote streamlined evaluation, comparison and reproducibility of clustering results in the future. This allowed us to objectively evaluate the performance of all tools on all data sets with up to 1,000 different parameter sets each, resulting in a total of more than 4 million calculated cluster validity indices. We observed that there was no universal best performer, but on the basis of this wide-ranging comparison we were able to develop a short guideline for biomedical clustering tasks. ClustEval allows biomedical researchers to pick the appropriate tool for their data type and allows method developers to compare their tool to the state of the art.

Satisfaction with and Benefits of a Psych-social Club: Development of a Mixed Method Evaluation Instrument

PubMed Central

Labun, Evelyn; Yurkovich, Eleanor; Ide, Bette A.

2015-01-01

Deinstitutionalization of psychiatric mental health hospitals began in the 1960’s; thus, the delivery of mental health services became dependent on regional centers and community based, contracted services. One such service model is the psych-social club. Such clubs provide mental health services on the lower end of the cost continuum and reduce the utilization of higher cost services (Yurkovich, Labun, Cook & Lattergrass, 2005). This paper fills a gap by reporting on the development of a mixed method instrument entitled Benefits & Satisfaction Tool for Members of a Psych-social Club (B&ST-MPC). It also reports on the psychometric properties of the instrument, and measures members’ perception of satisfaction with and benefits of their psych-social club utilization, thus providing evaluative information for developing client centered continuums of care (Yurkovich et al., 2005). The paper includes a brief overview of the first mixed method study, background information on the rationale for instrument development, including methods used, and a discussion of the instrument’s psychometric properties. PMID:23164402

Evaluation of automated decisionmaking methodologies and development of an integrated robotic system simulation

NASA Technical Reports Server (NTRS)

Haley, D. C.; Almand, B. J.; Thomas, M. M.; Krauze, L. D.; Gremban, K. D.; Sanborn, J. C.; Kelly, J. H.; Depkovich, T. M.

1984-01-01

A generic computer simulation for manipulator systems (ROBSIM) was implemented and the specific technologies necessary to increase the role of automation in various missions were developed. The specific items developed are: (1) capability for definition of a manipulator system consisting of multiple arms, load objects, and an environment; (2) capability for kinematic analysis, requirements analysis, and response simulation of manipulator motion; (3) postprocessing options such as graphic replay of simulated motion and manipulator parameter plotting; (4) investigation and simulation of various control methods including manual force/torque and active compliances control; (5) evaluation and implementation of three obstacle avoidance methods; (6) video simulation and edge detection; and (7) software simulation validation.

Development and validation of a fast static headspace GC method for determination of residual solvents in permethrin.

PubMed

Tian, Jingzhi; Rustum, Abu

2016-09-05

A fast static headspace gas chromatography (HS-GC) method was developed to separate all residual solvents present in commercial active pharmaceutical ingredient (API) batches of permethrin. A total of six residual solvents namely 2-methylpentane, 3-methylpentane, methylcyclopentane, n-hexane, cyclohexane and toluene were found in typical commercial batches of permethrin; and three of them are not in the list of ICH solvents. All six residual solvents were baseline separated in five minutes by the new method presented in this paper. The method was successfully validated as per International Conference on Harmonisation (ICH) guidelines. Evaluation of this method was conducted to separate 26 commonly used solvents in the manufacturing of various APIs, key intermediates of APIs and pharmaceutical excipients. The results of the evaluation demonstrated that this method can also be used as a general method to determine residual solvents in various APIs, intermediates and excipients that are used in pharmaceutical products. Copyright © 2016 Elsevier B.V. All rights reserved.

Development of representative magnetic resonance imaging-based atlases of the canine brain and evaluation of three methods for atlas-based segmentation.

PubMed

Milne, Marjorie E; Steward, Christopher; Firestone, Simon M; Long, Sam N; O'Brien, Terrence J; Moffat, Bradford A

2016-04-01

To develop representative MRI atlases of the canine brain and to evaluate 3 methods of atlas-based segmentation (ABS). 62 dogs without clinical signs of epilepsy and without MRI evidence of structural brain disease. The MRI scans from 44 dogs were used to develop 4 templates on the basis of brain shape (brachycephalic, mesaticephalic, dolichocephalic, and combined mesaticephalic and dolichocephalic). Atlas labels were generated by segmenting the brain, ventricular system, hippocampal formation, and caudate nuclei. The MRI scans from the remaining 18 dogs were used to evaluate 3 methods of ABS (manual brain extraction and application of a brain shape-specific template [A], automatic brain extraction and application of a brain shape-specific template [B], and manual brain extraction and application of a combined template [C]). The performance of each ABS method was compared by calculation of the Dice and Jaccard coefficients, with manual segmentation used as the gold standard. Method A had the highest mean Jaccard coefficient and was the most accurate ABS method assessed. Measures of overlap for ABS methods that used manual brain extraction (A and C) ranged from 0.75 to 0.95 and compared favorably with repeated measures of overlap for manual extraction, which ranged from 0.88 to 0.97. Atlas-based segmentation was an accurate and repeatable method for segmentation of canine brain structures. It could be performed more rapidly than manual segmentation, which should allow the application of computer-assisted volumetry to large data sets and clinical cases and facilitate neuroimaging research and disease diagnosis.

People's Need for Additional Job Training: Development and Evaluation of an Assessment Procedure.

ERIC Educational Resources Information Center

Copa, George H.; Maurice, Clyde F.

A procedure was developed and evaluated for assessing the self-perceived educational needs of people as one input to the process of planning, approving, and implementing relevant educational programs. The method of data collection involved selecting samples of people by randomly selecting households in a given geographic area, and then contacting…

Field-cage methodology for evaluating climatic suitability for introduced wood-borer parasitoids: preliminary results from the emerald ash borer system

Treesearch

Michael D. Ulyshen; Jian J. Duan; Leah S. Bauer; Juli Gould; Phil Taylor; Dick Bean; Carol Holko; Roy Van Driesche

2011-01-01

Field-cage methods were developed to evaluate the abilities of Tetrastichus planipennisi Yang (Hymenoptera: Eulophidae) and Spathius agrili Yang (Hymenoptera: Braconidae), biocontrol agents of Agrilus planipennis Fairmaire (Coleoptera: Buprestidae), to parasitize, develop and overwinter following three late-season releases at both a northern (Michigan) and a southern (...

Driving and Dementia in Older Adults: Implementation and Evaluation of a Continuing Education Project

ERIC Educational Resources Information Center

Meuser, Thomas M.; Carr, David B.; Berg-Weger, Marla; Niewoehner, Pat; Morris, John C.

2006-01-01

Purpose: We aimed to develop and evaluate a multimedia workshop curriculum to educate physicians and other health professionals about (a) driving-related assessment in older adults with dementia, and (b) strategies to encourage driving retirement for impaired individuals. Design and Methods: A curriculum developed by the Older Drivers Project of…

Evaluation of the FOCUS (Feedback on Counseling Using Simulation) Instrument for Assessment of Client-Centered Nutrition Counseling Behaviors

ERIC Educational Resources Information Center

Henry, Beverly W.; Smith, Thomas J.

2010-01-01

Objective: To develop an instrument to assess client-centered counseling behaviors (skills) of student-counselors in a standardized patient (SP) exercise. Methods: Descriptive study of the accuracy and utility of a newly developed counseling evaluation instrument. Study participants included 11 female student-counselors at a Midwestern…

Objective Evaluation of Muscle Strength in Infants with Hypotonia and Muscle Weakness

ERIC Educational Resources Information Center

Reus, Linda; van Vlimmeren, Leo A.; Staal, J. Bart; Janssen, Anjo J. W. M.; Otten, Barto J.; Pelzer, Ben J.; Nijhuis-van der Sanden, Maria W. G.

2013-01-01

The clinical evaluation of an infant with motor delay, muscle weakness, and/or hypotonia would improve considerably if muscle strength could be measured objectively and normal reference values were available. The authors developed a method to measure muscle strength in infants and tested 81 typically developing infants, 6-36 months of age, and 17…