A new tool for the evaluation of the analytical procedure: Green Analytical Procedure Index.

PubMed

Płotka-Wasylka, J

2018-05-01

A new means for assessing analytical protocols relating to green analytical chemistry attributes has been developed. The new tool, called GAPI (Green Analytical Procedure Index), evaluates the green character of an entire analytical methodology, from sample collection to final determination, and was created using such tools as the National Environmental Methods Index (NEMI) or Analytical Eco-Scale to provide not only general but also qualitative information. In GAPI, a specific symbol with five pentagrams can be used to evaluate and quantify the environmental impact involved in each step of an analytical methodology, mainly from green through yellow to red depicting low, medium to high impact, respectively. The proposed tool was used to evaluate analytical procedures applied in the determination of biogenic amines in wine samples, and polycyclic aromatic hydrocarbon determination by EPA methods. GAPI tool not only provides an immediately perceptible perspective to the user/reader but also offers exhaustive information on evaluated procedures. Copyright © 2018 Elsevier B.V. All rights reserved.

US-Japan Collaborative Research on Evaluation Tools and Methods Comparison of Evaluation Tools and Methods Used in the United States (U.S.) and Japan.

DOT National Transportation Integrated Search

2016-04-01

The United States (U.S.) and Japan have similar transportation challenges, and share a common belief that cooperative systems can deliver significant societal benefits for road users, especially in terms of safer, more energy-efficient, and environme...

Development and field testing of a decision support tool to facilitate shared decision making in contraceptive counseling.

PubMed

Dehlendorf, Christine; Fitzpatrick, Judith; Steinauer, Jody; Swiader, Lawrence; Grumbach, Kevin; Hall, Cara; Kuppermann, Miriam

2017-07-01

We developed and formatively evaluated a tablet-based decision support tool for use by women prior to a contraceptive counseling visit to help them engage in shared decision making regarding method selection. Drawing upon formative work around women's preferences for contraceptive counseling and conceptual understanding of health care decision making, we iteratively developed a storyboard and then digital prototypes, based on best practices for decision support tool development. Pilot testing using both quantitative and qualitative data and cognitive testing was conducted. We obtained feedback from patient and provider advisory groups throughout the development process. Ninety-six percent of women who used the tool in pilot testing reported that it helped them choose a method, and qualitative interviews indicated acceptability of the tool's content and presentation. Compared to the control group, women who used the tool demonstrated trends toward increased likelihood of complete satisfaction with their method. Participant responses to cognitive testing were used in tool refinement. Our decision support tool appears acceptable to women in the family planning setting. Formative evaluation of the tool supports its utility among patients making contraceptive decisions, which can be further evaluated in a randomized controlled trial. Copyright © 2017 Elsevier B.V. All rights reserved.

Assessment of SOAP note evaluation tools in colleges and schools of pharmacy.

PubMed

Sando, Karen R; Skoy, Elizabeth; Bradley, Courtney; Frenzel, Jeanne; Kirwin, Jennifer; Urteaga, Elizabeth

2017-07-01

To describe current methods used to assess SOAP notes in colleges and schools of pharmacy. Members of the American Association of Colleges of Pharmacy Laboratory Instructors Special Interest Group were invited to share assessment tools for SOAP notes. Content of submissions was evaluated to characterize overall qualities and how the tools assessed subjective, objective, assessment, and plan information. Thirty-nine assessment tools from 25 schools were evaluated. Twenty-nine (74%) of the tools were rubrics and ten (26%) were checklists. All rubrics included analytic scoring elements, while two (7%) were mixed with holistic and analytic scoring elements. A majority of the rubrics (35%) used a four-item rating scale. Substantial variability existed in how tools evaluated subjective and objective sections. All tools included problem identification in the assessment section. Other assessment items included goals (82%) and rationale (69%). Seventy-seven percent assessed drug therapy; however, only 33% assessed non-drug therapy. Other plan items included education (59%) and follow-up (90%). There is a great deal of variation in the specific elements used to evaluate SOAP notes in colleges and schools of pharmacy. Improved consistency in assessment methods to evaluate SOAP notes may better prepare students to produce standardized documentation when entering practice. Copyright © 2017 Elsevier Inc. All rights reserved.

Preferences of Turkish Language Teachers for the Assessment-Evaluation Tools and Methods

ERIC Educational Resources Information Center

Guney, Nail

2013-01-01

The aim of this study is to determine the rate of teachers' use of assessment and evaluation tools given in 2005 curriculum of Turkish language teaching. To this end; we presented a list of assessment and evaluation tools on the basis of random sampling to 216 teachers of Turkish who work in Ordu, Samsun, Ankara, Trabzon and Istanbul provinces.…

Constructing Benchmark Databases and Protocols for Medical Image Analysis: Diabetic Retinopathy

PubMed Central

Kauppi, Tomi; Kämäräinen, Joni-Kristian; Kalesnykiene, Valentina; Sorri, Iiris; Uusitalo, Hannu; Kälviäinen, Heikki

2013-01-01

We address the performance evaluation practices for developing medical image analysis methods, in particular, how to establish and share databases of medical images with verified ground truth and solid evaluation protocols. Such databases support the development of better algorithms, execution of profound method comparisons, and, consequently, technology transfer from research laboratories to clinical practice. For this purpose, we propose a framework consisting of reusable methods and tools for the laborious task of constructing a benchmark database. We provide a software tool for medical image annotation helping to collect class label, spatial span, and expert's confidence on lesions and a method to appropriately combine the manual segmentations from multiple experts. The tool and all necessary functionality for method evaluation are provided as public software packages. As a case study, we utilized the framework and tools to establish the DiaRetDB1 V2.1 database for benchmarking diabetic retinopathy detection algorithms. The database contains a set of retinal images, ground truth based on information from multiple experts, and a baseline algorithm for the detection of retinopathy lesions. PMID:23956787

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

NASA Technical Reports Server (NTRS)

Simon, Donald L.

2010-01-01

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

Reliability-Based Electronics Shielding Design Tools

NASA Technical Reports Server (NTRS)

Wilson, J. W.; O'Neill, P. J.; Zang, T. A.; Pandolf, J. E.; Tripathi, R. K.; Koontz, Steven L.; Boeder, P.; Reddell, B.; Pankop, C.

2007-01-01

Shielding design on large human-rated systems allows minimization of radiation impact on electronic systems. Shielding design tools require adequate methods for evaluation of design layouts, guiding qualification testing, and adequate follow-up on final design evaluation.

EMERGY METHODS: VALUABLE INTEGRATED ASSESSMENT TOOLS

EPA Science Inventory

NHEERL's Atlantic Ecology Division is investigating emergy methods as tools for integrated assessment in several projects evaluating environmental impacts, policies, and alternatives for remediation and intervention. Emergy accounting is a methodology that provides a quantitative...

Development of an Interactive Social Media Tool for Parents with Concerns about Vaccines

ERIC Educational Resources Information Center

Shoup, Jo Ann; Wagner, Nicole M.; Kraus, Courtney R.; Narwaney, Komal J.; Goddard, Kristin S.; Glanz, Jason M.

2015-01-01

Objective: Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method: We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results:…

Development of a Self-Report Tool to Evaluate Hearing Aid Outcomes among Chinese Speakers

ERIC Educational Resources Information Center

Wong, Lena L. N.; Hang, Na

2014-01-01

Purpose: This article reports on the development of a self-report tool--the Chinese Hearing Aid Outcomes Questionnaire (CHAOQ)--to evaluate hearing aid outcomes among Chinese speakers. Method: There were 4 phases to construct the CHAOQ and evaluate its psychometric properties. First, items were selected to evaluate a range of culturally relevant…

A method to evaluate hydraulic fracture using proppant detection.

PubMed

Liu, Juntao; Zhang, Feng; Gardner, Robin P; Hou, Guojing; Zhang, Quanying; Li, Hu

2015-11-01

Accurate determination of the proppant placement and propped fracture height are important for evaluating and optimizing stimulation strategies. A technology using non-radioactive proppant and a pulsed neutron gamma energy spectra logging tool to determine the placement and height of propped fractures is proposed. Gd2O3 was incorporated into ceramic proppant and a Monte Carlo method was utilized to build the logging tools and formation models. Characteristic responses of the recorded information of different logging tools to fracture widths, proppant concentrations and influencing factors were studied. The results show that Gd capture gamma rays can be used to evaluate propped fractures and it has higher sensitivity to the change of fracture width and traceable proppant content compared with the exiting non-radioactive proppant evaluation techniques and only an after-fracture measurement is needed for the new method; The changes in gas saturation and borehole size have a great impact on determining propped fractures when compensated neutron and pulsed neutron capture tool are used. A field example is presented to validate the application of the new technique. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

ERIC Educational Resources Information Center

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

NetBenchmark: a bioconductor package for reproducible benchmarks of gene regulatory network inference.

PubMed

Bellot, Pau; Olsen, Catharina; Salembier, Philippe; Oliveras-Vergés, Albert; Meyer, Patrick E

2015-09-29

In the last decade, a great number of methods for reconstructing gene regulatory networks from expression data have been proposed. However, very few tools and datasets allow to evaluate accurately and reproducibly those methods. Hence, we propose here a new tool, able to perform a systematic, yet fully reproducible, evaluation of transcriptional network inference methods. Our open-source and freely available Bioconductor package aggregates a large set of tools to assess the robustness of network inference algorithms against different simulators, topologies, sample sizes and noise intensities. The benchmarking framework that uses various datasets highlights the specialization of some methods toward network types and data. As a result, it is possible to identify the techniques that have broad overall performances.

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

Development, Evaluation, and Validation of Environmental Assessment Tools to Evaluate the College Nutrition Environment

ERIC Educational Resources Information Center

Freedman, Marjorie R.

2010-01-01

Objective: To develop, evaluate, and validate 2 nutrition environment assessment tools (surveys), for specific use in combating overweight on college/university campuses. Participants and Methods: Invitations to complete surveys were e-mailed to food service and health center directors at 47 universities, Winter 2008. Overall response rate was…

Presenting an Evaluation Model for the Cancer Registry Software.

PubMed

Moghaddasi, Hamid; Asadi, Farkhondeh; Rabiei, Reza; Rahimi, Farough; Shahbodaghi, Reihaneh

2017-12-01

As cancer is increasingly growing, cancer registry is of great importance as the main core of cancer control programs, and many different software has been designed for this purpose. Therefore, establishing a comprehensive evaluation model is essential to evaluate and compare a wide range of such software. In this study, the criteria of the cancer registry software have been determined by studying the documents and two functional software of this field. The evaluation tool was a checklist and in order to validate the model, this checklist was presented to experts in the form of a questionnaire. To analyze the results of validation, an agreed coefficient of %75 was determined in order to apply changes. Finally, when the model was approved, the final version of the evaluation model for the cancer registry software was presented. The evaluation model of this study contains tool and method of evaluation. The evaluation tool is a checklist including the general and specific criteria of the cancer registry software along with their sub-criteria. The evaluation method of this study was chosen as a criteria-based evaluation method based on the findings. The model of this study encompasses various dimensions of cancer registry software and a proper method for evaluating it. The strong point of this evaluation model is the separation between general criteria and the specific ones, while trying to fulfill the comprehensiveness of the criteria. Since this model has been validated, it can be used as a standard to evaluate the cancer registry software.

Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites

PubMed Central

Steinwachs, Donald; Rubin, Haya R

2003-01-01

Background Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness. Objective This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality. Methods An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness. Results Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80. Conclusions Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information. PMID:14713658

Enhancing Learning Outcomes through Evaluation of Serious Gaming: A Mixed Methods Study

ERIC Educational Resources Information Center

Douglas, Kerrie Anna

2012-01-01

This study compared the change in counseling student's self-efficacy and skill related to suicide assessment and intervention through the use of a novel intervention-oriented evaluation method, evaluation focused discussion groups, in an experimental embedded mixed methods design. An innovation counselor pedagogical tool, Suicide Risk Assessment…

The development of a plant risk evaluation (PRE) tool for assessing the invasive potential of ornamental plants.

PubMed

Conser, Christiana; Seebacher, Lizbeth; Fujino, David W; Reichard, Sarah; DiTomaso, Joseph M

2015-01-01

Weed Risk Assessment (WRA) methods for evaluating invasiveness in plants have evolved rapidly in the last two decades. Many WRA tools exist, but none were specifically designed to screen ornamental plants prior to being released into the environment. To be accepted as a tool to evaluate ornamental plants for the nursery industry, it is critical that a WRA tool accurately predicts non-invasiveness without falsely categorizing them as invasive. We developed a new Plant Risk Evaluation (PRE) tool for ornamental plants. The 19 questions in the final PRE tool were narrowed down from 56 original questions from existing WRA tools. We evaluated the 56 WRA questions by screening 21 known invasive and 14 known non-invasive ornamental plants. After statistically comparing the predictability of each question and the frequency the question could be answered for both invasive and non-invasive species, we eliminated questions that provided no predictive power, were irrelevant in our current model, or could not be answered reliably at a high enough percentage. We also combined many similar questions. The final 19 remaining PRE questions were further tested for accuracy using 56 additional known invasive plants and 36 known non-invasive ornamental species. The resulting evaluation demonstrated that when "needs further evaluation" classifications were not included, the accuracy of the model was 100% for both predicting invasiveness and non-invasiveness. When "needs further evaluation" classifications were included as either false positive or false negative, the model was still 93% accurate in predicting invasiveness and 97% accurate in predicting non-invasiveness, with an overall accuracy of 95%. We conclude that the PRE tool should not only provide growers with a method to accurately screen their current stock and potential new introductions, but also increase the probability of the tool being accepted for use by the industry as the basis for a nursery certification program.

The Stuttering Treatment Research Evaluation and Assessment Tool (STREAT): Evaluating Treatment Research as Part of Evidence-Based Practice

ERIC Educational Resources Information Center

Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.

2006-01-01

Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…

Interactive visualization of public health indicators to support policymaking: An exploratory study

PubMed Central

Zakkar, Moutasem; Sedig, Kamran

2017-01-01

Purpose The purpose of this study is to examine the use of interactive visualizations to represent data/information related to social determinants of health and public health indicators, and to investigate the benefits of such visualizations for health policymaking. Methods: The study developed a prototype for an online interactive visualization tool that represents the social determinants of health. The study participants explored and used the tool. The tool was evaluated using the informal user experience evaluation method. This method involves the prospective users of a tool to use and play with it and their feedback to be collected through interviews. Results: Using visualizations to represent and interact with health indicators has advantages over traditional representation techniques that do not allow users to interact with the information. Communicating healthcare indicators to policymakers is a complex task because of the complexity of the indicators, diversity of audiences, and different audience needs. This complexity can lead to information misinterpretation, which occurs when users of the health data ignore or do not know why, where, and how the data has been produced, or where and how it can be used. Conclusions: Public health policymaking is a complex process, and data is only one element among others needed in this complex process. Researchers and healthcare organizations should conduct a strategic evaluation to assess the usability of interactive visualizations and decision support tools before investing in these tools. Such evaluation should take into consideration the cost, ease of use, learnability, and efficiency of those tools, and the factors that influence policymaking. PMID:29026455

Methods for assessing reliability and validity for a measurement tool: a case study and critique using the WHO haemoglobin colour scale.

PubMed

White, Sarah A; van den Broek, Nynke R

2004-05-30

Before introducing a new measurement tool it is necessary to evaluate its performance. Several statistical methods have been developed, or used, to evaluate the reliability and validity of a new assessment method in such circumstances. In this paper we review some commonly used methods. Data from a study that was conducted to evaluate the usefulness of a specific measurement tool (the WHO Colour Scale) is then used to illustrate the application of these methods. The WHO Colour Scale was developed under the auspices of the WHO to provide a simple portable and reliable method of detecting anaemia. This Colour Scale is a discrete interval scale, whereas the actual haemoglobin values it is used to estimate are on a continuous interval scale and can be measured accurately using electrical laboratory equipment. The methods we consider are: linear regression, correlation coefficients, paired t-tests plotting differences against mean values and deriving limits of agreement; kappa and weighted kappa statistics, sensitivity and specificity, an intraclass correlation coefficient and the repeatability coefficient. We note that although the definition and properties of each of these methods is well established inappropriate methods continue to be used in medical literature for assessing reliability and validity, as evidenced in the context of the evaluation of the WHO Colour Scale. Copyright 2004 John Wiley & Sons, Ltd.

Nondestructive Evaluation of Foam Insulation for the External Tank Return to Flight

NASA Technical Reports Server (NTRS)

Walker, James L.; Richter, Joel D.

2006-01-01

Nondestructive evaluation methods have been developed to identify defects in the foam thermal protection system (TPS) of the Space Shuttle External Tank (ET). Terahertz imaging and backscatter radiography have been brought from prototype lab systems to production hardened inspection tools in just a few years. These methods have been demonstrated to be capable of detecting void type defects under many inches of foam which, if not repaired, could lead to detrimental foam loss. The evolution of these methods from lab tools to implementation on the ET will be discussed.

Innovative tools and techniques in identifying highway safety improvement projects : project summary.

DOT National Transportation Integrated Search

2017-01-01

Researchers completed the following activities: - Reviewed the literature, state HSIP processes and practices, and HSIP tools used by various agencies. - Evaluated the applicability of safety assessment methods and tools used by other states and loca...

Evaluation of hand sensibility: a review.

PubMed

Novak, C B

2001-01-01

Many assessment devices and measures have been described to evaluate sensibility, with little consensus on the optimal measurement tool. The purpose of this paper is to review the assessment methods and devices used in the evaluation of hand sensibility. Consideration is given to the characteristics of each measurement tool, the information necessary for complete patient evaluation, and the battery of valid and reliable measurements that provide the most complete and accurate patient assessment.

Evaluating the effectiveness of gloves in reducing the hazards of hand-transmitted vibration.

PubMed

Griffin, M J

1998-05-01

A method of evaluating the effectiveness of gloves in reducing the hazards of hand-transmitted vibration is proposed. The glove isolation effectiveness was calculated from: (a) the measured transmissibility of a glove, (b) the vibration spectrum on the handle of a specific tool (or class of tools), and (c) the frequency weighting indicating the degree to which different frequencies of vibration cause injury. With previously reported tool vibration spectra and glove transmissibilities (from 10-1000 Hz), the method was used to test 10 gloves with 20 different powered tools. The frequency weighting for hand-transmitted vibration advocated in British standard 6842 (1987) and international standard 5349 (1986) greatly influences the apparent isolation effectiveness of gloves. With the frequency weighting, the gloves had little effect on the transmission of vibration to the hand from most of the tools. Only for two or three tools (those dominated by high frequency vibration) did any glove provide useful attenuation. Without the frequency weighting, some gloves showed useful attenuation of the vibration on most powered tools. In view of the uncertain effect of the vibration frequency in the causation of disorders from hand-transmitted vibration, it is provisionally suggested that the wearing of a glove by the user of a particular vibratory tool could be encouraged if the glove reduces the transmission of vibration when it is evaluated without the frequency weighting and does not increase the vibration when it is evaluated with the frequency weighting. A current international standard for the measurement and evaluation of the vibration transmitted by gloves can classify a glove as an antivibration glove when it provides no useful attenuation of vibration, whereas a glove providing useful attenuation of vibration on a specific tool can fail the test.

Methods for Evaluating the Performance and Human Stress-Factors of Percussive Riveting

NASA Astrophysics Data System (ADS)

Ahn, Jonathan Y.

The aerospace industry automates portions of their manufacturing and assembly processes. However, mechanics still remain vital to production, especially in areas where automated machines cannot fit, or have yet to match the quality of human craftsmanship. One such task is percussive riveting. Because percussive riveting is associated with a high risk of injury, these tool must be certified prior to release. The major contribution of this thesis is to develop a test bench capable of percussive riveting for ergonomic evaluation purposes. The major issues investigated are: (i) automate the tool evaluation method to be repeatable; (ii) demonstrate use of displacement and force sensors; and (iii) correlate performance and risk exposure of percussive tools. A test bench equipped with servomotors and pneumatic cylinders to control xyz-position of a rivet gun and bucking bar simultaneously, is used to explore this evaluation approach.

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

A community resource benchmarking predictions of peptide binding to MHC-I molecules.

PubMed

Peters, Bjoern; Bui, Huynh-Hoa; Frankild, Sune; Nielson, Morten; Lundegaard, Claus; Kostem, Emrah; Basch, Derek; Lamberth, Kasper; Harndahl, Mikkel; Fleri, Ward; Wilson, Stephen S; Sidney, John; Lund, Ole; Buus, Soren; Sette, Alessandro

2006-06-09

Recognition of peptides bound to major histocompatibility complex (MHC) class I molecules by T lymphocytes is an essential part of immune surveillance. Each MHC allele has a characteristic peptide binding preference, which can be captured in prediction algorithms, allowing for the rapid scan of entire pathogen proteomes for peptide likely to bind MHC. Here we make public a large set of 48,828 quantitative peptide-binding affinity measurements relating to 48 different mouse, human, macaque, and chimpanzee MHC class I alleles. We use this data to establish a set of benchmark predictions with one neural network method and two matrix-based prediction methods extensively utilized in our groups. In general, the neural network outperforms the matrix-based predictions mainly due to its ability to generalize even on a small amount of data. We also retrieved predictions from tools publicly available on the internet. While differences in the data used to generate these predictions hamper direct comparisons, we do conclude that tools based on combinatorial peptide libraries perform remarkably well. The transparent prediction evaluation on this dataset provides tool developers with a benchmark for comparison of newly developed prediction methods. In addition, to generate and evaluate our own prediction methods, we have established an easily extensible web-based prediction framework that allows automated side-by-side comparisons of prediction methods implemented by experts. This is an advance over the current practice of tool developers having to generate reference predictions themselves, which can lead to underestimating the performance of prediction methods they are not as familiar with as their own. The overall goal of this effort is to provide a transparent prediction evaluation allowing bioinformaticians to identify promising features of prediction methods and providing guidance to immunologists regarding the reliability of prediction tools.

ANTONIA perfusion and stroke. A software tool for the multi-purpose analysis of MR perfusion-weighted datasets and quantitative ischemic stroke assessment.

PubMed

Forkert, N D; Cheng, B; Kemmling, A; Thomalla, G; Fiehler, J

2014-01-01

The objective of this work is to present the software tool ANTONIA, which has been developed to facilitate a quantitative analysis of perfusion-weighted MRI (PWI) datasets in general as well as the subsequent multi-parametric analysis of additional datasets for the specific purpose of acute ischemic stroke patient dataset evaluation. Three different methods for the analysis of DSC or DCE PWI datasets are currently implemented in ANTONIA, which can be case-specifically selected based on the study protocol. These methods comprise a curve fitting method as well as a deconvolution-based and deconvolution-free method integrating a previously defined arterial input function. The perfusion analysis is extended for the purpose of acute ischemic stroke analysis by additional methods that enable an automatic atlas-based selection of the arterial input function, an analysis of the perfusion-diffusion and DWI-FLAIR mismatch as well as segmentation-based volumetric analyses. For reliability evaluation, the described software tool was used by two observers for quantitative analysis of 15 datasets from acute ischemic stroke patients to extract the acute lesion core volume, FLAIR ratio, perfusion-diffusion mismatch volume with manually as well as automatically selected arterial input functions, and follow-up lesion volume. The results of this evaluation revealed that the described software tool leads to highly reproducible results for all parameters if the automatic arterial input function selection method is used. Due to the broad selection of processing methods that are available in the software tool, ANTONIA is especially helpful to support image-based perfusion and acute ischemic stroke research projects.

Assessment Tools for Evaluation of Oral Feeding in Infants Less than Six Months Old

PubMed Central

Pados, Britt F.; Park, Jinhee; Estrem, Hayley; Awotwi, Araba

2015-01-01

Background Feeding difficulty is common in infants less than six months old. Identification of infants in need of specialized treatment is critical to ensure appropriate nutrition and feeding skill development. Valid and reliable assessment tools help clinicians objectively evaluate feeding. Purpose To identify and evaluate assessment tools available for clinical assessment of bottle- and breast-feeding in infants less than six months old. Methods/Search Strategy CINAHL, HaPI, PubMed, and Web of Science were searched for “infant feeding” and “assessment tool.” The literature (n=237) was reviewed for relevant assessment tools. A secondary search was conducted in CINAHL and PubMed for additional literature on identified tools. Findings/Results Eighteen assessment tools met inclusion criteria. Of these, seven were excluded because of limited available literature or because they were intended for use with a specific diagnosis or in research only. There are 11 assessment tools available for clinical practice. Only two of these were intended for bottle-feeding. All 11 indicated they were appropriate for use with breast-feeding. None of the available tools have adequate psychometric development and testing. Implications for Practice All of the tools should be used with caution. The Early Feeding Skills Assessment and Bristol Breastfeeding Assessment Tool had the most supportive psychometric development and testing. Implications for Research Feeding assessment tools need to be developed and tested to guide optimal clinical care of infants from birth through six months. A tool that assesses both bottle- and breast-feeding would allow for consistent assessment across feeding methods. PMID:26945280

Data Mining in Health and Medical Information.

ERIC Educational Resources Information Center

Bath, Peter A.

2004-01-01

Presents a literature review that covers the following topics related to data mining (DM) in health and medical information: the potential of DM in health and medicine; statistical methods; evaluation of methods; DM tools for health and medicine; inductive learning of symbolic rules; application of DM tools in diagnosis and prognosis; and…

Evaluating the compatibility of multi-functional and intensive urban land uses

NASA Astrophysics Data System (ADS)

Taleai, M.; Sharifi, A.; Sliuzas, R.; Mesgari, M.

2007-12-01

This research is aimed at developing a model for assessing land use compatibility in densely built-up urban areas. In this process, a new model was developed through the combination of a suite of existing methods and tools: geographical information system, Delphi methods and spatial decision support tools: namely multi-criteria evaluation analysis, analytical hierarchy process and ordered weighted average method. The developed model has the potential to calculate land use compatibility in both horizontal and vertical directions. Furthermore, the compatibility between the use of each floor in a building and its neighboring land uses can be evaluated. The method was tested in a built-up urban area located in Tehran, the capital city of Iran. The results show that the model is robust in clarifying different levels of physical compatibility between neighboring land uses. This paper describes the various steps and processes of developing the proposed land use compatibility evaluation model (CEM).

Evaluating the utility of two gestural discomfort evaluation methods

PubMed Central

Son, Minseok; Jung, Jaemoon; Park, Woojin

2017-01-01

Evaluating physical discomfort of designed gestures is important for creating safe and usable gesture-based interaction systems; yet, gestural discomfort evaluation has not been extensively studied in HCI, and few evaluation methods seem currently available whose utility has been experimentally confirmed. To address this, this study empirically demonstrated the utility of the subjective rating method after a small number of gesture repetitions (a maximum of four repetitions) in evaluating designed gestures in terms of physical discomfort resulting from prolonged, repetitive gesture use. The subjective rating method has been widely used in previous gesture studies but without empirical evidence on its utility. This study also proposed a gesture discomfort evaluation method based on an existing ergonomics posture evaluation tool (Rapid Upper Limb Assessment) and demonstrated its utility in evaluating designed gestures in terms of physical discomfort resulting from prolonged, repetitive gesture use. Rapid Upper Limb Assessment is an ergonomics postural analysis tool that quantifies the work-related musculoskeletal disorders risks for manual tasks, and has been hypothesized to be capable of correctly determining discomfort resulting from prolonged, repetitive gesture use. The two methods were evaluated through comparisons against a baseline method involving discomfort rating after actual prolonged, repetitive gesture use. Correlation analyses indicated that both methods were in good agreement with the baseline. The methods proposed in this study seem useful for predicting discomfort resulting from prolonged, repetitive gesture use, and are expected to help interaction designers create safe and usable gesture-based interaction systems. PMID:28423016

The Development of a Plant Risk Evaluation (PRE) Tool for Assessing the Invasive Potential of Ornamental Plants

PubMed Central

Conser, Christiana; Seebacher, Lizbeth; Fujino, David W.; Reichard, Sarah; DiTomaso, Joseph M.

2015-01-01

Weed Risk Assessment (WRA) methods for evaluating invasiveness in plants have evolved rapidly in the last two decades. Many WRA tools exist, but none were specifically designed to screen ornamental plants prior to being released into the environment. To be accepted as a tool to evaluate ornamental plants for the nursery industry, it is critical that a WRA tool accurately predicts non-invasiveness without falsely categorizing them as invasive. We developed a new Plant Risk Evaluation (PRE) tool for ornamental plants. The 19 questions in the final PRE tool were narrowed down from 56 original questions from existing WRA tools. We evaluated the 56 WRA questions by screening 21 known invasive and 14 known non-invasive ornamental plants. After statistically comparing the predictability of each question and the frequency the question could be answered for both invasive and non-invasive species, we eliminated questions that provided no predictive power, were irrelevant in our current model, or could not be answered reliably at a high enough percentage. We also combined many similar questions. The final 19 remaining PRE questions were further tested for accuracy using 56 additional known invasive plants and 36 known non-invasive ornamental species. The resulting evaluation demonstrated that when “needs further evaluation” classifications were not included, the accuracy of the model was 100% for both predicting invasiveness and non-invasiveness. When “needs further evaluation” classifications were included as either false positive or false negative, the model was still 93% accurate in predicting invasiveness and 97% accurate in predicting non-invasiveness, with an overall accuracy of 95%. We conclude that the PRE tool should not only provide growers with a method to accurately screen their current stock and potential new introductions, but also increase the probability of the tool being accepted for use by the industry as the basis for a nursery certification program. PMID:25803830

Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

ERIC Educational Resources Information Center

Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

2013-01-01

Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design

PubMed Central

2011-01-01

Background Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines on assessing and managing osteoporosis are available, many patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions, a series of mixed-methods studies, and advice from experts in osteoporosis and human-factors engineering were used collectively to develop a multicomponent tool (targeted to family physicians and patients at risk for osteoporosis) that may support clinical decision making in osteoporosis disease management at the point of care. Methods A three-phased approach will be used to evaluate the osteoporosis tool. In phase 1, the tool will be implemented in three family practices. It will involve ensuring optimal functioning of the tool while minimizing disruption to usual practice. In phase 2, the tool will be pilot tested in a quasi-experimental interrupted time series (ITS) design to determine if it can improve osteoporosis disease management at the point of care. Phase 3 will involve conducting a qualitative postintervention follow-up study to better understand participants' experiences and perceived utility of the tool and readiness to adopt the tool at the point of care. Discussion The osteoporosis tool has the potential to make several contributions to the development and evaluation of complex, chronic disease interventions, such as the inclusion of an implementation strategy prior to conducting an evaluation study. Anticipated benefits of the tool may be to increase awareness for patients about osteoporosis and its associated risks and provide an opportunity to discuss a management plan with their physician, which may all facilitate patient self-management. PMID:21781318

The Registry of Knowledge Translation Methods and Tools: a resource to support evidence-informed public health.

PubMed

Peirson, Leslea; Catallo, Cristina; Chera, Sunita

2013-08-01

This paper examines the development of a globally accessible online Registry of Knowledge Translation Methods and Tools to support evidence-informed public health. A search strategy, screening and data extraction tools, and writing template were developed to find, assess, and summarize relevant methods and tools. An interactive website and searchable database were designed to house the registry. Formative evaluation was undertaken to inform refinements. Over 43,000 citations were screened; almost 700 were full-text reviewed, 140 of which were included. By November 2012, 133 summaries were available. Between January 1 and November 30, 2012 over 32,945 visitors from more than 190 countries accessed the registry. Results from 286 surveys and 19 interviews indicated the registry is valued and useful, but would benefit from a more intuitive indexing system and refinements to the summaries. User stories and promotional activities help expand the reach and uptake of knowledge translation methods and tools in public health contexts. The National Collaborating Centre for Methods and Tools' Registry of Methods and Tools is a unique and practical resource for public health decision makers worldwide.

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Evaluation of Professional Role Competency during Psychiatry Residency

ERIC Educational Resources Information Center

Grujich, Nikola N.; Razmy, Ajmal; Zaretsky, Ari; Styra, Rima G.; Sockalingam, Sanjeev

2012-01-01

Objective: The authors sought to determine psychiatry residents' perceptions on the current method of evaluating professional role competency and the use of multi-source feedback (MSF) as an assessment tool. Method: Authors disseminated a structured, anonymous survey to 128 University of Toronto psychiatry residents, evaluating the current mode of…

Applications of AN OO Methodology and Case to a Daq System

NASA Astrophysics Data System (ADS)

Bee, C. P.; Eshghi, S.; Jones, R.; Kolos, S.; Magherini, C.; Maidantchik, C.; Mapelli, L.; Mornacchi, G.; Niculescu, M.; Patel, A.; Prigent, D.; Spiwoks, R.; Soloviev, I.; Caprini, M.; Duval, P. Y.; Etienne, F.; Ferrato, D.; Le van Suu, A.; Qian, Z.; Gaponenko, I.; Merzliakov, Y.; Ambrosini, G.; Ferrari, R.; Fumagalli, G.; Polesello, G.

The RD13 project has evaluated the use of the Object Oriented Information Engineering (OOIE) method during the development of several software components connected to the DAQ system. The method is supported by a sophisticated commercial CASE tool (Object Management Workbench) and programming environment (Kappa) which covers the full life-cycle of the software including model simulation, code generation and application deployment. This paper gives an overview of the method, CASE tool, DAQ components which have been developed and we relate our experiences with the method and tool, its integration into our development environment and the spiral lifecycle it supports.

A software technology evaluation program

NASA Technical Reports Server (NTRS)

Novaes-Card, David N.

1985-01-01

A set of quantitative approaches is presented for evaluating software development methods and tools. The basic idea is to generate a set of goals which are refined into quantifiable questions which specify metrics to be collected on the software development and maintenance process and product. These metrics can be used to characterize, evaluate, predict, and motivate. They can be used in an active as well as passive way by learning form analyzing the data and improving the methods and tools based upon what is learned from that analysis. Several examples were given representing each of the different approaches to evaluation. The cost of the approaches varied inversely with the level of confidence in the interpretation of the results.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Objective and subjective treatment evaluation of scars using optical coherence tomography, sonography, photography, and standardised questionnaires.

PubMed

Reinholz, Markus; Schwaiger, Hannah; Poetschke, Julian; Epple, Andreas; Ruzicka, Thomas; Von Braunmühl, Tanja; Gauglitz, Gerd G

2016-12-01

Currently, different types of treatments for pathological scars are available, however, to date, there is no established method of measurement to objectively assess therapeutic outcome. Treatment success is usually evaluated clinically by the physician and patient. Non-invasive imaging techniques, such as HD-OCT (high-definition optical coherence tomography), may represent a valuable diagnostic tool to objectively measure therapeutic outcome. To compare HD-OCT with ultrasound and subjective evaluation tools, such as questionnaires. In total, eight patients with pathological scars were treated in this pilot study with cryotherapy and intralesional steroid injections, and evaluated pre- and post-treatment using clinical examination, photography, sonography, and HD-OCT. The analysis of objective and subjective measuring methods was used to draw direct comparisons. HD-OCT revealed reduced epidermal and dermal thickness of the scar after four treatments with triamcinolone acetonide and cryotherapy. Based on sonography, a total reduction in scar height and reduction in scar depth was demonstrated. Both methods correlated well with the injected amount of triamcinolone acetonide. In addition, a positive correlation between well-established subjective and objective evaluation methods was found. We demonstrate that HD-OCT may be used as an objective diagnostic instrument to evaluate skin thickness under therapy for pathological scars, and serves as a valuable adjunctive device in combination with ultrasound and subjective evaluation tools. This provides additional information for the therapist concerning the quality and success of the applied treatment.

Designing Real-time Decision Support for Trauma Resuscitations

PubMed Central

Yadav, Kabir; Chamberlain, James M.; Lewis, Vicki R.; Abts, Natalie; Chawla, Shawn; Hernandez, Angie; Johnson, Justin; Tuveson, Genevieve; Burd, Randall S.

2016-01-01

Background Use of electronic clinical decision support (eCDS) has been recommended to improve implementation of clinical decision rules. Many eCDS tools, however, are designed and implemented without taking into account the context in which clinical work is performed. Implementation of the pediatric traumatic brain injury (TBI) clinical decision rule at one Level I pediatric emergency department includes an electronic questionnaire triggered when ordering a head computed tomography using computerized physician order entry (CPOE). Providers use this CPOE tool in less than 20% of trauma resuscitation cases. A human factors engineering approach could identify the implementation barriers that are limiting the use of this tool. Objectives The objective was to design a pediatric TBI eCDS tool for trauma resuscitation using a human factors approach. The hypothesis was that clinical experts will rate a usability-enhanced eCDS tool better than the existing CPOE tool for user interface design and suitability for clinical use. Methods This mixed-methods study followed usability evaluation principles. Pediatric emergency physicians were surveyed to identify barriers to using the existing eCDS tool. Using standard trauma resuscitation protocols, a hierarchical task analysis of pediatric TBI evaluation was developed. Five clinical experts, all board-certified pediatric emergency medicine faculty members, then iteratively modified the hierarchical task analysis until reaching consensus. The software team developed a prototype eCDS display using the hierarchical task analysis. Three human factors engineers provided feedback on the prototype through a heuristic evaluation, and the software team refined the eCDS tool using a rapid prototyping process. The eCDS tool then underwent iterative usability evaluations by the five clinical experts using video review of 50 trauma resuscitation cases. A final eCDS tool was created based on their feedback, with content analysis of the evaluations performed to ensure all concerns were identified and addressed. Results Among 26 EPs (76% response rate), the main barriers to using the existing tool were that the information displayed is redundant and does not fit clinical workflow. After the prototype eCDS tool was developed based on the trauma resuscitation hierarchical task analysis, the human factors engineers rated it to be better than the CPOE tool for nine of 10 standard user interface design heuristics on a three-point scale. The eCDS tool was also rated better for clinical use on the same scale, in 84% of 50 expert–video pairs, and was rated equivalent in the remainder. Clinical experts also rated barriers to use of the eCDS tool as being low. Conclusions An eCDS tool for diagnostic imaging designed using human factors engineering methods has improved perceived usability among pediatric emergency physicians. PMID:26300010

An experimental method for the assessment of color simulation tools.

PubMed

Lillo, Julio; Alvaro, Leticia; Moreira, Humberto

2014-07-22

The Simulcheck method for evaluating the accuracy of color simulation tools in relation to dichromats is described and used to test three color simulation tools: Variantor, Coblis, and Vischeck. A total of 10 dichromats (five protanopes, five deuteranopes) and 10 normal trichromats participated in the current study. Simulcheck includes two psychophysical tasks: the Pseudoachromatic Stimuli Identification task and the Minimum Achromatic Contrast task. The Pseudoachromatic Stimuli Identification task allows determination of the two chromatic angles (h(uv) values) that generate a minimum response in the yellow–blue opponent mechanism and, consequently, pseudoachromatic stimuli (greens or reds). The Minimum Achromatic Contrast task requires the selection of the gray background that produces minimum contrast (near zero change in the achromatic mechanism) for each pseudoachromatic stimulus selected in the previous task (L(R) values). Results showed important differences in the colorimetric transformations performed by the three evaluated simulation tools and their accuracy levels. Vischeck simulation accurately implemented the algorithm of Brettel, Viénot, and Mollon (1997). Only Vischeck appeared accurate (similarity in huv and L(R) values between real and simulated dichromats) and, consequently, could render reliable color selections. It is concluded that Simulcheck is a consistent method because it provided an equivalent pattern of results for huv and L(R) values irrespective of the stimulus set used to evaluate a simulation tool. Simulcheck was also considered valid because real dichromats provided expected huv and LR values when performing the two psychophysical tasks included in this method. © 2014 ARVO.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

A multi-center study benchmarks software tools for label-free proteome quantification

PubMed Central

Gillet, Ludovic C; Bernhardt, Oliver M.; MacLean, Brendan; Röst, Hannes L.; Tate, Stephen A.; Tsou, Chih-Chiang; Reiter, Lukas; Distler, Ute; Rosenberger, George; Perez-Riverol, Yasset; Nesvizhskii, Alexey I.; Aebersold, Ruedi; Tenzer, Stefan

2016-01-01

The consistent and accurate quantification of proteins by mass spectrometry (MS)-based proteomics depends on the performance of instruments, acquisition methods and data analysis software. In collaboration with the software developers, we evaluated OpenSWATH, SWATH2.0, Skyline, Spectronaut and DIA-Umpire, five of the most widely used software methods for processing data from SWATH-MS (sequential window acquisition of all theoretical fragment ion spectra), a method that uses data-independent acquisition (DIA) for label-free protein quantification. We analyzed high-complexity test datasets from hybrid proteome samples of defined quantitative composition acquired on two different MS instruments using different SWATH isolation windows setups. For consistent evaluation we developed LFQbench, an R-package to calculate metrics of precision and accuracy in label-free quantitative MS, and report the identification performance, robustness and specificity of each software tool. Our reference datasets enabled developers to improve their software tools. After optimization, all tools provided highly convergent identification and reliable quantification performance, underscoring their robustness for label-free quantitative proteomics. PMID:27701404

Toward a New Approach to the Evaluation of a Digital Curriculum Using Learning Analytics

ERIC Educational Resources Information Center

Rangel, Virginia Snodgrass; Bell, Elizabeth R.; Monroy, Carlos; Whitaker, J. Reid

2015-01-01

Understanding how an educational intervention is implemented is essential to evaluating its effectiveness. With the increased use of digital tools in classrooms, however, traditional methods of measuring implementation fall short. Fortunately, there is a way to learn about the interactions that users have with digital tools that are embedded into…

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

Recommendations and Improvements for the Evaluation of Integrated Community-Wide Interventions Approaches.

PubMed

van Koperen, Tessa M; Renders, Carry M; Spierings, Eline J M; Hendriks, Anna-Marie; Westerman, Marjan J; Seidell, Jacob C; Schuit, Albertine J

2016-01-01

Background . Integrated community-wide intervention approaches (ICIAs) are implemented to prevent childhood obesity. Programme evaluation improves these ICIAs, but professionals involved often struggle with performance. Evaluation tools have been developed to support Dutch professionals involved in ICIAs. It is unclear how useful these tools are to intended users. We therefore researched the facilitators of and barriers to ICIA programme evaluation as perceived by professionals and their experiences of the evaluation tools. Methods . Focus groups and interviews with 33 public health professionals. Data were analysed using a thematic content approach. Findings . Evaluation is hampered by insufficient time, budget, and experience with ICIAs, lack of leadership, and limited advocacy for evaluation. Epidemiologists are regarded as responsible for evaluation but feel incompetent to perform evaluation or advocate its need in a political environment. Managers did not prioritise process evaluations, involvement of stakeholders, and capacity building. The evaluation tools are perceived as valuable but too comprehensive considering limited resources. Conclusion . Evaluating ICIAs is important but most professionals are unfamiliar with it and management does not prioritise process evaluation nor incentivize professionals to evaluate. To optimise programme evaluation, more resources and coaching are required to improve professionals' evaluation capabilities and specifically the use of evaluation.

Recommendations and Improvements for the Evaluation of Integrated Community-Wide Interventions Approaches

PubMed Central

Spierings, Eline J. M.; Westerman, Marjan J.; Seidell, Jacob C.; Schuit, Albertine J.

2016-01-01

Background. Integrated community-wide intervention approaches (ICIAs) are implemented to prevent childhood obesity. Programme evaluation improves these ICIAs, but professionals involved often struggle with performance. Evaluation tools have been developed to support Dutch professionals involved in ICIAs. It is unclear how useful these tools are to intended users. We therefore researched the facilitators of and barriers to ICIA programme evaluation as perceived by professionals and their experiences of the evaluation tools. Methods. Focus groups and interviews with 33 public health professionals. Data were analysed using a thematic content approach. Findings. Evaluation is hampered by insufficient time, budget, and experience with ICIAs, lack of leadership, and limited advocacy for evaluation. Epidemiologists are regarded as responsible for evaluation but feel incompetent to perform evaluation or advocate its need in a political environment. Managers did not prioritise process evaluations, involvement of stakeholders, and capacity building. The evaluation tools are perceived as valuable but too comprehensive considering limited resources. Conclusion. Evaluating ICIAs is important but most professionals are unfamiliar with it and management does not prioritise process evaluation nor incentivize professionals to evaluate. To optimise programme evaluation, more resources and coaching are required to improve professionals' evaluation capabilities and specifically the use of evaluation. PMID:28116149

Methods for transition toward computer assisted cognitive examination.

PubMed

Jurica, P; Valenzi, S; Struzik, Z R; Cichocki, A

2015-01-01

We present a software framework which enables the extension of current methods for the assessment of cognitive fitness using recent technological advances. Screening for cognitive impairment is becoming more important as the world's population grows older. Current methods could be enhanced by use of computers. Introduction of new methods to clinics requires basic tools for collection and communication of collected data. To develop tools that, with minimal interference, offer new opportunities for the enhancement of the current interview based cognitive examinations. We suggest methods and discuss process by which established cognitive tests can be adapted for data collection through digitization by pen enabled tablets. We discuss a number of methods for evaluation of collected data, which promise to increase the resolution and objectivity of the common scoring strategy based on visual inspection. By involving computers in the roles of both instructing and scoring, we aim to increase the precision and reproducibility of cognitive examination. The tools provided in Python framework CogExTools available at http://bsp. brain.riken.jp/cogextools/ enable the design, application and evaluation of screening tests for assessment of cognitive impairment. The toolbox is a research platform; it represents a foundation for further collaborative development by the wider research community and enthusiasts. It is free to download and use, and open-source. We introduce a set of open-source tools that facilitate the design and development of new cognitive tests for modern technology. We provide these tools in order to enable the adaptation of technology for cognitive examination in clinical settings. The tools provide the first step in a possible transition toward standardized mental state examination using computers.

The PBL-Evaluator: A Web-Based Tool for Assessment in Tutorials.

ERIC Educational Resources Information Center

Chaves, John F.; Chaves, John A.; Lantz, Marilyn S.

1998-01-01

Describes design and use of the PBL Evaluator, a computer-based method of evaluating dental students' clinical problem-solving skills. Analysis of Indiana University students' self-, peer, and tutor ratings for one iteration of a course in critical thinking and professional behavior shows differences in these ratings. The method is found useful…

Ensuring Patient Safety in Care Transitions: An Empirical Evaluation of a Handoff Intervention Tool

PubMed Central

Abraham, Joanna; Kannampallil, Thomas; Patel, Bela; Almoosa, Khalid; Patel, Vimla L.

2012-01-01

Successful handoffs ensure smooth, efficient and safe patient care transitions. Tools and systems designed for standardization of clinician handoffs often focuses on ensuring the communication activity during transitions, with limited support for preparatory activities such as information seeking and organization. We designed and evaluated a Handoff Intervention Tool (HAND-IT) based on a checklist-inspired, body system format allowing structured information organization, and a problem-case narrative format allowing temporal description of patient care events. Based on a pre-post prospective study using a multi-method analysis we evaluated the effectiveness of HAND-IT as a documentation tool. We found that the use of HAND-IT led to fewer transition breakdowns, greater tool resilience, and likely led to better learning outcomes for less-experienced clinicians when compared to the current tool. We discuss the implications of our results for improving patient safety with a continuity of care-based approach. PMID:23304268

IT security evaluation - “hybrid” approach and risk of its implementation

NASA Astrophysics Data System (ADS)

Livshitz, I. I.; Neklyudov, A. V.; Lontsikh, P. A.

2018-05-01

It is relevant to evolve processes of evaluation of the IT security nowadays. Creating and application of the common evaluation approaches for an IT component, which are processed by the governmental and civil organizations, are still not solving problem. It is suggested to create a more precise and complex assessment tool for an IT security – the “hybrid” method of the IT security evaluation for a particular object, which is based on a range of adequate assessment tools.

Dietary Adherence Monitoring Tool for Free-living, Controlled Feeding Studies

USDA-ARS?s Scientific Manuscript database

Objective: To devise a dietary adherence monitoring tool for use in controlled human feeding trials involving free-living study participants. Methods: A scoring tool was devised to measure and track dietary adherence for an 8-wk randomized trial evaluating the effects of two different dietary patter...

Tool independence for the Web Accessibility Quantitative Metric.

PubMed

Vigo, Markel; Brajnik, Giorgio; Arrue, Myriam; Abascal, Julio

2009-07-01

The Web Accessibility Quantitative Metric (WAQM) aims at accurately measuring the accessibility of web pages. One of the main features of WAQM among others is that it is evaluation tool independent for ranking and accessibility monitoring scenarios. This article proposes a method to attain evaluation tool independence for all foreseeable scenarios. After demonstrating that homepages have a more similar error profile than any other web page in a given web site, 15 homepages were measured with 10,000 different values of WAQM parameters using EvalAccess and LIFT, two automatic evaluation tools for accessibility. A similar procedure was followed with random pages and with several test files obtaining several tuples that minimise the difference between both tools. One thousand four hundred forty-nine web pages from 15 web sites were measured with these tuples and those values that minimised the difference between the tools were selected. Once the WAQM was tuned, the accessibility of 15 web sites was measured with two metrics for web sites, concluding that even if similar values can be produced, obtaining the same scores is undesirable since evaluation tools behave in a different way.

An agent based simulation tool for scheduling emergency department physicians.

PubMed

Jones, Spencer S; Evans, R Scott

2008-11-06

Emergency department overcrowding is a problem that threatens the public health of communities and compromises the quality of care given to individual patients. The Institute of Medicine recommends that hospitals employ information technology and operations research methods to reduce overcrowding. This paper describes the development of an agent based simulation tool that has been designed to evaluate the impact of various physician staffing configurations on patient waiting times in the emergency department. We evaluate the feasibility of this tool at a single hospital emergency department.

Pavement, bridge, and safety cost evaluation tool for overweight truck corridors serving coastal port regions and border ports of entry

DOT National Transportation Integrated Search

2017-08-01

To address the need for a rational but fast method to determine costs and a proposed permit fee, the research team developed the Stage 1 Expedient Analysis Method. The method was used to evaluate potential oversize/overweight (OS/OW) freight corridor...

A potential tool for clinicians; evaluating a computer-led dietary assessment method in overweight and obese women during weight loss

USDA-ARS?s Scientific Manuscript database

Background: Dietary assessment methods used in overweight/obese participants have been scrutinized for underreporting energy. Objective: Evaluate the effectiveness of a computer-administered, 24-hour recall method (ASA24) to measure energy and nutrient intake in overweight/obese women and to further...

Assessing hospital disaster preparedness: a comparison of an on-site survey, directly observed drill performance, and video analysis of teamwork.

PubMed

Kaji, Amy H; Langford, Vinette; Lewis, Roger J

2008-09-01

There is currently no validated method for assessing hospital disaster preparedness. We determine the degree of correlation between the results of 3 methods for assessing hospital disaster preparedness: administration of an on-site survey, drill observation using a structured evaluation tool, and video analysis of team performance in the hospital incident command center. This was a prospective, observational study conducted during a regional disaster drill, comparing the results from an on-site survey, a structured disaster drill evaluation tool, and a video analysis of teamwork, performed at 6 911-receiving hospitals in Los Angeles County, CA. The on-site survey was conducted separately from the drill and assessed hospital disaster plan structure, vendor agreements, modes of communication, medical and surgical supplies, involvement of law enforcement, mutual aid agreements with other facilities, drills and training, surge capacity, decontamination capability, and pharmaceutical stockpiles. The drill evaluation tool, developed by Johns Hopkins University under contract from the Agency for Healthcare Research and Quality, was used to assess various aspects of drill performance, such as the availability of the hospital disaster plan, the geographic configuration of the incident command center, whether drill participants were identifiable, whether the noise level interfered with effective communication, and how often key information (eg, number of available staffed floor, intensive care, and isolation beds; number of arriving victims; expected triage level of victims; number of potential discharges) was received by the incident command center. Teamwork behaviors in the incident command center were quantitatively assessed, using the MedTeams analysis of the video recordings obtained during the disaster drill. Spearman rank correlations of the results between pair-wise groupings of the 3 assessment methods were calculated. The 3 evaluation methods demonstrated qualitatively different results with respect to each hospital's level of disaster preparedness. The Spearman rank correlation coefficient between the results of the on-site survey and the video analysis of teamwork was -0.34; between the results of the on-site survey and the structured drill evaluation tool, 0.15; and between the results of the video analysis and the drill evaluation tool, 0.82. The disparate results obtained from the 3 methods suggest that each measures distinct aspects of disaster preparedness, and perhaps no single method adequately characterizes overall hospital preparedness.

Factors Influencing Physical Therapists' Use of Standardized Measures of Walking Capacity Poststroke Across the Care Continuum

PubMed Central

Pattison, Kira M.; Brooks, Dina; Cameron, Jill I.

2015-01-01

Background The use of standardized assessment tools is an element of evidence-informed rehabilitation, but physical therapists report administering these tools inconsistently poststroke. An in-depth understanding of physical therapists' approaches to walking assessment is needed to develop strategies to advance assessment practice. Objectives The objective of this study was to explore the methods physical therapists use to evaluate walking poststroke, reasons for selecting these methods, and the use of assessment results in clinical practice. Design A qualitative descriptive study involving semistructured telephone interviews was conducted. Methods Registered physical therapists assessing a minimum of 10 people with stroke per year in Ontario, Canada, were purposively recruited from acute care, rehabilitation, and outpatient settings. Interviews were audiotaped and transcribed verbatim. Transcripts were coded line by line by the interviewer. Credibility was optimized through triangulation of analysts, audit trail, and collection of field notes. Results Study participants worked in acute care (n=8), rehabilitation (n=11), or outpatient (n=9) settings and reported using movement observation and standardized assessment tools to evaluate walking. When selecting methods to evaluate walking, physical therapists described being influenced by a hierarchy of factors. Factors included characteristics of the assessment tool, the therapist, the workplace, and patients, as well as influential individuals or organizations. Familiarity exerted the primary influence on adoption of a tool into a therapist's assessment repertoire, whereas patient factors commonly determined daily use. Participants reported using the results from walking assessments to communicate progress to the patient and health care professionals. Conclusions Multilevel factors influence physical therapists' adoption and daily administration of standardized tools to assess walking. Findings will inform knowledge translation efforts aimed at increasing the standardized assessment of walking poststroke. PMID:25929532

Usability evaluation of a medication reconciliation tool: Embedding safety probes to assess users' detection of medication discrepancies.

PubMed

Russ, Alissa L; Jahn, Michelle A; Patel, Himalaya; Porter, Brian W; Nguyen, Khoa A; Zillich, Alan J; Linsky, Amy; Simon, Steven R

2018-06-01

An electronic medication reconciliation tool was previously developed by another research team to aid provider-patient communication for medication reconciliation. To evaluate the usability of this tool, we integrated artificial safety probes into standard usability methods. The objective of this article is to describe this method of using safety probes, which enabled us to evaluate how well the tool supports users' detection of medication discrepancies. We completed a mixed-method usability evaluation in a simulated setting with 30 participants: 20 healthcare professionals (HCPs) and 10 patients. We used factual scenarios but embedded three artificial safety probes: (1) a missing medication (i.e., omission); (2) an extraneous medication (i.e., commission); and (3) an inaccurate dose (i.e., dose discrepancy). We measured users' detection of each probe to estimate the probability that a HCP or patient would detect these discrepancies. Additionally, we recorded participants' detection of naturally occurring discrepancies. Each safety probe was detected by ≤50% of HCPs. Patients' detection rates were generally higher. Estimates indicate that a HCP and patient, together, would detect 44.8% of these medication discrepancies. Additionally, HCPs and patients detected 25 and 45 naturally-occurring discrepancies, respectively. Overall, detection of medication discrepancies was low. Findings indicate that more advanced interface designs are warranted. Future research is needed on how technologies can be designed to better aid HCPs' and patients' detection of medication discrepancies. This is one of the first studies to evaluate the usability of a collaborative medication reconciliation tool and assess HCPs' and patients' detection of medication discrepancies. Results demonstrate that embedded safety probes can enhance standard usability methods by measuring additional, clinically-focused usability outcomes. The novel safety probes we used may serve as an initial, standard set for future medication reconciliation research. More prevalent use of safety probes could strengthen usability research for a variety of health information technologies. Published by Elsevier Inc.

An Integrated Approach of Fuzzy Linguistic Preference Based AHP and Fuzzy COPRAS for Machine Tool Evaluation.

PubMed

Nguyen, Huu-Tho; Md Dawal, Siti Zawiah; Nukman, Yusoff; Aoyama, Hideki; Case, Keith

2015-01-01

Globalization of business and competitiveness in manufacturing has forced companies to improve their manufacturing facilities to respond to market requirements. Machine tool evaluation involves an essential decision using imprecise and vague information, and plays a major role to improve the productivity and flexibility in manufacturing. The aim of this study is to present an integrated approach for decision-making in machine tool selection. This paper is focused on the integration of a consistent fuzzy AHP (Analytic Hierarchy Process) and a fuzzy COmplex PRoportional ASsessment (COPRAS) for multi-attribute decision-making in selecting the most suitable machine tool. In this method, the fuzzy linguistic reference relation is integrated into AHP to handle the imprecise and vague information, and to simplify the data collection for the pair-wise comparison matrix of the AHP which determines the weights of attributes. The output of the fuzzy AHP is imported into the fuzzy COPRAS method for ranking alternatives through the closeness coefficient. Presentation of the proposed model application is provided by a numerical example based on the collection of data by questionnaire and from the literature. The results highlight the integration of the improved fuzzy AHP and the fuzzy COPRAS as a precise tool and provide effective multi-attribute decision-making for evaluating the machine tool in the uncertain environment.

Evaluating Student-Generated Film as a Learning Tool for Qualitative Methods: Geographical "Drifts" and the City

ERIC Educational Resources Information Center

Anderson, Jon

2013-01-01

Film as a tool for learning offers considerable opportunity for enhancing student understanding. This paper reflects on the experiences of a project that required students to make a short film demonstrating their practical understanding of qualitative methods. In the psychogeographical tradition, students were asked to "drift" across the…

Spatial Visualization Learning in Engineering: Traditional Methods vs. a Web-Based Tool

ERIC Educational Resources Information Center

Pedrosa, Carlos Melgosa; Barbero, Basilio Ramos; Miguel, Arturo Román

2014-01-01

This study compares an interactive learning manager for graphic engineering to develop spatial vision (ILMAGE_SV) to traditional methods. ILMAGE_SV is an asynchronous web-based learning tool that allows the manipulation of objects with a 3D viewer, self-evaluation, and continuous assessment. In addition, student learning may be monitored, which…

Different methods of image segmentation in the process of meat marbling evaluation

NASA Astrophysics Data System (ADS)

Ludwiczak, A.; Ślósarz, P.; Lisiak, D.; Przybylak, A.; Boniecki, P.; Stanisz, M.; Koszela, K.; Zaborowicz, M.; Przybył, K.; Wojcieszak, D.; Janczak, D.; Bykowska, M.

2015-07-01

The level of marbling in meat assessment based on digital images is very popular, as computer vision tools are becoming more and more advanced. However considering muscle cross sections as the data source for marbling level evaluation, there are still a few problems to cope with. There is a need for an accurate method which would facilitate this evaluation procedure and increase its accuracy. The presented research was conducted in order to compare the effect of different image segmentation tools considering their usefulness in meat marbling evaluation on the muscle anatomical cross - sections. However this study is considered to be an initial trial in the presented field of research and an introduction to ultrasonic images processing and analysis.

Evaluating the Effectiveness of Web-based Climate Resilience Decision Support Tools: Insights from Coastal New Jersey

NASA Astrophysics Data System (ADS)

Brady, M.; Lathrop, R.; Auermuller, L. M.; Leichenko, R.

2016-12-01

Despite the recent surge of Web-based decision support tools designed to promote resiliency in U.S. coastal communities, to-date there has been no systematic study of their effectiveness. This study demonstrates a method to evaluate important aspects of effectiveness of four Web map tools designed to promote consideration of climate risk information in local decision-making and planning used in coastal New Jersey. In summer 2015, the research team conducted in-depth phone interviews with users of one regulatory and three non-regulatory Web map tools using a semi-structured questionnaire. The interview and analysis design drew from a combination of effectiveness evaluation approaches developed in software and information usability, program evaluation, and management information system (MIS) research. Effectiveness assessment results were further analyzed and discussed in terms of conceptual hierarchy of system objectives defined by respective tool developer and user organizations represented in the study. Insights from the interviews suggest that users rely on Web tools as a supplement to desktop and analog map sources because they provide relevant and up-to-date information in a highly accessible and mobile format. The users also reported relying on multiple information sources and comparison between digital and analog sources for decision support. However, with respect to this decision support benefit, users were constrained by accessibility factors such as lack of awareness and training with some tools, lack of salient information such as planning time horizons associated with future flood scenarios, and environmental factors such as mandates restricting some users to regulatory tools. Perceptions of Web tool credibility seem favorable overall, but factors including system design imperfections and inconsistencies in data and information across platforms limited trust, highlighting a need for better coordination between tools. Contributions of the study include user feedback on web-tool system designs consistent with collaborative methods for enhancing usability and a systematic look at effectiveness that includes both user perspectives and consideration of developer and organizational objectives.

Improved Aerodynamic Analysis for Hybrid Wing Body Conceptual Design Optimization

NASA Technical Reports Server (NTRS)

Gern, Frank H.

2012-01-01

This paper provides an overview of ongoing efforts to develop, evaluate, and validate different tools for improved aerodynamic modeling and systems analysis of Hybrid Wing Body (HWB) aircraft configurations. Results are being presented for the evaluation of different aerodynamic tools including panel methods, enhanced panel methods with viscous drag prediction, and computational fluid dynamics. Emphasis is placed on proper prediction of aerodynamic loads for structural sizing as well as viscous drag prediction to develop drag polars for HWB conceptual design optimization. Data from transonic wind tunnel tests at the Arnold Engineering Development Center s 16-Foot Transonic Tunnel was used as a reference data set in order to evaluate the accuracy of the aerodynamic tools. Triangularized surface data and Vehicle Sketch Pad (VSP) models of an X-48B 2% scale wind tunnel model were used to generate input and model files for the different analysis tools. In support of ongoing HWB scaling studies within the NASA Environmentally Responsible Aviation (ERA) program, an improved finite element based structural analysis and weight estimation tool for HWB center bodies is currently under development. Aerodynamic results from these analyses are used to provide additional aerodynamic validation data.

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

Engaging stakeholders to design a comparative effectiveness trial in children with uncontrolled asthma

PubMed Central

Erwin, Kim; Martin, Molly A; Flippin, Tara; Norell, Sarah; Shadlyn, Ariana; Yang, Jie; Falco, Paula; Rivera, Jaime; Ignoffo, Stacy; Kumar, Rajesh; Margellos-Anast, Helen; McDermott, Michael; McMahon, Kate; Mosnaim, Giselle; Nyenhuis, Sharmilee M; Press, Valerie G; Ramsay, Jessica E; Soyemi, Kenneth; Thompson, Trevonne M; Krishnan, Jerry A

2016-01-01

Aim: To present the methods and outcomes of stakeholder engagement in the development of interventions for children presenting to the emergency department (ED) for uncontrolled asthma. Methods: We engaged stakeholders (caregivers, physicians, nurses, administrators) from six EDs in a three-phase process to: define design requirements; prototype and refine; and evaluate. Results: Interviews among 28 stakeholders yielded themes regarding in-home asthma management practices and ED discharge experiences. Quantitative and qualitative evaluation showed strong preference for the new discharge tool over current tools. Conclusion: Engaging end-users in contextual inquiry resulted in CAPE (CHICAGO Action Plan after ED discharge), a new stakeholder-balanced discharge tool, which is being tested in a multicenter comparative effectiveness trial. PMID:26690579

A better way of fitting clips? A comparative study with respect to physical workload.

PubMed

Gaudez, Clarisse; Wild, Pascal; Aublet-Cuvelier, Agnès

2015-11-01

The clip fitting task is a frequently encountered assembly operation in the car industry. It can cause upper limb pain. During task laboratory simulations, upper limb muscular activity and external force were compared for 4 clip fitting methods: with the bare hand, with an unpowered tool commonly used at a company and with unpowered and powered prototype tools. None of the 4 fitting methods studied induced a lower overall workload than the other three. Muscle activity was lower at the dominant limb when using the unpowered tools and at the non-dominant limb with the bare hand or with the powered tool. Fitting clips with the bare hand required a higher external force than fitting with the three tools. Evaluation of physical workload was different depending on whether external force or muscle activity results were considered. Measuring external force only, as recommended in several standards, is insufficient for evaluating physical workload. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Introduction of the TEAM-HF Costing Tool: A User-Friendly Spreadsheet Program to Estimate Costs of Providing Patient-Centered Interventions

PubMed Central

Reed, Shelby D.; Li, Yanhong; Kamble, Shital; Polsky, Daniel; Graham, Felicia L.; Bowers, Margaret T.; Samsa, Gregory P.; Paul, Sara; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara J.

2011-01-01

Background Patient-centered health care interventions, such as heart failure disease management programs, are under increasing pressure to demonstrate good value. Variability in costing methods and assumptions in economic evaluations of such interventions limit the comparability of cost estimates across studies. Valid cost estimation is critical to conducting economic evaluations and for program budgeting and reimbursement negotiations. Methods and Results Using sound economic principles, we developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Costing Tool, a spreadsheet program that can be used by researchers or health care managers to systematically generate cost estimates for economic evaluations and to inform budgetary decisions. The tool guides users on data collection and cost assignment for associated personnel, facilities, equipment, supplies, patient incentives, miscellaneous items, and start-up activities. The tool generates estimates of total program costs, cost per patient, and cost per week and presents results using both standardized and customized unit costs for side-by-side comparisons. Results from pilot testing indicated that the tool was well-formatted, easy to use, and followed a logical order. Cost estimates of a 12-week exercise training program in patients with heart failure were generated with the costing tool and were found to be consistent with estimates published in a recent study. Conclusions The TEAM-HF Costing Tool could prove to be a valuable resource for researchers and health care managers to generate comprehensive cost estimates of patient-centered interventions in heart failure or other conditions for conducting high-quality economic evaluations and making well-informed health care management decisions. PMID:22147884

Retrieval evaluation and distance learning from perceived similarity between endomicroscopy videos.

PubMed

André, Barbara; Vercauteren, Tom; Buchner, Anna M; Wallace, Michael B; Ayache, Nicholas

2011-01-01

Evaluating content-based retrieval (CBR) is challenging because it requires an adequate ground-truth. When the available groundtruth is limited to textual metadata such as pathological classes, retrieval results can only be evaluated indirectly, for example in terms of classification performance. In this study we first present a tool to generate perceived similarity ground-truth that enables direct evaluation of endomicroscopic video retrieval. This tool uses a four-points Likert scale and collects subjective pairwise similarities perceived by multiple expert observers. We then evaluate against the generated ground-truth a previously developed dense bag-of-visual-words method for endomicroscopic video retrieval. Confirming the results of previous indirect evaluation based on classification, our direct evaluation shows that this method significantly outperforms several other state-of-the-art CBR methods. In a second step, we propose to improve the CBR method by learning an adjusted similarity metric from the perceived similarity ground-truth. By minimizing a margin-based cost function that differentiates similar and dissimilar video pairs, we learn a weight vector applied to the visual word signatures of videos. Using cross-validation, we demonstrate that the learned similarity distance is significantly better correlated with the perceived similarity than the original visual-word-based distance.

5As Team obesity intervention in primary care: development and evaluation of shared decision-making weight management tools.

PubMed

Osunlana, A M; Asselin, J; Anderson, R; Ogunleye, A A; Cave, A; Sharma, A M; Campbell-Scherer, D L

2015-08-01

Despite several clinical practice guidelines, there remains a considerable gap in prevention and management of obesity in primary care. To address the need for changing provider behaviour, a randomized controlled trial with convergent mixed method evaluation, the 5As Team (5AsT) study, was conducted. As part of the 5AsT intervention, the 5AsT tool kit was developed. This paper describes the development process and evaluation of these tools. Tools were co-developed by the multidisciplinary research team and the 5AsT, which included registered nurses/nurse practitioners (n = 15), mental health workers (n = 7) and registered dieticians (n = 7), who were previously randomized to the 5AsT intervention group at a primary care network in Edmonton, Alberta, Canada. The 5AsT tool development occurred through a practice/implementation-oriented, need-based, iterative process during learning collaborative sessions of the 5AsT intervention. Feedback during tool development was received through field notes and final provider evaluation was carried out through anonymous questionnaires. Twelve tools were co-developed with 5AsT. All tools were evaluated as either 'most useful' or 'moderately useful' in primary care practice by the 5AsT. Four key findings during 5AsT tool development were the need for: tools that were adaptive, tools to facilitate interdisciplinary practice, tools to help patients understand realistic expectations for weight loss and shared decision-making tools for goal setting and relapse prevention. The 5AsT tools are primary care tools which extend the utility of the 5As of obesity management framework in clinical practice. © 2015 The Authors. Clinical Obesity published by John Wiley & Sons Ltd on behalf of World Obesity.

5As Team obesity intervention in primary care: development and evaluation of shared decision‐making weight management tools

PubMed Central

Asselin, J.; Anderson, R.; Ogunleye, A. A.; Cave, A.; Sharma, A. M.; Campbell‐Scherer, D. L.

2015-01-01

Summary Despite several clinical practice guidelines, there remains a considerable gap in prevention and management of obesity in primary care. To address the need for changing provider behaviour, a randomized controlled trial with convergent mixed method evaluation, the 5As Team (5AsT) study, was conducted. As part of the 5AsT intervention, the 5AsT tool kit was developed. This paper describes the development process and evaluation of these tools. Tools were co‐developed by the multidisciplinary research team and the 5AsT, which included registered nurses/nurse practitioners (n = 15), mental health workers (n = 7) and registered dieticians (n = 7), who were previously randomized to the 5AsT intervention group at a primary care network in Edmonton, Alberta, Canada. The 5AsT tool development occurred through a practice/implementation‐oriented, need‐based, iterative process during learning collaborative sessions of the 5AsT intervention. Feedback during tool development was received through field notes and final provider evaluation was carried out through anonymous questionnaires. Twelve tools were co‐developed with 5AsT. All tools were evaluated as either ‘most useful’ or ‘moderately useful’ in primary care practice by the 5AsT. Four key findings during 5AsT tool development were the need for: tools that were adaptive, tools to facilitate interdisciplinary practice, tools to help patients understand realistic expectations for weight loss and shared decision‐making tools for goal setting and relapse prevention. The 5AsT tools are primary care tools which extend the utility of the 5As of obesity management framework in clinical practice. PMID:26129630

Open-source image registration for MRI-TRUS fusion-guided prostate interventions.

PubMed

Fedorov, Andriy; Khallaghi, Siavash; Sánchez, C Antonio; Lasso, Andras; Fels, Sidney; Tuncali, Kemal; Sugar, Emily Neubauer; Kapur, Tina; Zhang, Chenxi; Wells, William; Nguyen, Paul L; Abolmaesumi, Purang; Tempany, Clare

2015-06-01

We propose two software tools for non-rigid registration of MRI and transrectal ultrasound (TRUS) images of the prostate. Our ultimate goal is to develop an open-source solution to support MRI-TRUS fusion image guidance of prostate interventions, such as targeted biopsy for prostate cancer detection and focal therapy. It is widely hypothesized that image registration is an essential component in such systems. The two non-rigid registration methods are: (1) a deformable registration of the prostate segmentation distance maps with B-spline regularization and (2) a finite element-based deformable registration of the segmentation surfaces in the presence of partial data. We evaluate the methods retrospectively using clinical patient image data collected during standard clinical procedures. Computation time and Target Registration Error (TRE) calculated at the expert-identified anatomical landmarks were used as quantitative measures for the evaluation. The presented image registration tools were capable of completing deformable registration computation within 5 min. Average TRE was approximately 3 mm for both methods, which is comparable with the slice thickness in our MRI data. Both tools are available under nonrestrictive open-source license. We release open-source tools that may be used for registration during MRI-TRUS-guided prostate interventions. Our tools implement novel registration approaches and produce acceptable registration results. We believe these tools will lower the barriers in development and deployment of interventional research solutions and facilitate comparison with similar tools.

Participatory methods for Inuit public health promotion and programme evaluation in Nunatsiavut, Canada.

PubMed

Saini, Manpreet

2017-01-01

Engaging stakeholders is crucial for health promotion and programme evaluations; understanding how to best engage stakeholders is less clear, especially within Indigenous communities. The objectives of this thesis research were to use participatory methods to: (1) co-develop and evaluate a whiteboard video for use as a public health promotion tool in Rigolet, Nunatsiavut, and (2) develop and validate a framework for participatory evaluation of Inuit public health initiatives in Nunatsiavut, Labrador. Data collection tools included interactive workshops, community events, interviews, focus-group discussions and surveys. Results indicated the whiteboard video was an engaging and suitable medium for sharing public health messaging due to its contextually relevant elements. Participants identified 4 foundational evaluation framework components necessary to conduct appropriate evaluations, including: (1) community engagement, (2) collaborative evaluation development, (3) tailored evaluation data collection and (4) evaluation scope. This research illustrates stakeholder participation is critical to develop and evaluate contextually relevant public health initiatives in Nunatsiavut, Labrador and should be considered in other Indigenous communities.

RNA-Puzzles: A CASP-like evaluation of RNA three-dimensional structure prediction

PubMed Central

Cruz, José Almeida; Blanchet, Marc-Frédérick; Boniecki, Michal; Bujnicki, Janusz M.; Chen, Shi-Jie; Cao, Song; Das, Rhiju; Ding, Feng; Dokholyan, Nikolay V.; Flores, Samuel Coulbourn; Huang, Lili; Lavender, Christopher A.; Lisi, Véronique; Major, François; Mikolajczak, Katarzyna; Patel, Dinshaw J.; Philips, Anna; Puton, Tomasz; Santalucia, John; Sijenyi, Fredrick; Hermann, Thomas; Rother, Kristian; Rother, Magdalena; Serganov, Alexander; Skorupski, Marcin; Soltysinski, Tomasz; Sripakdeevong, Parin; Tuszynska, Irina; Weeks, Kevin M.; Waldsich, Christina; Wildauer, Michael; Leontis, Neocles B.; Westhof, Eric

2012-01-01

We report the results of a first, collective, blind experiment in RNA three-dimensional (3D) structure prediction, encompassing three prediction puzzles. The goals are to assess the leading edge of RNA structure prediction techniques; compare existing methods and tools; and evaluate their relative strengths, weaknesses, and limitations in terms of sequence length and structural complexity. The results should give potential users insight into the suitability of available methods for different applications and facilitate efforts in the RNA structure prediction community in ongoing efforts to improve prediction tools. We also report the creation of an automated evaluation pipeline to facilitate the analysis of future RNA structure prediction exercises. PMID:22361291

The development and validity of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To develop the construct, content, and criterion validity of the Salford Gait Tool (SF-GT) and to evaluate agreement between gait observations using the SF-GT and kinematic gait data. Tool development and comparative evaluation. University in the United Kingdom. For designing construct and content validity, convenience samples of 10 children with hemiplegic, diplegic, and quadriplegic cerebral palsy (CP) and 152 physical therapy students and 4 physical therapists were recruited. For developing criterion validity, kinematic gait data of 13 gait clusters containing 56 children with hemiplegic, diplegic, and quadriplegic CP and 11 neurologically intact children was used. For clinical evaluation, a convenience sample of 23 pediatric physical therapists participated. We developed a sagittal plane observational gait assessment tool through a series of design, test, and redesign iterations. The tool's grading system was calibrated using kinematic gait data of 13 gait clusters and was evaluated by comparing the agreement of gait observations using the SF-GT with kinematic gait data. Criterion standard kinematic gait data. There was 58% mean agreement based on grading categories and 80% mean agreement based on degree estimations evaluated with the least significant difference method. The new SF-GT has good concurrent criterion validity.

Expert consensus on best evaluative practices in community-based rehabilitation.

PubMed

Grandisson, Marie; Thibeault, Rachel; Hébert, Michèle; Cameron, Debra

2016-01-01

The objective of this study was to generate expert consensus on best evaluative practices for community-based rehabilitation (CBR). This consensus includes key features of the evaluation process and methods, and discussion of whether a shared framework should be used to report findings and, if so, which framework should play this role. A Delphi study with two predefined rounds was conducted. Experts in CBR from a wide range of geographical areas and disciplinary backgrounds were recruited to complete the questionnaires. Both quantitative and qualitative analyses were performed to generate the recommendations for best practices in CBR evaluation. A panel of 42 experts reached consensus on 13 recommendations for best evaluative practices in CBR. In regard to the critical qualities of sound CBR evaluation processes, panellists emphasized that these processes should be inclusive, participatory, empowering and respectful of local cultures and languages. The group agreed that evaluators should consider the use of mixed methods and participatory tools, and should combine indicators from a universal list of CBR indicators with locally generated ones. The group also agreed that a common framework should guide CBR evaluations, and that this framework should be a flexible combination between the CBR Matrix and the CBR Principles. An expert panel reached consensus on key features of best evaluative practices in CBR. Knowledge transfer initiatives are now required to develop guidelines, tools and training opportunities to facilitate CBR program evaluations. CBR evaluation processes should strive to be inclusive, participatory, empowering and respectful of local cultures and languages. CBR evaluators should strongly consider using mixed methods, participatory tools, a combination of indicators generated with the local community and with others from a bank of CBR indicators. CBR evaluations should be situated within a shared, but flexible, framework. This shared framework could combine the CBR Matrix and the CBR Principles.

Criteria for Comparing Children's Web Search Tools.

ERIC Educational Resources Information Center

Kuntz, Jerry

1999-01-01

Presents criteria for evaluating and comparing Web search tools designed for children. Highlights include database size; accountability; categorization; search access methods; help files; spell check; URL searching; links to alternative search services; advertising; privacy policy; and layout and design. (LRW)

Testing and refining the Science in Risk Assessment and Policy (SciRAP) web-based platform for evaluating the reliability and relevance of in vivo toxicity studies.

PubMed

Beronius, Anna; Molander, Linda; Zilliacus, Johanna; Rudén, Christina; Hanberg, Annika

2018-05-28

The Science in Risk Assessment and Policy (SciRAP) web-based platform was developed to promote and facilitate structure and transparency in the evaluation of ecotoxicity and toxicity studies for hazard and risk assessment of chemicals. The platform includes sets of criteria and a colour-coding tool for evaluating the reliability and relevance of individual studies. The SciRAP method for evaluating in vivo toxicity studies was first published in 2014 and the aim of the work presented here was to evaluate and develop that method further. Toxicologists and risk assessors from different sectors and geographical areas were invited to test the SciRAP criteria and tool on a specific set of in vivo toxicity studies and to provide feedback concerning the scientific soundness and user-friendliness of the SciRAP approach. The results of this expert assessment were used to refine and improve both the evaluation criteria and the colour-coding tool. It is expected that the SciRAP web-based platform will continue to be developed and enhanced to keep up to date with the needs of end-users. Copyright © 2018 John Wiley & Sons, Ltd.

Assessing Reliability and Validity of the "GroPromo" Audit Tool for Evaluation of Grocery Store Marketing and Promotional Environments

ERIC Educational Resources Information Center

Kerr, Jacqueline; Sallis, James F.; Bromby, Erica; Glanz, Karen

2012-01-01

Objective: To evaluate reliability and validity of a new tool for assessing the placement and promotional environment in grocery stores. Methods: Trained observers used the "GroPromo" instrument in 40 stores to code the placement of 7 products in 9 locations within a store, along with other promotional characteristics. To test construct validity,…

Application of stable isotope tools for evaluating natural and stimulated biodegradation of organic pollutants in field studies.

PubMed

Fischer, Anko; Manefield, Mike; Bombach, Petra

2016-10-01

Stable isotope tools are increasingly applied for in-depth evaluation of biodegradation of organic pollutants at contaminated field sites. They can be divided into three methods i) determination of changes in natural abundance of stable isotopes using compound-specific stable isotope analysis (CSIA), ii) detection of incorporation of stable-isotope label from a stable-isotope labelled target compound into degradation and/or mineralisation products and iii) determination of stable-isotope label incorporation into biomarkers using stable isotope probing (SIP). Stable isotope tools have been applied as key monitoring tools for multiple-line-of-evidence-approaches (MLEA) for sensitive evaluation of pollutant biodegradation. This review highlights the application of CSIA, SIP and MLEA including stable isotope tools for assessing natural and stimulated biodegradation of organic pollutants in field studies dealing with soil and groundwater contaminations. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating the integration of cultural competence skills into health and physical assessment tools: a survey of Canadian schools of nursing.

PubMed

Chircop, Andrea; Edgecombe, Nancy; Hayward, Kathryn; Ducey-Gilbert, Cherie; Sheppard-Lemoine, Debbie

2013-04-01

Currently used audiovisual (AV) teaching tools to teach health and physical assessment reflect a Eurocentric bias using the biomedical model. The purpose of our study was to (a) identify commonly used AV teaching tools of Canadian schools of nursing and (b) evaluate the identified tools. A two-part descriptive quantitative method design was used. First, we surveyed schools of nursing across Canada. Second, the identified AV teaching tools were evaluated for content and modeling of cultural competence. The majority of the schools (67%) used publisher-produced videos associated with a physical assessment textbook. Major findings included minimal demonstration of negotiation with a client around cultural aspects of the interview including the need for an interpreter, modesty, and inclusion of support persons. Identification of culturally specific examples given during the videos was superficial and did not provide students with a comprehensive understanding of necessary culturally competent skills.

Big data analytics in hyperspectral imaging for detection of microbial colonies on agar plates (Conference Presentation)

NASA Astrophysics Data System (ADS)

Yoon, Seung-Chul; Park, Bosoon; Lawrence, Kurt C.

2017-05-01

Various types of optical imaging techniques measuring light reflectivity and scattering can detect microbial colonies of foodborne pathogens on agar plates. Until recently, these techniques were developed to provide solutions for hypothesis-driven studies, which focused on developing tools and batch/offline machine learning methods with well defined sets of data. These have relatively high accuracy and rapid response time because the tools and methods are often optimized for the collected data. However, they often need to be retrained or recalibrated when new untrained data and/or features are added. A big-data driven technique is more suitable for online learning of new/ambiguous samples and for mining unknown or hidden features. Although big data research in hyperspectral imaging is emerging in remote sensing and many tools and methods have been developed so far in many other applications such as bioinformatics, the tools and methods still need to be evaluated and adjusted in applications where the conventional batch machine learning algorithms were dominant. The primary objective of this study is to evaluate appropriate big data analytic tools and methods for online learning and mining of foodborne pathogens on agar plates. After the tools and methods are successfully identified, they will be applied to rapidly search big color and hyperspectral image data of microbial colonies collected over the past 5 years in house and find the most probable colony or a group of colonies in the collected big data. The meta-data, such as collection time and any unstructured data (e.g. comments), will also be analyzed and presented with output results. The expected results will be novel, big data-driven technology to correctly detect and recognize microbial colonies of various foodborne pathogens on agar plates.

Applying systems theory to the evaluation of a whole school approach to violence prevention.

PubMed

Kearney, Sarah; Leung, Loksee; Joyce, Andrew; Ollis, Debbie; Green, Celia

2016-02-01

Issue addressed Our Watch led a complex 12-month evaluation of a whole school approach to Respectful Relationships Education (RRE) implemented in 19 schools. RRE is an emerging field aimed at preventing gender-based violence. This paper will illustrate how from an implementation science perspective, the evaluation was a critical element in the change process at both a school and policy level. Methods Using several conceptual approaches from systems science, the evaluation sought to examine how the multiple systems layers - student, teacher, school, community and government - interacted and influenced each other. A distinguishing feature of the evaluation included 'feedback loops'; that is, evaluation data was provided to participants as it became available. Evaluation tools included a combination of standardised surveys (with pre- and post-intervention data provided to schools via individualised reports), reflection tools, regular reflection interviews and summative focus groups. Results Data was shared during implementation with project staff, department staff and schools to support continuous improvement at these multiple systems levels. In complex settings, implementation can vary according to context; and the impact of evaluation processes, tools and findings differed across the schools. Interviews and focus groups conducted at the end of the project illustrated which of these methods were instrumental in motivating change and engaging stakeholders at both a school and departmental level and why. Conclusion The evaluation methods were a critical component of the pilot's approach, helping to shape implementation through data feedback loops and reflective practice for ongoing, responsive and continuous improvement. Future health promotion research on complex interventions needs to examine how the evaluation itself is influencing implementation. So what? The pilot has demonstrated that the evaluation, including feedback loops to inform project activity, were an asset to implementation. This has implications for other health promotion activities, where evaluation tools could be utilised to enhance, rather than simply measure, an intervention. The findings are relevant to a range of health promotion research activities because they demonstrate the importance of meta-evaluation techniques that seek to understand how the evaluation itself was influencing implementation and outcomes.

Feasibility of dietary assessment methods, other tools and procedures for a pan-European food consumption survey among infants, toddlers and children.

PubMed

Ocké, Marga; Brants, Henny; Dofkova, Marcela; Freisling, Heinz; van Rossum, Caroline; Ruprich, Jiri; Slimani, Nadia; Temme, Elisabeth; Trolle, Ellen; Vandevijvere, Stefanie; Huybrechts, Inge; de Boer, Evelien

2015-08-01

To test the feasibility of tools and procedures for a pan-European food consumption survey among children 0-10 years and to recommend one of two tested dietary assessment methods. Two pilot studies including 378 children were conducted in Belgium and the Czech Republic in the Pilot studies for Assessment of Nutrient intake and food Consumption among Kids in Europe. One protocol included a 3-day food diary which was checked with a parent, and data were entered afterwards using EPIC-Soft. The alternative protocol consisted of two non-consecutive 1-day food diaries followed by EPIC-Soft completion interviews. Both protocols included general and food propensity questionnaires and anthropometric measurements. The protocols were compared using evaluation questionnaires among the participating parents and study personnel. The parents found the questionnaires and instructions for filling in the food diaries understandable. Food description and food quantification was evaluated as problematic by 29 and 15% of the participants for the 3-day diaries versus 15 and 12% for the 1-day diaries. The protocol with 1-day food diaries was evaluated as less burdensome by the parents and logistically more challenging by the interviewers. Both dietary assessment methods with related tools and administration protocols were evaluated as feasible. The administration protocol with two 1-day food diaries with completion interviews offers more advantages for the future pan-European survey in children 0-10 years. The positive evaluation of feasibility of tools and materials is an important step towards harmonised food consumption data at European level among the younger age groups.

A Web-Based Treatment Decision Support Tool for Patients With Advanced Knee Arthritis: Evaluation of User Interface and Content Design

PubMed Central

Zheng, Hua; Rosal, Milagros C; Li, Wenjun; Borg, Amy; Yang, Wenyun; Ayers, David C

2018-01-01

Background Data-driven surgical decisions will ensure proper use and timing of surgical care. We developed a Web-based patient-centered treatment decision and assessment tool to guide treatment decisions among patients with advanced knee osteoarthritis who are considering total knee replacement surgery. Objective The aim of this study was to examine user experience and acceptance of the Web-based treatment decision support tool among older adults. Methods User-centered formative and summative evaluations were conducted for the tool. A sample of 28 patients who were considering total knee replacement participated in the study. Participants’ responses to the user interface design, the clarity of information, as well as usefulness, satisfaction, and acceptance of the tool were collected through qualitative (ie, individual patient interviews) and quantitative (ie, standardized Computer System Usability Questionnaire) methods. Results Participants were older adults with a mean age of 63 (SD 11) years. Three-quarters of them had no technical questions using the tool. User interface design recommendations included larger fonts, bigger buttons, less colors, simpler navigation without extra “next page” click, less mouse movement, and clearer illustrations with simple graphs. Color-coded bar charts and outcome-specific graphs with positive action were easiest for them to understand the outcomes data. Questionnaire data revealed high satisfaction with the tool usefulness and interface quality, and also showed ease of use of the tool, regardless of age or educational status. Conclusions We evaluated the usability of a patient-centered decision support tool designed for advanced knee arthritis patients to facilitate their knee osteoarthritis treatment decision making. The lessons learned can inform other decision support tools to improve interface and content design for older patients’ use. PMID:29712620

Comparison of three methods for evaluation of work postures in a truck assembly plant.

PubMed

Zare, Mohsen; Biau, Sophie; Brunet, Rene; Roquelaure, Yves

2017-11-01

This study compared the results of three risk assessment tools (self-reported questionnaire, observational tool, direct measurement method) for the upper limbs and back in a truck assembly plant at two cycle times (11 and 8 min). The weighted Kappa factor showed fair agreement between the observational and direct measurement method for the arm (0.39) and back (0.47). The weighted Kappa factor for these methods was poor for the neck (0) and wrist (0) but the observed proportional agreement (P o ) was 0.78 for the neck and 0.83 for the wrist. The weighted Kappa factor between questionnaire and direct measurement showed poor or slight agreement (0) for different body segments in both cycle times. The results revealed moderate agreement between the observational tool and the direct measurement method, and poor agreement between the self-reported questionnaire and direct measurement. Practitioner Summary: This study provides risk exposure measurement by different common ergonomic methods in the field. The results help to develop valid measurements and improve exposure evaluation. Hence, the ergonomist/practitioners should apply the methods with caution, or at least knowing what the issues/errors are.

Evaluation of the environmental impact of Brownfield remediation options: comparison of two life cycle assessment-based evaluation tools.

PubMed

Cappuyns, Valérie; Kessen, Bram

2012-01-01

The choice between different options for the remediation of a contaminated site traditionally relies on economical, technical and regulatory criteria without consideration of the environmental impact of the soil remediation process itself. In the present study, the environmental impact assessment of two potential soil remediation techniques (excavation and off-site cleaning and in situ steam extraction) was performed using two life cycle assessment (LCA)-based evaluation tools, namely the REC (risk reduction, environmental merit and cost) method and the ReCiPe method. The comparison and evaluation of the different tools used to estimate the environmental impact of Brownfield remediation was based on a case study which consisted of the remediation of a former oil and fat processing plant. For the environmental impact assessment, both the REC and ReCiPe methods result in a single score for the environmental impact of the soil remediation process and allow the same conclusion to be drawn: excavation and off-site cleaning has a more pronounced environmental impact than in situ soil remediation by means of steam extraction. The ReCiPe method takes into account more impact categories, but is also more complex to work with and needs more input data. Within the routine evaluation of soil remediation alternatives, a detailed LCA evaluation will often be too time consuming and costly and the estimation of the environmental impact with the REC method will in most cases be sufficient. The case study worked out in this paper wants to provide a basis for a more sounded selection of soil remediation technologies based on a more detailed assessment of the secondary impact of soil remediation.

Detection and Phenotypic Characterization of Adult Neurogenesis

PubMed Central

Kuhn, H. Georg; Eisch, Amelia J.; Spalding, Kirsty; Peterson, Daniel A.

2016-01-01

Studies of adult neurogenesis have greatly expanded in the last decade, largely as a result of improved tools for detecting and quantifying neurogenesis. In this review, we summarize and critically evaluate detection methods for neurogenesis in mammalian and human brain tissue. Besides thymidine analog labeling, cell-cycle markers are discussed, as well as cell stage and lineage commitment markers. Use of these histological tools is critically evaluated in terms of their strengths and limitations, as well as possible artifacts. Finally, we discuss the method of radiocarbon dating for determining cell and tissue turnover in humans. PMID:26931327

Comparison of in silico models for prediction of mutagenicity.

PubMed

Bakhtyari, Nazanin G; Raitano, Giuseppa; Benfenati, Emilio; Martin, Todd; Young, Douglas

2013-01-01

Using a dataset with more than 6000 compounds, the performance of eight quantitative structure activity relationships (QSAR) models was evaluated: ACD/Tox Suite, Absorption, Distribution, Metabolism, Elimination, and Toxicity of chemical substances (ADMET) predictor, Derek, Toxicity Estimation Software Tool (T.E.S.T.), TOxicity Prediction by Komputer Assisted Technology (TOPKAT), Toxtree, CEASAR, and SARpy (SAR in python). In general, the results showed a high level of performance. To have a realistic estimate of the predictive ability, the results for chemicals inside and outside the training set for each model were considered. The effect of applicability domain tools (when available) on the prediction accuracy was also evaluated. The predictive tools included QSAR models, knowledge-based systems, and a combination of both methods. Models based on statistical QSAR methods gave better results.

Bayesian cross-validation for model evaluation and selection, with application to the North American Breeding Bird Survey

USGS Publications Warehouse

Link, William; Sauer, John R.

2016-01-01

The analysis of ecological data has changed in two important ways over the last 15 years. The development and easy availability of Bayesian computational methods has allowed and encouraged the fitting of complex hierarchical models. At the same time, there has been increasing emphasis on acknowledging and accounting for model uncertainty. Unfortunately, the ability to fit complex models has outstripped the development of tools for model selection and model evaluation: familiar model selection tools such as Akaike's information criterion and the deviance information criterion are widely known to be inadequate for hierarchical models. In addition, little attention has been paid to the evaluation of model adequacy in context of hierarchical modeling, i.e., to the evaluation of fit for a single model. In this paper, we describe Bayesian cross-validation, which provides tools for model selection and evaluation. We describe the Bayesian predictive information criterion and a Bayesian approximation to the BPIC known as the Watanabe-Akaike information criterion. We illustrate the use of these tools for model selection, and the use of Bayesian cross-validation as a tool for model evaluation, using three large data sets from the North American Breeding Bird Survey.

A Simplified Decision Support Approach for Evaluating Wetlands Ecosystem Services NABS11

EPA Science Inventory

State-level managers and environmental advocates often must justify their restoration actions in terms of tangible beneficial outcomes. Wetlands functional assessment tools (e.g, Wetland Evaluation Technique (WET), Habitat Evaluation Procedures (HEP), Hydrogeomorphic Method (HGM)...

On-line Tools for Assessing Petroleum Releases

EPA Science Inventory

The Internet tools described in this report provide methods and models for evaluation of contaminated sites. Two problems are addressed by models. The first is the placement of wells for correct delineation of contaminant plumes. Because aquifer recharge can displace plumes dow...

METAL FINISHING FACILITY POLLUTION PREVENTION TOOL (MFFPPT)

EPA Science Inventory

The Metal Finishing Facility Pollution Tool (MFFPPT) is being developed to allow the metal finishing industry an easy method to evaluate potential pollution prevention options. In order to reduce the quantity of pollutants generated by a process, the sources of pollutants within ...

An Integrated Approach of Fuzzy Linguistic Preference Based AHP and Fuzzy COPRAS for Machine Tool Evaluation

PubMed Central

Nguyen, Huu-Tho; Md Dawal, Siti Zawiah; Nukman, Yusoff; Aoyama, Hideki; Case, Keith

2015-01-01

Globalization of business and competitiveness in manufacturing has forced companies to improve their manufacturing facilities to respond to market requirements. Machine tool evaluation involves an essential decision using imprecise and vague information, and plays a major role to improve the productivity and flexibility in manufacturing. The aim of this study is to present an integrated approach for decision-making in machine tool selection. This paper is focused on the integration of a consistent fuzzy AHP (Analytic Hierarchy Process) and a fuzzy COmplex PRoportional ASsessment (COPRAS) for multi-attribute decision-making in selecting the most suitable machine tool. In this method, the fuzzy linguistic reference relation is integrated into AHP to handle the imprecise and vague information, and to simplify the data collection for the pair-wise comparison matrix of the AHP which determines the weights of attributes. The output of the fuzzy AHP is imported into the fuzzy COPRAS method for ranking alternatives through the closeness coefficient. Presentation of the proposed model application is provided by a numerical example based on the collection of data by questionnaire and from the literature. The results highlight the integration of the improved fuzzy AHP and the fuzzy COPRAS as a precise tool and provide effective multi-attribute decision-making for evaluating the machine tool in the uncertain environment. PMID:26368541

A combination of HPLC and automated data analysis for monitoring the efficiency of high-pressure homogenization.

PubMed

Eggenreich, Britta; Rajamanickam, Vignesh; Wurm, David Johannes; Fricke, Jens; Herwig, Christoph; Spadiut, Oliver

2017-08-01

Cell disruption is a key unit operation to make valuable, intracellular target products accessible for further downstream unit operations. Independent of the applied cell disruption method, each cell disruption process must be evaluated with respect to disruption efficiency and potential product loss. Current state-of-the-art methods, like measuring the total amount of released protein and plating-out assays, are usually time-delayed and involve manual intervention making them error-prone. An automated method to monitor cell disruption efficiency at-line is not available to date. In the current study we implemented a methodology, which we had originally developed to monitor E. coli cell integrity during bioreactor cultivations, to automatically monitor and evaluate cell disruption of a recombinant E. coli strain by high-pressure homogenization. We compared our tool with a library of state-of-the-art methods, analyzed the effect of freezing the biomass before high-pressure homogenization and finally investigated this unit operation in more detail by a multivariate approach. A combination of HPLC and automated data analysis describes a valuable, novel tool to monitor and evaluate cell disruption processes. Our methodology, which can be used both in upstream (USP) and downstream processing (DSP), describes a valuable tool to evaluate cell disruption processes as it can be implemented at-line, gives results within minutes after sampling and does not need manual intervention.

Systematic Review of the Properties of Tools Used to Measure Outcomes in Anxiety Intervention Studies for Children with Autism Spectrum Disorders

PubMed Central

Wigham, Sarah; McConachie, Helen

2014-01-01

Background Evidence about relevant outcomes is required in the evaluation of clinical interventions for children with autism spectrum disorders (ASD). However, to date, the variety of outcome measurement tools being used, and lack of knowledge about the measurement properties of some, compromise conclusions regarding the most effective interventions. Objectives This two-stage systematic review aimed to identify the tools used in studies evaluating interventions for anxiety for high-functioning children with ASD in middle childhood, and then to evaluate the tools for their appropriateness and measurement properties. Methods Electronic databases including Medline, PsychInfo, Embase, and the Cochrane database and registers were searched for anxiety intervention studies for children with ASD in middle childhood. Articles examining the measurement properties of the tools used were then searched for using a methodological filter in PubMed, and the quality of the papers evaluated using the COSMIN checklist. Results Ten intervention studies were identified in which six tools measuring anxiety and one of overall symptom change were used as primary outcomes. One further tool was included as it is recommended for standard use in UK children's mental health services. Sixty three articles on the properties of the tools were evaluated for the quality of evidence, and the quality of the measurement properties of each tool was summarised. Conclusions Overall three questionnaires were found robust in their measurement properties, the Spence Children's Anxiety Scale, its revised version – the Revised Children's Anxiety and Depression Scale, and also the Screen for Child Anxiety Related Emotional Disorders. Crucially the articles on measurement properties provided almost no evidence on responsiveness to change, nor on the validity of use of the tools for evaluation of interventions for children with ASD. PROSPERO Registration number CRD42012002684. PMID:24465519

An open tool for input function estimation and quantification of dynamic PET FDG brain scans.

PubMed

Bertrán, Martín; Martínez, Natalia; Carbajal, Guillermo; Fernández, Alicia; Gómez, Álvaro

2016-08-01

Positron emission tomography (PET) analysis of clinical studies is mostly restricted to qualitative evaluation. Quantitative analysis of PET studies is highly desirable to be able to compute an objective measurement of the process of interest in order to evaluate treatment response and/or compare patient data. But implementation of quantitative analysis generally requires the determination of the input function: the arterial blood or plasma activity which indicates how much tracer is available for uptake in the brain. The purpose of our work was to share with the community an open software tool that can assist in the estimation of this input function, and the derivation of a quantitative map from the dynamic PET study. Arterial blood sampling during the PET study is the gold standard method to get the input function, but is uncomfortable and risky for the patient so it is rarely used in routine studies. To overcome the lack of a direct input function, different alternatives have been devised and are available in the literature. These alternatives derive the input function from the PET image itself (image-derived input function) or from data gathered from previous similar studies (population-based input function). In this article, we present ongoing work that includes the development of a software tool that integrates several methods with novel strategies for the segmentation of blood pools and parameter estimation. The tool is available as an extension to the 3D Slicer software. Tests on phantoms were conducted in order to validate the implemented methods. We evaluated the segmentation algorithms over a range of acquisition conditions and vasculature size. Input function estimation algorithms were evaluated against ground truth of the phantoms, as well as on their impact over the final quantification map. End-to-end use of the tool yields quantification maps with [Formula: see text] relative error in the estimated influx versus ground truth on phantoms. The main contribution of this article is the development of an open-source, free to use tool that encapsulates several well-known methods for the estimation of the input function and the quantification of dynamic PET FDG studies. Some alternative strategies are also proposed and implemented in the tool for the segmentation of blood pools and parameter estimation. The tool was tested on phantoms with encouraging results that suggest that even bloodless estimators could provide a viable alternative to blood sampling for quantification using graphical analysis. The open tool is a promising opportunity for collaboration among investigators and further validation on real studies.

Fast algorithms for Quadrature by Expansion I: Globally valid expansions

NASA Astrophysics Data System (ADS)

Rachh, Manas; Klöckner, Andreas; O'Neil, Michael

2017-09-01

The use of integral equation methods for the efficient numerical solution of PDE boundary value problems requires two main tools: quadrature rules for the evaluation of layer potential integral operators with singular kernels, and fast algorithms for solving the resulting dense linear systems. Classically, these tools were developed separately. In this work, we present a unified numerical scheme based on coupling Quadrature by Expansion, a recent quadrature method, to a customized Fast Multipole Method (FMM) for the Helmholtz equation in two dimensions. The method allows the evaluation of layer potentials in linear-time complexity, anywhere in space, with a uniform, user-chosen level of accuracy as a black-box computational method. Providing this capability requires geometric and algorithmic considerations beyond the needs of standard FMMs as well as careful consideration of the accuracy of multipole translations. We illustrate the speed and accuracy of our method with various numerical examples.

Developmental Testing of Habitability and Human Factors Tools and Methods During Neemo 15

NASA Technical Reports Server (NTRS)

Thaxton, S. S.; Litaker, H. L., Jr.; Holden, K. L.; Adolf, J. A.; Pace, J.; Morency, R. M.

2011-01-01

Currently, no established methods exist to collect real-time human factors and habitability data while crewmembers are living aboard the International Space Station (ISS), traveling aboard other space vehicles, or living in remote habitats. Currently, human factors and habitability data regarding space vehicles and habitats are acquired at the end of missions during postflight crew debriefs. These debriefs occur weeks or often longer after events have occurred, which forces a significant reliance on incomplete human memory, which is imperfect. Without a means to collect real-time data, small issues may have a cumulative effect and continue to cause crew frustration and inefficiencies. Without timely and appropriate reporting methodologies, issues may be repeated or lost. TOOL DEVELOPMENT AND EVALUATION: As part of a directed research project (DRP) aiming to develop and validate tools and methods for collecting near real-time human factors and habitability data, a preliminary set of tools and methods was developed. These tools and methods were evaluated during the NASA Extreme Environments Mission Operations (NEEMO) 15 mission in October 2011. Two versions of a software tool were used to collect observational data from NEEMO crewmembers that also used targeted strategies for using video cameras to collect observations. Space habitability observation reporting tool (SHORT) was created based on a tool previously developed by NASA to capture human factors and habitability issues during spaceflight. SHORT uses a web-based interface that allows users to enter a text description of any observations they wish to report and assign a priority level if changes are needed. In addition to the web-based format, a mobile Apple (iOS) format was implemented, referred to as iSHORT. iSHORT allows users to provide text, audio, photograph, and video data to report observations. iSHORT can be deployed on an iPod Touch, iPhone, or iPad; for NEEMO 15, the app was provided on an iPad2.

Advanced Video Analysis Needs for Human Performance Evaluation

NASA Technical Reports Server (NTRS)

Campbell, Paul D.

1994-01-01

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

A dielectric logging tool with insulated collar for formation fluid detection around borehole

NASA Astrophysics Data System (ADS)

Wang, Bin; Li, Kang; Kong, Fan-Min; Zhao, Jia

2015-08-01

A dielectric tool with insulated collar for analyzing fluid saturation outside a borehole was introduced. The UWB (ultra-wideband) antenna mounted on the tool was optimized to launch a transient pulse. The broadband evaluation method provided more advantages when compared with traditional dielectric tools. The EM (electromagnetic) power distribution outside the borehole was studied, and it was shown that energy was propagated in two modes. Furthermore, the mechanism of the modes was discussed. In order to increase this tools' investigation depth, a novel insulated collar was introduced. In addition, operation in difference formations was discussed and this tool proved to be able to efficiently launch lateral EM waves. Response voltages indicated that the proposed scheme was able to evaluate the fluid saturation of reservoir formations and dielectric dispersion properties. It may be used as an alternative tool for imaging logging applications.

Development and Early Piloting of a CanMEDS Competency-Based Feedback Tool for Surgical Grand Rounds.

PubMed

Fahim, Christine; Bhandari, Mohit; Yang, Ilun; Sonnadara, Ranil

2016-01-01

Grand rounds offer an excellent opportunity for the evaluation of medical expertise, and other competencies, such as communication and professionalism. The purpose of this study was to develop a tool that would facilitate the provision of formative feedback for grand rounds to improve learning. The resulting CanMEDS-based evaluation tool was piloted in an academic surgical department. This study employed the use of a 3-phase, qualitatively-focused, embedded mixed methods approach. In Phase 1, an intrinsic case study was conducted to identify preliminary themes. These findings were crystallized using a quantitative survey. Following interpretation of these data, a grand rounds evaluation tool was developed in Phase 2. The tool was piloted in the Phase 3 focus group. This study was piloted at an academic surgical center among members of the Department of Surgery, McMaster University, Ontario, Canada. Purposive sampling was used for this study. A total of n = 7 individuals participated in the Phase 1 interviews, and n = 24 participants completed the Phase 1 survey. Participants included a representative sample of medical students, residents, fellows, and staff. The tool was piloted among n = 19 participants. The proposed evaluation tool contains 13 Likert-scale questions and 2 open-ended questions. The tool outlines specific questions to assess grand rounds presenters within the structure of the 7 CanMEDS competency domains. "Evaluation fatigue" was identified as a major barrier in the willingness to provide effective feedback. Further, a number of factors regarding the preferred content, structure, and format of surgical grand rounds were identified. This pilot study presents a CanMEDS-specific evaluation tool that can be applied to surgical grand rounds. With the increasing adoption of competency-based medical education, comprehensive evaluation of surgical activities is required. This form provides a template for the development of competency-based evaluation tools for medical and surgical learning activities. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Automated benchmarking of peptide-MHC class I binding predictions.

PubMed

Trolle, Thomas; Metushi, Imir G; Greenbaum, Jason A; Kim, Yohan; Sidney, John; Lund, Ole; Sette, Alessandro; Peters, Bjoern; Nielsen, Morten

2015-07-01

Numerous in silico methods predicting peptide binding to major histocompatibility complex (MHC) class I molecules have been developed over the last decades. However, the multitude of available prediction tools makes it non-trivial for the end-user to select which tool to use for a given task. To provide a solid basis on which to compare different prediction tools, we here describe a framework for the automated benchmarking of peptide-MHC class I binding prediction tools. The framework runs weekly benchmarks on data that are newly entered into the Immune Epitope Database (IEDB), giving the public access to frequent, up-to-date performance evaluations of all participating tools. To overcome potential selection bias in the data included in the IEDB, a strategy was implemented that suggests a set of peptides for which different prediction methods give divergent predictions as to their binding capability. Upon experimental binding validation, these peptides entered the benchmark study. The benchmark has run for 15 weeks and includes evaluation of 44 datasets covering 17 MHC alleles and more than 4000 peptide-MHC binding measurements. Inspection of the results allows the end-user to make educated selections between participating tools. Of the four participating servers, NetMHCpan performed the best, followed by ANN, SMM and finally ARB. Up-to-date performance evaluations of each server can be found online at http://tools.iedb.org/auto_bench/mhci/weekly. All prediction tool developers are invited to participate in the benchmark. Sign-up instructions are available at http://tools.iedb.org/auto_bench/mhci/join. mniel@cbs.dtu.dk or bpeters@liai.org Supplementary data are available at Bioinformatics online. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Automated benchmarking of peptide-MHC class I binding predictions

PubMed Central

Trolle, Thomas; Metushi, Imir G.; Greenbaum, Jason A.; Kim, Yohan; Sidney, John; Lund, Ole; Sette, Alessandro; Peters, Bjoern; Nielsen, Morten

2015-01-01

Motivation: Numerous in silico methods predicting peptide binding to major histocompatibility complex (MHC) class I molecules have been developed over the last decades. However, the multitude of available prediction tools makes it non-trivial for the end-user to select which tool to use for a given task. To provide a solid basis on which to compare different prediction tools, we here describe a framework for the automated benchmarking of peptide-MHC class I binding prediction tools. The framework runs weekly benchmarks on data that are newly entered into the Immune Epitope Database (IEDB), giving the public access to frequent, up-to-date performance evaluations of all participating tools. To overcome potential selection bias in the data included in the IEDB, a strategy was implemented that suggests a set of peptides for which different prediction methods give divergent predictions as to their binding capability. Upon experimental binding validation, these peptides entered the benchmark study. Results: The benchmark has run for 15 weeks and includes evaluation of 44 datasets covering 17 MHC alleles and more than 4000 peptide-MHC binding measurements. Inspection of the results allows the end-user to make educated selections between participating tools. Of the four participating servers, NetMHCpan performed the best, followed by ANN, SMM and finally ARB. Availability and implementation: Up-to-date performance evaluations of each server can be found online at http://tools.iedb.org/auto_bench/mhci/weekly. All prediction tool developers are invited to participate in the benchmark. Sign-up instructions are available at http://tools.iedb.org/auto_bench/mhci/join. Contact: mniel@cbs.dtu.dk or bpeters@liai.org Supplementary information: Supplementary data are available at Bioinformatics online. PMID:25717196

Integrate Evaluation into the Planning Process.

ERIC Educational Resources Information Center

Camp, William

1985-01-01

In an attempt to correct for limitations in the Program Evaluation and Review Technique-Critical Path Method (PERT-CPM), the Graphical Evaluation and Review Technique (GERT) has been developed. This management tool allows for evaluation during the facilities' development process. Two figures and two references are provided. (DCS)

Multidisciplinary eHealth Survey Evaluation Methods

ERIC Educational Resources Information Center

Karras, Bryant T.; Tufano, James T.

2006-01-01

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

Evaluation of a Digital Consultation and Self-Care Advice Tool in Primary Care: A Multi-Methods Study

PubMed Central

Bowers, Gillian; Bowers, John

2018-01-01

Digital services are often regarded as a solution to the growing demands on primary care services. Provision of a tool offering advice to support self-management as well as the ability to digitally consult with a General Practitioner (GP) has the potential to alleviate some of the pressure on primary care. This paper reports on a Phase II, 6-month evaluation of eConsult, a web-based triage and consultation system that was piloted across 11 GP practices across Scotland. Through a multi-method approach the evaluation explored eConsult use across practices, exposing both barriers and facilitators to its adoption. Findings suggest that expectations that eConsult would offer an additional and alternative method of accessing GP services were largely met. However, there is less certainty that it has fulfilled expectations of promoting self-help. In addition, low uptake meant that evaluation of current effectiveness was difficult for practices to quantify. The presence of an eConsult champion(s) within the practice was seen to be a significant factor in ensuring successful integration of the tool. A lack of patient and staff engagement, insufficient support and lack of protocols around processes were seen as barriers to its success. PMID:29724040

Evaluation of a simple method for the automatic assignment of MeSH descriptors to health resources in a French online catalogue.

PubMed

Névéol, Aurélie; Pereira, Suzanne; Kerdelhué, Gaetan; Dahamna, Badisse; Joubert, Michel; Darmoni, Stéfan J

2007-01-01

The growing number of resources to be indexed in the catalogue of online health resources in French (CISMeF) calls for curating strategies involving automatic indexing tools while maintaining the catalogue's high indexing quality standards. To develop a simple automatic tool that retrieves MeSH descriptors from documents titles. In parallel to research on advanced indexing methods, a bag-of-words tool was developed for timely inclusion in CISMeF's maintenance system. An evaluation was carried out on a corpus of 99 documents. The indexing sets retrieved by the automatic tool were compared to manual indexing based on the title and on the full text of resources. 58% of the major main headings were retrieved by the bag-of-words algorithm and the precision on main heading retrieval was 69%. Bag-of-words indexing has effectively been used on selected resources to be included in CISMeF since August 2006. Meanwhile, on going work aims at improving the current version of the tool.

A novel, image analysis-based method for the evaluation of in vitro antagonism.

PubMed

Szekeres, András; Leitgeb, Balázs; Kredics, László; Manczinger, László; Vágvölgyi, Csaba

2006-06-01

A novel method is proposed for the accurate evaluation of in vitro antagonism. Based on the measurement of areas of the fungal colonies, biocontrol indices were calculated, which are characteristic to the antagonistic Trichoderma strains. These indices provide a useful tool to describe the biocontrol abilities of fungi.

Improving Reference Service: The Case for Using a Continuous Quality Improvement Method.

ERIC Educational Resources Information Center

Aluri, Rao

1993-01-01

Discusses the evaluation of library reference service; examines problems with past evaluations, including the lack of long-term planning and a systems perspective; and suggests a method for continuously monitoring and improving reference service using quality improvement tools such as checklists, cause and effect diagrams, Pareto charts, and…

Multi-modal virtual environment research at Armstrong Laboratory

NASA Technical Reports Server (NTRS)

Eggleston, Robert G.

1995-01-01

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Performance evaluation of structure based and ligand based virtual screening methods on ten selected anti-cancer targets.

PubMed

Ramasamy, Thilagavathi; Selvam, Chelliah

2015-10-15

Virtual screening has become an important tool in drug discovery process. Structure based and ligand based approaches are generally used in virtual screening process. To date, several benchmark sets for evaluating the performance of the virtual screening tool are available. In this study, our aim is to compare the performance of both structure based and ligand based virtual screening methods. Ten anti-cancer targets and their corresponding benchmark sets from 'Demanding Evaluation Kits for Objective In silico Screening' (DEKOIS) library were selected. X-ray crystal structures of protein-ligand complexes were selected based on their resolution. Openeye tools such as FRED, vROCS were used and the results were carefully analyzed. At EF1%, vROCS produced better results but at EF5% and EF10%, both FRED and ROCS produced almost similar results. It was noticed that the enrichment factor values were decreased while going from EF1% to EF5% and EF10% in many cases. Published by Elsevier Ltd.

QUAST: quality assessment tool for genome assemblies.

PubMed

Gurevich, Alexey; Saveliev, Vladislav; Vyahhi, Nikolay; Tesler, Glenn

2013-04-15

Limitations of genome sequencing techniques have led to dozens of assembly algorithms, none of which is perfect. A number of methods for comparing assemblers have been developed, but none is yet a recognized benchmark. Further, most existing methods for comparing assemblies are only applicable to new assemblies of finished genomes; the problem of evaluating assemblies of previously unsequenced species has not been adequately considered. Here, we present QUAST-a quality assessment tool for evaluating and comparing genome assemblies. This tool improves on leading assembly comparison software with new ideas and quality metrics. QUAST can evaluate assemblies both with a reference genome, as well as without a reference. QUAST produces many reports, summary tables and plots to help scientists in their research and in their publications. In this study, we used QUAST to compare several genome assemblers on three datasets. QUAST tables and plots for all of them are available in the Supplementary Material, and interactive versions of these reports are on the QUAST website. http://bioinf.spbau.ru/quast . Supplementary data are available at Bioinformatics online.

Evaluation of nursing faculty through observation.

PubMed

Crawford, L H

1998-10-01

The purpose of this study was to assess current use and faculty perceptions of classroom observation as a method of faculty evaluation in schools of nursing. Baccalaureate schools of nursing were surveyed to determine current use of classroom observation and its worth from the perception of administrators and faculty. Although most schools used classroom observation as a method of faculty evaluation, further clarification and research is needed in the following areas: purpose of classroom observation; number of observations necessary; weight given to classroom observation in relation to other evaluation methods; and tools used.

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

Usage-Based Collection Evaluation with a Curricular Focus

ERIC Educational Resources Information Center

Kohn, Karen C.

2013-01-01

Systematic evaluation of a library's collection can be a useful tool for collection development. After reviewing three evaluation methods and their usefulness for our small academic library, I undertook a usage-based evaluation, focusing on narrow segments of our collection that served specific undergraduate courses. For each section, I collected…

Building clinical networks: a developmental evaluation framework.

PubMed

Carswell, Peter; Manning, Benjamin; Long, Janet; Braithwaite, Jeffrey

2014-05-01

Clinical networks have been designed as a cross-organisational mechanism to plan and deliver health services. With recent concerns about the effectiveness of these structures, it is timely to consider an evidence-informed approach for how they can be developed and evaluated. To document an evaluation framework for clinical networks by drawing on the network evaluation literature and a 5-year study of clinical networks. We searched literature in three domains: network evaluation, factors that aid or inhibit network development, and on robust methods to measure network characteristics. This material was used to build a framework required for effective developmental evaluation. The framework's architecture identifies three stages of clinical network development; partner selection, network design and network management. Within each stage is evidence about factors that act as facilitators and barriers to network growth. These factors can be used to measure progress via appropriate methods and tools. The framework can provide for network growth and support informed decisions about progress. For the first time in one place a framework incorporating rigorous methods and tools can identify factors known to affect the development of clinical networks. The target user group is internal stakeholders who need to conduct developmental evaluation to inform key decisions along their network's developmental pathway.

Assessing resident's knowledge and communication skills using four different evaluation tools.

PubMed

Nuovo, Jim; Bertakis, Klea D; Azari, Rahman

2006-07-01

This study assesses the relationship between 4 Accreditation Council for Graduate Medical Education (ACGME) outcome project measures for interpersonal and communication skills and medical knowledge; specifically, monthly performance evaluations, objective structured clinical examinations (OSCEs), the American Board of Family Practice in-training examination (ABFP-ITE) and the Davis observation code (DOC) practice style profiles. Based on previous work, we have DOC scoring for 29 residents from the University of California, Davis Department of Family and Community Medicine. For all these residents we also had the results of monthly performance evaluations, 2 required OSCE exercises, and the results of 3 American Board of Family Medicine (ABFM) ITEs. Data for each of these measures were abstracted for each resident. The Pearson correlation coefficient was used to assess the presence or lack of correlation between each of these evaluation methods. There is little correlation between various evaluation methods used to assess medical knowledge, and there is also little correlation between various evaluation methods used to assess communication skills. The outcome project remains a 'work in progress', with the need for larger studies to assess the value of different assessment measures of resident competence. It is unlikely that DOC will become a useful evaluation tool.

A multicenter study benchmarks software tools for label-free proteome quantification.

PubMed

Navarro, Pedro; Kuharev, Jörg; Gillet, Ludovic C; Bernhardt, Oliver M; MacLean, Brendan; Röst, Hannes L; Tate, Stephen A; Tsou, Chih-Chiang; Reiter, Lukas; Distler, Ute; Rosenberger, George; Perez-Riverol, Yasset; Nesvizhskii, Alexey I; Aebersold, Ruedi; Tenzer, Stefan

2016-11-01

Consistent and accurate quantification of proteins by mass spectrometry (MS)-based proteomics depends on the performance of instruments, acquisition methods and data analysis software. In collaboration with the software developers, we evaluated OpenSWATH, SWATH 2.0, Skyline, Spectronaut and DIA-Umpire, five of the most widely used software methods for processing data from sequential window acquisition of all theoretical fragment-ion spectra (SWATH)-MS, which uses data-independent acquisition (DIA) for label-free protein quantification. We analyzed high-complexity test data sets from hybrid proteome samples of defined quantitative composition acquired on two different MS instruments using different SWATH isolation-window setups. For consistent evaluation, we developed LFQbench, an R package, to calculate metrics of precision and accuracy in label-free quantitative MS and report the identification performance, robustness and specificity of each software tool. Our reference data sets enabled developers to improve their software tools. After optimization, all tools provided highly convergent identification and reliable quantification performance, underscoring their robustness for label-free quantitative proteomics.

Deterministic and fuzzy-based methods to evaluate community resilience

NASA Astrophysics Data System (ADS)

Kammouh, Omar; Noori, Ali Zamani; Taurino, Veronica; Mahin, Stephen A.; Cimellaro, Gian Paolo

2018-04-01

Community resilience is becoming a growing concern for authorities and decision makers. This paper introduces two indicator-based methods to evaluate the resilience of communities based on the PEOPLES framework. PEOPLES is a multi-layered framework that defines community resilience using seven dimensions. Each of the dimensions is described through a set of resilience indicators collected from literature and they are linked to a measure allowing the analytical computation of the indicator's performance. The first method proposed in this paper requires data on previous disasters as an input and returns as output a performance function for each indicator and a performance function for the whole community. The second method exploits a knowledge-based fuzzy modeling for its implementation. This method allows a quantitative evaluation of the PEOPLES indicators using descriptive knowledge rather than deterministic data including the uncertainty involved in the analysis. The output of the fuzzy-based method is a resilience index for each indicator as well as a resilience index for the community. The paper also introduces an open source online tool in which the first method is implemented. A case study illustrating the application of the first method and the usage of the tool is also provided in the paper.

In vivo assessment of the effect of taxifolin glycoside on atopic dermatitis-like skin lesions using biomedical tools in NC/Nga mice.

PubMed

Kim, J Y; Lee, O S; Ha, S; Kim, J H; Park, G; Kim, J K; Oh, C H

2015-07-01

Noninvasive methods of assessment are widely used in clinical trials. However, such methods have not been established in atopic dermatitis (AD), which is a chronic inflammatory skin disease. To demonstrate, using biomedical tools, the benefits of a new substance, taxifolin glycoside (TAX), in an AD model, the NC/Nga mouse. We evaluated the efficacy of topical TAX for AD by measuring clinical skin severity score, cytokine expression and serum IgE level, and by using biomedical measures (vapometry and corneometry). Topical TAX was applied to AD-induced NC/Nga mice for 3 weeks. The anti-inflammatory effects of this compound were demonstrated noninvasively using biomedical tools and immunological assays. Our method of AD assessment using biomedical tools is more objective and accurate than visual inspection. The results obtained using the biomedical tools were identical to those obtained using immunological assays. In vivo biomedical tools are useful for diagnosing and monitoring treatment effects in AD. © 2014 British Association of Dermatologists.

Development of an Adaptable Display and Diagnostic System for the Evaluation of Tropical Cyclone Forecasts

NASA Astrophysics Data System (ADS)

Kucera, P. A.; Burek, T.; Halley-Gotway, J.

2015-12-01

NCAR's Joint Numerical Testbed Program (JNTP) focuses on the evaluation of experimental forecasts of tropical cyclones (TCs) with the goal of developing new research tools and diagnostic evaluation methods that can be transitioned to operations. Recent activities include the development of new TC forecast verification methods and the development of an adaptable TC display and diagnostic system. The next generation display and diagnostic system is being developed to support evaluation needs of the U.S. National Hurricane Center (NHC) and broader TC research community. The new hurricane display and diagnostic capabilities allow forecasters and research scientists to more deeply examine the performance of operational and experimental models. The system is built upon modern and flexible technology that includes OpenLayers Mapping tools that are platform independent. The forecast track and intensity along with associated observed track information are stored in an efficient MySQL database. The system provides easy-to-use interactive display system, and provides diagnostic tools to examine forecast track stratified by intensity. Consensus forecasts can be computed and displayed interactively. The system is designed to display information for both real-time and for historical TC cyclones. The display configurations are easily adaptable to meet the needs of the end-user preferences. Ongoing enhancements include improving capabilities for stratification and evaluation of historical best tracks, development and implementation of additional methods to stratify and compute consensus hurricane track and intensity forecasts, and improved graphical display tools. The display is also being enhanced to incorporate gridded forecast, satellite, and sea surface temperature fields. The presentation will provide an overview of the display and diagnostic system development and demonstration of the current capabilities.

Comparing the performance of biomedical clustering methods.

PubMed

Wiwie, Christian; Baumbach, Jan; Röttger, Richard

2015-11-01

Identifying groups of similar objects is a popular first step in biomedical data analysis, but it is error-prone and impossible to perform manually. Many computational methods have been developed to tackle this problem. Here we assessed 13 well-known methods using 24 data sets ranging from gene expression to protein domains. Performance was judged on the basis of 13 common cluster validity indices. We developed a clustering analysis platform, ClustEval (http://clusteval.mpi-inf.mpg.de), to promote streamlined evaluation, comparison and reproducibility of clustering results in the future. This allowed us to objectively evaluate the performance of all tools on all data sets with up to 1,000 different parameter sets each, resulting in a total of more than 4 million calculated cluster validity indices. We observed that there was no universal best performer, but on the basis of this wide-ranging comparison we were able to develop a short guideline for biomedical clustering tasks. ClustEval allows biomedical researchers to pick the appropriate tool for their data type and allows method developers to compare their tool to the state of the art.

A Model of Risk Analysis in Analytical Methodology for Biopharmaceutical Quality Control.

PubMed

Andrade, Cleyton Lage; Herrera, Miguel Angel De La O; Lemes, Elezer Monte Blanco

2018-01-01

One key quality control parameter for biopharmaceutical products is the analysis of residual cellular DNA. To determine small amounts of DNA (around 100 pg) that may be in a biologically derived drug substance, an analytical method should be sensitive, robust, reliable, and accurate. In principle, three techniques have the ability to measure residual cellular DNA: radioactive dot-blot, a type of hybridization; threshold analysis; and quantitative polymerase chain reaction. Quality risk management is a systematic process for evaluating, controlling, and reporting of risks that may affects method capabilities and supports a scientific and practical approach to decision making. This paper evaluates, by quality risk management, an alternative approach to assessing the performance risks associated with quality control methods used with biopharmaceuticals, using the tool hazard analysis and critical control points. This tool provides the possibility to find the steps in an analytical procedure with higher impact on method performance. By applying these principles to DNA analysis methods, we conclude that the radioactive dot-blot assay has the largest number of critical control points, followed by quantitative polymerase chain reaction, and threshold analysis. From the analysis of hazards (i.e., points of method failure) and the associated method procedure critical control points, we conclude that the analytical methodology with the lowest risk for performance failure for residual cellular DNA testing is quantitative polymerase chain reaction. LAY ABSTRACT: In order to mitigate the risk of adverse events by residual cellular DNA that is not completely cleared from downstream production processes, regulatory agencies have required the industry to guarantee a very low level of DNA in biologically derived pharmaceutical products. The technique historically used was radioactive blot hybridization. However, the technique is a challenging method to implement in a quality control laboratory: It is laborious, time consuming, semi-quantitative, and requires a radioisotope. Along with dot-blot hybridization, two alternatives techniques were evaluated: threshold analysis and quantitative polymerase chain reaction. Quality risk management tools were applied to compare the techniques, taking into account the uncertainties, the possibility of circumstances or future events, and their effects upon method performance. By illustrating the application of these tools with DNA methods, we provide an example of how they can be used to support a scientific and practical approach to decision making and can assess and manage method performance risk using such tools. This paper discusses, considering the principles of quality risk management, an additional approach to the development and selection of analytical quality control methods using the risk analysis tool hazard analysis and critical control points. This tool provides the possibility to find the method procedural steps with higher impact on method reliability (called critical control points). Our model concluded that the radioactive dot-blot assay has the larger number of critical control points, followed by quantitative polymerase chain reaction and threshold analysis. Quantitative polymerase chain reaction is shown to be the better alternative analytical methodology in residual cellular DNA analysis. © PDA, Inc. 2018.

On the question of economic efficiency and how to assess it

NASA Astrophysics Data System (ADS)

Petrosyan, M. O.; Kovalev, I. V.; Zelenkov, P. V.; Chuvashova, M. N.; Grishina, I. A.; Pershakova, K. K.

2016-04-01

Over the years, since the world moved to a system of market-based economic relations scientists and businessmen worldwide wonder how to ease and modernize the process of analyzing business performance. During this time, a variety of methods and tools have been developed to deal with this problem. After all, the productivity of the company is directly related to it’s competitive qualities, so the managers are interested in the quality of evaluation of their companies. The article deals with the traditional methods of evaluating the performance of enterprises and some of the tools used in order to improve its quality.

Transformative, Mixed Methods Checklist for Psychological Research with Mexican Americans

ERIC Educational Resources Information Center

Canales, Genevieve

2013-01-01

This is a description of the creation of a research methods tool, the "Transformative, Mixed Methods Checklist for Psychological Research With Mexican Americans." For conducting literature reviews of and planning mixed methods studies with Mexican Americans, it contains evaluative criteria calling for transformative mixed methods, perspectives…

Decision tools in health care: focus on the problem, not the solution.

PubMed

Liu, Joseph; Wyatt, Jeremy C; Altman, Douglas G

2006-01-20

Systematic reviews or randomised-controlled trials usually help to establish the effectiveness of drugs and other health technologies, but are rarely sufficient by themselves to ensure actual clinical use of the technology. The process from innovation to routine clinical use is complex. Numerous computerised decision support systems (DSS) have been developed, but many fail to be taken up into actual use. Some developers construct technologically advanced systems with little relevance to the real world. Others did not determine whether a clinical need exists. With NHS investing 5 billion pounds sterling in computer systems, also occurring in other countries, there is an urgent need to shift from a technology-driven approach to one that identifies and employs the most cost-effective method to manage knowledge, regardless of the technology. The generic term, 'decision tool' (DT), is therefore suggested to demonstrate that these aids, which seem different technically, are conceptually the same from a clinical viewpoint. Many computerised DSSs failed for various reasons, for example, they were not based on best available knowledge; there was insufficient emphasis on their need for high quality clinical data; their development was technology-led; or evaluation methods were misapplied. We argue that DSSs and other computer-based, paper-based and even mechanical decision aids are members of a wider family of decision tools. A DT is an active knowledge resource that uses patient data to generate case specific advice, which supports decision making about individual patients by health professionals, the patients themselves or others concerned about them. The identification of DTs as a consistent and important category of health technology should encourage the sharing of lessons between DT developers and users and reduce the frequency of decision tool projects focusing only on technology. The focus of evaluation should become more clinical, with the impact of computer-based DTs being evaluated against other computer, paper- or mechanical tools, to identify the most cost effective tool for each clinical problem. We suggested the generic term 'decision tool' to demonstrate that decision-making aids, such as computerised DSSs, paper algorithms, and reminders are conceptually the same, so the methods to evaluate them should be the same.

Comparative study of coated and uncoated tool inserts with dry machining of EN47 steel using Taguchi L9 optimization technique

NASA Astrophysics Data System (ADS)

Vasu, M.; Shivananda, Nayaka H.

2018-04-01

EN47 steel samples are machined on a self-centered lathe using Chemical Vapor Deposition of coated TiCN/Al2O3/TiN and uncoated tungsten carbide tool inserts, with nose radius 0.8mm. Results are compared with each other and optimized using statistical tool. Input (cutting) parameters that are considered in this work are feed rate (f), cutting speed (Vc), and depth of cut (ap), the optimization criteria are based on the Taguchi (L9) orthogonal array. ANOVA method is adopted to evaluate the statistical significance and also percentage contribution for each model. Multiple response characteristics namely cutting force (Fz), tool tip temperature (T) and surface roughness (Ra) are evaluated. The results discovered that coated tool insert (TiCN/Al2O3/TiN) exhibits 1.27 and 1.29 times better than the uncoated tool insert for tool tip temperature and surface roughness respectively. A slight increase in cutting force was observed for coated tools.

Analysis on design and optimization of dispersion-managed communication systems

NASA Astrophysics Data System (ADS)

El-Aasser, Mostafa A.; Dua, Puneit; Dutta, Niloy K.

2002-07-01

The variational method is a useful tool that can be used for design and optimization of dispersion-managed communication systems. Using this powerful tool, we evaluate the characteristics of a carrier signal for certain system parameters and describe several features of a dispersion-managed soliton.

[Blended-learning in psychosomatics and psychotherapy - Increasing the satisfaction and knowledge of students with a web-based e-learning tool].

PubMed

Ferber, Julia; Schneider, Gudrun; Havlik, Linda; Heuft, Gereon; Friederichs, Hendrik; Schrewe, Franz-Bernhard; Schulz-Steinel, Andrea; Burgmer, Markus

2014-01-01

To improve the synergy of established methods of teaching, the Department of Psychosomatics and Psychotherapy, University Hospital Münster, developed a web-based elearning tool using video clips of standardized patients. The effect of this blended-learning approach was evaluated. A multiple-choice test was performed by a naive (without the e-learning tool) and an experimental (with the tool) cohort of medical students to test the groups' expertise in psychosomatics. In addition, participants' satisfaction with the new tool was evaluated (numeric rating scale of 0-10). The experimental cohort was more satisfied with the curriculum and more interested in psychosomatics. Furthermore, the experimental cohort scored significantly better in the multiple-choice test. The new tool proved to be an important addition to the classical curriculum as a blended-learning approach which improves students' satisfaction and knowledge in psychosomatics.

New Automotive Air Conditioning System Simulation Tool Developed in MATLAB/Simulink

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kiss, T.; Chaney, L.; Meyer, J.

Further improvements in vehicle fuel efficiency require accurate evaluation of the vehicle's transient total power requirement. When operated, the air conditioning (A/C) system is the largest auxiliary load on a vehicle; therefore, accurate evaluation of the load it places on the vehicle's engine and/or energy storage system is especially important. Vehicle simulation software, such as 'Autonomie,' has been used by OEMs to evaluate vehicles' energy performance. A transient A/C simulation tool incorporated into vehicle simulation models would also provide a tool for developing more efficient A/C systems through a thorough consideration of the transient A/C system performance. The dynamic systemmore » simulation software Matlab/Simulink was used to develop new and more efficient vehicle energy system controls. The various modeling methods used for the new simulation tool are described in detail. Comparison with measured data is provided to demonstrate the validity of the model.« less

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

Evaluation of three methods for retrospective correction of vignetting on medical microscopy images utilizing two open source software tools.

PubMed

Babaloukas, Georgios; Tentolouris, Nicholas; Liatis, Stavros; Sklavounou, Alexandra; Perrea, Despoina

2011-12-01

Correction of vignetting on images obtained by a digital camera mounted on a microscope is essential before applying image analysis. The aim of this study is to evaluate three methods for retrospective correction of vignetting on medical microscopy images and compare them with a prospective correction method. One digital image from four different tissues was used and a vignetting effect was applied on each of these images. The resulted vignetted image was replicated four times and in each replica a different method for vignetting correction was applied with fiji and gimp software tools. The highest peak signal-to-noise ratio from the comparison of each method to the original image was obtained from the prospective method in all tissues. The morphological filtering method provided the highest peak signal-to-noise ratio value amongst the retrospective methods. The prospective method is suggested as the method of choice for correction of vignetting and if it is not applicable, then the morphological filtering may be suggested as the retrospective alternative method. © 2011 The Authors Journal of Microscopy © 2011 Royal Microscopical Society.

Recommendations following a multi-laboratory comparison of microbial source tracking methods

EPA Science Inventory

Microbial source tracking (MST) methods are under development to provide resource managers with tools to identify sources of fecal contamination in water. Some of the most promising methods currently under development were recently evaluated in the Source Identification Protocol ...

Performance evaluation of infrared imaging system in field test

NASA Astrophysics Data System (ADS)

Wang, Chensheng; Guo, Xiaodong; Ren, Tingting; Zhang, Zhi-jie

2014-11-01

Infrared imaging system has been applied widely in both military and civilian fields. Since the infrared imager has various types and different parameters, for system manufacturers and customers, there is great demand for evaluating the performance of IR imaging systems with a standard tool or platform. Since the first generation IR imager was developed, the standard method to assess the performance has been the MRTD or related improved methods which are not perfect adaptable for current linear scanning imager or 2D staring imager based on FPA detector. For this problem, this paper describes an evaluation method based on the triangular orientation discrimination metric which is considered as the effective and emerging method to evaluate the synthesis performance of EO system. To realize the evaluation in field test, an experiment instrument is developed. And considering the importance of operational environment, the field test is carried in practical atmospheric environment. The test imagers include panoramic imaging system and staring imaging systems with different optics and detectors parameters (both cooled and uncooled). After showing the instrument and experiment setup, the experiment results are shown. The target range performance is analyzed and discussed. In data analysis part, the article gives the range prediction values obtained from TOD method, MRTD method and practical experiment, and shows the analysis and results discussion. The experimental results prove the effectiveness of this evaluation tool, and it can be taken as a platform to give the uniform performance prediction reference.

Assessment Tools for Evaluation of Oral Feeding in Infants Younger Than 6 Months.

PubMed

Pados, Britt F; Park, Jinhee; Estrem, Hayley; Awotwi, Araba

2016-04-01

Feeding difficulty is common in infants younger than 6 months. Identification of infants in need of specialized treatment is critical to ensure appropriate nutrition and feeding skill development. Valid and reliable assessment tools help clinicians objectively evaluate feeding. To identify and evaluate assessment tools available for clinical assessment of bottle- and breastfeeding in infants younger than 6 months. CINAHL, HaPI, PubMed, and Web of Science were searched for "infant feeding" and "assessment tool." The literature (n = 237) was reviewed for relevant assessment tools. A secondary search was conducted in CINAHL and PubMed for additional literature on identified tools. Eighteen assessment tools met inclusion criteria. Of these, 7 were excluded because of limited available literature or because they were intended for use with a specific diagnosis or in research only. There are 11 assessment tools available for clinical practice. Only 2 of these were intended for bottle-feeding. All 11 indicated that they were appropriate for use with breastfeeding. None of the available tools have adequate psychometric development and testing. All of the tools should be used with caution. The Early Feeding Skills Assessment and Bristol Breastfeeding Assessment Tool had the most supportive psychometric development and testing. Feeding assessment tools need to be developed and tested to guide optimal clinical care of infants from birth through 6 months. A tool that assesses both bottle- and breastfeeding would allow for consistent assessment across feeding methods.

The Personnel Effectiveness Grid (PEG): A New Tool for Estimating Personnel Department Effectiveness

ERIC Educational Resources Information Center

Petersen, Donald J.; Malone, Robert L.

1975-01-01

Examines the difficulties inherent in attempting a formal personnel evaluation system, the major formal methods currently used for evaluating personnel department accountabilities, some parameters that should be part of a valid evaluation program, and a model for conducting the evaluation. (Available from Office of Publications, Graduate School of…

Evaluating the Diagnostic Validity of a Facet-Based Formative Assessment System

ERIC Educational Resources Information Center

DeBarger, Angela Haydel; DiBello, Louis; Minstrell, Jim; Feng, Mingyu; Stout, William; Pellegrino, James; Haertel, Geneva; Harris, Christopher; Ructinger, Liliana

2011-01-01

This paper describes methods for an alignment study and psychometric analyses of a formative assessment system, Diagnoser Tools for physics. Diagnoser Tools begin with facet clusters as the interpretive framework for designing questions and instructional activities. Thus each question in the diagnostic assessments includes distractors that…

Assessment of optional sediment transport functions via the complex watershed simulation model SWAT

USDA-ARS?s Scientific Manuscript database

The Soil and Water Assessment Tool 2012 (SWAT2012) offers four sediment routing methods as optional alternatives to the default simplified Bagnold method. Previous studies compared only one of these alternative sediment routing methods with the default method. The proposed study evaluated the impac...

Developing tools for the safety specification in risk management plans: lessons learned from a pilot project.

PubMed

Cooper, Andrew J P; Lettis, Sally; Chapman, Charlotte L; Evans, Stephen J W; Waller, Patrick C; Shakir, Saad; Payvandi, Nassrin; Murray, Alison B

2008-05-01

Following the adoption of the ICH E2E guideline, risk management plans (RMP) defining the cumulative safety experience and identifying limitations in safety information are now required for marketing authorisation applications (MAA). A collaborative research project was conducted to gain experience with tools for presenting and evaluating data in the safety specification. This paper presents those tools found to be useful and the lessons learned from their use. Archive data from a successful MAA were utilised. Methods were assessed for demonstrating the extent of clinical safety experience, evaluating the sensitivity of the clinical trial data to detect treatment differences and identifying safety signals from adverse event and laboratory data to define the extent of safety knowledge with the drug. The extent of clinical safety experience was demonstrated by plots of patient exposure over time. Adverse event data were presented using dot plots, which display the percentages of patients with the events of interest, the odds ratio, and 95% confidence interval. Power and confidence interval plots were utilised for evaluating the sensitivity of the clinical database to detect treatment differences. Box and whisker plots were used to display laboratory data. This project enabled us to identify new evidence-based methods for presenting and evaluating clinical safety data. These methods represent an advance in the way safety data from clinical trials can be analysed and presented. This project emphasises the importance of early and comprehensive planning of the safety package, including evaluation of the use of epidemiology data.

Software Tools to Support the Assessment of System Health

NASA Technical Reports Server (NTRS)

Melcher, Kevin J.

2013-01-01

This presentation provides an overview of three software tools that were developed by the NASA Glenn Research Center to support the assessment of system health: the Propulsion Diagnostic Method Evaluation Strategy (ProDIMES), the Systematic Sensor Selection Strategy (S4), and the Extended Testability Analysis (ETA) tool. Originally developed to support specific NASA projects in aeronautics and space, these software tools are currently available to U.S. citizens through the NASA Glenn Software Catalog. The ProDiMES software tool was developed to support a uniform comparison of propulsion gas path diagnostic methods. Methods published in the open literature are typically applied to dissimilar platforms with different levels of complexity. They often address different diagnostic problems and use inconsistent metrics for evaluating performance. As a result, it is difficult to perform a one ]to ]one comparison of the various diagnostic methods. ProDIMES solves this problem by serving as a theme problem to aid in propulsion gas path diagnostic technology development and evaluation. The overall goal is to provide a tool that will serve as an industry standard, and will truly facilitate the development and evaluation of significant Engine Health Management (EHM) capabilities. ProDiMES has been developed under a collaborative project of The Technical Cooperation Program (TTCP) based on feedback provided by individuals within the aircraft engine health management community. The S4 software tool provides a framework that supports the optimal selection of sensors for health management assessments. S4 is structured to accommodate user ]defined applications, diagnostic systems, search techniques, and system requirements/constraints. One or more sensor suites that maximize this performance while meeting other user ]defined system requirements that are presumed to exist. S4 provides a systematic approach for evaluating combinations of sensors to determine the set or sets of sensors that optimally meet the performance goals and the constraints. It identifies optimal sensor suite solutions by utilizing a merit (i.e., cost) function with one of several available optimization approaches. As part of its analysis, S4 can expose fault conditions that are difficult to diagnose due to an incomplete diagnostic philosophy and/or a lack of sensors. S4 was originally developed and applied to liquid rocket engines. It was subsequently used to study the optimized selection of sensors for a simulation ]based aircraft engine diagnostic system. The ETA Tool is a software ]based analysis tool that augments the testability analysis and reporting capabilities of a commercial ]off ]the ]shelf (COTS) package. An initial diagnostic assessment is performed by the COTS software using a user ]developed, qualitative, directed ]graph model of the system being analyzed. The ETA Tool accesses system design information captured within the model and the associated testability analysis output to create a series of six reports for various system engineering needs. These reports are highlighted in the presentation. The ETA Tool was developed by NASA to support the verification of fault management requirements early in the Launch Vehicle process. Due to their early development during the design process, the TEAMS ]based diagnostic model and the ETA Tool were able to positively influence the system design by highlighting gaps in failure detection, fault isolation, and failure recovery.

Detecting Surgical Tools by Modelling Local Appearance and Global Shape.

PubMed

Bouget, David; Benenson, Rodrigo; Omran, Mohamed; Riffaud, Laurent; Schiele, Bernt; Jannin, Pierre

2015-12-01

Detecting tools in surgical videos is an important ingredient for context-aware computer-assisted surgical systems. To this end, we present a new surgical tool detection dataset and a method for joint tool detection and pose estimation in 2d images. Our two-stage pipeline is data-driven and relaxes strong assumptions made by previous works regarding the geometry, number, and position of tools in the image. The first stage classifies each pixel based on local appearance only, while the second stage evaluates a tool-specific shape template to enforce global shape. Both local appearance and global shape are learned from training data. Our method is validated on a new surgical tool dataset of 2 476 images from neurosurgical microscopes, which is made freely available. It improves over existing datasets in size, diversity and detail of annotation. We show that our method significantly improves over competitive baselines from the computer vision field. We achieve 15% detection miss-rate at 10(-1) false positives per image (for the suction tube) over our surgical tool dataset. Results indicate that performing semantic labelling as an intermediate task is key for high quality detection.

Performance Evaluation and Online Realization of Data-driven Normalization Methods Used in LC/MS based Untargeted Metabolomics Analysis.

PubMed

Li, Bo; Tang, Jing; Yang, Qingxia; Cui, Xuejiao; Li, Shuang; Chen, Sijie; Cao, Quanxing; Xue, Weiwei; Chen, Na; Zhu, Feng

2016-12-13

In untargeted metabolomics analysis, several factors (e.g., unwanted experimental &biological variations and technical errors) may hamper the identification of differential metabolic features, which requires the data-driven normalization approaches before feature selection. So far, ≥16 normalization methods have been widely applied for processing the LC/MS based metabolomics data. However, the performance and the sample size dependence of those methods have not yet been exhaustively compared and no online tool for comparatively and comprehensively evaluating the performance of all 16 normalization methods has been provided. In this study, a comprehensive comparison on these methods was conducted. As a result, 16 methods were categorized into three groups based on their normalization performances across various sample sizes. The VSN, the Log Transformation and the PQN were identified as methods of the best normalization performance, while the Contrast consistently underperformed across all sub-datasets of different benchmark data. Moreover, an interactive web tool comprehensively evaluating the performance of 16 methods specifically for normalizing LC/MS based metabolomics data was constructed and hosted at http://server.idrb.cqu.edu.cn/MetaPre/. In summary, this study could serve as a useful guidance to the selection of suitable normalization methods in analyzing the LC/MS based metabolomics data.

Performance Evaluation and Online Realization of Data-driven Normalization Methods Used in LC/MS based Untargeted Metabolomics Analysis

PubMed Central

Li, Bo; Tang, Jing; Yang, Qingxia; Cui, Xuejiao; Li, Shuang; Chen, Sijie; Cao, Quanxing; Xue, Weiwei; Chen, Na; Zhu, Feng

2016-01-01

In untargeted metabolomics analysis, several factors (e.g., unwanted experimental & biological variations and technical errors) may hamper the identification of differential metabolic features, which requires the data-driven normalization approaches before feature selection. So far, ≥16 normalization methods have been widely applied for processing the LC/MS based metabolomics data. However, the performance and the sample size dependence of those methods have not yet been exhaustively compared and no online tool for comparatively and comprehensively evaluating the performance of all 16 normalization methods has been provided. In this study, a comprehensive comparison on these methods was conducted. As a result, 16 methods were categorized into three groups based on their normalization performances across various sample sizes. The VSN, the Log Transformation and the PQN were identified as methods of the best normalization performance, while the Contrast consistently underperformed across all sub-datasets of different benchmark data. Moreover, an interactive web tool comprehensively evaluating the performance of 16 methods specifically for normalizing LC/MS based metabolomics data was constructed and hosted at http://server.idrb.cqu.edu.cn/MetaPre/. In summary, this study could serve as a useful guidance to the selection of suitable normalization methods in analyzing the LC/MS based metabolomics data. PMID:27958387

Measuring Workload Demand of Informatics Systems with the Clinical Case Demand Index

PubMed Central

Iyengar, M. Sriram; Rogith, Deevakar; Florez-Arango, Jose F

2017-01-01

Introduction: The increasing use of Health Information Technology (HIT) can add substantially to workload on clinical providers. Current methods for assessing workload do not take into account the nature of clinical cases and the use of HIT tools while solving them. Methods: The Clinical Case Demand Index (CCDI), consisting of a summary score and visual representation, was developed to meet this need. Consistency with current perceived workload measures was evaluated in a Randomized Control Trial of a mobile health system. Results: CCDI is significantly correlated with existing workload measures and inversely related to provider performance. Discussion: CCDI combines subjective and objective characteristics of clinical cases along with cognitive and clinical dimensions. Applications include evaluation of HIT tools, clinician scheduling, medical education. Conclusion: CCDI supports comparative effectiveness research of HIT tools. In addition, CCDI could have numerous applications including training, clinical trials, design of clinical workflows, and others. PMID:29854166

Visual analytics for aviation safety: A collaborative approach to sensemaking

NASA Astrophysics Data System (ADS)

Wade, Andrew

Visual analytics, the "science of analytical reasoning facilitated by interactive visual interfaces", is more than just visualization. Understanding the human reasoning process is essential for designing effective visualization tools and providing correct analyses. This thesis describes the evolution, application and evaluation of a new method for studying analytical reasoning that we have labeled paired analysis. Paired analysis combines subject matter experts (SMEs) and tool experts (TE) in an analytic dyad, here used to investigate aircraft maintenance and safety data. The method was developed and evaluated using interviews, pilot studies and analytic sessions during an internship at the Boeing Company. By enabling a collaborative approach to sensemaking that can be captured by researchers, paired analysis yielded rich data on human analytical reasoning that can be used to support analytic tool development and analyst training. Keywords: visual analytics, paired analysis, sensemaking, boeing, collaborative analysis.

System Life Cycle Evaluation(SM) (SLiCE): harmonizing water treatment systems with implementers' needs.

PubMed

Goodman, Joseph; Caravati, Kevin; Foote, Andrew; Nelson, Molly; Woods, Emily

2013-06-01

One of the methods proposed to improve access to clean drinking water is the mobile packaged water treatment system (MPWTS). The lack of published system performance comparisons combined with the diversity of technology available and intended operating conditions make it difficult for stakeholders to choose the system best suited for their application. MPWTS are often deployed in emergency situations, making selection of the appropriate system crucial to avoiding wasted resources and loss of life. Measurable critical-to-quality characteristics (CTQs) and a system selection tool for MPWTS were developed by utilizing relevant literature, including field studies, and implementing and comparing seven different MPWTS. The proposed System Life Cycle Evaluation (SLiCE) method uses these CTQs to evaluate the diversity in system performance and harmonize relevant performance with stakeholder preference via a selection tool. Agencies and field workers can use SLiCE results to inform and drive decision-making. The evaluation and selection tool also serves as a catalyst for communicating system performance, common design flaws, and stakeholder needs to system manufacturers. The SLiCE framework can be adopted into other emerging system technologies to communicate system performance over the life cycle of use.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

A Cost Analysis Model for Army Sponsored Graduate Dental Education Programs.

DTIC Science & Technology

1997-04-01

characteristics of a good measurement tool ? Cooper and Emory in their textbook, Business Research Methods, state there are three major criteria for evaluating...a measurement tool : validity, reliability, and practicality (Cooper and Emory 1995). Validity can be compartmentalized into internal and external...tremendous expense? The AEGD-1 year program is used extensively as a recruiting tool to encourage senior dental students to join the Army Dental Corps. The

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

Energy evaluation of protection effectiveness of anti-vibration gloves.

PubMed

Hermann, Tomasz; Dobry, Marian Witalis

2017-09-01

This article describes an energy method of assessing protection effectiveness of anti-vibration gloves on the human dynamic structure. The study uses dynamic models of the human and the glove specified in Standard No. ISO 10068:2012. The physical models of human-tool systems were developed by combining human physical models with a power tool model. The combined human-tool models were then transformed into mathematical models from which energy models were finally derived. Comparative energy analysis was conducted in the domain of rms powers. The energy models of the human-tool systems were solved using numerical simulation implemented in the MATLAB/Simulink environment. The simulation procedure demonstrated the effectiveness of the anti-vibration glove as a method of protecting human operators of hand-held power tools against vibration. The desirable effect is achieved by lowering the flow of energy in the human-tool system when the anti-vibration glove is employed.

Evaluation of the acceptability of a CD-Rom as a health promotion tool for Inuit in Ottawa.

PubMed

McShane, Kelly E; Smylie, Janet K; Hastings, Paul D; Prince, Conrad; Siedule, Connie

2013-01-01

There are few health promotion tools for urban Inuit, and there is a specific dearth of evaluations on such tools. The current study used a community-specific approach in the evaluation of a health promotion tool, based on an urban Inuit community's preferences of health knowledge sources and distribution strategies. In partnership with the Tungasuvvingat Inuit Family Health Team in Ottawa, a CD-Rom was developed featuring an Inuk Elder presenting prenatal health messages in both Inuktitut and English. Also, relevant evaluation materials were developed. Using a mixed methods approach, 40 participants completed interviews prior to viewing the CD-Rom and participated in a focus group at follow-up. Questionnaires were also completed pre- and post-viewing to assess changes between expectations and reactions in order to document acceptability. Significant increases were found on satisfaction, acceptability of medium and relevance of content ratings. Qualitative findings also included (a) interest, uncertainty and conditional interest prior to viewing; and (b) positive evaluations of the CD-Rom. This suggests that CD-Rom technology has the potential for health promotion for urban Inuit, and the community-specific evaluation approach yielded useful information.

Evaluation of the acceptability of a CD-Rom as a health promotion tool for Inuit in Ottawa

PubMed Central

McShane, Kelly E.; Smylie, Janet K.; Hastings, Paul D.; Prince, Conrad; Siedule, Connie

2013-01-01

Background There are few health promotion tools for urban Inuit, and there is a specific dearth of evaluations on such tools. Objective The current study used a community-specific approach in the evaluation of a health promotion tool, based on an urban Inuit community's preferences of health knowledge sources and distribution strategies. In partnership with the Tungasuvvingat Inuit Family Health Team in Ottawa, a CD-Rom was developed featuring an Inuk Elder presenting prenatal health messages in both Inuktitut and English. Also, relevant evaluation materials were developed. Design Using a mixed methods approach, 40 participants completed interviews prior to viewing the CD-Rom and participated in a focus group at follow-up. Questionnaires were also completed pre- and post-viewing to assess changes between expectations and reactions in order to document acceptability. Results Significant increases were found on satisfaction, acceptability of medium and relevance of content ratings. Qualitative findings also included (a) interest, uncertainty and conditional interest prior to viewing; and (b) positive evaluations of the CD-Rom. Conclusions This suggests that CD-Rom technology has the potential for health promotion for urban Inuit, and the community-specific evaluation approach yielded useful information. PMID:23717816

TU-C-17A-03: An Integrated Contour Evaluation Software Tool Using Supervised Pattern Recognition for Radiotherapy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, H; Tan, J; Kavanaugh, J

Purpose: Radiotherapy (RT) contours delineated either manually or semiautomatically require verification before clinical usage. Manual evaluation is very time consuming. A new integrated software tool using supervised pattern contour recognition was thus developed to facilitate this process. Methods: The contouring tool was developed using an object-oriented programming language C# and application programming interfaces, e.g. visualization toolkit (VTK). The C# language served as the tool design basis. The Accord.Net scientific computing libraries were utilized for the required statistical data processing and pattern recognition, while the VTK was used to build and render 3-D mesh models from critical RT structures in real-timemore » and 360° visualization. Principal component analysis (PCA) was used for system self-updating geometry variations of normal structures based on physician-approved RT contours as a training dataset. The inhouse design of supervised PCA-based contour recognition method was used for automatically evaluating contour normality/abnormality. The function for reporting the contour evaluation results was implemented by using C# and Windows Form Designer. Results: The software input was RT simulation images and RT structures from commercial clinical treatment planning systems. Several abilities were demonstrated: automatic assessment of RT contours, file loading/saving of various modality medical images and RT contours, and generation/visualization of 3-D images and anatomical models. Moreover, it supported the 360° rendering of the RT structures in a multi-slice view, which allows physicians to visually check and edit abnormally contoured structures. Conclusion: This new software integrates the supervised learning framework with image processing and graphical visualization modules for RT contour verification. This tool has great potential for facilitating treatment planning with the assistance of an automatic contour evaluation module in avoiding unnecessary manual verification for physicians/dosimetrists. In addition, its nature as a compact and stand-alone tool allows for future extensibility to include additional functions for physicians’ clinical needs.« less

Development and validation of methods for man-made machine interface evaluation. [for shuttles and shuttle payloads

NASA Technical Reports Server (NTRS)

Malone, T. B.; Micocci, A.

1975-01-01

The alternate methods of conducting a man-machine interface evaluation are classified as static and dynamic, and are evaluated. A dynamic evaluation tool is presented to provide for a determination of the effectiveness of the man-machine interface in terms of the sequence of operations (task and task sequences) and in terms of the physical characteristics of the interface. This dynamic checklist approach is recommended for shuttle and shuttle payload man-machine interface evaluations based on reduced preparation time, reduced data, and increased sensitivity of critical problems.

Project Pride Evaluation Report.

ERIC Educational Resources Information Center

Jennewein, Marilyn; And Others

Project PRIDE (Probe, Research, Inquire, Discover, and Evaluate) is evaluated in this report to provide data to be used as a learning tool for project staff and student participants. Major objectives of the project are to provide an inter-disciplinary, objective approach to the study of the American heritage, and to incorporate methods and…

A Comparative Analysis of Life-Cycle Assessment Tools for ...

EPA Pesticide Factsheets

We identified and evaluated five life-cycle assessment tools that community decision makers can use to assess the environmental and economic impacts of end-of-life (EOL) materials management options. The tools evaluated in this report are waste reduction mode (WARM), municipal solid waste-decision support tool (MSW-DST), solid waste optimization life-cycle framework (SWOLF), environmental assessment system for environmental technologies (EASETECH), and waste and resources assessment for the environment (WRATE). WARM, MSW-DST, and SWOLF were developed for US-specific materials management strategies, while WRATE and EASETECH were developed for European-specific conditions. All of the tools (with the exception of WARM) allow specification of a wide variety of parameters (e.g., materials composition and energy mix) to a varying degree, thus allowing users to model specific EOL materials management methods even outside the geographical domain they are originally intended for. The flexibility to accept user-specified input for a large number of parameters increases the level of complexity and the skill set needed for using these tools. The tools were evaluated and compared based on a series of criteria, including general tool features, the scope of the analysis (e.g., materials and processes included), and the impact categories analyzed (e.g., climate change, acidification). A series of scenarios representing materials management problems currently relevant to c

Current State and Model for Development of Technology-Based Care for Attention Deficit Hyperactivity Disorder

PubMed Central

Riley, Steven J.; Calub, Catrina A.; Schweitzer, Julie B.

2016-01-01

Abstract Introduction: Care (i.e., evaluation and intervention) delivered through technology is used in many areas of mental health services, including for persons with attention deficit hyperactivity disorder (ADHD). Technology can facilitate care for individuals with ADHD, their parents, and their care providers. The adoption of technological tools for ADHD care requires evidence-based studies to support the transition from development to integration into use in the home, school, or work for persons with the disorder. The initial phase, which is development of technological tools, has begun in earnest; however, the evidence base for many of these tools is lacking. In some instances, the uptake of a piece of technology into home use or clinical practice may be further along than the research to support its use. Methods: In this study, we review the current evidence regarding technology for ADHD and also propose a model to evaluate the support for other tools that have yet to be tested. Results: We propose using the Research Domain Criteria as a framework for evaluating the tools' relationships to dimensions related to ADHD. Conclusion: This article concludes with recommendations for testing new tools that may have promise in improving the evaluation or treatment of persons with ADHD. PMID:26985703

Developing a Physiotherapy-Specific Preliminary Clinical Decision-Making Tool for Oxygen Titration: A Modified Delphi Study

PubMed Central

Duong, Michelle; Bertin, Kendra; Henry, Renee; Singh, Deepti; Timmins, Nolla; Brooks, Dina; Mathur, Sunita

2014-01-01

ABSTRACT Purpose: To develop and evaluate a preliminary clinical decision-making tool (CDMT) to assist physiotherapists in titrating oxygen for acutely ill adults in Ontario. Methods: A panel of 14 experienced cardiorespiratory physiotherapists was recruited. Factors relating to oxygen titration were identified using a modified Delphi technique. Four rounds of questionnaires were conducted, during which the goals were to (1) generate factors, (2) reduce factors and debate contentious factors, (3) finalize factors and develop the preliminary CDMT, and (4) evaluate the usability of the tool in a clinical context. Results: The panel reached consensus on a total of 89 factors, which were compiled to create the preliminary CDMT. The global tool reached consensus for sensibility, receiving a mean score of 6/7 on a 7-point Likert-type scale (1=unacceptable; 7=excellent). Five of the nine individual components of evaluation of the tool achieved scores ≥6.0; the remaining four had mean scores between 5.4 and 5.9. Conclusion: This study produced a preliminary CDMT for oxygen titration, which the panel agreed was highly comprehensible and globally sensible. Further research is necessary to evaluate the sensibility and applicability of the tool in a clinical setting. PMID:25125782

Evaluation and Ranking of Researchers – Bh Index

PubMed Central

Bharathi, D. Gnana

2013-01-01

Evaluation and ranking of every author is very crucial as it is widely used to evaluate the performance of the researcher. This article proposes a new method, called Bh-Index, to evaluate the researchers based on the publications and citations. The method is built on h-Index and only the h-core articles are taken into consideration. The method assigns value additions to those articles that receive significantly high citations in comparison to the h-Index of the researcher. It provides a wide range of values for a given h-Index and effective evaluation even for a short period. Use of Bh-Index along with the h-Index gives a powerful tool to evaluate the researchers. PMID:24349183

A systematic review on popularity, application and characteristics of protein secondary structure prediction tools.

PubMed

Kashani-Amin, Elaheh; Tabatabaei-Malazy, Ozra; Sakhteman, Amirhossein; Larijani, Bagher; Ebrahim-Habibi, Azadeh

2018-02-27

Prediction of proteins' secondary structure is one of the major steps in the generation of homology models. These models provide structural information which is used to design suitable ligands for potential medicinal targets. However, selecting a proper tool between multiple secondary structure prediction (SSP) options is challenging. The current study is an insight onto currently favored methods and tools, within various contexts. A systematic review was performed for a comprehensive access to recent (2013-2016) studies which used or recommended protein SSP tools. Three databases, Web of Science, PubMed and Scopus were systematically searched and 99 out of 209 studies were finally found eligible to extract data. Four categories of applications for 59 retrieved SSP tools were: (I) prediction of structural features of a given sequence, (II) evaluation of a method, (III) providing input for a new SSP method and (IV) integrating a SSP tool as a component for a program. PSIPRED was found to be the most popular tool in all four categories. JPred and tools utilizing PHD (Profile network from HeiDelberg) method occupied second and third places of popularity in categories I and II. JPred was only found in the two first categories, while PHD was present in three fields. This study provides a comprehensive insight about the recent usage of SSP tools which could be helpful for selecting a proper tool's choice. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Conducting systematic reviews of economic evaluations.

PubMed

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other types of evidence. The updated JBI guidance will be useful for researchers wanting to synthesize evidence about economic questions, either as stand-alone reviews or part of comprehensive or mixed method evidence reviews. Although the updated methodology produced by the work of the working group has improved the JBI guidance for systematic reviews of economic evaluations, there are areas where further work is required. These include adjusting the critical appraisal tool to separate out questions addressing intervention cost and effectiveness measurement; providing more explicit guidance for assessing generalizability of findings; and offering a more robust method for evidence synthesis that facilitates achieving the more ambitious review objectives.

[Sensitivity to change].

PubMed

Igl, W; Zwingmann, C; Faller, H

2005-04-01

In rehabilitation research patient questionnaires are widely used for evaluative purposes, i. e. to measure improvements or deteriorations over time. This is only possible if the questionnaires applied appropriately reflect "true" change over time, i. e. they have to be sensitive to change. The aim of this paper is to point out the importance of the "sensitivity to change" concept for evaluative assessment tools and evaluative studies, respectively, considering quality of life research as an example. Various qualitative aspects, e. g. scaling of response options of assessment tools, are covered as well as quantitative methods, i. e. study designs and indices. Furthermore, recommendations for interpretation are given.

The Course Improvement Flowchart: A Description of a Tool and Process for the Evaluation of University Teaching

ERIC Educational Resources Information Center

Morgan, Philip

2008-01-01

The use of evaluation to examine and improve the quality of teaching and courses is now a component of most universities. However, despite the various methods and opportunities for evaluation, a lack of understanding of the processes, measures and value are some of the major impediments to effective evaluation. Evaluation requires an understanding…

Realistic nurse-led policy implementation, optimization and evaluation: novel methodological exemplar.

PubMed

Noyes, Jane; Lewis, Mary; Bennett, Virginia; Widdas, David; Brombley, Karen

2014-01-01

To report the first large-scale realistic nurse-led implementation, optimization and evaluation of a complex children's continuing-care policy. Health policies are increasingly complex, involve multiple Government departments and frequently fail to translate into better patient outcomes. Realist methods have not yet been adapted for policy implementation. Research methodology - Evaluation using theory-based realist methods for policy implementation. An expert group developed the policy and supporting tools. Implementation and evaluation design integrated diffusion of innovation theory with multiple case study and adapted realist principles. Practitioners in 12 English sites worked with Consultant Nurse implementers to manipulate the programme theory and logic of new decision-support tools and care pathway to optimize local implementation. Methods included key-stakeholder interviews, developing practical diffusion of innovation processes using key-opinion leaders and active facilitation strategies and a mini-community of practice. New and existing processes and outcomes were compared for 137 children during 2007-2008. Realist principles were successfully adapted to a shorter policy implementation and evaluation time frame. Important new implementation success factors included facilitated implementation that enabled 'real-time' manipulation of programme logic and local context to best-fit evolving theories of what worked; using local experiential opinion to change supporting tools to more realistically align with local context and what worked; and having sufficient existing local infrastructure to support implementation. Ten mechanisms explained implementation success and differences in outcomes between new and existing processes. Realistic policy implementation methods have advantages over top-down approaches, especially where clinical expertise is low and unlikely to diffuse innovations 'naturally' without facilitated implementation and local optimization. © 2013 John Wiley & Sons Ltd.

Prospective performance evaluation of selected common virtual screening tools. Case study: Cyclooxygenase (COX) 1 and 2.

PubMed

Kaserer, Teresa; Temml, Veronika; Kutil, Zsofia; Vanek, Tomas; Landa, Premysl; Schuster, Daniela

2015-01-01

Computational methods can be applied in drug development for the identification of novel lead candidates, but also for the prediction of pharmacokinetic properties and potential adverse effects, thereby aiding to prioritize and identify the most promising compounds. In principle, several techniques are available for this purpose, however, which one is the most suitable for a specific research objective still requires further investigation. Within this study, the performance of several programs, representing common virtual screening methods, was compared in a prospective manner. First, we selected top-ranked virtual screening hits from the three methods pharmacophore modeling, shape-based modeling, and docking. For comparison, these hits were then additionally predicted by external pharmacophore- and 2D similarity-based bioactivity profiling tools. Subsequently, the biological activities of the selected hits were assessed in vitro, which allowed for evaluating and comparing the prospective performance of the applied tools. Although all methods performed well, considerable differences were observed concerning hit rates, true positive and true negative hits, and hitlist composition. Our results suggest that a rational selection of the applied method represents a powerful strategy to maximize the success of a research project, tightly linked to its aims. We employed cyclooxygenase as application example, however, the focus of this study lied on highlighting the differences in the virtual screening tool performances and not in the identification of novel COX-inhibitors. Copyright © 2015 The Authors. Published by Elsevier Masson SAS.. All rights reserved.

QUAST: quality assessment tool for genome assemblies

PubMed Central

Gurevich, Alexey; Saveliev, Vladislav; Vyahhi, Nikolay; Tesler, Glenn

2013-01-01

Summary: Limitations of genome sequencing techniques have led to dozens of assembly algorithms, none of which is perfect. A number of methods for comparing assemblers have been developed, but none is yet a recognized benchmark. Further, most existing methods for comparing assemblies are only applicable to new assemblies of finished genomes; the problem of evaluating assemblies of previously unsequenced species has not been adequately considered. Here, we present QUAST—a quality assessment tool for evaluating and comparing genome assemblies. This tool improves on leading assembly comparison software with new ideas and quality metrics. QUAST can evaluate assemblies both with a reference genome, as well as without a reference. QUAST produces many reports, summary tables and plots to help scientists in their research and in their publications. In this study, we used QUAST to compare several genome assemblers on three datasets. QUAST tables and plots for all of them are available in the Supplementary Material, and interactive versions of these reports are on the QUAST website. Availability: http://bioinf.spbau.ru/quast Contact: gurevich@bioinf.spbau.ru Supplementary information: Supplementary data are available at Bioinformatics online. PMID:23422339

Exploring Assessment Tools for Research and Evaluation in Astronomy Education and Outreach

NASA Astrophysics Data System (ADS)

Buxner, S. R.; Wenger, M. C.; Dokter, E. F. C.

2011-09-01

The ability to effectively measure knowledge, attitudes, and skills in formal and informal educational settings is an important aspect of astronomy education research and evaluation. Assessments may take the form of interviews, observations, surveys, exams, or other probes to help unpack people's understandings or beliefs. In this workshop, we discussed characteristics of a variety of tools that exist to assess understandings of different concepts in astronomy as well as attitudes towards science and science teaching; these include concept inventories, surveys, interview protocols, observation protocols, card sorting, reflection videos, and other methods currently being used in astronomy education research and EPO program evaluations. In addition, we discussed common questions in the selection of assessment tools including issues of reliability and validity, time to administer, format of implementation, analysis, and human subject concerns.

Efficacy of teaching methods used to develop critical thinking in nursing and midwifery undergraduate students: A systematic review of the literature.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2016-05-01

The value and importance of incorporating strategies that promote critical thinking in nursing and midwifery undergraduate programmes are well documented. However, relatively little is known about the effectiveness of teaching strategies in promoting CT. Evaluating effectiveness is important to promote 'best practise' in teaching. To evaluate the efficacy of teaching methods used to develop critical thinking skills in nursing and midwifery undergraduate students. The following six databases; CINAHL, Ovid Medline, ERIC, Informit, PsycINFO and Scopus were searched and resulted in the retrieval of 1315 papers. After screening for inclusion, each paper was evaluated using the Critical Appraisal Skills Programme tool. Twenty-eight studies met the inclusion criteria and quality appraisal. Twelve different teaching interventions were tested in 8 countries. Results varied, with little consistency across studies using the same type of intervention or outcome tool. Sixteen tools were used to measure the efficacy of teaching in developing critical thinking. Seventeen studies identified a significant increase in critical thinking, while nine studies found no increases, and two found unexplained decreases in CT when using a similar educational intervention. Whilst this review aimed to identify effective teaching strategies that promote and develop critical thinking, flaws in methodology and outcome measures contributed to inconsistent findings. The continued use of generalised CT tools is unlikely to help identify appropriate teaching methods that will improve CT abilities of midwifery and nursing students and prepare them for practise. The review was limited to empirical studies published in English that used measures of critical thinking with midwifery and nursing students. Discipline specific strategies and tools that measure students' abilities to apply CT in practise are needed. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

Development and Implementation of a Design Metric for Systems Containing Long-Term Fluid Loops

NASA Technical Reports Server (NTRS)

Steele, John W.

2016-01-01

John Steele, a chemist and technical fellow from United Technologies Corporation, provided a water quality module to assist engineers and scientists with a metric tool to evaluate risks associated with the design of space systems with fluid loops. This design metric is a methodical, quantitative, lessons-learned based means to evaluate the robustness of a long-term fluid loop system design. The tool was developed by a cross-section of engineering disciplines who had decades of experience and problem resolution.

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

EVALUATION OF THE CARBON FOOTPRINT OF AN INNOVATIVE SEWER REHABILITATION METHOD - abstract

EPA Science Inventory

A benefit of trenchless methods touted by many practitioners when compared to open cut construction is lower carbon dioxide emissions. In an attempt to verify these claims, tools have been developed that calculate the environmental impact of traditional open cut methods and commo...

EVALUATION OF THE CARBON FOOTPRINT OF AN INNOVATIVE SEWER REHABILITATION METHOD

EPA Science Inventory

A benefit of trenchless methods touted by many practitioners when compared to open cut construction is lower carbon dioxide emissions. In an attempt to verify these claims, tools have been developed that calculate the environmental impact of traditional open cut methods and commo...

Evaluation of the clinical process in a critical care information system using the Lean method: a case study

PubMed Central

2012-01-01

Background There are numerous applications for Health Information Systems (HIS) that support specific tasks in the clinical workflow. The Lean method has been used increasingly to optimize clinical workflows, by removing waste and shortening the delivery cycle time. There are a limited number of studies on Lean applications related to HIS. Therefore, we applied the Lean method to evaluate the clinical processes related to HIS, in order to evaluate its efficiency in removing waste and optimizing the process flow. This paper presents the evaluation findings of these clinical processes, with regards to a critical care information system (CCIS), known as IntelliVue Clinical Information Portfolio (ICIP), and recommends solutions to the problems that were identified during the study. Methods We conducted a case study under actual clinical settings, to investigate how the Lean method can be used to improve the clinical process. We used observations, interviews, and document analysis, to achieve our stated goal. We also applied two tools from the Lean methodology, namely the Value Stream Mapping and the A3 problem-solving tools. We used eVSM software to plot the Value Stream Map and A3 reports. Results We identified a number of problems related to inefficiency and waste in the clinical process, and proposed an improved process model. Conclusions The case study findings show that the Value Stream Mapping and the A3 reports can be used as tools to identify waste and integrate the process steps more efficiently. We also proposed a standardized and improved clinical process model and suggested an integrated information system that combines database and software applications to reduce waste and data redundancy. PMID:23259846

INNOVATIVE METHODS FOR EMISSION-INVENTORY DEVELOPMENT AND EVALUATION: WORKSHOP SUMMARY

EPA Science Inventory

Emission inventories are an essential tool for evaluating, managing, and regulating air pollution. Refinements and innovations in instruments that measure air pollutants, models that calculate emissions as well as techniques for data management and uncertainty assessment are nee...

Modeling fate and transport of "Contaminants of Emerging Concern" (CECs): is the Soil Water Assessment Tool (SWAT) the appropriate model?

USDA-ARS?s Scientific Manuscript database

Background/Question/Methods As the scientific and regulatory communities realize the significant environmental impacts and ubiquity of “contaminants of emerging concern” (CECs), it is increasingly imperative to develop quantitative assessment tools to evaluate and predict the fate and transport of...

A Tool for Estimating Variability in Wood Preservative Treatment Retention

Treesearch

Patricia K. Lebow; Adam M. Taylor; Timothy M. Young

2015-01-01

Composite sampling is standard practice for evaluation of preservative retention levels in preservative-treated wood. Current protocols provide an average retention value but no estimate of uncertainty. Here we describe a statistical method for calculating uncertainty estimates using the standard sampling regime with minimal additional chemical analysis. This tool can...

A Web-Based Learning Tool Improves Student Performance in Statistics: A Randomized Masked Trial

ERIC Educational Resources Information Center

Gonzalez, Jose A.; Jover, Lluis; Cobo, Erik; Munoz, Pilar

2010-01-01

Background: e-status is a web-based tool able to generate different statistical exercises and to provide immediate feedback to students' answers. Although the use of Information and Communication Technologies (ICTs) is becoming widespread in undergraduate education, there are few experimental studies evaluating its effects on learning. Method: All…

Interactive Whiteboards: A New Tool for Extension Education

ERIC Educational Resources Information Center

Schroeder, Mary M.; Burns, Connie S.; Reicks, Marla M.

2011-01-01

Use of interactive whiteboards (IWBs) in school classrooms and conference rooms is increasing. To evaluate the effectiveness of IWBs as a tool for Extension education, two groups of 3rd and 4th grade Minnesota students (n=325) were taught nutrition using traditional methods or IWBs. Significant increases in knowledge and behavior were observed in…

Integrating Wikis as Educational Tools for the Development of a Community of Inquiry

ERIC Educational Resources Information Center

Eteokleous, Nikleia; Ktoridou, Despo; Orphanou, Maria

2014-01-01

This article describes a study that attempted to evaluate the integration of wikis as an educational tool in successfully achieving the learning objectives of a fifth-grade linguistics and literature course. A mixed-method approach was employed--data were collected via questionnaires, reflective journals, observations, and interviews. The results…

Evaluation of Psychological Hardiness and Coping Style as Risk/Resilience Factors for Health Risk Behaviour

DTIC Science & Technology

2011-04-01

205 RESEARCH DESIGN & METHODS Objective/Hypothesis: The objective of the study is to evaluate the utility of a short hardiness-resilience...problems. Study Design & Methods : This research will evaluate the utility of hardiness, as measured by the DRS-15R, as a screening tool for...may take a toll on defense workers. This research points the way to new approaches for early identification of military workers at risk for stress

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

PubMed

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design. Copyright © 2015 Elsevier Inc. All rights reserved.

Evaluation of the methods for enumerating coliform bacteria from water samples using precise reference standards.

PubMed

Wohlsen, T; Bates, J; Vesey, G; Robinson, W A; Katouli, M

2006-04-01

To use BioBall cultures as a precise reference standard to evaluate methods for enumeration of Escherichia coli and other coliform bacteria in water samples. Eight methods were evaluated including membrane filtration, standard plate count (pour and spread plate methods), defined substrate technology methods (Colilert and Colisure), the most probable number method and the Petrifilm disposable plate method. Escherichia coli and Enterobacter aerogenes BioBall cultures containing 30 organisms each were used. All tests were performed using 10 replicates. The mean recovery of both bacteria varied with the different methods employed. The best and most consistent results were obtained with Petrifilm and the pour plate method. Other methods either yielded a low recovery or showed significantly high variability between replicates. The BioBall is a very suitable quality control tool for evaluating the efficiency of methods for bacterial enumeration in water samples.

The Second Life Researcher Toolkit - An Exploration of Inworld Tools, Methods and Approaches for Researching Educational Projects in Second Life

NASA Astrophysics Data System (ADS)

Moschini, Elena

Academics are beginning to explore the educational potential of Second LifeTM (SL) by setting up inworld educational activities and projects. Given the relative novelty of the use of virtual world environments in higher education many such projects are still at pilot stage. However the initial pilot and experimentation stage will have to be followed by a rigorous evaluation process as for more traditional teaching projects. The chapter addresses issues about SL research tools and research methods. It introduces a "researcher toolkit" that includes: the various stages in the evaluation of SL educational projects and the theoretical framework that can inform such projects; an outline of the inworld tools that can be utilised or customised for academic research purposes; a review of methods for collecting feedback from participants and of the main ethical issues involved in researching virtual world environments; a discussion on the technical skills required to operate a research project in SL. The chapter also offers an indication of the inworld opportunities for the dissemination of SL research findings.

Improving smoothing efficiency of rigid conformal polishing tool using time-dependent smoothing evaluation model

NASA Astrophysics Data System (ADS)

Song, Chi; Zhang, Xuejun; Zhang, Xin; Hu, Haifei; Zeng, Xuefeng

2017-06-01

A rigid conformal (RC) lap can smooth mid-spatial-frequency (MSF) errors, which are naturally smaller than the tool size, while still removing large-scale errors in a short time. However, the RC-lap smoothing efficiency performance is poorer than expected, and existing smoothing models cannot explicitly specify the methods to improve this efficiency. We presented an explicit time-dependent smoothing evaluation model that contained specific smoothing parameters directly derived from the parametric smoothing model and the Preston equation. Based on the time-dependent model, we proposed a strategy to improve the RC-lap smoothing efficiency, which incorporated the theoretical model, tool optimization, and efficiency limit determination. Two sets of smoothing experiments were performed to demonstrate the smoothing efficiency achieved using the time-dependent smoothing model. A high, theory-like tool influence function and a limiting tool speed of 300 RPM were o

Is detection of adverse events affected by record review methodology? an evaluation of the "Harvard Medical Practice Study" method and the "Global Trigger Tool".

PubMed

Unbeck, Maria; Schildmeijer, Kristina; Henriksson, Peter; Jürgensen, Urban; Muren, Olav; Nilsson, Lena; Pukk Härenstam, Karin

2013-04-15

There has been a theoretical debate as to which retrospective record review method is the most valid, reliable, cost efficient and feasible for detecting adverse events. The aim of the present study was to evaluate the feasibility and capability of two common retrospective record review methods, the "Harvard Medical Practice Study" method and the "Global Trigger Tool" in detecting adverse events in adult orthopaedic inpatients. We performed a three-stage structured retrospective record review process in a random sample of 350 orthopaedic admissions during 2009 at a Swedish university hospital. Two teams comprised each of a registered nurse and two physicians were assigned, one to each method. All records were primarily reviewed by registered nurses. Records containing a potential adverse event were forwarded to physicians for review in stage 2. Physicians made an independent review regarding, for example, healthcare causation, preventability and severity. In the third review stage all adverse events that were found with the two methods together were compared and all discrepancies after review stage 2 were analysed. Events that had not been identified by one of the methods in the first two review stages were reviewed by the respective physicians. Altogether, 160 different adverse events were identified in 105 (30.0%) of the 350 records with both methods combined. The "Harvard Medical Practice Study" method identified 155 of the 160 (96.9%, 95% CI: 92.9-99.0) adverse events in 104 (29.7%) records compared with 137 (85.6%, 95% CI: 79.2-90.7) adverse events in 98 (28.0%) records using the "Global Trigger Tool". Adverse events "causing harm without permanent disability" accounted for most of the observed difference. The overall positive predictive value for criteria and triggers using the "Harvard Medical Practice Study" method and the "Global Trigger Tool" was 40.3% and 30.4%, respectively. More adverse events were identified using the "Harvard Medical Practice Study" method than using the "Global Trigger Tool". Differences in review methodology, perception of less severe adverse events and context knowledge may explain the observed difference between two expert review teams in the detection of adverse events.

Diagnostic Tools for Performance Evaluation of Innovative In-Situ Remediation Technologies at Chlorinated Solvent-Contaminated Sites

DTIC Science & Technology

2011-07-01

to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT...these innovative methods with conventional diagnostic tools that are currently used for assessing bioremediation performance. 132 Rula Deeb (510) 596...conventional diagnostic tools that are currently used for assessing bioremediation performance. DEMONSTRATION RESULTS 3-D multi-level systems

Adapting the Quebecois method for assessing implementation to the French National Alzheimer Plan 2008–2012: lessons for gerontological services integration

PubMed Central

Somme, Dominique; Trouvé, Hélène; Perisset, Catherine; Corvol, Aline; Ankri, Joël; Saint-Jean, Olivier; de Stampa, Matthieu

2014-01-01

Introduction Many countries face ageing-related demographic and epidemiological challenges, notably neurodegenerative disorders, due to the multiple care services they require, thereby pleading for a more integrated system of care. The integrated Quebecois method issued from the Programme of Research to Integrate Services for the Maintenance of Autonomy inspired a French pilot experiment and the National Alzheimer Plan 2008–2012. Programme of Research to Integrate Services for the Maintenance of Autonomy method implementation was rated with an evaluation grid adapted to assess its successive degrees of completion. Discussion The approaching end of the president's term led to the method's institutionalization (2011–2012), before the implementation study ended. When the government changed, the study was interrupted. The results extracted from that ‘lost’ study (presented herein) have, nonetheless, ‘found’ some key lessons. Key lessons/conclusion It was possible to implement a Quebecois integrated-care method in France. We describe the lessons and pitfalls encountered in adapting this evaluation tool. This process is necessarily multidisciplinary and requires a test phase. A simple tool for quantitative assessment of integration was obtained. The first assessment of the tool was unsatisfactory but requires further studies. In the meantime, we recommend using mixed methodologies to assess the services integration level. PMID:24959112

Probabilistic structural analysis by extremum methods

NASA Technical Reports Server (NTRS)

Nafday, Avinash M.

1990-01-01

The objective is to demonstrate discrete extremum methods of structural analysis as a tool for structural system reliability evaluation. Specifically, linear and multiobjective linear programming models for analysis of rigid plastic frames under proportional and multiparametric loadings, respectively, are considered. Kinematic and static approaches for analysis form a primal-dual pair in each of these models and have a polyhedral format. Duality relations link extreme points and hyperplanes of these polyhedra and lead naturally to dual methods for system reliability evaluation.

Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer's disease.

PubMed

Vallejo, Vanessa; Wyss, Patric; Rampa, Luca; Mitache, Andrei V; Müri, René M; Mosimann, Urs P; Nef, Tobias

2017-01-01

Despite growing interest in developing ecological assessment of difficulties in patients with Alzheimer's disease new methods assessing the cognitive difficulties related to functional activities are missing. To complete current evaluation, the use of Serious Games can be a promising approach as it offers the possibility to recreate a virtual environment with daily living activities and a precise and complete cognitive evaluation. The aim of the present study was to evaluate the usability and the screening potential of a new ecological tool for assessment of cognitive functions in patients with Alzheimer's disease. Eighteen patients with Alzheimer's disease and twenty healthy controls participated to the study. They were asked to complete six daily living virtual tasks assessing several cognitive functions: three navigation tasks, one shopping task, one cooking task and one table preparation task following a one-day scenario. Usability of the game was evaluated through a questionnaire and through the analysis of the computer interactions for the two groups. Furthermore, the performances in terms of time to achieve the task and percentage of completion on the several tasks were recorded. Results indicate that both groups subjectively found the game user friendly and they were objectively able to play the game without computer interactions difficulties. Comparison of the performances between the two groups indicated a significant difference in terms of percentage of achievement of the several tasks and in terms of time they needed to achieve the several tasks. This study suggests that this new Serious Game based assessment tool is a user-friendly and ecological method to evaluate the cognitive abilities related to the difficulties patients can encounter in daily living activities and can be used as a screening tool as it allowed to distinguish Alzheimer's patient's performance from healthy controls.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Seth, Arpan; Klise, Katherine A.; Siirola, John D.

In the event of contamination in a water distribution network (WDN), source identification (SI) methods that analyze sensor data can be used to identify the source location(s). Knowledge of the source location and characteristics are important to inform contamination control and cleanup operations. Various SI strategies that have been developed by researchers differ in their underlying assumptions and solution techniques. The following manuscript presents a systematic procedure for testing and evaluating SI methods. The performance of these SI methods is affected by various factors including the size of WDN model, measurement error, modeling error, time and number of contaminant injections,more » and time and number of measurements. This paper includes test cases that vary these factors and evaluates three SI methods on the basis of accuracy and specificity. The tests are used to review and compare these different SI methods, highlighting their strengths in handling various identification scenarios. These SI methods and a testing framework that includes the test cases and analysis tools presented in this paper have been integrated into EPA’s Water Security Toolkit (WST), a suite of software tools to help researchers and others in the water industry evaluate and plan various response strategies in case of a contamination incident. Lastly, a set of recommendations are made for users to consider when working with different categories of SI methods.« less

RESEARCH TOWARDS DEVELOPING METHODS FOR SELECTED PHARMACEUTICAL AND PERSONAL CARE PRODUCTS (PPCPS) ADAPTED FOR BIOSOLIDS

EPA Science Inventory

Development, standardization, and validation of analytical methods provides state-of-the-science

techniques to evaluate the presence, or absence, of select PPCPs in biosolids. This research

provides the approaches, methods, and tools to assess the exposures and redu...

Evaluation of Supplemental Nutrition Assistance Program Education: Application of Behavioral Theory and Survey Validation

ERIC Educational Resources Information Center

Wyker, Brett A.; Jordan, Patricia; Quigley, Danielle L.

2012-01-01

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

Analyzing for Individual Differences in Evaluating Compensatory Education Programs. Occasional Paper No. 27.

ERIC Educational Resources Information Center

Krus, Patricia H.

Trait-Treatment Interaction (TTI), a research method for observing experimental effects of treatments on subjects of different aptitudes and learning characteristics, is suggested as an effective evaluation tool to provide evaluators and educators in compensatory education programs with information about which program is best for different kinds…

Dermatological Feasibility of Multimodal Facial Color Imaging Modality for Cross-Evaluation of Facial Actinic Keratosis

PubMed Central

Bae, Youngwoo; Son, Taeyoon; Nelson, J. Stuart; Kim, Jae-Hong; Choi, Eung Ho; Jung, Byungjo

2010-01-01

Background/Purpose Digital color image analysis is currently considered as a routine procedure in dermatology. In our previous study, a multimodal facial color imaging modality (MFCIM), which provides a conventional, parallel- and cross-polarization, and fluorescent color image, was introduced for objective evaluation of various facial skin lesions. This study introduces a commercial version of MFCIM, DermaVision-PRO, for routine clinical use in dermatology and demonstrates its dermatological feasibility for cross-evaluation of skin lesions. Methods/Results Sample images of subjects with actinic keratosis or non-melanoma skin cancers were obtained at four different imaging modes. Various image analysis methods were applied to cross-evaluate the skin lesion and, finally, extract valuable diagnostic information. DermaVision-PRO is potentially a useful tool as an objective macroscopic imaging modality for quick prescreening and cross-evaluation of facial skin lesions. Conclusion DermaVision-PRO may be utilized as a useful tool for cross-evaluation of widely distributed facial skin lesions and an efficient database management of patient information. PMID:20923462

Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design.

PubMed

Kastner, Monika; Sawka, Anna; Thorpe, Kevin; Chignel, Mark; Marquez, Christine; Newton, David; Straus, Sharon E

2011-07-22

Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines on assessing and managing osteoporosis are available, many patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions, a series of mixed-methods studies, and advice from experts in osteoporosis and human-factors engineering were used collectively to develop a multicomponent tool (targeted to family physicians and patients at risk for osteoporosis) that may support clinical decision making in osteoporosis disease management at the point of care. A three-phased approach will be used to evaluate the osteoporosis tool. In phase 1, the tool will be implemented in three family practices. It will involve ensuring optimal functioning of the tool while minimizing disruption to usual practice. In phase 2, the tool will be pilot tested in a quasi-experimental interrupted time series (ITS) design to determine if it can improve osteoporosis disease management at the point of care. Phase 3 will involve conducting a qualitative postintervention follow-up study to better understand participants' experiences and perceived utility of the tool and readiness to adopt the tool at the point of care. The osteoporosis tool has the potential to make several contributions to the development and evaluation of complex, chronic disease interventions, such as the inclusion of an implementation strategy prior to conducting an evaluation study. Anticipated benefits of the tool may be to increase awareness for patients about osteoporosis and its associated risks and provide an opportunity to discuss a management plan with their physician, which may all facilitate patient self-management.

Toolbox for Evaluating Residents as Teachers

ERIC Educational Resources Information Center

Coverdale, John H.; Ismail, Nadia; Mian, Ayesha; Dewey, Charlene

2010-01-01

Objective: The authors review existing assessment tools related to evaluating residents' teaching skills and teaching effectiveness. Methods: PubMed and PsycInfo databases were searched using combinations of keywords including "residents," "residents as teachers," "teaching skills," and "assessments" or "rating scales." Results: Eleven evaluation…

USE OF ZEOLITE FOR REMOVING AMMONIA AND AMMONIA-CAUSED TOXCITY IN MARINE TOXICITY IDENTIFCATION EVALUATIONS (TIES)

EPA Science Inventory

Ammonia occurs in marine waters including effluents, receiving waters, and sediment interstitial waters. At sufficiently high concentrations, ammonia can be toxic to aquatic species. Toxicity identification evaluation (TIE) methods provide researchers with tools for identifyi...

Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Review of Currently Available Instruments

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

An extensive list of published and unpublished instruments used to investigate or evaluate sleep issues in children was collected and assessed based on the fundamental operational principles of instrument development (11 steps). Of all the available tools identified, only a few were validated and standardized using appropriate psychometric criteria. In fact, only 2 fulfill all desirable criteria and approximately 11 instruments seem to adhere to most of the psychometric tool development requirements, and were therefore assessed in greater detail. Notwithstanding, in the rapidly developing scientific world of pediatric sleep, there are too many tools being used that have not undergone careful and methodical psychometric evaluation, and as such may be fraught with biased or invalid findings. It is hoped that this initial effort in categorizing and assessing available tools for pediatric sleep will serve as recognition of the relatively early developmental stage of our field, and provide the necessary impetus for future tool development using multicentered approaches and adequate methodologies. PMID:20934896

Evaluating biomarkers for prognostic enrichment of clinical trials.

PubMed

Kerr, Kathleen F; Roth, Jeremy; Zhu, Kehao; Thiessen-Philbrook, Heather; Meisner, Allison; Wilson, Francis Perry; Coca, Steven; Parikh, Chirag R

2017-12-01

A potential use of biomarkers is to assist in prognostic enrichment of clinical trials, where only patients at relatively higher risk for an outcome of interest are eligible for the trial. We investigated methods for evaluating biomarkers for prognostic enrichment. We identified five key considerations when considering a biomarker and a screening threshold for prognostic enrichment: (1) clinical trial sample size, (2) calendar time to enroll the trial, (3) total patient screening costs and the total per-patient trial costs, (4) generalizability of trial results, and (5) ethical evaluation of trial eligibility criteria. Items (1)-(3) are amenable to quantitative analysis. We developed the Biomarker Prognostic Enrichment Tool for evaluating biomarkers for prognostic enrichment at varying levels of screening stringency. We demonstrate that both modestly prognostic and strongly prognostic biomarkers can improve trial metrics using Biomarker Prognostic Enrichment Tool. Biomarker Prognostic Enrichment Tool is available as a webtool at http://prognosticenrichment.com and as a package for the R statistical computing platform. In some clinical settings, even biomarkers with modest prognostic performance can be useful for prognostic enrichment. In addition to the quantitative analysis provided by Biomarker Prognostic Enrichment Tool, investigators must consider the generalizability of trial results and evaluate the ethics of trial eligibility criteria.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Formal implementation of a performance evaluation model for the face recognition system.

PubMed

Shin, Yong-Nyuo; Kim, Jason; Lee, Yong-Jun; Shin, Woochang; Choi, Jin-Young

2008-01-01

Due to usability features, practical applications, and its lack of intrusiveness, face recognition technology, based on information, derived from individuals' facial features, has been attracting considerable attention recently. Reported recognition rates of commercialized face recognition systems cannot be admitted as official recognition rates, as they are based on assumptions that are beneficial to the specific system and face database. Therefore, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of any face recognition system. In this paper, we propose and formalize a performance evaluation model for the biometric recognition system, implementing an evaluation tool for face recognition systems based on the proposed model. Furthermore, we performed evaluations objectively by providing guidelines for the design and implementation of a performance evaluation system, formalizing the performance test process.

Engaging stakeholders to design a comparative effectiveness trial in children with uncontrolled asthma.

PubMed

Erwin, Kim; Martin, Molly A; Flippin, Tara; Norell, Sarah; Shadlyn, Ariana; Yang, Jie; Falco, Paula; Rivera, Jaime; Ignoffo, Stacy; Kumar, Rajesh; Margellos-Anast, Helen; McDermott, Michael; McMahon, Kate; Mosnaim, Giselle; Nyenhuis, Sharmilee M; Press, Valerie G; Ramsay, Jessica E; Soyemi, Kenneth; Thompson, Trevonne M; Krishnan, Jerry A

2016-01-01

To present the methods and outcomes of stakeholder engagement in the development of interventions for children presenting to the emergency department (ED) for uncontrolled asthma. We engaged stakeholders (caregivers, physicians, nurses, administrators) from six EDs in a three-phase process to: define design requirements; prototype and refine; and evaluate. Interviews among 28 stakeholders yielded themes regarding in-home asthma management practices and ED discharge experiences. Quantitative and qualitative evaluation showed strong preference for the new discharge tool over current tools. Engaging end-users in contextual inquiry resulted in CAPE (CHICAGO Action Plan after ED discharge), a new stakeholder-balanced discharge tool, which is being tested in a multicenter comparative effectiveness trial.

Improving a web-based employability intervention for work-disabled employees: results of a pilot economic evaluation.

PubMed

Noben, Cindy; Evers, Silvia; Genabeek, Joost van; Nijhuis, Frans; de Rijk, Angelique

2017-04-01

Purpose The purpose of this study is to improve web-based employability interventions for employees with work-related health problems for both intervention content and study design by means of a pilot economic evaluation. Methods Uptake rate analysis for the intervention elements, cost effectiveness, cost utility and subgroup analyses were conducted to identify potential content-related intervention improvements. Differences in work ability and quality-adjusted life years and overall contribution of resource items to the total costs were assessed. These were used to guide study design improvements. Results Sixty-three participants were a-select allocated to either the intervention (n = 29) or the control (n = 34) group. Uptake regarding the intervention elements ranged between 3% and 70%. Cost-effectiveness and cost-utility analyses resulted in negative effects although higher total costs. Incremental effects were marginal (work ability -0.51; QALY -0.01). Conclusions The web-based tool to enhance employability among work disabled employees requires improvements regarding targeting and intensity; outcome measures selected and collection of cost data. With respect to the studies of disability and rehabilitation, the findings and methods presented in this pilot economic evaluation could guide the assessment of future assistive "e-health" technologies. IMPLICATIONS FOR REHABILITATION The methods presented in this pilot economic evaluation have large potentials to guide the assessment of future assistive e-health technologies addressing work-disabilities. The findings show that the web-based tool requires content related improvements with respect to targeting and intensity to enhance employability among work disabled employees. The findings show that the web-based tool would benefit from improvements related to the study design by more adequately selecting and collecting both outcome measures and cost data. The burden attributable to large-scale studies and implementation issues were prevented as the outcomes of the pilot economic evaluation did not support the implementation of the web-based tool.

Toward a standard for the evaluation of PET-Auto-Segmentation methods following the recommendations of AAPM task group No. 211: Requirements and implementation.

PubMed

Berthon, Beatrice; Spezi, Emiliano; Galavis, Paulina; Shepherd, Tony; Apte, Aditya; Hatt, Mathieu; Fayad, Hadi; De Bernardi, Elisabetta; Soffientini, Chiara D; Ross Schmidtlein, C; El Naqa, Issam; Jeraj, Robert; Lu, Wei; Das, Shiva; Zaidi, Habib; Mawlawi, Osama R; Visvikis, Dimitris; Lee, John A; Kirov, Assen S

2017-08-01

The aim of this paper is to define the requirements and describe the design and implementation of a standard benchmark tool for evaluation and validation of PET-auto-segmentation (PET-AS) algorithms. This work follows the recommendations of Task Group 211 (TG211) appointed by the American Association of Physicists in Medicine (AAPM). The recommendations published in the AAPM TG211 report were used to derive a set of required features and to guide the design and structure of a benchmarking software tool. These items included the selection of appropriate representative data and reference contours obtained from established approaches and the description of available metrics. The benchmark was designed in a way that it could be extendable by inclusion of bespoke segmentation methods, while maintaining its main purpose of being a standard testing platform for newly developed PET-AS methods. An example of implementation of the proposed framework, named PETASset, was built. In this work, a selection of PET-AS methods representing common approaches to PET image segmentation was evaluated within PETASset for the purpose of testing and demonstrating the capabilities of the software as a benchmark platform. A selection of clinical, physical, and simulated phantom data, including "best estimates" reference contours from macroscopic specimens, simulation template, and CT scans was built into the PETASset application database. Specific metrics such as Dice Similarity Coefficient (DSC), Positive Predictive Value (PPV), and Sensitivity (S), were included to allow the user to compare the results of any given PET-AS algorithm to the reference contours. In addition, a tool to generate structured reports on the evaluation of the performance of PET-AS algorithms against the reference contours was built. The variation of the metric agreement values with the reference contours across the PET-AS methods evaluated for demonstration were between 0.51 and 0.83, 0.44 and 0.86, and 0.61 and 1.00 for DSC, PPV, and the S metric, respectively. Examples of agreement limits were provided to show how the software could be used to evaluate a new algorithm against the existing state-of-the art. PETASset provides a platform that allows standardizing the evaluation and comparison of different PET-AS methods on a wide range of PET datasets. The developed platform will be available to users willing to evaluate their PET-AS methods and contribute with more evaluation datasets. © 2017 The Authors. Medical Physics published by Wiley Periodicals, Inc. on behalf of American Association of Physicists in Medicine.

Prospective Comparison of Live Evaluation and Video Review in the Evaluation of Operator Performance in a Pediatric Emergency Airway Simulation

PubMed Central

House, Joseph B.; Dooley-Hash, Suzanne; Kowalenko, Terry; Sikavitsas, Athina; Seeyave, Desiree M.; Younger, John G.; Hamstra, Stanley J.; Nypaver, Michele M.

2012-01-01

Introduction Real-time assessment of operator performance during procedural simulation is a common practice that requires undivided attention by 1 or more reviewers, potentially over many repetitions of the same case. Objective To determine whether reviewers display better interrater agreement of procedural competency when observing recorded, rather than live, performance; and to develop an assessment tool for pediatric rapid sequence intubation (pRSI). Methods A framework of a previously established Objective Structured Assessment of Technical Skills (OSATS) tool was modified for pRSI. Emergency medicine residents (postgraduate year 1–4) were prospectively enrolled in a pRSI simulation scenario and evaluated by 2 live raters using the modified tool. Sessions were videotaped and reviewed by the same raters at least 4 months later. Raters were blinded to their initial rating. Interrater agreement was determined by using the Krippendorff generalized concordance method. Results Overall interrater agreement for live review was 0.75 (95% confidence interval [CI], 0.72–0.78) and for video was 0.79 (95% CI, 0.73–0.82). Live review was significantly superior to video review in only 1 of the OSATS domains (Preparation) and was equivalent in the other domains. Intrarater agreement between the live and video evaluation was very good, greater than 0.75 for all raters, with a mean of 0.81 (95% CI, 0.76–0.85). Conclusion The modified OSATS assessment tool demonstrated some evidence of validity in discriminating among levels of resident experience and high interreviewer reliability. With this tool, intrareviewer reliability was high between live and 4-months' delayed video review of the simulated procedure, which supports feasibility of delayed video review in resident assessment. PMID:23997874

Comparative evaluation of spectroscopic models using different multivariate statistical tools in a multicancer scenario

NASA Astrophysics Data System (ADS)

Ghanate, A. D.; Kothiwale, S.; Singh, S. P.; Bertrand, Dominique; Krishna, C. Murali

2011-02-01

Cancer is now recognized as one of the major causes of morbidity and mortality. Histopathological diagnosis, the gold standard, is shown to be subjective, time consuming, prone to interobserver disagreement, and often fails to predict prognosis. Optical spectroscopic methods are being contemplated as adjuncts or alternatives to conventional cancer diagnostics. The most important aspect of these approaches is their objectivity, and multivariate statistical tools play a major role in realizing it. However, rigorous evaluation of the robustness of spectral models is a prerequisite. The utility of Raman spectroscopy in the diagnosis of cancers has been well established. Until now, the specificity and applicability of spectral models have been evaluated for specific cancer types. In this study, we have evaluated the utility of spectroscopic models representing normal and malignant tissues of the breast, cervix, colon, larynx, and oral cavity in a broader perspective, using different multivariate tests. The limit test, which was used in our earlier study, gave high sensitivity but suffered from poor specificity. The performance of other methods such as factorial discriminant analysis and partial least square discriminant analysis are at par with more complex nonlinear methods such as decision trees, but they provide very little information about the classification model. This comparative study thus demonstrates not just the efficacy of Raman spectroscopic models but also the applicability and limitations of different multivariate tools for discrimination under complex conditions such as the multicancer scenario.

Research-IQ: Development and Evaluation of an Ontology-anchored Integrative Query Tool

PubMed Central

Borlawsky, Tara B.; Lele, Omkar; Payne, Philip R. O.

2011-01-01

Investigators in the translational research and systems medicine domains require highly usable, efficient and integrative tools and methods that allow for the navigation of and reasoning over emerging large-scale data sets. Such resources must cover a spectrum of granularity from bio-molecules to population phenotypes. Given such information needs, we report upon the initial design and evaluation of an ontology-anchored integrative query tool, Research-IQ, which employs a combination of conceptual knowledge engineering and information retrieval techniques to enable the intuitive and rapid construction of queries, in terms of semi-structured textual propositions, that can subsequently be applied to integrative data sets. Our initial results, based upon both quantitative and qualitative evaluations of the efficacy and usability of Research-IQ, demonstrate its potential to increase clinical and translational research throughput. PMID:21821150

Inventory on the dietary assessment tools available and needed in africa: a prerequisite for setting up a common methodological research infrastructure for nutritional surveillance, research, and prevention of diet-related non-communicable diseases.

PubMed

Pisa, Pedro T; Landais, Edwige; Margetts, Barrie; Vorster, Hester H; Friedenreich, Christine M; Huybrechts, Inge; Martin-Prevel, Yves; Branca, Francesco; Lee, Warren T K; Leclercq, Catherine; Jerling, Johann; Zotor, Francis; Amuna, Paul; Al Jawaldeh, Ayoub; Aderibigbe, Olaide Ruth; Amoussa, Waliou Hounkpatin; Anderson, Cheryl A M; Aounallah-Skhiri, Hajer; Atek, Madjid; Benhura, Chakare; Chifamba, Jephat; Covic, Namukolo; Dary, Omar; Delisle, Hélène; El Ati, Jalila; El Hamdouchi, Asmaa; El Rhazi, Karima; Faber, Mieke; Kalimbira, Alexander; Korkalo, Liisa; Kruger, Annamarie; Ledo, James; Machiweni, Tatenda; Mahachi, Carol; Mathe, Nonsikelelo; Mokori, Alex; Mouquet-Rivier, Claire; Mutie, Catherine; Nashandi, Hilde Liisa; Norris, Shane A; Onabanjo, Oluseye Olusegun; Rambeloson, Zo; Saha, Foudjo Brice U; Ubaoji, Kingsley Ikechukwu; Zaghloul, Sahar; Slimani, Nadia

2018-01-02

To carry out an inventory on the availability, challenges, and needs of dietary assessment (DA) methods in Africa as a pre-requisite to provide evidence, and set directions (strategies) for implementing common dietary methods and support web-research infrastructure across countries. The inventory was performed within the framework of the "Africa's Study on Physical Activity and Dietary Assessment Methods" (AS-PADAM) project. It involves international institutional and African networks. An inventory questionnaire was developed and disseminated through the networks. Eighteen countries responded to the dietary inventory questionnaire. Various DA tools were reported in Africa; 24-Hour Dietary Recall and Food Frequency Questionnaire were the most commonly used tools. Few tools were validated and tested for reliability. Face-to-face interview was the common method of administration. No computerized software or other new (web) technologies were reported. No tools were standardized across countries. The lack of comparable DA methods across represented countries is a major obstacle to implement comprehensive and joint nutrition-related programmes for surveillance, programme evaluation, research, and prevention. There is a need to develop new or adapt existing DA methods across countries by employing related research infrastructure that has been validated and standardized in other settings, with the view to standardizing methods for wider use.

The Development, Validation, and User Evaluation of Foodbook24: A Web-Based Dietary Assessment Tool Developed for the Irish Adult Population

PubMed Central

McNulty, Breige; Kehoe, Laura; Evans, Katie; Walton, Janette; Flynn, Albert

2017-01-01

Background The application of technology in the area of dietary assessment has resulted in the development of an array of tools, which are often specifically designed for a particular country or region. Objective The aim of this study was to describe the development, validation, and user evaluation of a Web-based dietary assessment tool “Foodbook24.” Methods Foodbook24 is a Web-based, dietary assessment tool consisting of a 24-hour dietary recall (24HDR) and food frequency questionnaire (FFQ) alongside supplementary questionnaires. Validity of the 24HDR component was assessed by 40 participants, who completed 3 nonconsecutive, self-administered 24HDR using Foodbook24 and a 4-day semi-weighed food diary at separate time points. Participants also provided fasted blood samples and 24-hour urine collections for the identification of biomarkers of nutrient and food group intake during each recording period. Statistical analyses on the nutrient and food group intake data derived from each method were performed in SPSS version 20.0 (SPSS Inc). Mean nutrient intakes (and standard deviations) recorded using each method of dietary assessment were calculated. Spearman and Pearson correlations, Wilcoxon Signed Rank and Paired t test were used to investigate the agreement and differences between the nutritional output from Foodbook24 (test method) and the 4-day semi-weighed food diary (reference method). Urinary and plasma biomarkers of nutrient intake were used as an objective validation of Foodbook24. To investigate the user acceptability of Foodbook24, participants from different studies involved with Foodbook24 were asked to complete an evaluation questionnaire. Results For nutrient intake, correlations between the dietary assessment methods were acceptable to very good in strength and statistically significant (range r=.32 to .75). There were some significant differences between reported mean intakes of micronutrients recorded by both methods; however, with the exception of protein (P=.03), there were no significant differences in the reporting of energy or macronutrient intake. Of the 19 food groups investigated in this analysis, there were significant differences between 6 food groups reported by both methods. Spearman correlations for biomarkers of nutrient and food group intake and reported intake were similar for both methods. A total of 118 participants evaluated the acceptability of Foodbook24. The tool was well-received and the majority, 67.8% (80/118), opted for Foodbook24 as the preferred method for future dietary intake assessment when compared against a traditional interviewer led recall and semi-weighed food diary. Conclusions The results of this study demonstrate the validity and user acceptability of Foodbook24. The results also highlight the potential of Foodbook24, a Web-based dietary assessment method, and present a viable alternative to nutritional surveillance in Ireland. PMID:28495662

Assessing the Clinical Skills of Dental Students: A Review of the Literature

ERIC Educational Resources Information Center

Taylor, Carly L.; Grey, Nick; Satterthwaite, Julian D.

2013-01-01

Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

Machine Learning-Based App for Self-Evaluation of Teacher-Specific Instructional Style and Tools

ERIC Educational Resources Information Center

Duzhin, Fedor; Gustafsson, Anders

2018-01-01

Course instructors need to assess the efficacy of their teaching methods, but experiments in education are seldom politically, administratively, or ethically feasible. Quasi-experimental tools, on the other hand, are often problematic, as they are typically too complicated to be of widespread use to educators and may suffer from selection bias…

Evaluation Tool for the Application of Discovery Teaching Method in the Greek Environmental School Projects

ERIC Educational Resources Information Center

Kalathaki, Maria

2015-01-01

Greek school community emphasizes on the discovery direction of teaching methodology in the school Environmental Education (EE) in order to promote Education for the Sustainable Development (ESD). In ESD school projects the used methodology is experiential teamwork for inquiry based learning. The proposed tool checks whether and how a school…

Social Question and Answer Services versus Library Virtual Reference: Evaluation and Comparison from the Users' Perspective

ERIC Educational Resources Information Center

Zhang, Yin; Deng, Shengli

2014-01-01

Introduction: In recent years, the introduction of social question and answer services and other Internet tools have expanded the ways in which people have their questions answered. There has been speculation and debate over whether such services and other Internet tools are replacing library virtual reference services. Method: Most previous…

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Evaluating hospital design from an operations management perspective.

PubMed

Vos, Leti; Groothuis, Siebren; van Merode, Godefridus G

2007-12-01

This paper describes an evaluation method for the assessment of hospital building design from the viewpoint of operations management to assure that the building design supports the efficient and effective operating of care processes now and in the future. The different steps of the method are illustrated by a case study. In the case study an experimental design is applied to assess the effect of used logistical concepts, patient mix and technologies. The study shows that the evaluation method provides a valuable tool for the assessment of both functionality and the ability to meet future developments in operational control of a building design.

Standardized plant disease evaluations will enhance resistance gene discovery

USDA-ARS?s Scientific Manuscript database

Gene discovery and marker development using DNA-based tools require plant populations with well documented phenotypes. If dissimilar phenotype evaluation methods or data scoring techniques are employed with different crops, or at different labs for the same crops, then data mining for genetic marker...

Evaluating conflation methods using uncertainty modeling

NASA Astrophysics Data System (ADS)

Doucette, Peter; Dolloff, John; Canavosio-Zuzelski, Roberto; Lenihan, Michael; Motsko, Dennis

2013-05-01

The classic problem of computer-assisted conflation involves the matching of individual features (e.g., point, polyline, or polygon vectors) as stored in a geographic information system (GIS), between two different sets (layers) of features. The classical goal of conflation is the transfer of feature metadata (attributes) from one layer to another. The age of free public and open source geospatial feature data has significantly increased the opportunity to conflate such data to create enhanced products. There are currently several spatial conflation tools in the marketplace with varying degrees of automation. An ability to evaluate conflation tool performance quantitatively is of operational value, although manual truthing of matched features is laborious and costly. In this paper, we present a novel methodology that uses spatial uncertainty modeling to simulate realistic feature layers to streamline evaluation of feature matching performance for conflation methods. Performance results are compiled for DCGIS street centerline features.

Surgeon-tool force/torque signatures--evaluation of surgical skills in minimally invasive surgery.

PubMed

Rosen, J; MacFarlane, M; Richards, C; Hannaford, B; Sinanan, M

1999-01-01

The best method of training for laparoscopic surgical skills is controversial. Some advocate observation in the operating room, while others promote animal and simulated models or a combination of surgical related tasks. The mode of proficiency evaluation common to all of these methods has been subjective evaluation by a skilled surgeon. In order to define an objective means of evaluating performance, an instrumented laparoscopic grasper was developed measuring the force/torque at the surgeon hand/tool interface. The measured database demonstrated substantial differences between experienced and novice surgeon groups. Analyzing forces and torques combined with the state transition during surgical procedures allows an objective measurement of skill in MIS. Teaching the novice surgeon to limit excessive loads and improve movement efficiency during surgical procedures can potentially result in less injury to soft tissues and less wasted time during laparoscopic surgery. Moreover the force/torque database measured in this study may be used for developing realistic virtual reality simulators and optimization of medical robots performance.

Besides Precision & Recall: Exploring Alternative Approaches to Evaluating an Automatic Indexing Tool for MEDLINE

PubMed Central

Névéol, Aurélie; Zeng, Kelly; Bodenreider, Olivier

2006-01-01

Objective This paper explores alternative approaches for the evaluation of an automatic indexing tool for MEDLINE, complementing the traditional precision and recall method. Materials and methods The performance of MTI, the Medical Text Indexer used at NLM to produce MeSH recommendations for biomedical journal articles is evaluated on a random set of MEDLINE citations. The evaluation examines semantic similarity at the term level (indexing terms). In addition, the documents retrieved by queries resulting from MTI index terms for a given document are compared to the PubMed related citations for this document. Results Semantic similarity scores between sets of index terms are higher than the corresponding Dice similarity scores. Overall, 75% of the original documents and 58% of the top ten related citations are retrieved by queries based on the automatic indexing. Conclusions The alternative measures studied in this paper confirm previous findings and may be used to select particular documents from the test set for a more thorough analysis. PMID:17238409

Psychiatric service staff perceptions of implementing a shared decision-making tool: a process evaluation study

PubMed Central

Schön, Ulla-Karin; Grim, Katarina; Wallin, Lars; Rosenberg, David; Svedberg, Petra

2018-01-01

ABSTRACT Purpose: Shared decision making, SDM, in psychiatric services, supports users to experience a greater sense of involvement in treatment, self-efficacy, autonomy and reduced coercion. Decision tools adapted to the needs of users have the potential to support SDM and restructure how users and staff work together to arrive at shared decisions. The aim of this study was to describe and analyse the implementation process of an SDM intervention for users of psychiatric services in Sweden. Method: The implementation was studied through a process evaluation utilizing both quantitative and qualitative methods. In designing the process evaluation for the intervention, three evaluation components were emphasized: contextual factors, implementation issues and mechanisms of impact. Results: The study addresses critical implementation issues related to decision-making authority, the perceived decision-making ability of users and the readiness of the service to increase influence and participation. It also emphasizes the importance of facilitation, as well as suggesting contextual adaptations that may be relevant for the local organizations. Conclusion: The results indicate that staff perceived the decision support tool as user-friendly and useful in supporting participation in decision-making, and suggest that such concrete supports to participation can be a factor in implementation if adequate attention is paid to organizational contexts and structures. PMID:29405889

Prediction of miRNA targets.

PubMed

Oulas, Anastasis; Karathanasis, Nestoras; Louloupi, Annita; Pavlopoulos, Georgios A; Poirazi, Panayiota; Kalantidis, Kriton; Iliopoulos, Ioannis

2015-01-01

Computational methods for miRNA target prediction are currently undergoing extensive review and evaluation. There is still a great need for improvement of these tools and bioinformatics approaches are looking towards high-throughput experiments in order to validate predictions. The combination of large-scale techniques with computational tools will not only provide greater credence to computational predictions but also lead to the better understanding of specific biological questions. Current miRNA target prediction tools utilize probabilistic learning algorithms, machine learning methods and even empirical biologically defined rules in order to build models based on experimentally verified miRNA targets. Large-scale protein downregulation assays and next-generation sequencing (NGS) are now being used to validate methodologies and compare the performance of existing tools. Tools that exhibit greater correlation between computational predictions and protein downregulation or RNA downregulation are considered the state of the art. Moreover, efficiency in prediction of miRNA targets that are concurrently verified experimentally provides additional validity to computational predictions and further highlights the competitive advantage of specific tools and their efficacy in extracting biologically significant results. In this review paper, we discuss the computational methods for miRNA target prediction and provide a detailed comparison of methodologies and features utilized by each specific tool. Moreover, we provide an overview of current state-of-the-art high-throughput methods used in miRNA target prediction.

Competence evaluation processes for nursing students abroad: Findings from an international case study.

PubMed

Tommasini, Cristina; Dobrowolska, Beata; Zarzycka, Danuta; Bacatum, Claudia; Bruun, Anne Marie Gran; Korsath, Dag; Roel, Siv; Jansen, Mette Bro; Milling, Tine; Deschamps, Anne; Mantzoukas, Stefanos; Mantzouka, Christine; Palese, Alvisa

2017-04-01

Assessing clinical competence in nursing students abroad is a challenge, and requires both methods and instruments capable of capturing the multidimensional nature of the clinical competences acquired. The aim of the study was to compare the clinical competence assessment processes and instruments adopted for nursing students during their clinical placement abroad. A case study design was adopted in 2015. A purposeful sample of eight nursing programmes located in seven countries (Belgium, Denmark, Greece, Norway, Poland, Portugal and Italy) were approached. Tools as instruments for evaluating competences developed in clinical training by international nursing students, and written procedures aimed at guiding the evaluation process, were scrutinised through a content analysis method. All clinical competence evaluation procedures and instruments used in the nursing programmes involved were provided in English. A final evaluation of the competences was expected by all nursing programmes at the end of the clinical placement, while only four provided an intermediate evaluation. Great variability emerged in the tools, with between five and 88 items included. Through content analysis, 196 items emerged, classified into 12 different core competence categories, the majority were categorised as 'Technical skills' (=60), 'Self-learning and critical thinking' (=27) and 'Nursing care process' (=25) competences. Little emphasis was given in the tools to competences involving 'Self-adaptation', 'Inter-professional skills', 'Clinical documentation', 'Managing nursing care', 'Patient communication', and 'Theory and practice integration'. Institutions signing Bilateral Agreements should agree upon the competences expected from students during their clinical education abroad. The tools used in the process, as well as the role expected by the student, should also be agreed upon. Intercultural competences should be further addressed in the process of evaluation, in addition to adaptation to different settings. There is also a need to establish those competences achievable or not in the host country, aiming at increasing transparency in learning expectations and evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

The development and initial validation of a clinical tool for patients' preferences on patient participation--The 4Ps.

PubMed

Eldh, Ann Catrine; Luhr, Kristina; Ehnfors, Margareta

2015-12-01

To report on the development and initial testing of a clinical tool, The Patient Preferences for Patient Participation tool (The 4Ps), which will allow patients to depict, prioritize, and evaluate their participation in health care. While patient participation is vital for high quality health care, a common definition incorporating all stakeholders' experience is pending. In order to support participation in health care, a tool for determining patients' preferences on participation is proposed, including opportunities to evaluate participation while considering patient preferences. Exploratory mixed methods studies informed the development of the tool, and descriptive design guided its initial testing. The 4Ps tool was tested with 21 Swedish researcher experts (REs) and patient experts (PEs) with experience of patient participation. Individual Think Aloud interviews were employed to capture experiences of content, response process, and acceptability. 'The 4Ps' included three sections for the patient to depict, prioritize, and evaluate participation using 12 items corresponding to 'Having Dialogue', 'Sharing Knowledge', 'Planning', and 'Managing Self-care'. The REs and PEs considered 'The 4Ps' comprehensible, and that all items corresponded to the concept of patient participation. The tool was perceived to facilitate patient participation whilst requiring amendments to content and layout. A tool like The 4Ps provides opportunities for patients to depict participation, and thus supports communication and collaboration. Further patient evaluation is needed to understand the conditions for patient participation. While The 4Ps is promising, revision and testing in clinical practice is required. © 2014 John Wiley & Sons Ltd.

Guiding principles for the implementation of non-animal safety assessment approaches for cosmetics: skin sensitisation.

PubMed

Goebel, Carsten; Aeby, Pierre; Ade, Nadège; Alépée, Nathalie; Aptula, Aynur; Araki, Daisuke; Dufour, Eric; Gilmour, Nicola; Hibatallah, Jalila; Keller, Detlef; Kern, Petra; Kirst, Annette; Marrec-Fairley, Monique; Maxwell, Gavin; Rowland, Joanna; Safford, Bob; Schellauf, Florian; Schepky, Andreas; Seaman, Chris; Teichert, Thomas; Tessier, Nicolas; Teissier, Silvia; Weltzien, Hans Ulrich; Winkler, Petra; Scheel, Julia

2012-06-01

Characterisation of skin sensitisation potential is a key endpoint for the safety assessment of cosmetic ingredients especially when significant dermal exposure to an ingredient is expected. At present the mouse local lymph node assay (LLNA) remains the 'gold standard' test method for this purpose however non-animal test methods are under development that aim to replace the need for new animal test data. COLIPA (the European Cosmetics Association) funds an extensive programme of skin sensitisation research, method development and method evaluation and helped coordinate the early evaluation of the three test methods currently undergoing pre-validation. In May 2010, a COLIPA scientific meeting was held to analyse to what extent skin sensitisation safety assessments for cosmetic ingredients can be made in the absence of animal data. In order to propose guiding principles for the application and further development of non-animal safety assessment strategies it was evaluated how and when non-animal test methods, predictions based on physico-chemical properties (including in silico tools), threshold concepts and weight-of-evidence based hazard characterisation could be used to enable safety decisions. Generation and assessment of potency information from alternative tools which at present is predominantly derived from the LLNA is considered the future key research area. Copyright © 2012 Elsevier Inc. All rights reserved.

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource

A New Disability-related Health Care Needs Assessment Tool for Persons With Brain Disorders

PubMed Central

Kim, Yoon; Eun, Sang June; Kim, Wan Ho; Lee, Bum-Suk; Leigh, Ja-Ho; Kim, Jung-Eun

2013-01-01

Objectives This study aimed to develop a health needs assessment (HNA) tool for persons with brain disorders and to assess the unmet needs of persons with brain disorders using the developed tool. Methods The authors used consensus methods to develop a HNA tool. Using a randomized stratified systematic sampling method adjusted for sex, age, and districts, 57 registered persons (27 severe and 30 mild cases) with brain disorders dwelling in Seoul, South Korea were chosen and medical specialists investigated all of the subjects with the developed tools. Results The HNA tool for brain disorders we developed included four categories: 1) medical interventions and operations, 2) assistive devices, 3) rehabilitation therapy, and 4) regular follow-up. This study also found that 71.9% of the subjects did not receive appropriate medical care, which implies that the severity of their disability is likely to be exacerbated and permanent, and the loss irrecoverable. Conclusions Our results showed that the HNA tool for persons with brain disorders based on unmet needs defined by physicians can be a useful method for evaluating the appropriateness and necessity of medical services offered to the disabled, and it can serve as the norm for providing health care services for disabled persons. Further studies should be undertaken to increase validity and reliability of the tool. Fundamental research investigating the factors generating or affecting the unmet needs is necessary; its results could serve as basis for developing policies to eliminate or alleviate these factors. PMID:24137530

Evaluation of Time Domain EM Coupling Techniques. Volume II.

DTIC Science & Technology

1980-08-01

tool for the analysis of elec- tromangetic coupling and shielding problems: the finite-difference, time-domain (FD- TD ) solution of Maxwell’s equations...The objective of the program was to evaluate the suitability of the FD- TD method to determine the amount of electromagnetic coupling through an...specific questfiowwere addressed during this program: 1. Can the FD- TD method accurately model electromagnetic coupling into a conducting structure for

Online survey software as a data collection tool for medical education: A case study on lesson plan assessment.

PubMed

Kimiafar, Khalil; Sarbaz, Masoumeh; Sheikhtaheri, Abbas

2016-01-01

Background: There are no general strategies or tools to evaluate daily lesson plans; however, assessments conducted using traditional methods usually include course plans. This study aimed to evaluate the strengths and weaknesses of online survey software in collecting data on education in medical fields and the application of such softwares to evaluate students' views and modification of lesson plans. Methods: After investigating the available online survey software, esurveypro was selected for assessing daily lesson plans. After using the software for one semester, a questionnaire was prepared to assess the advantages and disadvantages of this method and students' views in a cross-sectional study. Results: The majority of the students (51.7%) rated the evaluation of classes per session (lesson plans) using the online survey as useful or very useful. About 51% (n=36) of the students considered this method effective in improving the management of each session, 67.1% (n=47) considered it effective in improving the management of sessions for the next semester, and 51.4% (n=36) said it had a high impact on improving the educational content of subsequent sessions. Finally, 61.4% (n=43) students expressed high and very high levels of satisfaction with using an online survey at each session. Conclusion: The use of online surveys may be appropriate to improve lesson plans and educational planning at different levels. This method can be used for other evaluations and for assessing people's opinions at different levels of an educational system.

A Survey of Practice Patterns in Concussion Assessment and Management.

PubMed

Ferrara, Michael S.; McCrea, Michael; Peterson, Connie L.; Guskiewicz, Kevin M.

2001-06-01

OBJECTIVES: To identify methods used by athletic trainers to assess concussions and the use of that information to assist in return-to-play decisions and to determine athletic trainers' familiarity with new standardized methods of concussion assessment. DESIGN AND SETTING: A 21-item questionnaire was distributed to attendees of a minicourse at the 1999 National Athletic Trainers' Association Annual Meeting and Clinical Symposia entitled "Use of Standardized Assessment of Concussion (SAC) in the Immediate Sideline Evaluation of Injured Athletes." SUBJECTS: A total of 339 valid surveys were returned by the attendees of the minicourse. MEASUREMENTS: We used frequency analysis and descriptive statistics. RESULTS: Clinical examination (33%) and a symptom checklist (15.3%) were the most common evaluative tools used to assess concussions. The Colorado Guidelines (28%) were used more than other concussion management guidelines. Athletic trainers (34%) and team physicians (40%) were primarily responsible for making decisions regarding return to play. A large number of respondents (83.5%) believed that the use of a standardized method of concussion assessment provided more information than routine clinical and physical examination alone. CONCLUSIONS: Athletic trainers are using a variety of clinical tools to evaluate concussions in athletes. Clinical evaluation and collaboration with physicians still appear to be the primary methods used for return-to-play decisions. However, athletic trainers are beginning to use standardized methods of concussion to evaluate these injuries and to assist them in assessing the severity of injury and deciding when it is safe to return to play.

Introduction of the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Costing Tool: a user-friendly spreadsheet program to estimate costs of providing patient-centered interventions.

PubMed

Reed, Shelby D; Li, Yanhong; Kamble, Shital; Polsky, Daniel; Graham, Felicia L; Bowers, Margaret T; Samsa, Gregory P; Paul, Sara; Schulman, Kevin A; Whellan, David J; Riegel, Barbara J

2012-01-01

Patient-centered health care interventions, such as heart failure disease management programs, are under increasing pressure to demonstrate good value. Variability in costing methods and assumptions in economic evaluations of such interventions limit the comparability of cost estimates across studies. Valid cost estimation is critical to conducting economic evaluations and for program budgeting and reimbursement negotiations. Using sound economic principles, we developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Costing Tool, a spreadsheet program that can be used by researchers and health care managers to systematically generate cost estimates for economic evaluations and to inform budgetary decisions. The tool guides users on data collection and cost assignment for associated personnel, facilities, equipment, supplies, patient incentives, miscellaneous items, and start-up activities. The tool generates estimates of total program costs, cost per patient, and cost per week and presents results using both standardized and customized unit costs for side-by-side comparisons. Results from pilot testing indicated that the tool was well-formatted, easy to use, and followed a logical order. Cost estimates of a 12-week exercise training program in patients with heart failure were generated with the costing tool and were found to be consistent with estimates published in a recent study. The TEAM-HF Costing Tool could prove to be a valuable resource for researchers and health care managers to generate comprehensive cost estimates of patient-centered interventions in heart failure or other conditions for conducting high-quality economic evaluations and making well-informed health care management decisions.

A new impetus for guideline development and implementation: construction and evaluation of a toolbox.

PubMed

Hilbink, Mirrian A H W; Ouwens, Marielle M T J; Burgers, Jako S; Kool, Rudolf B

2014-03-19

In the last decade, guideline organizations faced a number of problems, including a lack of standardization in guideline development methods and suboptimal guideline implementation. To contribute to the solution of these problems, we produced a toolbox for guideline development, implementation, revision, and evaluation. All relevant guideline organizations in the Netherlands were approached to prioritize the topics. We sent out a questionnaire and discussed the results at an invitational conference. Based on consensus, twelve topics were selected for the development of new tools. Subsequently, working groups were composed for the development of the tools. After development of the tools, their draft versions were pilot tested in 40 guideline projects. Based on the results of the pilot tests, the tools were refined and their final versions were presented. The vast majority of organizations involved in pilot testing of the tools reported satisfaction with using the tools. Guideline experts involved in pilot testing of the tools proposed a variety of suggestions for the implementation of the tools. The tools are available in Dutch and in English at a web-based platform on guideline development and implementation (http://www.ha-ring.nl). A collaborative approach was used for the development and evaluation of a toolbox for development, implementation, revision, and evaluation of guidelines. This approach yielded a potentially powerful toolbox for improving the quality and implementation of Dutch clinical guidelines. Collaboration between guideline organizations within this project led to stronger linkages, which is useful for enhancing coordination of guideline development and implementation and preventing duplication of efforts. Use of the toolbox could improve quality standards in the Netherlands, and might facilitate the development of high-quality guidelines in other countries as well.

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

Testing contamination source identification methods for water distribution networks

DOE PAGES

Seth, Arpan; Klise, Katherine A.; Siirola, John D.; ...

2016-04-01

In the event of contamination in a water distribution network (WDN), source identification (SI) methods that analyze sensor data can be used to identify the source location(s). Knowledge of the source location and characteristics are important to inform contamination control and cleanup operations. Various SI strategies that have been developed by researchers differ in their underlying assumptions and solution techniques. The following manuscript presents a systematic procedure for testing and evaluating SI methods. The performance of these SI methods is affected by various factors including the size of WDN model, measurement error, modeling error, time and number of contaminant injections,more » and time and number of measurements. This paper includes test cases that vary these factors and evaluates three SI methods on the basis of accuracy and specificity. The tests are used to review and compare these different SI methods, highlighting their strengths in handling various identification scenarios. These SI methods and a testing framework that includes the test cases and analysis tools presented in this paper have been integrated into EPA’s Water Security Toolkit (WST), a suite of software tools to help researchers and others in the water industry evaluate and plan various response strategies in case of a contamination incident. Lastly, a set of recommendations are made for users to consider when working with different categories of SI methods.« less

Modelling in Evaluating a Working Life Project in Higher Education

ERIC Educational Resources Information Center

Sarja, Anneli; Janhonen, Sirpa; Havukainen, Pirjo; Vesterinen, Anne

2012-01-01

This article describes an evaluation method based on collaboration between the higher education, a care home and university, in a R&D project. The aim of the project was to elaborate modelling as a tool of developmental evaluation for innovation and competence in project cooperation. The approach was based on activity theory. Modelling enabled a…

Introducing Reflexivity to Evaluation Practice: An In-Depth Case Study

ERIC Educational Resources Information Center

van Draanen, Jenna

2017-01-01

There is currently a paucity of literature in the field of evaluation regarding the practice of reflection and reflexivity and a lack of available tools to guide this practice--yet using a reflexive model can enhance evaluation practice. This paper focuses on the methods and results of a reflexive inquiry that was conducted during a participatory…

In-house coordination for organ donation--single-center experience in a pilot project in Germany (2006 to 2013).

PubMed

Kaiser, G M; Wirges, U; Becker, S; Baier, C; Radunz, S; Kraus, H; Paul, A

2014-01-01

A challenge for solid organ transplantation in Germany is the shortage of organs. In an effort to increase donation rates, some federal states mandated hospitals to install transplantation officers to coordinate, evaluate, and enhance the donation and transplantation processes. In 2009 the German Foundation for Organ Transplantation (DSO) implemented the In-House Coordination Project, which includes retrospective, quarterly, information technology-based case analyses of all deceased patients with primary or secondary brain injury in regard to the organ donation process in maximum care hospitals. From 2006 to 2008 an analysis of potential organ donors was performed in our hospital using a time-consuming, complex method using questionnaires, hand-written patient files, and the hospital IT documentation system (standard method). Analyses in the In-House Coordination Project are instead carried out by a proprietary semiautomated IT tool called Transplant Check, which uses easily accessible standard data records of the hospital controlling and accounting unit. The aim of our study was to compare the results of the standard method and Transplant Check in detecting and evaluating potential donors. To do so, the same period of time (2006 to 2008) was re-evaluated using the IT tool. Transplant Check was able to record significantly more patients who fulfilled the criteria for inclusion than the standard method (641 vs 424). The methods displayed a wide overlap, apart from 22 patients who were only recorded by the standard method. In these cases, the accompanying brain injury diagnosis was not recorded in the controlling and accounting unit data records due to little relative clinical significance. None of the 22 patients fulfilled the criteria for brain death. In summary, Transplant Check is an easy-to-use, reliable, and valid tool for evaluating donor potential in a maximum care hospital. Therefore from 2010 on, analyses were performed exclusively with Transplant Check at our university hospital. Copyright © 2014 Elsevier Inc. All rights reserved.

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis

PubMed Central

2013-01-01

Background Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. Methods We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. Results In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. Conclusions There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to assess risk of bias of RCTs. Further empirical evidence on the use of individual items and the psychometric properties of risk of bias tools is needed. PMID:24044807

Evaluation of the clinical process in a critical care information system using the Lean method: a case study.

PubMed

Yusof, Maryati Mohd; Khodambashi, Soudabeh; Mokhtar, Ariffin Marzuki

2012-12-21

There are numerous applications for Health Information Systems (HIS) that support specific tasks in the clinical workflow. The Lean method has been used increasingly to optimize clinical workflows, by removing waste and shortening the delivery cycle time. There are a limited number of studies on Lean applications related to HIS. Therefore, we applied the Lean method to evaluate the clinical processes related to HIS, in order to evaluate its efficiency in removing waste and optimizing the process flow. This paper presents the evaluation findings of these clinical processes, with regards to a critical care information system (CCIS), known as IntelliVue Clinical Information Portfolio (ICIP), and recommends solutions to the problems that were identified during the study. We conducted a case study under actual clinical settings, to investigate how the Lean method can be used to improve the clinical process. We used observations, interviews, and document analysis, to achieve our stated goal. We also applied two tools from the Lean methodology, namely the Value Stream Mapping and the A3 problem-solving tools. We used eVSM software to plot the Value Stream Map and A3 reports. We identified a number of problems related to inefficiency and waste in the clinical process, and proposed an improved process model. The case study findings show that the Value Stream Mapping and the A3 reports can be used as tools to identify waste and integrate the process steps more efficiently. We also proposed a standardized and improved clinical process model and suggested an integrated information system that combines database and software applications to reduce waste and data redundancy.

Pre-Then-Post Testing: A Tool To Improve the Accuracy of Management Training Program Evaluation.

ERIC Educational Resources Information Center

Mezoff, Bob

1981-01-01

Explains a procedure to avoid the detrimental biases of conventional self-reports of training outcomes. The evaluation format provided is a method for using statistical procedures to increase the accuracy of self-reports by overcoming response-shift-bias. (Author/MER)

An Object-Based Approach to Evaluation of Climate Variability Projections and Predictions

NASA Astrophysics Data System (ADS)

Ammann, C. M.; Brown, B.; Kalb, C. P.; Bullock, R.

2017-12-01

Evaluations of the performance of earth system model predictions and projections are of critical importance to enhance usefulness of these products. Such evaluations need to address specific concerns depending on the system and decisions of interest; hence, evaluation tools must be tailored to inform about specific issues. Traditional approaches that summarize grid-based comparisons of analyses and models, or between current and future climate, often do not reveal important information about the models' performance (e.g., spatial or temporal displacements; the reason behind a poor score) and are unable to accommodate these specific information needs. For example, summary statistics such as the correlation coefficient or the mean-squared error provide minimal information to developers, users, and decision makers regarding what is "right" and "wrong" with a model. New spatial and temporal-spatial object-based tools from the field of weather forecast verification (where comparisons typically focus on much finer temporal and spatial scales) have been adapted to more completely answer some of the important earth system model evaluation questions. In particular, the Method for Object-based Diagnostic Evaluation (MODE) tool and its temporal (three-dimensional) extension (MODE-TD) have been adapted for these evaluations. More specifically, these tools can be used to address spatial and temporal displacements in projections of El Nino-related precipitation and/or temperature anomalies, ITCZ-associated precipitation areas, atmospheric rivers, seasonal sea-ice extent, and other features of interest. Examples of several applications of these tools in a climate context will be presented, using output of the CESM large ensemble. In general, these tools provide diagnostic information about model performance - accounting for spatial, temporal, and intensity differences - that cannot be achieved using traditional (scalar) model comparison approaches. Thus, they can provide more meaningful information that can be used in decision-making and planning. Future extensions and applications of these tools in a climate context will be considered.

The characteristics, implementation and effects of Aboriginal and Torres Strait Islander health promotion tools: a systematic literature search

PubMed Central

2014-01-01

Background Health promotion by and with Aboriginal and Torres Strait Islander (hereafter Indigenous) Australians is critically important given a wide gap in health parity compared to other Australians. The development and implementation of step-by-step guides, instruments, packages, frameworks or resources has provided a feasible and low-resource strategy for strengthening evidence-informed health promotion practice. Yet there has been little assessment of where and how these tools are implemented or their effectiveness. This paper reviews the characteristics, implementation and effects of Indigenous health promotion tools. Methods Indigenous health promotion tools were identified through a systematic literature search including a prior scoping study, eight databases, references of other reviews and the authors’ knowledge (n = 1494). Documents in the peer reviewed and grey literature were included if they described or evaluated tools designed, recommended or used for strengthening Indigenous Australian health promotion. Eligible publications were entered into an Excel spreadsheet and documented tools classified according to their characteristics, implementation and effects. Quality was appraised using the Dictionary for Effective Public Health Practice Project (EPHPP) and Critical Appraisal Skills Program (CASP) tools for quantitative and qualitative studies respectively. Results The review found that Indigenous health promotion tools were widely available. Of 74 publications that met inclusion criteria, sixty (81%) documented tools developed specifically for the Indigenous Australian population. All tools had been developed in reference to evidence; but only 22/74 (30%) publications specified intended or actual implementation, and only 11/74 (15%) publications evaluated impacts of the implemented tools. Impacts included health, environmental, community, organisational and health care improvements. The quality of impact evaluations was strong for only five (7%) studies. Conclusions The small number and generally moderate quality of implementation and evaluation studies means that little is known about how tools work to strengthen Indigenous health promotion practice. The findings suggest that rather than continuing to invest in tool development, practitioners, policy makers and researchers could evaluate the implementation and effects of existing tools and publish the results. There is a need for long-term investment in research to review the current use of health promotion tools and the factors that are likely to enhance their implementation. PMID:25012401

DELINEATION OF SUBSURFACE HYDROCARBON CONTAMINANT DISTRIBUTION USING A DIRECT PUSH RESISTIVITY METHOD

EPA Science Inventory

A direct push resistivity method was evaluated as a complementary screening tool to provide rapid in-situ contaminant detection to aid in better defining locations for drilling, sampling, and monitoring well installation at hazardous waste sites. Nine continuous direct push resi...

Model Identification of Integrated ARMA Processes

ERIC Educational Resources Information Center

Stadnytska, Tetiana; Braun, Simone; Werner, Joachim

2008-01-01

This article evaluates the Smallest Canonical Correlation Method (SCAN) and the Extended Sample Autocorrelation Function (ESACF), automated methods for the Autoregressive Integrated Moving-Average (ARIMA) model selection commonly available in current versions of SAS for Windows, as identification tools for integrated processes. SCAN and ESACF can…

Assessment in Simulations

ERIC Educational Resources Information Center

Raymond, Chad; Usherwood, Simon

2013-01-01

Simulations are employed widely as teaching tools in political science, yet evidence of their pedagogical effectiveness, in comparison to other methods of instruction, is mixed. The assessment of learning outcomes is often a secondary concern in simulation design, and the qualitative and quantitative methods used to evaluate outcomes are…

Mechanistic Indicators of Childhood Asthma (MICA): piloting an integrative design for evaluating environmental health

EPA Science Inventory

Background: Modem methods in molecular biology and advanced computational tools show promise in elucidating complex interactions that occur between genes and environmental factors in diseases such as asthma; however appropriately designed studies are critical for these methods to...

Feasibility, acceptability and clinical utility of the Cultural Formulation Interview: mixed-methods results from the DSM-5 international field trial.

PubMed

Lewis-Fernández, Roberto; Aggarwal, Neil Krishan; Lam, Peter C; Galfalvy, Hanga; Weiss, Mitchell G; Kirmayer, Laurence J; Paralikar, Vasudeo; Deshpande, Smita N; Díaz, Esperanza; Nicasio, Andel V; Boiler, Marit; Alarcón, Renato D; Rohlof, Hans; Groen, Simon; van Dijk, Rob C J; Jadhav, Sushrut; Sarmukaddam, Sanjeev; Ndetei, David; Scalco, Monica Z; Bassiri, Kavoos; Aguilar-Gaxiola, Sergio; Ton, Hendry; Westermeyer, Joseph; Vega-Dienstmaier, Johann M

2017-04-01

Background There is a need for clinical tools to identify cultural issues in diagnostic assessment. Aims To assess the feasibility, acceptability and clinical utility of the DSM-5 Cultural Formulation Interview (CFI) in routine clinical practice. Method Mixed-methods evaluation of field trial data from six countries. The CFI was administered to diagnostically diverse psychiatric out-patients during a diagnostic interview. In post-evaluation sessions, patients and clinicians completed debriefing qualitative interviews and Likert-scale questionnaires. The duration of CFI administration and the full diagnostic session were monitored. Results Mixed-methods data from 318 patients and 75 clinicians found the CFI feasible, acceptable and useful. Clinician feasibility ratings were significantly lower than patient ratings and other clinician-assessed outcomes. After administering one CFI, however, clinician feasibility ratings improved significantly and subsequent interviews required less time. Conclusions The CFI was included in DSM-5 as a feasible, acceptable and useful cultural assessment tool. © The Royal College of Psychiatrists 2017.

Evaluation and refinement of a handheld health information technology tool to support the timely update of bedside visual cues to prevent falls in hospitals.

PubMed

Teh, Ruth C-A; Visvanathan, Renuka; Ranasinghe, Damith; Wilson, Anne

2018-06-01

To evaluate clinicians' perspectives, before and after clinical implementation (i.e. trial) of a handheld health information technology (HIT) tool, incorporating an iPad device and automatically generated visual cues for bedside display, for falls risk assessment and prevention in hospital. This pilot study utilized mixed-methods research with focus group discussions and Likert-scale surveys to elicit clinicians' attitudes. The study was conducted across three phases within two medical wards of the Queen Elizabeth Hospital. Phase 1 (pretrial) involved focus group discussion (five staff) and surveys (48 staff) to elicit preliminary perspectives on tool use, benefits and barriers to use and recommendations for improvement. Phase 2 (tool trial) involved HIT tool implementation on two hospital wards over consecutive 12-week periods. Phase 3 (post-trial) involved focus group discussion (five staff) and surveys (29 staff) following tool implementation, with similar themes as in Phase 1. Qualitative data were evaluated using content analysis, and quantitative data using descriptive statistics and logistic regression analysis, with subgroup analyses on user status (P ≤ 0.05). Four findings emerged on clinicians' experience, positive perceptions, negative perceptions and recommendations for improvement of the tool. Pretrial, clinicians were familiar with using visual cues in hospital falls prevention. They identified potential benefits of the HIT tool in obtaining timely, useful falls risk assessment to improve patient care. During the trial, the wards differed in methods of tool implementation, resulting in lower uptake by clinicians on the subacute ward. Post-trial, clinicians remained supportive for incorporating the tool into clinical practice; however, there were issues with usability and lack of time for tool use. Staff who had not used the tool had less appreciation for it improving their understanding of patients' falls risk factors (odds ratio 0.12), or effectively preventing hospital falls (odds ratio 0.12). Clinicians' recommendations resulted in subsequent technological refinement of the tool, and provision of an additional iPad device for more efficient use. This study adds to the limited pool of knowledge about clinicians' attitudes toward health technology use in falls avoidance. Clinicians were willing to use the HIT tool, and their concerns about its usability were addressed in ongoing tool improvement. Including end-users in the development and refinement processes, as well as having high staff uptake of new technologies, is important in improving their acceptance and usage, and in maximizing beneficial feedback to further inform tool development.

Comparative assessment of three standardized robotic surgery training methods.

PubMed

Hung, Andrew J; Jayaratna, Isuru S; Teruya, Kara; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2013-10-01

To evaluate three standardized robotic surgery training methods, inanimate, virtual reality and in vivo, for their construct validity. To explore the concept of cross-method validity, where the relative performance of each method is compared. Robotic surgical skills were prospectively assessed in 49 participating surgeons who were classified as follows: 'novice/trainee': urology residents, previous experience <30 cases (n = 38) and 'experts': faculty surgeons, previous experience ≥30 cases (n = 11). Three standardized, validated training methods were used: (i) structured inanimate tasks; (ii) virtual reality exercises on the da Vinci Skills Simulator (Intuitive Surgical, Sunnyvale, CA, USA); and (iii) a standardized robotic surgical task in a live porcine model with performance graded by the Global Evaluative Assessment of Robotic Skills (GEARS) tool. A Kruskal-Wallis test was used to evaluate performance differences between novices and experts (construct validity). Spearman's correlation coefficient (ρ) was used to measure the association of performance across inanimate, simulation and in vivo methods (cross-method validity). Novice and expert surgeons had previously performed a median (range) of 0 (0-20) and 300 (30-2000) robotic cases, respectively (P < 0.001). Construct validity: experts consistently outperformed residents with all three methods (P < 0.001). Cross-method validity: overall performance of inanimate tasks significantly correlated with virtual reality robotic performance (ρ = -0.7, P < 0.001) and in vivo robotic performance based on GEARS (ρ = -0.8, P < 0.0001). Virtual reality performance and in vivo tissue performance were also found to be strongly correlated (ρ = 0.6, P < 0.001). We propose the novel concept of cross-method validity, which may provide a method of evaluating the relative value of various forms of skills education and assessment. We externally confirmed the construct validity of each featured training tool. © 2013 BJU International.

The research on user behavior evaluation method for network state

NASA Astrophysics Data System (ADS)

Zhang, Chengyuan; Xu, Haishui

2017-08-01

Based on the correlation between user behavior and network running state, this paper proposes a method of user behavior evaluation based on network state. Based on the analysis and evaluation methods in other fields of study, we introduce the theory and tools of data mining. Based on the network status information provided by the trusted network view, the user behavior data and the network state data are analysed. Finally, we construct the user behavior evaluation index and weight, and on this basis, we can accurately quantify the influence degree of the specific behavior of different users on the change of network running state, so as to provide the basis for user behavior control decision.

Exercise Black Skies 2008: Enhancing Live Training Through Virtual Preparation -- Part Two: An Evaluation of Tools and Techniques

DTIC Science & Technology

2009-06-01

visualisation tool. These tools are currently in use at the Surveillance and Control Training Unit (SACTU) in Williamtown, New South Wales, and the School...itself by facilitating the brevity and sharpness of learning points. The playback of video and audio was considered an extremely useful method of...The task assessor’s comments were supported by wall projections and audio replays of relevant mission segments that were controlled by an AAR

Study of the time and effort signal in cutting operations

NASA Astrophysics Data System (ADS)

Grosset, E.; Maillard, A.; Bouhelier, C.; Gasnier, J.

1990-02-01

Perception and treatment of an effort signal by computer methods is discussed. An automatic control system used to measure the wear of machine tools and carry out quality control throughout the cutting process is described. The testing system is used to evaluate the performance of tools which have been vacuum plated. The system is used as part of the BRITE study, the goal of which is to develop an expert system for measuring the wear of tools used during drilling and perforation operations.

Comparison of tool life and surface roughness with MQL, flood cooling, and dry cutting conditions with P20 and D2 steel

NASA Astrophysics Data System (ADS)

Senevirathne, S. W. M. A. I.; Punchihewa, H. K. G.

2017-09-01

Minimum quantity lubrication (MQL) is a cutting fluid (CF) application method that has given promising results in improving machining performances. It has shown that, the performance of cutting systems, depends on the work and tool materials used. AISI P20, and D2 are popular in tool making industry. However, the applicability of MQL in machining these two steels has not been studied previously. This experimental study is focused on evaluating performances of MQL compared to dry cutting, and conventional flood cooling method. Trials were carried out with P20, and D2 steels, using coated carbides as tool material, emulsion cutting oil as the CF. Tool nose wear, and arithmetic average surface roughness (Ra) were taken as response variables. Results were statistically analysed for differences in response variables. Although many past literature has suggested that MQL causes improvements in tool wear, and surface finish, this study has found contradicting results. MQL has caused nearly 200% increase in tool nose wear, and nearly 11-13% increase in surface roughness compared flood cooling method with both P20 and D2. Therefore, this study concludes that MQL affects adversely in machining P20, and D2 steels.

Citation Discovery Tools for Conducting Adaptive Meta-analyses to Update Systematic Reviews.

PubMed

Bae, Jong-Myon; Kim, Eun Hee

2016-03-01

The systematic review (SR) is a research methodology that aims to synthesize related evidence. Updating previously conducted SRs is necessary when new evidence has been produced, but no consensus has yet emerged on the appropriate update methodology. The authors have developed a new SR update method called 'adaptive meta-analysis' (AMA) using the 'cited by', 'similar articles', and 'related articles' citation discovery tools in the PubMed and Scopus databases. This study evaluates the usefulness of these citation discovery tools for updating SRs. Lists were constructed by applying the citation discovery tools in the two databases to the articles analyzed by a published SR. The degree of overlap between the lists and distribution of excluded results were evaluated. The articles ultimately selected for the SR update meta-analysis were found in the lists obtained from the 'cited by' and 'similar' tools in PubMed. Most of the selected articles appeared in both the 'cited by' lists in Scopus and PubMed. The Scopus 'related' tool did not identify the appropriate articles. The AMA, which involves using both citation discovery tools in PubMed, and optionally, the 'related' tool in Scopus, was found to be useful for updating an SR.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Experimental investigation and optimization of welding process parameters for various steel grades using NN tool and Taguchi method

NASA Astrophysics Data System (ADS)

Soni, Sourabh Kumar; Thomas, Benedict

2018-04-01

The term "weldability" has been used to describe a wide variety of characteristics when a material is subjected to welding. In our analysis we perform experimental investigation to estimate the tensile strength of welded joint strength and then optimization of welding process parameters by using taguchi method and Artificial Neural Network (ANN) tool in MINITAB and MATLAB software respectively. The study reveals the influence on weldability of steel by varying composition of steel by mechanical characterization. At first we prepare the samples of different grades of steel (EN8, EN 19, EN 24). The samples were welded together by metal inert gas welding process and then tensile testing on Universal testing machine (UTM) was conducted for the same to evaluate the tensile strength of the welded steel specimens. Further comparative study was performed to find the effects of welding parameter on quality of weld strength by employing Taguchi method and Neural Network tool. Finally we concluded that taguchi method and Neural Network Tool is much efficient technique for optimization.

Evaluating an holistic assessment tool for palliative care practice.

PubMed

McIlfatrick, Sonja; Hasson, Felicity

2014-04-01

To evaluate a holistic assessment tool for palliative care practice. This included identifying patients' needs using the holistic tool and exploring the usability, applicability and barriers and facilitators towards implementation in practice. The delivery of effective holistic palliative care requires a careful assessment of the patients' needs and circumstances. Whilst holistic assessment of palliative care needs is advocated, questions exist around the appropriateness of tools to assist this process. Mixed-method research design. Data collection involved an analysis of piloted holistic assessments undertaken using the tool (n = 132) and two focus groups with healthcare professionals (n = 10). The tool enabled health professionals to identify and gain an understanding of the needs of the patients, specifically in relation to the physical healthcare needs. Differences, however, between the analysis of the tool documentation and focus group responses were identified in particular areas. For example, 59 (68·8%) respondents had discussed preferred priorities of care with the patient; however, focus group comments revealed participants had concerns around this. Similarly, whilst over half of responses (n = 50; 57·5%) had considered a prognostic clinical indicator for the patient as an action, focus group results indicated questions around healthcare professionals' knowledge and perceived usefulness of such indicators. Positive aspects of the tool were that it was easy to understand and captured the needs of individuals. Negative aspects of the tool were that it was repetitive and the experience of assessors required consideration. The tool evaluation identified questions regarding holistic assessment in palliative care practice and the importance of communication. A holistic assessment tool can support patient assessment and identification of patients' needs in the 'real world' of palliative care practice, but the 'tool' is merely an aid to assist professionals to discuss difficult and sensitive aspects of care. © 2013 John Wiley & Sons Ltd.

Investigating Qualities of Teachers' Feedback Conversations for Fostering Reasoning and Feeling of Self-Worth in Learners: A Tool Called Feedback Mapping

ERIC Educational Resources Information Center

Quynn, Jennifer Ann

2013-01-01

Teacher feedback has been identified throughout the educational literature as a powerful classroom intervention. However few tools exist that allow teachers to understand their own feedback practice. This study details a method for evaluating the feedback experiences of students. The feedback conversations of middle school science teachers were…

The Virtual Learning Commons (VLC): Enabling Co-Innovation Across Disciplines

NASA Astrophysics Data System (ADS)

Pennington, D. D.; Gandara, A.; Del Rio, N.

2014-12-01

A key challenge for scientists addressing grand-challenge problems is identifying, understanding, and integrating potentially relevant methods, models and tools that that are rapidly evolving in the informatics community. Such tools are essential for effectively integrating data and models in complex research projects, yet it is often difficult to know what tools are available and it is not easy to understand or evaluate how they might be used in a given research context. The goal of the National Science Foundation-funded Virtual Learning Commons (VLC) is to improve awareness and understanding of emerging methodologies and technologies, facilitate individual and group evaluation of these, and trace the impact of innovations within and across teams, disciplines, and communities. The VLC is a Web-based social bookmarking site designed specifically to support knowledge exchange in research communities. It is founded on well-developed models of technology adoption, diffusion of innovation, and experiential learning. The VLC makes use of Web 2.0 (Social Web) and Web 3.0 (Semantic Web) approaches. Semantic Web approaches enable discovery of potentially relevant methods, models, and tools, while Social Web approaches enable collaborative learning about their function. The VLC is under development and the first release is expected Fall 2014.

A Quality Improvement Activity to Promote Interprofessional Collaboration Among Health Professions Students

PubMed Central

Stevenson, Katherine; Busch, Angela; Scott, Darlene J.; Henry, Carol; Wall, Patricia A.

2009-01-01

Objectives To develop and evaluate a classroom-based curriculum designed to promote interprofessional competencies by having undergraduate students from various health professions work together on system-based problems using quality improvement (QI) methods and tools to improve patient-centered care. Design Students from 4 health care programs (nursing, nutrition, pharmacy, and physical therapy) participated in an interprofessional QI activity. In groups of 6 or 7, students completed pre-intervention and post-intervention reflection tools on attitudes relating to interprofessio nal teams, and a tool designed to evaluate group process. Assessment One hundred thirty-four students (76.6%) completed both self-reflection instruments, and 132 (74.2%) completed the post-course group evaluation instrument. Although already high prior to the activity, students' mean post-intervention reflection scores increased for 12 of 16 items. Post-intervention group evaluation scores reflected a high level of satisfaction with the experience. Conclusion Use of a quality-based case study and QI methodology were an effective approach to enhancing interprofessional experiences among students. PMID:19657497

Appraisal Tools for Clinical Practice Guidelines: A Systematic Review

PubMed Central

Siering, Ulrich; Eikermann, Michaela; Hausner, Elke; Hoffmann-Eßer, Wiebke; Neugebauer, Edmund A.

2013-01-01

Introduction Clinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools. Methods Among others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items. Results We identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions “evaluation of evidence” (mentioned in 35 tools; 88%), “presentation of guideline content” (34 tools; 85%), “transferability” (33 tools; 83%), “independence” (32 tools; 80%), “scope” (30 tools; 75%), and “information retrieval” (29 tools; 73%). The quality dimensions “consideration of different perspectives” and “dissemination, implementation and evaluation of the guideline” were covered by only twenty (50%) and eighteen tools (45%) respectively. Conclusions Most guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools. PMID:24349397

Quantification of Sesquiterpene Lactones in Asteraceae Plant Extracts: Evaluation of their Allergenic Potential

PubMed Central

Salapovic, Helena; Geier, Johannes; Reznicek, Gottfried

2013-01-01

Sesquiterpene lactones (SLs), mainly those with an activated exocyclic methylene group, are important allergens in Asteraceae (Compositae) plants. As a screening tool, the Compositae mix, consisting of five Asteraceae plant extracts with allergenic potential (feverfew, tansy, arnica, yarrow, and German chamomile) is part of several national patch test baseline series. However, the SL content of the Compositae mix may vary due to the source material. Therefore, a simple spectrophotometric method for the quantitative measurement of SLs with the α-methylene-γ-butyrolactone moiety was developed, giving the percentage of allergenic compounds in plant extracts. The method has been validated and five Asteraceae extracts, namely feverfew (Tanacetum parthenium L.), tansy (Tanacetum vulgare L.), arnica (Arnica montana L.), yarrow (Achillea millefolium L.), and German chamomile (Chamomilla recutita L. Rauschert) that have been used in routine patch test screening were evaluated. A good correlation could be found between the results obtained using the proposed spectrophotometric method and the corresponding clinical results. Thus, the introduced method is a valuable tool for evaluating the allergenic potential and for the simple and efficient quality control of plant extracts with allergenic potential. PMID:24106675

Student Use of NABPLaw Online in a Pharmacy Laws Project

PubMed Central

Hammer, Dana P.; Hartnett, Cassandra J.; Williams, Donald H.

2006-01-01

Objectives To evaluate students’ frequency of use and degree of usefulness of NABPLaw Online, a pharmacy-specific, online, licensed resource produced by the National Association of Boards of Pharmacy (NABP). Methods Students usage of various information resources, including NABPLaw Online were evaluated through (1) usage statistics gathered by NABP, (2) students’ response to a questionnaire, and (3) citation analysis performed on students’ project reports. Results Students used NABPLaw Online less frequently than other online tools, partly related to the relevance of the tool to their projects, and partly related to ease of use in comparison to other tools. Conclusions Although it was not extensively used, NABPLaw Online represents a unique resource for students researching multistate aspects of pharmacy practice law. PMID:17149444

A benchmarking tool to evaluate computer tomography perfusion infarct core predictions against a DWI standard.

PubMed

Cereda, Carlo W; Christensen, Søren; Campbell, Bruce Cv; Mishra, Nishant K; Mlynash, Michael; Levi, Christopher; Straka, Matus; Wintermark, Max; Bammer, Roland; Albers, Gregory W; Parsons, Mark W; Lansberg, Maarten G

2016-10-01

Differences in research methodology have hampered the optimization of Computer Tomography Perfusion (CTP) for identification of the ischemic core. We aim to optimize CTP core identification using a novel benchmarking tool. The benchmarking tool consists of an imaging library and a statistical analysis algorithm to evaluate the performance of CTP. The tool was used to optimize and evaluate an in-house developed CTP-software algorithm. Imaging data of 103 acute stroke patients were included in the benchmarking tool. Median time from stroke onset to CT was 185 min (IQR 180-238), and the median time between completion of CT and start of MRI was 36 min (IQR 25-79). Volumetric accuracy of the CTP-ROIs was optimal at an rCBF threshold of <38%; at this threshold, the mean difference was 0.3 ml (SD 19.8 ml), the mean absolute difference was 14.3 (SD 13.7) ml, and CTP was 67% sensitive and 87% specific for identification of DWI positive tissue voxels. The benchmarking tool can play an important role in optimizing CTP software as it provides investigators with a novel method to directly compare the performance of alternative CTP software packages. © The Author(s) 2015.

[The pathogenetic approach to the development of tools and methods for the improvement of statokinetic stability in the operators of aerospace systems].

PubMed

Glaznikov, L A; Buĭnov, L G; Govorun, M I; Sorokina, L A; Nigmedzianov, R A; Golovanov, A E

2012-01-01

The objective of the present study was to estimate the efficacy of the tools and methods for the optimization of the activity of the central nervous system (CNS) and analyzers involved in the maintenance of the statokinetic (SK) stability in man. To this effect, we evaluated the outcome of bemitil treatment during 10 days with and without A.I. Yarotsky test and the influence of these procedures on the pathophysiological characteristics of selected elements of the work of operators of aerospace systems. Based on the data obtained in the study, the tools and methods have been developed that allow the efficacy and quality of certain aspects of the operators' activity to be improved, viz. general working capacity under conditions requiring enhanced statokinetic stability, self-confidence, emotional and somatic comfort.

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Stochastic Simulation Tool for Aerospace Structural Analysis

NASA Technical Reports Server (NTRS)

Knight, Norman F.; Moore, David F.

2006-01-01

Stochastic simulation refers to incorporating the effects of design tolerances and uncertainties into the design analysis model and then determining their influence on the design. A high-level evaluation of one such stochastic simulation tool, the MSC.Robust Design tool by MSC.Software Corporation, has been conducted. This stochastic simulation tool provides structural analysts with a tool to interrogate their structural design based on their mathematical description of the design problem using finite element analysis methods. This tool leverages the analyst's prior investment in finite element model development of a particular design. The original finite element model is treated as the baseline structural analysis model for the stochastic simulations that are to be performed. A Monte Carlo approach is used by MSC.Robust Design to determine the effects of scatter in design input variables on response output parameters. The tool was not designed to provide a probabilistic assessment, but to assist engineers in understanding cause and effect. It is driven by a graphical-user interface and retains the engineer-in-the-loop strategy for design evaluation and improvement. The application problem for the evaluation is chosen to be a two-dimensional shell finite element model of a Space Shuttle wing leading-edge panel under re-entry aerodynamic loading. MSC.Robust Design adds value to the analysis effort by rapidly being able to identify design input variables whose variability causes the most influence in response output parameters.

Qualitative Collection Analysis: The Conspectus Methodology. SPEC Kit 151.

ERIC Educational Resources Information Center

Jakubs, Deborah

The introduction to this Systems and Procedures Exchange Center (SPEC) kit explains the Conspectus method, which was developed in 1980 by the Research Libraries Group (RLG) as a means of systematically and qualitatively evaluating large library collections. The discussion considers advantages and disadvantages of this tool, which evaluates past…

Using Photo-Interviewing as Tool for Research and Evaluation.

ERIC Educational Resources Information Center

Dempsey, John V.; Tucker, Susan A.

Arguing that photo-interviewing yields richer data than that usually obtained from verbal interviewing procedures alone, it is proposed that this method of data collection be added to "standard" methodologies in instructional development research and evaluation. The process, as described in this paper, consists of using photographs of…

Evaluation of the accuracy of GPS as a method of locating traffic collisions.

DOT National Transportation Integrated Search

2004-06-01

The objective of this study were to determine the accuracy of GPS units as a traffic crash location tool, evaluate the accuracy of the location data obtained using the GPS units, and determine the largest sources of any errors found. : The analysis s...

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

ERIC Educational Resources Information Center

Wind, Stefanie A.; Engelhard, George, Jr.

2016-01-01

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement…

Evaluation of the constituents of vetiver oil against Anopheles minimus (Diptera: Culicidae), a malaria vector in Thailand

USDA-ARS?s Scientific Manuscript database

The development of resistance by mosquitoes to current synthetic compounds has resulted in reduced effectiveness of prevention and control methods worldwide. An alternative non-chemical based control tools are needed to be evaluated particularly plant-derived essential oils. Several components of ve...

Multicentre study for validation of the French addictovigilance network reports assessment tool

PubMed Central

Hardouin, Jean Benoit; Rousselet, Morgane; Gerardin, Marie; Guerlais, Marylène; Guillou, Morgane; Bronnec, Marie; Sébille, Véronique; Jolliet, Pascale

2016-01-01

Aims The French health authority (ANSM) is responsible for monitoring medicinal and other drug dependencies. To support these activities, the ANSM manages a network of 13 drug dependence evaluation and information centres (Centres d'Evaluation et d'Information sur la Pharmacodépendance ‐ Addictovigilance ‐ CEIP‐A) throughout France. In 2006, the Nantes CEIP‐A created a new tool called the EGAP (Echelle de GrAvité de la Pharmacodépendance‐ drug dependence severity scale) based on DSM IV criteria. This tool allows the creation of a substance use profile that enables the drug dependence severity to be homogeneously quantified by assigning a score to each substance indicated in the reports from health professionals. This article describes the validation and psychometric properties of the drug dependence severity score obtained from the scale ( Clinicaltrials.gov NCT01052675). Method The validity of the EGAP construct, the concurrent validity and the discriminative ability of the EGAP score, the consistency of answers to EGAP items, the internal consistency and inter rater reliability of the EGAP score were assessed using statistical methods that are generally used for psychometric tests. Results The total EGAP score was a reliable and precise measure for evaluating drug dependence (Cronbach alpha = 0.84; ASI correlation = 0.70; global ICC = 0.92). In addition to its good psychometric properties, the EGAP is a simple and efficient tool that can be easily specified on the official ANSM notification form. Conclusion The good psychometric properties of the total EGAP score justify its use for evaluating the severity of drug dependence. PMID:27302554

Quantification of major flavonoids in carnation tissues (Dianthus caryophyllus) as a tool for cultivar discrimination.

PubMed

Galeotti, Francesco; Barile, Elisa; Lanzotti, Virginia; Dolci, Marcello; Curir, Paolo

2008-01-01

One flavone-C-glycoside and two flavonol-O-glycosides were recognized and isolated as the main flavonoidal components in nine different carnation cultivars, and their chemical structures have been determined by spectroscopic methods, including UV detection, MS and NMR. The distribution of these three compounds in flowers, leaves, stems, young sprouts, and roots of each cultivar was evaluated by a simple HPLC-UV method: the graphic representation of their content in the different tissues allows to identify and characterize unambiguously each considered carnation cultivar. The presented method could be an easy, inexpensive and reliable tool for carnation cultivar discrimination.

Evaluation of a computerized aid for creating human behavioral representations of human-computer interaction.

PubMed

Williams, Kent E; Voigt, Jeffrey R

2004-01-01

The research reported herein presents the results of an empirical evaluation that focused on the accuracy and reliability of cognitive models created using a computerized tool: the cognitive analysis tool for human-computer interaction (CAT-HCI). A sample of participants, expert in interacting with a newly developed tactical display for the U.S. Army's Bradley Fighting Vehicle, individually modeled their knowledge of 4 specific tasks employing the CAT-HCI tool. Measures of the accuracy and consistency of task models created by these task domain experts using the tool were compared with task models created by a double expert. The findings indicated a high degree of consistency and accuracy between the different "single experts" in the task domain in terms of the resultant models generated using the tool. Actual or potential applications of this research include assessing human-computer interaction complexity, determining the productivity of human-computer interfaces, and analyzing an interface design to determine whether methods can be automated.

Outcome Measures in Spinal Cord Injury

PubMed Central

Alexander, Marcalee S.; Anderson, Kim; Biering-Sorensen, Fin; Blight, Andrew R.; Brannon, Ruth; Bryce, Thomas; Creasey, Graham; Catz, Amiram; Curt, Armin; Donovan, William; Ditunno, John; Ellaway, Peter; Finnerup, Nanna B.; Graves, Daniel E.; Haynes, Beth Ann; Heinemann, Allen W.; Jackson, Amie B.; Johnston, Mark; Kalpakjian, Claire Z.; Kleitman, Naomi; Krassioukov, Andrei; Krogh, Klaus; Lammertse, Daniel; Magasi, Susan; Mulcahey, MJ; Schurch, Brigitte; Sherwood, Arthur; Steeves, John D.; Stiens, Steven; Tulsky, David S.; van Hedel, Hubertus J.A.; Whiteneck, Gale

2009-01-01

Study Design review by the Spinal Cord Outcomes Partnership Endeavor (SCOPE), which is a broad-based international consortium of scientists and clinical researchers representing academic institutions, industry, government agencies, not-for-profit organizations and foundations. Objectives assessment of current and evolving tools for evaluating human spinal cord injury (SCI) outcomes for both clinical diagnosis and clinical research studies. Methods a framework for the appraisal of evidence of metric properties was used to examine outcome tools or tests for accuracy, sensitivity, reliability and validity for human SCI. Results imaging, neurological, functional, autonomic, sexual health, bladder/bowel, pain, and psycho-social tools were evaluated. Several specific tools for human SCI studies have or are being developed to allow the more accurate determination for a clinically meaningful benefit (improvement in functional outcome or quality of life) being achieved as a result of a therapeutic intervention. Conclusion significant progress has been made, but further validation studies are required to identify the most appropriate tools for specific targets in a human SCI study or clinical trial. PMID:19381157

extrap: Software to assist the selection of extrapolation methods for moving-boat ADCP streamflow measurements

NASA Astrophysics Data System (ADS)

Mueller, David S.

2013-04-01

Selection of the appropriate extrapolation methods for computing the discharge in the unmeasured top and bottom parts of a moving-boat acoustic Doppler current profiler (ADCP) streamflow measurement is critical to the total discharge computation. The software tool, extrap, combines normalized velocity profiles from the entire cross section and multiple transects to determine a mean profile for the measurement. The use of an exponent derived from normalized data from the entire cross section is shown to be valid for application of the power velocity distribution law in the computation of the unmeasured discharge in a cross section. Selected statistics are combined with empirically derived criteria to automatically select the appropriate extrapolation methods. A graphical user interface (GUI) provides the user tools to visually evaluate the automatically selected extrapolation methods and manually change them, as necessary. The sensitivity of the total discharge to available extrapolation methods is presented in the GUI. Use of extrap by field hydrographers has demonstrated that extrap is a more accurate and efficient method of determining the appropriate extrapolation methods compared with tools currently (2012) provided in the ADCP manufacturers' software.

SETs: stand evaluation tools: I. an individual-tree approach to making stand evaluations

Treesearch

Paul S. DeBald; Joseph J. Mendel

1976-01-01

The authors outline a stand-evaluation method that stresses individuality by (1) making on-the-ground projections of individual tree development; (2) summarizing stand values in terms of the individual trees in the stand and their potential development; and (3) tailoring several management possibilities to an individual stand so the owner can choose among them.

Forward impact extrusion of surface textured steel blanks using coated tooling

NASA Astrophysics Data System (ADS)

Hild, Rafael; Feuerhack, Andreas; Trauth, Daniel; Arghavani, Mostafa; Kruppe, Nathan C.; Brögelmann, Tobias; Bobzin, Kirsten; Klocke, Fritz

2017-10-01

A method to enable dry metal forming by the means of a self-lubricating coating and surface textures was researched using an innovative Pin-On-Cylinder-Tribometer. The experimental analysis was complemented by a numerical model of the complex contact conditions between coated tools and the surface textured specimen at the micro-level. Based on the results, the explanation of the tribological interactions between surface textured specimens and the tool in dry full forward extrusion is the objective of this work. Therefore, experimental dry extrusion tests were performed using a tool system. The extruded specimens were evaluated regarding their geometry as well as by the required punch force. Thereby, the effectiveness and the feasibility of dry metal forming on the example of full forward extrusion was evaluated. Thus, one more step towards the technical realization of dry metal forming of low alloy steels under industrial conditions was realized.

Validity of Eye Movement Methods and Indices for Capturing Semantic (Associative) Priming Effects

ERIC Educational Resources Information Center

Odekar, Anshula; Hallowell, Brooke; Kruse, Hans; Moates, Danny; Lee, Chao-Yang

2009-01-01

Purpose: The purpose of this investigation was to evaluate the usefulness of eye movement methods and indices as a tool for studying priming effects by verifying whether eye movement indices capture semantic (associative) priming effects in a visual cross-format (written word to semantically related picture) priming paradigm. Method: In the…

A Learner-Centered Grading Method Focused on Reaching Proficiency with Course Learning Outcomes

ERIC Educational Resources Information Center

Toledo, Santiago; Dubas, Justin M.

2017-01-01

Getting students to use grading feedback as a tool for learning is a continual challenge for educators. This work proposes a method for evaluating student performance that provides feedback to students based on standards of learning dictated by clearly delineated course learning outcomes. This method combines elements of standards-based grading…

Implementation and Evaluation of Flipped Classroom as IoT Element into Learning Process of Computer Network Education

ERIC Educational Resources Information Center

Zhamanov, Azamat; Yoo, Seong-Moo; Sakhiyeva, Zhulduz; Zhaparov, Meirambek

2018-01-01

Students nowadays are hard to be motivated to study lessons with traditional teaching methods. Computers, smartphones, tablets and other smart devices disturb students' attentions. Nevertheless, those smart devices can be used as auxiliary tools of modern teaching methods. In this article, the authors review two popular modern teaching methods:…

Factors that affect micro-tooling features created by direct printing approach

NASA Astrophysics Data System (ADS)

Kumbhani, Mayur N.

Current market required faster pace production of smaller, better, and improved products in shorter amount of time. Traditional high-rate manufacturing process such as hot embossing, injection molding, compression molding, etc. use tooling to replicate feature on a products. Miniaturization of many product in the field of biomedical, electronics, optical, and microfluidic is occurring on a daily bases. There is a constant need to produce cheaper, and faster tooling, which can be utilize by existing manufacturing processes. Traditionally, in order to manufacture micron size tooling features processes such as micro-machining, Electrical Discharge Machining (EDM), etc. are utilized. Due to a higher difficulty to produce smaller size features, and longer production cycle time, various additive manufacturing approaches are proposed, e.g. selective laser sintering (SLS), inkjet printing (3DP), fused deposition modeling (FDM), etc. were proposed. Most of these approaches can produce net shaped products from different materials such as metal, ceramic, or polymers. Several attempts were made to produce tooling features using additive manufacturing approaches. Most of these produced tooling were not cost effective, and the life cycle of these tooling was reported short. In this research, a method to produce tooling features using direct printing approach, where highly filled feedstock was dispensed on a substrate. This research evaluated different natural binders, such as guar gum, xanthan gum, and sodium carboxymethyl cellulose (NaCMC) and their combinations were evaluated. The best binder combination was then use to evaluate effect of different metal (316L stainless steel (3 mum), 316 stainless steel (45 mum), and 304 stainless steel (45 mum)) particle size on feature quality. Finally, the effect of direct printing process variables such as dispensing tip internal diameter (500 mum, and 333 mum) at different printing speeds were evaluated.

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

MiRduplexSVM: A High-Performing MiRNA-Duplex Prediction and Evaluation Methodology

PubMed Central

Karathanasis, Nestoras; Tsamardinos, Ioannis; Poirazi, Panayiota

2015-01-01

We address the problem of predicting the position of a miRNA duplex on a microRNA hairpin via the development and application of a novel SVM-based methodology. Our method combines a unique problem representation and an unbiased optimization protocol to learn from mirBase19.0 an accurate predictive model, termed MiRduplexSVM. This is the first model that provides precise information about all four ends of the miRNA duplex. We show that (a) our method outperforms four state-of-the-art tools, namely MaturePred, MiRPara, MatureBayes, MiRdup as well as a Simple Geometric Locator when applied on the same training datasets employed for each tool and evaluated on a common blind test set. (b) In all comparisons, MiRduplexSVM shows superior performance, achieving up to a 60% increase in prediction accuracy for mammalian hairpins and can generalize very well on plant hairpins, without any special optimization. (c) The tool has a number of important applications such as the ability to accurately predict the miRNA or the miRNA*, given the opposite strand of a duplex. Its performance on this task is superior to the 2nts overhang rule commonly used in computational studies and similar to that of a comparative genomic approach, without the need for prior knowledge or the complexity of performing multiple alignments. Finally, it is able to evaluate novel, potential miRNAs found either computationally or experimentally. In relation with recent confidence evaluation methods used in miRBase, MiRduplexSVM was successful in identifying high confidence potential miRNAs. PMID:25961860

Systematic Review of the Measurement Properties of Tools Used to Measure Behaviour Problems in Young Children with Autism

PubMed Central

Hanratty, Jennifer; Livingstone, Nuala; Robalino, Shannon; Terwee, Caroline B.; Glod, Magdalena; Oono, Inalegwu P.; Rodgers, Jacqui; Macdonald, Geraldine; McConachie, Helen

2015-01-01

Background Behaviour problems are common in young children with autism spectrum disorder (ASD). There are many different tools used to measure behavior problems but little is known about their validity for the population. Objectives To evaluate the measurement properties of behaviour problems tools used in evaluation of intervention or observational research studies with children with ASD up to the age of six years. Methods Behaviour measurement tools were identified as part of a larger, two stage, systematic review. First, sixteen major electronic databases, as well as grey literature and research registers were searched, and tools used listed and categorized. Second, using methodological filters, we searched for articles examining the measurement properties of the tools in use with young children with ASD in ERIC, MEDLINE, EMBASE, CINAHL, and PsycINFO. The quality of these papers was then evaluated using the COSMIN checklist. Results We identified twelve tools which had been used to measure behaviour problems in young children with ASD, and fifteen studies which investigated the measurement properties of six of these tools. There was no evidence available for the remaining six tools. Two questionnaires were found to be the most robust in their measurement properties, the Child Behavior Checklist and the Home Situations Questionnaire—Pervasive Developmental Disorders version. Conclusions We found patchy evidence on reliability and validity, for only a few of the tools used to measure behaviour problems in young children with ASD. More systematic research is required on measurement properties of tools for use in this population, in particular to establish responsiveness to change which is essential in measurement of outcomes of intervention. PROSPERO Registration Number CRD42012002223 PMID:26659821

Monitoring and evaluation of strategic change programme implementation-Lessons from a case analysis.

PubMed

Neumann, Jan; Robson, Andrew; Sloan, Diane

2018-02-01

This study considered the monitoring and evaluation of a large-scale and domestic and global strategic change programme implementation. It considers the necessary prerequisites to overcome challenges and barriers that prevent systematic and effective monitoring and evaluation to take place alongside its operationalisation. The work involves a case study based on a major industrial company from the energy sector. The change programme makes particular reference to changes in business models, business processes, organisation structures as well as Enterprise Resource Planning infrastructure. The case study focussed on the summative evaluation of the programme post-implementation. This assessment involved 25 semi-structured interviews with employees across a range of managerial strata capturing more than 65 roles within the change programme at both local and global levels. Data relating to their perception of evaluation effectiveness and shortcomings were analysed by means of template analysis. The study identifies responsibilities for executing an evaluation alongside various methods and tools that are appropriate, thereby focussing on the "Who" (roles, responsibility for particular activities) and "How" (methods and tools) rather than "What" to monitor and evaluate. The findings are presented generically so they offer new insights and transferability for practitioners involved in managing strategic change and its associated evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development of a participatory tool for the evaluation of Village Animal Health Workers in Cambodia.

PubMed

Calba, Clementine; Ponsich, Aurelia; Nam, Sophorn; Collineau, Lucie; Min, Sophoan; Thonnat, Jerome; Goutard, Flavie Luce

2014-06-01

In countries with a lack of primary care systems, health workers are of crucial importance to improving the delivery of health and animal health services at community level. But somehow they are rarely evaluated and usually with a top-down approach. This is the case in Cambodia, where thousands of Village Animal Health Workers (VAHWs) have been trained by the government, and where no standardized evaluation tool is available to accurately assess the situation. Based on methodology developed by the French NGO Agronomes et Vétérinaires Sans Frontières (AVSF) in Madagascar for farmers' association evaluation, we developed our own participatory methods to collect information about the VAHW context and build a criteria grid for their evaluation. In this framework, several participatory approaches were used such as problem trees, semi-structured interviews, pair-wise ranking and focus groups. The grid was built with the help of relevant stakeholders involved in the animal health system in Cambodia in order to (i) identify VAHW functions; (ii) set up criteria and associated questionnaires, and (iii) score the grid with all the stakeholders. The tool was divided into five categories of evaluation criteria: sustainability, treatment, production, vaccination and disease reporting. Our approach looked at local indicators of success developed and used by VAHWs themselves, which should lead to better acceptability of evaluation. This method gave priority to dialog aiming to engage decision makers and other stakeholders in a mutual learning process and could be applied in other countries to develop trust between health workers and official service representatives as well as to foster corrective action after evaluation. Copyright © 2014 The Authors. Published by Elsevier B.V. All rights reserved.

SECIMTools: a suite of metabolomics data analysis tools.

PubMed

Kirpich, Alexander S; Ibarra, Miguel; Moskalenko, Oleksandr; Fear, Justin M; Gerken, Joseph; Mi, Xinlei; Ashrafi, Ali; Morse, Alison M; McIntyre, Lauren M

2018-04-20

Metabolomics has the promise to transform the area of personalized medicine with the rapid development of high throughput technology for untargeted analysis of metabolites. Open access, easy to use, analytic tools that are broadly accessible to the biological community need to be developed. While technology used in metabolomics varies, most metabolomics studies have a set of features identified. Galaxy is an open access platform that enables scientists at all levels to interact with big data. Galaxy promotes reproducibility by saving histories and enabling the sharing workflows among scientists. SECIMTools (SouthEast Center for Integrated Metabolomics) is a set of Python applications that are available both as standalone tools and wrapped for use in Galaxy. The suite includes a comprehensive set of quality control metrics (retention time window evaluation and various peak evaluation tools), visualization techniques (hierarchical cluster heatmap, principal component analysis, modular modularity clustering), basic statistical analysis methods (partial least squares - discriminant analysis, analysis of variance, t-test, Kruskal-Wallis non-parametric test), advanced classification methods (random forest, support vector machines), and advanced variable selection tools (least absolute shrinkage and selection operator LASSO and Elastic Net). SECIMTools leverages the Galaxy platform and enables integrated workflows for metabolomics data analysis made from building blocks designed for easy use and interpretability. Standard data formats and a set of utilities allow arbitrary linkages between tools to encourage novel workflow designs. The Galaxy framework enables future data integration for metabolomics studies with other omics data.

Predicting tool life in turning operations using neural networks and image processing

NASA Astrophysics Data System (ADS)

Mikołajczyk, T.; Nowicki, K.; Bustillo, A.; Yu Pimenov, D.

2018-05-01

A two-step method is presented for the automatic prediction of tool life in turning operations. First, experimental data are collected for three cutting edges under the same constant processing conditions. In these experiments, the parameter of tool wear, VB, is measured with conventional methods and the same parameter is estimated using Neural Wear, a customized software package that combines flank wear image recognition and Artificial Neural Networks (ANNs). Second, an ANN model of tool life is trained with the data collected from the first two cutting edges and the subsequent model is evaluated on two different subsets for the third cutting edge: the first subset is obtained from the direct measurement of tool wear and the second is obtained from the Neural Wear software that estimates tool wear using edge images. Although the complete-automated solution, Neural Wear software for tool wear recognition plus the ANN model of tool life prediction, presented a slightly higher error than the direct measurements, it was within the same range and can meet all industrial requirements. These results confirm that the combination of image recognition software and ANN modelling could potentially be developed into a useful industrial tool for low-cost estimation of tool life in turning operations.

Challenges of NDE simulation tool validation, optimization, and utilization for composites

NASA Astrophysics Data System (ADS)

Leckey, Cara A. C.; Seebo, Jeffrey P.; Juarez, Peter

2016-02-01

Rapid, realistic nondestructive evaluation (NDE) simulation tools can aid in inspection optimization and prediction of inspectability for advanced aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, ultrasound modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation is still far from the goal of rapidly simulating damage detection techniques for large scale, complex geometry composite components/vehicles containing realistic damage types. Ongoing work at NASA Langley Research Center is focused on advanced ultrasonic simulation tool development. This paper discusses challenges of simulation tool validation, optimization, and utilization for composites. Ongoing simulation tool development work is described along with examples of simulation validation and optimization challenges that are more broadly applicable to all NDE simulation tools. The paper will also discuss examples of simulation tool utilization at NASA to develop new damage characterization methods for composites, and associated challenges in experimentally validating those methods.

A review of decision support, risk communication and patient information tools for thrombolytic treatment in acute stroke: lessons for tool developers

PubMed Central

2013-01-01

Background Tools to support clinical or patient decision-making in the treatment/management of a health condition are used in a range of clinical settings for numerous preference-sensitive healthcare decisions. Their impact in clinical practice is largely dependent on their quality across a range of domains. We critically analysed currently available tools to support decision making or patient understanding in the treatment of acute ischaemic stroke with intravenous thrombolysis, as an exemplar to provide clinicians/researchers with practical guidance on development, evaluation and implementation of such tools for other preference-sensitive treatment options/decisions in different clinical contexts. Methods Tools were identified from bibliographic databases, Internet searches and a survey of UK and North American stroke networks. Two reviewers critically analysed tools to establish: information on benefits/risks of thrombolysis included in tools, and the methods used to convey probabilistic information (verbal descriptors, numerical and graphical); adherence to guidance on presenting outcome probabilities (IPDASi probabilities items) and information content (Picker Institute Checklist); readability (Fog Index); and the extent that tools had comprehensive development processes. Results Nine tools of 26 identified included information on a full range of benefits/risks of thrombolysis. Verbal descriptors, frequencies and percentages were used to convey probabilistic information in 20, 19 and 18 tools respectively, whilst nine used graphical methods. Shortcomings in presentation of outcome probabilities (e.g. omitting outcomes without treatment) were identified. Patient information tools had an aggregate median Fog index score of 10. None of the tools had comprehensive development processes. Conclusions Tools to support decision making or patient understanding in the treatment of acute stroke with thrombolysis have been sub-optimally developed. Development of tools should utilise mixed methods and strategies to meaningfully involve clinicians, patients and their relatives in an iterative design process; include evidence-based methods to augment interpretability of textual and probabilistic information (e.g. graphical displays showing natural frequencies) on the full range of outcome states associated with available options; and address patients with different levels of health literacy. Implementation of tools will be enhanced when mechanisms are in place to periodically assess the relevance of tools and where necessary, update the mode of delivery, form and information content. PMID:23777368

Design pattern mining using distributed learning automata and DNA sequence alignment.

PubMed

Esmaeilpour, Mansour; Naderifar, Vahideh; Shukur, Zarina

2014-01-01

Over the last decade, design patterns have been used extensively to generate reusable solutions to frequently encountered problems in software engineering and object oriented programming. A design pattern is a repeatable software design solution that provides a template for solving various instances of a general problem. This paper describes a new method for pattern mining, isolating design patterns and relationship between them; and a related tool, DLA-DNA for all implemented pattern and all projects used for evaluation. DLA-DNA achieves acceptable precision and recall instead of other evaluated tools based on distributed learning automata (DLA) and deoxyribonucleic acid (DNA) sequences alignment. The proposed method mines structural design patterns in the object oriented source code and extracts the strong and weak relationships between them, enabling analyzers and programmers to determine the dependency rate of each object, component, and other section of the code for parameter passing and modular programming. The proposed model can detect design patterns better that available other tools those are Pinot, PTIDEJ and DPJF; and the strengths of their relationships. The result demonstrate that whenever the source code is build standard and non-standard, based on the design patterns, then the result of the proposed method is near to DPJF and better that Pinot and PTIDEJ. The proposed model is tested on the several source codes and is compared with other related models and available tools those the results show the precision and recall of the proposed method, averagely 20% and 9.6% are more than Pinot, 27% and 31% are more than PTIDEJ and 3.3% and 2% are more than DPJF respectively. The primary idea of the proposed method is organized in two following steps: the first step, elemental design patterns are identified, while at the second step, is composed to recognize actual design patterns.

The adenosine triphosphate method as a quality control tool to assess 'cleanliness' of frequently touched hospital surfaces.

PubMed

Knape, L; Hambraeus, A; Lytsy, B

2015-10-01

The adenosine triphosphate (ATP) method is widely accepted as a quality control method to complement visual assessment, in the specifications of requirements, when purchasing cleaning contractors in Swedish hospitals. To examine whether the amount of biological load, as measured by ATP on frequently touched near-patient surfaces, had been reduced after an intervention; to evaluate the correlation between visual assessment and ATP levels on the same surfaces; to identify aspects of the performance of the ATP method as a tool in evaluating hospital cleanliness. A prospective intervention study in three phases was carried out in a medical ward and an intensive care unit (ICU) at a regional hospital in mid-Sweden between 2012 and 2013. Existing cleaning procedures were defined and baseline tests were sampled by visual inspection and ATP measurements of ten frequently touched surfaces in patients' rooms before and after intervention. The intervention consisted of educating nursing staff about the importance of hospital cleaning and direct feedback of ATP levels before and after cleaning. The mixed model showed a significant decrease in ATP levels after the intervention (P < 0.001). Relative light unit values were lower in the ICU. Cleanliness as judged by visual assessments improved. In the logistic regression analysis, there was a significant association between visual assessments and ATP levels. Direct feedback of ATP levels, together with education and introduction of written cleaning protocols, were effective tools to improve cleanliness. Visual assessment correlated with the level of ATP but the correlation was not absolute. The ATP method could serve as an educational tool for staff, but is not enough to assess hospital cleanliness in general as only a limited part of a large area is covered. Copyright © 2015 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

A psychometric evaluation of the digital logic concept inventory

NASA Astrophysics Data System (ADS)

Herman, Geoffrey L.; Zilles, Craig; Loui, Michael C.

2014-10-01

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric evaluation). Classical Test Theory and Item Response Theory provide two psychometric frameworks for evaluating the quality of assessment tools. We discuss how these theories can be applied to assessment tools generally and then apply them to the Digital Logic Concept Inventory (DLCI). We demonstrate that the DLCI is sufficiently reliable for research purposes when used in its entirety and as a post-course assessment of students' conceptual understanding of digital logic. The DLCI can also discriminate between students across a wide range of ability levels, providing the most information about weaker students' ability levels.

Roles and methods of performance evaluation of hospital academic leadership.

PubMed

Zhou, Ying; Yuan, Huikang; Li, Yang; Zhao, Xia; Yi, Lihua

2016-01-01

The rapidly advancing implementation of public hospital reform urgently requires the identification and classification of a pool of exceptional medical specialists, corresponding with incentives to attract and retain them, providing a nucleus of distinguished expertise to ensure public hospital preeminence. This paper examines the significance of academic leadership, from a strategic management perspective, including various tools, methods and mechanisms used in the theory and practice of performance evaluation, and employed in the selection, training and appointment of academic leaders. Objective methods of assessing leadership performance are also provided for reference.

Necessity to Develop a Tool to Evaluate Activity of Daily Living for Electric Powered Indoor/Outdoor Chair Users

PubMed Central

Lee, Jiwon; Lim, Jae Kuk; Lee, Min Jun; Jo, Yoon-Sik; Park, Jae Sung; Kim, Jong Moon

2015-01-01

Objective To evaluate changes in activity of daily living before and after provision of electric-powered indoor/outdoor chair (EPIOC), discuss problems of current activities of daily living (ADL) evaluating tools for EPIOC users, and provide preliminary data to develop ADL evaluation tool for EPIOC user. Methods A total of 70 users who were prescribed EPIOC and had been using for more than 1 year were recruited in this study. Before and after provision of EPIOC, MBI and FIM scores were measured and a questionnaire consisting of six categories (general socioeconomic states, currently using state, whether EPIOC was helpful for social participation and occupational chances, psychiatric influences, self-reported degrees of independency, and barriers of using EPIOC) was used. Results No difference in MBI scores before and after provision of EPIOC was observed. However, the wheelchair ambulation category showed a significant difference. While motor FIM was not significantly different from MBI, FIM score were significantly (p<0.05) higher than MBI. For questions regarding social participation frequency, helpfulness of EPIOC on confidence, refreshing patients' emotions and self-reported degrees of independence, all of them showed positive responses. Especially, EPIOC users' self-reported degree of independency showed favorable results. There was discrepancy in MBI or FIM measured by physicians. Conclusion Our study showed that there was a gap between the existing ADL evaluation tool and the ADL level that EPIOC users were actually feeling. Thus, it is necessary to develop an evaluation tool specifically for EPIOC. PMID:25932425

Potato transformation and potato cyst nematode infection on potato plantlets in tissue culture

USDA-ARS?s Scientific Manuscript database

These two protocols describe the methods for generating transgenic potato plants and for evaluating potato cyst nematode (Globodera rostochiensis and G. pallida) infection on potato plantlets in tissue culture. These methods are useful tools that can be used in the study of the interactions between ...

EVALUATION OF THE CARBON FOOTPRINT OF INNOVATIVE WATER MAIN REHABILITATION TECHNOLOGIES VS OPEN CUT METHODS

EPA Science Inventory

A major benefit of trenchless rehabilitation technologies touted by many practitioners when comparing their products with traditional open cut construction methods is lower carbon dioxide (CO₂) emissions. In an attempt to verify these claims, multiple tools have been d...

EVALUATION OF THE CARBON FOOTPRINT OF INNOVATIVE WATER MAIN REHABILITATION TECHNOLOGIES VS. OPEN CUT METHODS

EPA Science Inventory

A major benefit of trenchless rehabilitation technologies touted by many practitioners when comparing their products with tradition open cut construction methods is lower carbon dioxide (CO₂) emissions. In an attempt to verify these claims, multiple tools have been dev...

An Artificial Intelligence Tutor: A Supplementary Tool for Teaching and Practicing Braille

ERIC Educational Resources Information Center

McCarthy, Tessa; Rosenblum, L. Penny; Johnson, Benny G.; Dittel, Jeffrey; Kearns, Devin M.

2016-01-01

Introduction: This study evaluated the usability and effectiveness of an artificial intelligence Braille Tutor designed to supplement the instruction of students with visual impairments as they learned to write braille contractions. Methods: A mixed-methods design was used, which incorporated a single-subject, adapted alternating treatments design…

Laboratory and field measurements and evaluations of vibration at the handles of riveting hammers

PubMed Central

McDOWELL, THOMAS W.; WARREN, CHRISTOPHER; WELCOME, DANIEL E.; DONG, REN G.

2015-01-01

The use of riveting hammers can expose workers to harmful levels of hand-transmitted vibration (HTV). As a part of efforts to reduce HTV exposures through tool selection, the primary objective of this study was to evaluate the applicability of a standardized laboratory-based riveting hammer assessment protocol for screening riveting hammers. The second objective was to characterize the vibration emissions of reduced vibration riveting hammers and to make approximations of the HTV exposures of workers operating these tools in actual work tasks. Eight pneumatic riveting hammers were selected for the study. They were first assessed in a laboratory using the standardized method for measuring vibration emissions at the tool handle. The tools were then further assessed under actual working conditions during three aircraft sheet metal riveting tasks. Although the average vibration magnitudes of the riveting hammers measured in the laboratory test were considerably different from those measured in the field study, the rank orders of the tools determined via these tests were fairly consistent, especially for the lower vibration tools. This study identified four tools that consistently exhibited lower frequency-weighted and unweighted accelerations in both the laboratory and workplace evaluations. These observations suggest that the standardized riveting hammer test is acceptable for identifying tools that could be expected to exhibit lower vibrations in workplace environments. However, the large differences between the accelerations measured in the laboratory and field suggest that the standardized laboratory-based tool assessment is not suitable for estimating workplace riveting hammer HTV exposures. Based on the frequency-weighted accelerations measured at the tool handles during the three work tasks, the sheet metal mechanics assigned to these tasks at the studied workplace are unlikely to exceed the daily vibration exposure action value (2.5 m s−2) using any of the evaluated riveting hammers. PMID:22539561

International funding agencies: potential leaders of impact evaluation in protected areas?

PubMed Central

Craigie, Ian D.; Barnes, Megan D.; Geldmann, Jonas; Woodley, Stephen

2015-01-01

Globally, protected areas are the most commonly used tools to halt biodiversity loss. Yet, some are failing to adequately conserve the biodiversity they contain. There is an urgent need for knowledge on how to make them function more effectively. Impact evaluation methods provide a set of tools that could yield this knowledge. However, rigorous outcome-focused impact evaluation is not yet used as extensively as it could be in protected area management. We examine the role of international protected area funding agencies in facilitating the use of impact evaluation. These agencies are influential stakeholders as they allocate hundreds of millions of dollars annually to support protected areas, creating a unique opportunity to shape how the conservation funds are spent globally. We identify key barriers to the use of impact evaluation, detail how large funders are uniquely placed to overcome many of these, and highlight the potential benefits if impact evaluation is used more extensively. PMID:26460135

Soak Up the Rain New England Webinar Series: National ...

EPA Pesticide Factsheets

Presenters will provide an introduction to the most recent EPA green infrastructure tools to R1 stakeholders; and their use in making decisions about implementing green infrastructure. We will discuss structuring your green infrastructure decision, finding appropriate information and tools, evaluating options and selecting the right Best Management Practices mix for your needs.WMOST (Watershed Management Optimization Support Tool)- for screening a wide range of practices for cost-effectiveness in achieving watershed or water utilities management goals.GIWiz (Green Infrastructure Wizard)- a web application connecting communities to EPA Green Infrastructure tools and resources.Opti-Tool-designed to assist in developing technically sound and optimized cost-effective Stormwater management plans. National Stormwater Calculator- a desktop application for estimating the impact of land cover change and green infrastructure controls on stormwater runoff. DASEES-GI (Decision Analysis for a Sustainable Environment, Economy, and Society) – a framework for linking objectives and measures with green infrastructure methods. Presenters will provide an introduction to the most recent EPA green infrastructure tools to R1 stakeholders; and their use in making decisions about implementing green infrastructure. We will discuss structuring your green infrastructure decision, finding appropriate information and tools, evaluating options and selecting the right Best Management Pr

Online survey software as a data collection tool for medical education: A case study on lesson plan assessment

PubMed Central

Kimiafar, Khalil; Sarbaz, Masoumeh; Sheikhtaheri, Abbas

2016-01-01

Background: There are no general strategies or tools to evaluate daily lesson plans; however, assessments conducted using traditional methods usually include course plans. This study aimed to evaluate the strengths and weaknesses of online survey software in collecting data on education in medical fields and the application of such softwares to evaluate students' views and modification of lesson plans. Methods: After investigating the available online survey software, esurveypro was selected for assessing daily lesson plans. After using the software for one semester, a questionnaire was prepared to assess the advantages and disadvantages of this method and students’ views in a cross-sectional study. Results: The majority of the students (51.7%) rated the evaluation of classes per session (lesson plans) using the online survey as useful or very useful. About 51% (n=36) of the students considered this method effective in improving the management of each session, 67.1% (n=47) considered it effective in improving the management of sessions for the next semester, and 51.4% (n=36) said it had a high impact on improving the educational content of subsequent sessions. Finally, 61.4% (n=43) students expressed high and very high levels of satisfaction with using an online survey at each session. Conclusion: The use of online surveys may be appropriate to improve lesson plans and educational planning at different levels. This method can be used for other evaluations and for assessing people’s opinions at different levels of an educational system. PMID:28491839

How can systems engineering inform the methods of programme evaluation in health professions education?

PubMed

Rojas, David; Grierson, Lawrence; Mylopoulos, Maria; Trbovich, Patricia; Bagli, Darius; Brydges, Ryan

2018-04-01

We evaluate programmes in health professions education (HPE) to determine their effectiveness and value. Programme evaluation has evolved from use of reductionist frameworks to those addressing the complex interactions between programme factors. Researchers in HPE have recently suggested a 'holistic programme evaluation' aiming to better describe and understand the implications of 'emergent processes and outcomes'. We propose a programme evaluation framework informed by principles and tools from systems engineering. Systems engineers conceptualise complexity and emergent elements in unique ways that may complement and extend contemporary programme evaluations in HPE. We demonstrate how the abstract decomposition space (ADS), an engineering knowledge elicitation tool, provides the foundation for a systems engineering informed programme evaluation designed to capture both planned and emergent programme elements. We translate the ADS tool to use education-oriented language, and describe how evaluators can use it to create a programme-specific ADS through iterative refinement. We provide a conceptualisation of emergent elements and an equation that evaluators can use to identify the emergent elements in their programme. Using our framework, evaluators can analyse programmes not as isolated units with planned processes and planned outcomes, but as unfolding, complex interactive systems that will exhibit emergent processes and emergent outcomes. Subsequent analysis of these emergent elements will inform the evaluator as they seek to optimise and improve the programme. Our proposed systems engineering informed programme evaluation framework provides principles and tools for analysing the implications of planned and emergent elements, as well as their potential interactions. We acknowledge that our framework is preliminary and will require application and constant refinement. We suggest that our framework will also advance our understanding of the construct of 'emergence' in HPE research. © 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

Agreement between clinical estimation and a new quantitative analysis by Photoshop software in fundus and angiographic image variables.

PubMed

Ramezani, Alireza; Ahmadieh, Hamid; Azarmina, Mohsen; Soheilian, Masoud; Dehghan, Mohammad H; Mohebbi, Mohammad R

2009-12-01

To evaluate the validity of a new method for the quantitative analysis of fundus or angiographic images using Photoshop 7.0 (Adobe, USA) software by comparing with clinical evaluation. Four hundred and eighteen fundus and angiographic images of diabetic patients were evaluated by three retina specialists and then by computing using Photoshop 7.0 software. Four variables were selected for comparison: amount of hard exudates (HE) on color pictures, amount of HE on red-free pictures, severity of leakage, and the size of the foveal avascular zone (FAZ). The coefficient of agreement (Kappa) between the two methods in the amount of HE on color and red-free photographs were 85% (0.69) and 79% (0.59), respectively. The agreement for severity of leakage was 72% (0.46). In the two methods for the evaluation of the FAZ size using the magic and lasso software tools, the agreement was 54% (0.09) and 89% (0.77), respectively. Agreement in the estimation of the FAZ size by the lasso magnetic tool was excellent and was almost as good in the quantification of HE on color and on red-free images. Considering the agreement of this new technique for the measurement of variables in fundus images using Photoshop software with the clinical evaluation, this method seems to have sufficient validity to be used for the quantitative analysis of HE, leakage, and FAZ size on the angiograms of diabetic patients.

Ontology-based configuration of problem-solving methods and generation of knowledge-acquisition tools: application of PROTEGE-II to protocol-based decision support.

PubMed

Tu, S W; Eriksson, H; Gennari, J H; Shahar, Y; Musen, M A

1995-06-01

PROTEGE-II is a suite of tools and a methodology for building knowledge-based systems and domain-specific knowledge-acquisition tools. In this paper, we show how PROTEGE-II can be applied to the task of providing protocol-based decision support in the domain of treating HIV-infected patients. To apply PROTEGE-II, (1) we construct a decomposable problem-solving method called episodic skeletal-plan refinement, (2) we build an application ontology that consists of the terms and relations in the domain, and of method-specific distinctions not already captured in the domain terms, and (3) we specify mapping relations that link terms from the application ontology to the domain-independent terms used in the problem-solving method. From the application ontology, we automatically generate a domain-specific knowledge-acquisition tool that is custom-tailored for the application. The knowledge-acquisition tool is used for the creation and maintenance of domain knowledge used by the problem-solving method. The general goal of the PROTEGE-II approach is to produce systems and components that are reusable and easily maintained. This is the rationale for constructing ontologies and problem-solving methods that can be composed from a set of smaller-grained methods and mechanisms. This is also why we tightly couple the knowledge-acquisition tools to the application ontology that specifies the domain terms used in the problem-solving systems. Although our evaluation is still preliminary, for the application task of providing protocol-based decision support, we show that these goals of reusability and easy maintenance can be achieved. We discuss design decisions and the tradeoffs that have to be made in the development of the system.

Challenges of NDE Simulation Tool Challenges of NDE Simulation Tool

NASA Technical Reports Server (NTRS)

Leckey, Cara A. C.; Juarez, Peter D.; Seebo, Jeffrey P.; Frank, Ashley L.

2015-01-01

Realistic nondestructive evaluation (NDE) simulation tools enable inspection optimization and predictions of inspectability for new aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of advanced aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation cannot rapidly simulate damage detection techniques for large scale, complex geometry composite components/vehicles with realistic damage types. This paper discusses some of the challenges of model development and validation for composites, such as the level of realism and scale of simulation needed for NASA' applications. Ongoing model development work is described along with examples of model validation studies. The paper will also discuss examples of the use of simulation tools at NASA to develop new damage characterization methods, and associated challenges of validating those methods.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

PubMed

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Applying CBR to machine tool product configuration design oriented to customer requirements

NASA Astrophysics Data System (ADS)

Wang, Pengjia; Gong, Yadong; Xie, Hualong; Liu, Yongxian; Nee, Andrew Yehching

2017-01-01

Product customization is a trend in the current market-oriented manufacturing environment. However, deduction from customer requirements to design results and evaluation of design alternatives are still heavily reliant on the designer's experience and knowledge. To solve the problem of fuzziness and uncertainty of customer requirements in product configuration, an analysis method based on the grey rough model is presented. The customer requirements can be converted into technical characteristics effectively. In addition, an optimization decision model for product planning is established to help the enterprises select the key technical characteristics under the constraints of cost and time to serve the customer to maximal satisfaction. A new case retrieval approach that combines the self-organizing map and fuzzy similarity priority ratio method is proposed in case-based design. The self-organizing map can reduce the retrieval range and increase the retrieval efficiency, and the fuzzy similarity priority ratio method can evaluate the similarity of cases comprehensively. To ensure that the final case has the best overall performance, an evaluation method of similar cases based on grey correlation analysis is proposed to evaluate similar cases to select the most suitable case. Furthermore, a computer-aided system is developed using MATLAB GUI to assist the product configuration design. The actual example and result on an ETC series machine tool product show that the proposed method is effective, rapid and accurate in the process of product configuration. The proposed methodology provides a detailed instruction for the product configuration design oriented to customer requirements.

Projected outcomes of a public-industry partnership for enhancing corn nitrogen research and datasets

USDA-ARS?s Scientific Manuscript database

Research is needed over a wide geographic range of soil and weather scenarios to evaluate methods and tools for corn N fertilizer applications. The objectives of this research were to conduct standardized corn N rate response field studies to evaluate the performance of multiple public-domain N deci...

Introduction of Sustainable Development in Engineers' Curricula: Problematic and Evaluation Methods

ERIC Educational Resources Information Center

Lourdel, N.; Gondran, N.; Laforest, V.; Brodhag, C.

2005-01-01

Purpose: Owing to its complexity, sustainable development cannot be simply integrated as a supplementary course within the engineers' curricula. The first point of this paper aims to focalise on how to reflect pedagogically. After dealing with these questions, a tool that can evaluate the student's understanding of sustainable development concepts…

Photomask quality evaluation using lithography simulation and multi-detector MVM-SEM

NASA Astrophysics Data System (ADS)

Ito, Keisuke; Murakawa, Tsutomu; Fukuda, Naoki; Shida, Soichi; Iwai, Toshimichi; Matsumoto, Jun; Nakamura, Takayuki; Matsushita, Shohei; Hagiwara, Kazuyuki; Hara, Daisuke

2013-06-01

The detection and management of mask defects which are transferred onto wafer becomes more important day by day. As the photomask patterns becomes smaller and more complicated, using Inverse Lithography Technology (ILT) and Source Mask Optimization (SMO) with Optical Proximity Correction (OPC). To evaluate photomask quality, the current method uses aerial imaging by optical inspection tools. This technique at 1Xnm node has a resolution limit because small defects will be difficult to detect. We already reported the MEEF influence of high-end photomask using wide FOV SEM contour data of "E3630 MVM-SEM®" and lithography simulator "TrueMask® DS" of D2S Inc. in the prior paper [1]. In this paper we evaluate the correlation between our evaluation method and optical inspection tools as ongoing assessment. Also in order to reduce the defect classification work, we can compose the 3 Dimensional (3D) information of defects and can judge whether repairs of defects would be required. Moreover, we confirm the possibility of wafer plane CD measurement based on the combination between E3630 MVM-SEM® and 3D lithography simulation.

Evaluating the Interdisciplinary Discoverability of Data

NASA Astrophysics Data System (ADS)

Gordon, S.; Habermann, T.

2017-12-01

Documentation needs are similar across communities. Communities tend to agree on many of the basic concepts necessary for discovery. Shared concepts such as a title or a description of the data exist in most metadata dialects. Many dialects have been designed and recommendations implemented to create metadata valuable for data discovery. These implementations can create barriers to discovering the right data. How can we ensure that the documentation we curate will be discoverable and understandable by researchers outside of our own disciplines and organizations? Since communities tend to use and understand many of the same documentation concepts, the barriers to interdisciplinary discovery are caused by the differences in the implementation. Thus tools and methods designed for the conceptual layer that evaluate records for documentation concepts, regardless of the dialect, can be effective in identifying opportunities for improvement and providing guidance. The Metadata Evaluation Web Service combined with a Jupyter Notebook interface allows a user to gather insight about a collection of records with respect to different communities' conceptual recommendations. It accomplishes this via data visualizations and provides links to implementation specific guidance on the ESIP Wiki for each recommendation applied to the collection. By utilizing these curation tools as part of an iterative process the data's impact can be increased by making it discoverable to a greater scientific and research community. Due to the conceptual focus of the methods and tools used, they can be utilized by any community or organization regardless of their documentation dialect or tools.

Effective Tools and Resources from the MAVEN Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Mason, T.

2015-12-01

Since 2010, NASA's Mars Atmosphere and Volatile Evolution (MAVEN) Education and Public Outreach (E/PO) team has developed and implemented a robust and varied suite of projects, serving audiences of all ages and diverse backgrounds from across the country. With a program designed to reach formal K-12 educators and students, afterschool and summertime communities, museum docents, journalists, and online audiences, we have incorporated an equally varied approach to developing tools, resources, and evaluation methods to specifically reach each target population and to determine the effectiveness of our efforts. This poster will highlight some of the tools and resources we have developed to share the complex science and engineering of the MAVEN mission, as well as initial evaluation results and lessons-learned from each of our E/PO projects.

Wear and breakage monitoring of cutting tools by an optical method: theory

NASA Astrophysics Data System (ADS)

Li, Jianfeng; Zhang, Yongqing; Chen, Fangrong; Tian, Zhiren; Wang, Yao

1996-10-01

An essential part of a machining system in the unmanned flexible manufacturing system, is the ability to automatically change out tools that are worn or damaged. An optoelectronic method for in situ monitoring of the flank wear and breakage of cutting tools is presented. A flank wear estimation system is implemented in a laboratory environment, and its performance is evaluated through turning experiments. The flank wear model parameters that need to be known a priori are determined through several preliminary experiments, or from data available in the literature. The resulting cutting conditions are typical of those used in finishing cutting operations. Through time and amplitude domain analysis of the cutting tool wear states and breakage states, it is found that the original signal digital specificity (sigma) 2x and the self correlation coefficient (rho) (m) can reflect the change regularity of the cutting tool wear and break are determined, but which is not enough due to the complexity of the wear and break procedure of cutting tools. Time series analysis and frequency spectrum analysis will be carried out, which will be described in the later papers.

Operation Reliability Assessment for Cutting Tools by Applying a Proportional Covariate Model to Condition Monitoring Information

PubMed Central

Cai, Gaigai; Chen, Xuefeng; Li, Bing; Chen, Baojia; He, Zhengjia

2012-01-01

The reliability of cutting tools is critical to machining precision and production efficiency. The conventional statistic-based reliability assessment method aims at providing a general and overall estimation of reliability for a large population of identical units under given and fixed conditions. However, it has limited effectiveness in depicting the operational characteristics of a cutting tool. To overcome this limitation, this paper proposes an approach to assess the operation reliability of cutting tools. A proportional covariate model is introduced to construct the relationship between operation reliability and condition monitoring information. The wavelet packet transform and an improved distance evaluation technique are used to extract sensitive features from vibration signals, and a covariate function is constructed based on the proportional covariate model. Ultimately, the failure rate function of the cutting tool being assessed is calculated using the baseline covariate function obtained from a small sample of historical data. Experimental results and a comparative study show that the proposed method is effective for assessing the operation reliability of cutting tools. PMID:23201980

Applying Propensity Score Methods in Medical Research: Pitfalls and Prospects

PubMed Central

Luo, Zhehui; Gardiner, Joseph C.; Bradley, Cathy J.

2012-01-01

The authors review experimental and nonexperimental causal inference methods, focusing on assumptions for the validity of instrumental variables and propensity score (PS) methods. They provide guidance in four areas for the analysis and reporting of PS methods in medical research and selectively evaluate mainstream medical journal articles from 2000 to 2005 in the four areas, namely, examination of balance, overlapping support description, use of estimated PS for evaluation of treatment effect, and sensitivity analyses. In spite of the many pitfalls, when appropriately evaluated and applied, PS methods can be powerful tools in assessing average treatment effects in observational studies. Appropriate PS applications can create experimental conditions using observational data when randomized controlled trials are not feasible and, thus, lead researchers to an efficient estimator of the average treatment effect. PMID:20442340

Recommendations for evaluation of computational methods

NASA Astrophysics Data System (ADS)

Jain, Ajay N.; Nicholls, Anthony

2008-03-01

The field of computational chemistry, particularly as applied to drug design, has become increasingly important in terms of the practical application of predictive modeling to pharmaceutical research and development. Tools for exploiting protein structures or sets of ligands known to bind particular targets can be used for binding-mode prediction, virtual screening, and prediction of activity. A serious weakness within the field is a lack of standards with respect to quantitative evaluation of methods, data set preparation, and data set sharing. Our goal should be to report new methods or comparative evaluations of methods in a manner that supports decision making for practical applications. Here we propose a modest beginning, with recommendations for requirements on statistical reporting, requirements for data sharing, and best practices for benchmark preparation and usage.

Using the Draw-a-Scientist Test for Inquiry and Evaluation

ERIC Educational Resources Information Center

Miele, Eleanor

2014-01-01

The Draw-a-Scientist Test (DAST) is a tool to assess stereotypical imagery of scientists. This paper describes the use of the DAST as both a model for inquiry and as a method of assessing the affective domain. The DAST was administered in a science education methods course for undergraduate students of elementary education, a methods course for…

Nuclear medicine and quantitative imaging research (instrumentation and quantitative methods of evaluation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1990-09-01

This report summarizes goals and accomplishments of the research program supported under DOE Grant No. FG02-86ER60418 entitled Instrumentation and Quantitative Methods of Evaluation, with R. Beck, P. I. and M. Cooper, Co-P.I. during the period January 15, 1990 through September 1, 1990. This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development andmore » transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development of new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility. 7 figs.« less

[Review of assessment methods used to evaluate feeding for children with pervasive developmental disorder].

PubMed

Nadon, G; Ehrmann Feldman, D; Gisel, E

2008-08-01

Current evaluations used by occupational therapists to assess and treat feeding problems derive mainly from the domain of dysphagia. The purpose of this article is to familiarize the reader with tools used, in research, for children with pervasive developmental disorders (PDD) and to determine if any of these meet the needs of occupational therapists. The following data bases were searched: Medline, CINAHL, HAPI and PsyINFO, using the terms pervasive developmental disorder, autism, Asperger syndrome, pervasive developmental disorder not otherwise specified, eating behavior, eating disorder, food preference, food selectivity, feeding disorders, picky eater and child. All articles published between 1980 and 2006 (n=27) were reviewed. A total of 20 studies met our selection criteria. Assessment methods are compared using the Disability Creation Model (DCP). The DCP is the Quebec alternative to the International Classification of Functioning, Disability and Health (ICF). None of the evaluation tools reviewed met all factors that may influence eating in children with PDD. Implications for research and practice in occupational therapy are discussed.

A simplified method of evaluating the stress wave environment of internal equipment

NASA Technical Reports Server (NTRS)

Colton, J. D.; Desmond, T. P.

1979-01-01

A simplified method called the transfer function technique (TFT) was devised for evaluating the stress wave environment in a structure containing internal equipment. The TFT consists of following the initial in-plane stress wave that propagates through a structure subjected to a dynamic load and characterizing how the wave is altered as it is transmitted through intersections of structural members. As a basis for evaluating the TFT, impact experiments and detailed stress wave analyses were performed for structures with two or three, or more members. Transfer functions that relate the wave transmitted through an intersection to the incident wave were deduced from the predicted wave response. By sequentially applying these transfer functions to a structure with several intersections, it was found that the environment produced by the initial stress wave propagating through the structure can be approximated well. The TFT can be used as a design tool or as an analytical tool to determine whether a more detailed wave analysis is warranted.

Designer's unified cost model

NASA Technical Reports Server (NTRS)

Freeman, William T.; Ilcewicz, L. B.; Swanson, G. D.; Gutowski, T.

1992-01-01

A conceptual and preliminary designers' cost prediction model has been initiated. The model will provide a technically sound method for evaluating the relative cost of different composite structural designs, fabrication processes, and assembly methods that can be compared to equivalent metallic parts or assemblies. The feasibility of developing cost prediction software in a modular form for interfacing with state of the art preliminary design tools and computer aided design programs is being evaluated. The goal of this task is to establish theoretical cost functions that relate geometric design features to summed material cost and labor content in terms of process mechanics and physics. The output of the designers' present analytical tools will be input for the designers' cost prediction model to provide the designer with a data base and deterministic cost methodology that allows one to trade and synthesize designs with both cost and weight as objective functions for optimization. The approach, goals, plans, and progress is presented for development of COSTADE (Cost Optimization Software for Transport Aircraft Design Evaluation).

Winter maintenance performance measure.

DOT National Transportation Integrated Search

2016-01-01

The Winter Performance Index is a method of quantifying winter storm events and the DOTs response to them. : It is a valuable tool for evaluating the States maintenance practices, performing post-storm analysis, training : maintenance personnel...

United States - Japan evaluation tools and methods.

DOT National Transportation Integrated Search

2014-01-01

Cooperative systems based on intelligent transportation system (ITS) technologies can deliver significant benefits for all road users and the public, especially in terms of safer, more energy-efficient, and environmentally friendly surface transporta...

A method for building evaluation competency among community-based organizations.

PubMed

Kelly, Cheryl M; LaRose, Jessi; Scharff, Darcell P

2014-05-01

Community-based organizations often lack the capacity (e.g., time, staff, skills) to effectively evaluate programs, policies, and environmental changes. Providing evaluation technical assistance and training can be an effective and feasible way to build individual evaluation competency. The purpose of this article is to present a practical approach and related tools that can be used by evaluators and others (e.g., academic partners, funders) providing assistance to build evaluation skills in community organizations. The approach described was developed in collaboration with local universities and a regional health foundation to provide intensive technical support to 19 community-based organizations awarded funding to implement obesity prevention projects. Technical assistance processes and tools were designed to be tailored to organizations' capacity and needs and can be used as templates by others who provide technical assistance. Evaluators, funders, and academic partners can use lessons learned from this experience to help shape and implement evaluation technical assistance approaches with community-based organizations.

The East Anglian specialist registrar assessment tool

PubMed Central

Robinson, Susan; Boursicot, Katharine; Hayhurst, Catherine

2007-01-01

Background In our region, it was acknowledged that the process of assessment needed to be improved, but before developing a system for this, there was a need to define the “competent or satisfactory trainee”. Objective To outline the process by which a consensus was achieved on this standard, and how a system for formally assessing competency across a wide range of knowledge skills and attitudes was subsequently agreed on, thus enabling increased opportunities for training and feedback and improving the accuracy of assessment in the region. Methods The opinions of trainees and trainers from across the region were collated, and a consensus was achieved with regard to the minimum acceptable standard for a trainee in emergency medicine, thus defining a competent trainee. The group that set the standard then focused on identifying the assessment methods most appropriate for the evaluation of the knowledge, skills and attitudes required of an emergency medicine trainee. The tool was subsequently trialled for a period of 6 months, and opinion evaluated by use of a questionnaire. Results The use of the tool was reviewed from both the trainers' and trainees' perspectives. 42% (n = 11) of trainers and 31% (n = 8) trainees responded to the questionnaire. In the region, there were 26 trainers and 26 trainees. Five trainees and nine trainers had used the tool. 93% (14/15) of respondents thought that the descriptors used to describe the satisfactory trainee were acceptable; 89% (8/9) of trainers thought that it helped them assess trainees more accurately. 60% (3/5) of trainees thought that, as a result, they had a better understanding of their weak areas. Conclusion We believe that we achieved a consensus across our region as to what defined a satisfactory trainee and set the standard against which all our trainees would subsequently be evaluated. The use of this tool to assess trainees during the pilot period was disappointing; however, we were encouraged that most of those using the tool thought that it allowed an objective assessment of trainees and feedback on areas requiring further work. Those who used the tool identified important reasons that may have hindered widespread use of the assessment tool. PMID:17351222

Extension of a GIS procedure for calculating the RUSLE equation LS factor

NASA Astrophysics Data System (ADS)

Zhang, Hongming; Yang, Qinke; Li, Rui; Liu, Qingrui; Moore, Demie; He, Peng; Ritsema, Coen J.; Geissen, Violette

2013-03-01

The Universal Soil Loss Equation (USLE) and revised USLE (RUSLE) are often used to estimate soil erosion at regional landscape scales, however a major limitation is the difficulty in extracting the LS factor. The geographic information system-based (GIS-based) methods which have been developed for estimating the LS factor for USLE and RUSLE also have limitations. The unit contributing area-based estimation method (UCA) converts slope length to unit contributing area for considering two-dimensional topography, however is not able to predict the different zones of soil erosion and deposition. The flowpath and cumulative cell length-based method (FCL) overcomes this disadvantage but does not consider channel networks and flow convergence in two-dimensional topography. The purpose of this research was to overcome these limitations and extend the FCL method through inclusion of channel networks and convergence flow. We developed LS-TOOL in Microsoft's.NET environment using C♯ with a user-friendly interface. Comparing the LS factor calculated with the three methodologies (UCA, FCL and LS-TOOL), LS-TOOL delivers encouraging results. In particular, LS-TOOL uses breaks in slope identified from the DEM to locate soil erosion and deposition zones, channel networks and convergence flow areas. Comparing slope length and LS factor values generated using LS-TOOL with manual methods, LS-TOOL corresponds more closely with the reality of the Xiannangou catchment than results using UCA or FCL. The LS-TOOL algorithm can automatically calculate slope length, slope steepness, L factor, S factor, and LS factors, providing the results as ASCII files which can be easily used in some GIS software. This study is an important step forward in conducting more accurate large area erosion evaluation.

The Added-Value of Using Participatory Approaches to Assess the Acceptability of Surveillance Systems: The Case of Bovine Tuberculosis in Belgium

PubMed Central

Calba, Clémentine; Goutard, Flavie Luce; Vanholme, Luc; Antoine-Moussiaux, Nicolas; Hendrikx, Pascal; Saegerman, Claude

2016-01-01

Context and Objective Bovine tuberculosis (bTB) surveillance in Belgium is essential to maintain the officially free status and to preserve animal and public health. An evaluation of the system is thus needed to ascertain the surveillance provides a precise description of the current situation in the country. The evaluation should assess stakeholders’ perceptions and expectations about the system due to the fact that the acceptability has an influence on the levels of sensitivity and timeliness of the surveillance system. The objective of the study was to assess the acceptability of the bTB surveillance in Belgium, using participatory tools and the OASIS flash tool (‘analysis tool for surveillance systems’). Methods For the participatory process, focus group discussions and individual interviews were implemented with representatives involved with the system, both from cattle and wildlife part of the surveillance. Three main tools were used: (i) relational diagrams associated with smileys, (ii) flow diagrams associated with proportional piling, and (iii) impact diagrams associated with proportional piling. A total of six criteria were assessed, among which five were scored on a scale from -1 to +1. For the OASIS flash tool, one full day meeting with representatives from stakeholders involved with the surveillance was organised. A total of 19 criteria linked to acceptability were scored on a scale from 0 to 3. Results and Conclusion Both methods highlighted a medium acceptability of the bTB surveillance. The main elements having a negative influence were the consequences of official notification of a bTB suspect case in a farm, the low remuneration paid to private veterinarians for execution of intradermal tuberculin tests and the practical difficulties about the containment of the animals. Based on the two evaluation processes, relevant recommendations to improve the surveillance were made. Based on the comparison between the two evaluation processes, the added value of the participatory approach was highlighted. PMID:27462705

Adverse drug events with hyperkalaemia during inpatient stays: evaluation of an automated method for retrospective detection in hospital databases

PubMed Central

2014-01-01

Background Adverse drug reactions and adverse drug events (ADEs) are major public health issues. Many different prospective tools for the automated detection of ADEs in hospital databases have been developed and evaluated. The objective of the present study was to evaluate an automated method for the retrospective detection of ADEs with hyperkalaemia during inpatient stays. Methods We used a set of complex detection rules to take account of the patient’s clinical and biological context and the chronological relationship between the causes and the expected outcome. The dataset consisted of 3,444 inpatient stays in a French general hospital. An automated review was performed for all data and the results were compared with those of an expert chart review. The complex detection rules’ analytical quality was evaluated for ADEs. Results In terms of recall, 89.5% of ADEs with hyperkalaemia “with or without an abnormal symptom” were automatically identified (including all three serious ADEs). In terms of precision, 63.7% of the automatically identified ADEs with hyperkalaemia were true ADEs. Conclusions The use of context-sensitive rules appears to improve the automated detection of ADEs with hyperkalaemia. This type of tool may have an important role in pharmacoepidemiology via the routine analysis of large inter-hospital databases. PMID:25212108

Screening and assessment tools for determining fitness to drive: a review of the literature for the pathways project.

PubMed

Dickerson, Anne E

2014-04-01

With a brief introduction, 10 tables summarize the findings from the literature describing screening and assessment tools used with older adults to identify risk or determine fitness to drive. With a focus on occupational therapy's duty to address driving as a valued activity, this paper offers information about tools used by occupational therapy practitioners across practice settings and specialists in driver rehabilitation. The tables are organized into groups of key research studies of assessment tools, screening batteries, tools used in combination (i.e., as a battery), driving simulation as an assessment tool, and screening/assessment for individuals with stroke, vision impairment, Parkinson's disease, dementia, and aging. Each table has a summary of important concepts to consider as occupational therapists choose the methods and tools to evaluate fitness to drive.

A new disability-related health care needs assessment tool for persons with brain disorders.

PubMed

Kim, Yoon; Eun, Sang June; Kim, Wan Ho; Lee, Bum-Suk; Leigh, Ja-Ho; Kim, Jung-Eun; Lee, Jin Yong

2013-09-01

This study aimed to develop a health needs assessment (HNA) tool for persons with brain disorders and to assess the unmet needs of persons with brain disorders using the developed tool. The authors used consensus methods to develop a HNA tool. Using a randomized stratified systematic sampling method adjusted for sex, age, and districts, 57 registered persons (27 severe and 30 mild cases) with brain disorders dwelling in Seoul, South Korea were chosen and medical specialists investigated all of the subjects with the developed tools. The HNA tool for brain disorders we developed included four categories: 1) medical interventions and operations, 2) assistive devices, 3) rehabilitation therapy, and 4) regular follow-up. This study also found that 71.9% of the subjects did not receive appropriate medical care, which implies that the severity of their disability is likely to be exacerbated and permanent, and the loss irrecoverable. Our results showed that the HNA tool for persons with brain disorders based on unmet needs defined by physicians can be a useful method for evaluating the appropriateness and necessity of medical services offered to the disabled, and it can serve as the norm for providing health care services for disabled persons. Further studies should be undertaken to increase validity and reliability of the tool. Fundamental research investigating the factors generating or affecting the unmet needs is necessary; its results could serve as basis for developing policies to eliminate or alleviate these factors.

[Multicenter validation of an evaluation tool for clinical training activities (SVAT) of the nursing students].

PubMed

Finotto, Sergio; Gradellini, Cinzia; Bandini, Stefania; Burrai, Francesco; Lucchi Casadei, Sandra; Villani, Carolina; Vincenzi, Simone; Mecugni, Daniela

2017-01-01

To evaluate the psychometric characteristics of the Scheda di Valutazione delle Attività di Tirocinio (SVAT). The degree courses in Nursing of the University of Modena and Reggio Emilia, site of Reggio Emilia, the University of Bologna Formative Section BO1, Imola and training center of Cesena, the University of Ferrara training centers of Ferrara and Codigoro were all enrolled in the research. For the content validation the reactive Delphi method was chosen. The panel of experts expressed a qualitative-intuitive judgment on the adequacy of language and on the stimulus material (SVAT). For internal consistency Cronbach's alpha was calculated the. The test-retest method was used for the reliability of stability. all indicators of the SVAT have achieved a degree of consensus not less than 80% demonstrating its content validity. The face validity is demonstrated by an average score equal to or greater than 7 obtained by all indicators. The reliability of internal consistency of the SVAT was appraised by Cronbach's alpha that was 0.987 for the entire instrument. The reliability of the stability has been calculated through the correlation's coefficient expressed by Pearson's r that was 0.983 (p = 1.3E-198). in Italy there is no a "gold standard" tool to evaluate the clinical performance of nursing students during and at the end of their clinical training. The SVAT proves to be a valuable and reliable tool it furthermore could stimulate the discussion and the debate among educators and nurses, so that also in our country, it may be possible develop and refine tools that support the evaluation of clinical skills of nursing students.

The MIXED framework: A novel approach to evaluating mixed-methods rigor.

PubMed

Eckhardt, Ann L; DeVon, Holli A

2017-10-01

Evaluation of rigor in mixed-methods (MM) research is a persistent challenge due to the combination of inconsistent philosophical paradigms, the use of multiple research methods which require different skill sets, and the need to combine research at different points in the research process. Researchers have proposed a variety of ways to thoroughly evaluate MM research, but each method fails to provide a framework that is useful for the consumer of research. In contrast, the MIXED framework is meant to bridge the gap between an academic exercise and practical assessment of a published work. The MIXED framework (methods, inference, expertise, evaluation, and design) borrows from previously published frameworks to create a useful tool for the evaluation of a published study. The MIXED framework uses an experimental eight-item scale that allows for comprehensive integrated assessment of MM rigor in published manuscripts. Mixed methods are becoming increasingly prevalent in nursing and healthcare research requiring researchers and consumers to address issues unique to MM such as evaluation of rigor. © 2017 John Wiley & Sons Ltd.

BCILAB: a platform for brain-computer interface development

NASA Astrophysics Data System (ADS)

Kothe, Christian Andreas; Makeig, Scott

2013-10-01

Objective. The past two decades have seen dramatic progress in our ability to model brain signals recorded by electroencephalography, functional near-infrared spectroscopy, etc., and to derive real-time estimates of user cognitive state, response, or intent for a variety of purposes: to restore communication by the severely disabled, to effect brain-actuated control and, more recently, to augment human-computer interaction. Continuing these advances, largely achieved through increases in computational power and methods, requires software tools to streamline the creation, testing, evaluation and deployment of new data analysis methods. Approach. Here we present BCILAB, an open-source MATLAB-based toolbox built to address the need for the development and testing of brain-computer interface (BCI) methods by providing an organized collection of over 100 pre-implemented methods and method variants, an easily extensible framework for the rapid prototyping of new methods, and a highly automated framework for systematic testing and evaluation of new implementations. Main results. To validate and illustrate the use of the framework, we present two sample analyses of publicly available data sets from recent BCI competitions and from a rapid serial visual presentation task. We demonstrate the straightforward use of BCILAB to obtain results compatible with the current BCI literature. Significance. The aim of the BCILAB toolbox is to provide the BCI community a powerful toolkit for methods research and evaluation, thereby helping to accelerate the pace of innovation in the field, while complementing the existing spectrum of tools for real-time BCI experimentation, deployment and use.

Ultrasound – A new approach for non-woven scaffolds investigation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Khramtsova, E. A.; Morokov, E. S.; Levin, V. M.

2016-05-18

In this study we verified the method of impulse acoustic microscopy as a tool for scaffold evaluation in tissue engineering investigation. Cellulose diacetate (CDA) non-woven 3D scaffold was used as a model object. Scanning electron microscopy and optical microscopy were used as reference methods in order to realize feasibility of acoustic microscopy method in a regenerative medicine field. Direct comparison of the different methods was carried out.

An Evaluation of Fractal Surface Measurement Methods for Characterizing Landscape Complexity from Remote-Sensing Imagery

NASA Technical Reports Server (NTRS)

Lam, Nina Siu-Ngan; Qiu, Hong-Lie; Quattrochi, Dale A.; Emerson, Charles W.; Arnold, James E. (Technical Monitor)

2001-01-01

The rapid increase in digital data volumes from new and existing sensors necessitates the need for efficient analytical tools for extracting information. We developed an integrated software package called ICAMS (Image Characterization and Modeling System) to provide specialized spatial analytical functions for interpreting remote sensing data. This paper evaluates the three fractal dimension measurement methods: isarithm, variogram, and triangular prism, along with the spatial autocorrelation measurement methods Moran's I and Geary's C, that have been implemented in ICAMS. A modified triangular prism method was proposed and implemented. Results from analyzing 25 simulated surfaces having known fractal dimensions show that both the isarithm and triangular prism methods can accurately measure a range of fractal surfaces. The triangular prism method is most accurate at estimating the fractal dimension of higher spatial complexity, but it is sensitive to contrast stretching. The variogram method is a comparatively poor estimator for all of the surfaces, particularly those with higher fractal dimensions. Similar to the fractal techniques, the spatial autocorrelation techniques are found to be useful to measure complex images but not images with low dimensionality. These fractal measurement methods can be applied directly to unclassified images and could serve as a tool for change detection and data mining.

Process evaluation of physical activity counselling with and without the use of mobile technology: A mixed methods study.

PubMed

Verwey, R; van der Weegen, S; Spreeuwenberg, M; Tange, H; van der Weijden, T; de Witte, L

2016-01-01

A monitoring-and-feedback tool was developed to stimulate physical activity by giving feedback on physical activity performance to patients and practice nurses. The tool consists of an activity monitor (accelerometer), wirelessly connected to a Smartphone and a web application. Use of this tool is combined with a behaviour change counselling protocol (the Self-management Support Programme) based on the Five A's model (Assess-Advise-Agree-Assist-Arrange). To examine the reach, implementation and satisfaction with the counselling protocol and the tool. A process evaluation was conducted in two intervention groups of a three-armed cluster randomised controlled trial, in which the counselling protocol was evaluated with (group 1, n=65) and without (group 2, n=66) the use of the tool using a mixed methods design. Sixteen family practices in the South of the Netherlands. Practice nurses (n=20) and their associated physically inactive patients (n=131), diagnosed with Chronic Obstructive Pulmonary Disease or Type 2 Diabetes, aged between 40 and 70 years old, and having access to a computer with an Internet connection. Semi structured interviews about the receipt of the intervention were conducted with the nurses and log files were kept regarding the consultations. After the intervention, questionnaires were presented to patients and nurses regarding compliance to and satisfaction with the interventions. Functioning and use of the tool were also evaluated by system and helpdesk logging. Eighty-six percent of patients (group 1: n=57 and group 2: n=56) and 90% of nurses (group 1: n=10 and group 2: n=9) responded to the questionnaires. The execution of the Self-management Support Programme was adequate; in 83% (group 1: n=52, group 2: n=57) of the patients, the number and planning of the consultations were carried out as intended. Eighty-eight percent (n=50) of the patients in group 1 used the tool until the end of the intervention period. Technical problems occurred in 58% (n=33). Participants from group 1 were significantly more positive: patients: χ(2)(2, N=113)=11.17, p=0.004, and nurses: χ(2)(2, N=19)=6.37, p=0.040. Use of the tool led to greater awareness of the importance of physical activity, more discipline in carrying it out and more enjoyment. The interventions were adequately executed and received as planned. Patients from both groups appreciated the focus on physical activity and personal attention given by the nurse. The most appreciated aspect of the combined intervention was the tool, although technical problems frequently occurred. Patients with the tool estimated more improvement of physical activity than patients without the tool. Copyright © 2015 Elsevier Ltd. All rights reserved.

Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record

PubMed Central

Chrimes, Dillon; Kushniruk, Andre; Kitos, Nicole R.

2014-01-01

Purpose Usability testing can be used to evaluate human computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in “live” clinical workflow or whether a tool is successful. Therefore, “Near-live” clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. Methods The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved “think-aloud” protocol analysis of 8 primary care providers interacting with several scripted clinical scenarios. Phase II used “near-live” clinical simulations of 5 providers interacting with standardized trained patient actors enacting the clinical scenario of counseling for pre-diabetes, each of whom had a pedometer that recorded the number of steps taken over a week. In both phases, all sessions were audio-taped and motion screen-capture software was activated for onscreen recordings. Transcripts were coded using iterative qualitative content analysis methods. Results In Phase I, the impact of the components and layout of ADAPT on user’s Navigation, Understandability, and Workflow were associated with the largest volume of negative comments (i.e. approximately 80% of end-user commentary), while Usability and Content of ADAPT were representative of more positive than negative user commentary. The heuristic category of Usability had a positive-to-negative comment ratio of 2.1, reflecting positive perception of the usability of the tool, its functionality, and overall co-productive utilization of ADAPT. However, there were mixed perceptions about content (i.e., how the information was displayed, organized and described in the tool). In Phase II, the duration of patient encounters was approximately 10 minutes with all of the Patient Instructions (prescriptions) and behavioral contracting being activated at the end of each visit. Upon activation, providers accepted the pathway prescribed by the tool 100% of the time and completed all the fields in the tool in the simulation cases. Only 14% of encounter time was spent using the functionality of the ADAPT tool in terms of keystrokes and entering relevant data. The rest of the time was spent on communication and dialogue to populate the patient instructions. In all cases, the interaction sequence of reviewing and discussing exercise and diet of the patient was linked to the functionality of the ADAPT tool in terms of monitoring, response-efficacy, self-efficacy, and negotiation in the patient-provider dialogue. There was a change from one-way dialogue to two-way dialogue and negotiation that ended in a behavioral contract. This change demonstrated the tool’s sequence, which supported recording current exercise and diet followed by a diet and exercise goal setting procedure to reduce the risk of diabetes onset. Conclusions This study demonstrated that “think-aloud” protocol analysis with “near-live” clinical simulations provided a successful usability evaluation of a new primary care pre-diabetes shared goal setting tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to show the influence of the ADAPT framework on the usability, workflow integration, and communication between the patient and provider. The think-aloud tests with the provider showed the tool can be used according to the ADAPT framework (exercise-to-diet behavior change and tool utilization), while the clinical simulations revealed the ADAPT framework to realistically support patient-provider communication to obtain behavioral change contract. SDM interactions and mechanisms affecting protocol-based care can be more completely captured by combining “near-live” clinical simulations with traditional “think-aloud analysis” which augments clinician utilization. More analysis is required to verify if the rich communication actions found in Phase II compliment clinical workflows. PMID:24981988

Mixed Methods Design Study Investigating the Use of a Music Authentic Performance Assessment Tool by High School Band Directors to Measure Student Musical Growth

ERIC Educational Resources Information Center

Beason, Christine F.

2017-01-01

This research project was designed to determine if the Model Cornerstone Assessment for Performance, Proficient level, published by the National Association for Music Education would be an appropriate tool to use to demonstrate student growth as one element of teacher evaluations, specifically the T-TESS. This study focused on four main research…

Lean management and medical laboratory: application in transfusionnal immuno-hematology.

PubMed

Thibert, Jean-Baptiste; Le Vacon, Françoise; Danic, Bruno

2017-10-01

Despite a common use in industrial applications, only a few studies describe the lean management methods in medical laboratory. These tools have been evaluated in analysis laboratory of blood donors, especially in immuno-hematology sector. The aim was to optimize the organization and maintain team cohesion and strong staff involvement in a restructuring context. The tools used and the results obtained are presented in this study.

Development and Evaluation of a Web Map Mind Tool Environment with the Theory of Spatial Thinking and Project-Based Learning Strategy

ERIC Educational Resources Information Center

Hou, Huei-Tse; Yu, Tsai-Fang; Wu, Yi-Xuan; Sung, Yao-Ting; Chang, Kuo-En

2016-01-01

The theory of spatial thinking is relevant to the learning and teaching of many academic domains. One promising method to facilitate learners' higher-order thinking is to utilize a web map mind tool to assist learners in applying spatial thinking to cooperative problem solving. In this study, an environment is designed based on the theory of…

Can I solve my structure by SAD phasing? Planning an experiment, scaling data and evaluating the useful anomalous correlation and anomalous signal.

PubMed

Terwilliger, Thomas C; Bunkóczi, Gábor; Hung, Li Wei; Zwart, Peter H; Smith, Janet L; Akey, David L; Adams, Paul D

2016-03-01

A key challenge in the SAD phasing method is solving a structure when the anomalous signal-to-noise ratio is low. Here, algorithms and tools for evaluating and optimizing the useful anomalous correlation and the anomalous signal in a SAD experiment are described. A simple theoretical framework [Terwilliger et al. (2016), Acta Cryst. D72, 346-358] is used to develop methods for planning a SAD experiment, scaling SAD data sets and estimating the useful anomalous correlation and anomalous signal in a SAD data set. The phenix.plan_sad_experiment tool uses a database of solved and unsolved SAD data sets and the expected characteristics of a SAD data set to estimate the probability that the anomalous substructure will be found in the SAD experiment and the expected map quality that would be obtained if the substructure were found. The phenix.scale_and_merge tool scales unmerged SAD data from one or more crystals using local scaling and optimizes the anomalous signal by identifying the systematic differences among data sets, and the phenix.anomalous_signal tool estimates the useful anomalous correlation and anomalous signal after collecting SAD data and estimates the probability that the data set can be solved and the likely figure of merit of phasing.

Innovations for the future of pharmacovigilance.

PubMed

Almenoff, June S

2007-01-01

Post-marketing pharmacovigilance involves the review and management of safety information from many sources. Among these sources, spontaneous adverse event reporting systems are among the most challenging and resource-intensive to manage. Traditionally, efforts to monitor spontaneous adverse event reporting systems have focused on review of individual case reports. The science of pharmacovigilance could be enhanced with the availability of systems-based tools that facilitate analysis of aggregate data for purposes of signal detection, signal evaluation and knowledge management. GlaxoSmithKline (GSK) recently implemented Online Signal Management (OSM) as a data-driven framework for managing the pharmacovigilance of marketed products. This pioneering work builds upon the strong history GSK has of innovation in this area. OSM is a software application co-developed by GSK and Lincoln Technologies that integrates traditional pharmacovigilance methods with modern quantitative statistical methods and data visualisation tools. OSM enables the rapid identification of trends from the individual adverse event reports received by GSK. OSM also provides knowledge-management tools to ensure the successful tracking of emerging safety issues. GSK has developed standard procedures and 'best practices' around the use of OSM to ensure the systematic evaluation of complex safety datasets. In summary, the implementation of OSM provides new tools and efficient processes to advance the science of pharmacovigilance.

Evaluating the Discrete Element Method as a Tool for Predicting the Seasonal Evolution of the MIZ

DTIC Science & Technology

2014-09-30

distribution (Hopkins & Thorndike 2006). The DEM treats sea ice as a collection of discrete pieces of ice, thus affording the method certain...Annals of Glaciology, 33(1), 355-360. Hopkins, M. A., & Thorndike , A. S. (2006) Floe formation in Arctic sea ice. Journal of Geophysical Research

Photovoice as an Evaluation Tool for Student Learning on a Field Trip

ERIC Educational Resources Information Center

Behrendt, Marc; Machtmes, Krisanna

2016-01-01

Background: Photovoice is one method that enables an educator to view an experience from a student's perspective. This study examined how teachers might use photovoice during an informal learning experience to understand the students' experiences and experiential gain. Design and methods: Participants in this study consisted of six students, three…

An Evaluation Method for PV Systems by using Limited Data Item

NASA Astrophysics Data System (ADS)

Oozeki, Takashi; Izawa, Toshiyasu; Otani, Kenji; Tsuzuku, Ken; Koike, Hisafumi; Kurokawa, Kosuke

Beside photovoltaic (PV) systems are recently expected to introduce around Japan, almost all of them have not been taken care after established since PV systems are called maintenance free. In fact, there are few troubles about PV operations behind owners of PV systems because characteristics of them cannot be identified completely such as the ideal output energy. Therefore, it is very important to evaluate the characteristics of them. For evaluating them, equipments of measuring are required, and they, especially Pyrheliometer, are expensive as much as owners of the PV system cannot equip usually. Consequently, An evaluation method which can reveal the performance of operation such as the performance ratio with a very few kinds of data is necessary. In this paper, proposed method can evaluate performance ratio, shading losses, inverter efficiency losses by using only system output data items. The adequacies of the method are indicated by comparing with actual data and field survey results. As a result, the method is intended to be checking tool of PV system performance.

Skylab experiments. Volume 7: Living and working in space. [Skylab mission data on human factors engineering and spacecraft components for high school level education

NASA Technical Reports Server (NTRS)

1973-01-01

Experiments conducted on the Skylab vehicle that will measure and evaluate the ability of the crew to live and work effectively in space are discussed. The methods and techniques of human engineering as they relate to the design and evaluation of work spaces, requirements, and tools are described. The application of these methods and the Skylab measurements to the design of future spacecraft are analyzed.

In-service teachers' perceptions of project-based learning.

PubMed

Habók, Anita; Nagy, Judit

2016-01-01

The study analyses teachers' perceptions of methods, teacher roles, success and evaluation in PBL and traditional classroom instruction. The analysis is based on empirical data collected in primary schools and vocational secondary schools. An analysis of 109 questionnaires revealed numerous differences based on degree of experience and type of school. In general, project-based methods were preferred among teachers, who mostly perceived themselves as facilitators and considered motivation and transmission of values central to their work. Teachers appeared not to capitalize on the use of ICT tools or emotions. Students actively participated in the evaluation process via oral evaluation.

Application of Heart Rate Variability in Diagnosis and Prognosis of Individuals with Diabetes Mellitus: Systematic Review.

PubMed

França da Silva, Anne Kastelianne; Penachini da Costa de Rezende Barbosa, Marianne; Marques Vanderlei, Franciele; Destro Christofaro, Diego Giuliano; Marques Vanderlei, Luiz Carlos

2016-05-01

The use of heart rate variability as a tool capable of discriminating individuals with diabetes mellitus is still little explored, as its use has been limited to comparing those with and without the disease. Thus, the purpose of this study was to verify the use of heart rate variability as a tool for diagnostic and prognostic evaluation in person with diabetes and to identify whether there are cutoff points generated from the use of this tool in these individuals. A search was conducted in the electronic databases MEDLINE, Cochrane Library, Web of Science, EMBASE, and LILACS starting from the oldest records until January 2015, by means of descriptors related to the target condition, evaluated tool, and evaluation method. All the studies were evaluated for methodological quality using the QUADAS-2 instrument. Eight studies were selected. In general, the studies showed that the heart rate variability is useful to discriminate cardiac autonomic neuropathy in person with diabetes, and the sample entropy, SD1/SD2 indices, SDANN, HF, and slope of TFC have better discriminatory power to detect autonomic dysfunction, with sensitivity and specificity values ranging from 72% to 100% and 71% to 97%, respectively. Although there are methodological differences in indices used, in general, this tool demonstrated good sensitivity and specificity and can be used as an additional and/or complementary tool to the conventional autonomic tests, in order to obtain safer and more effective diagnostic, collaborating for better risk stratification conditions of these patients. © 2016 Wiley Periodicals, Inc.

Hearing Aid Satisfaction: What Does Research from the Past 20 Years Say?

PubMed Central

Wong, Lena L. N.; Hickson, Louise; McPherson, Bradley

2003-01-01

Hearing aid satisfaction is a pleasurable emotional experience as an outcome of an evaluation of performance. Many tools have been designed to measure the degree of satisfaction overall, or along the dimensions of cost, appearance, acoustic benefit, comfort, and service. Various studies have used these tools to examine the relationships between satisfaction and other factors. Findings are not always consistent across studies, but in general, hearing aid satisfaction has been found to be related to experience, expectation, personality and attitude, usage, type of hearing aids, sound quality, listening situations, and problems in hearing aid use. Inconsistent findings across studies and difficulties in evaluating the underlying relationships are probably caused by problems with the tools (eg, lack of validity) and the methods used to evaluate relationships (eg, correlation analyses evaluate association and not causal effect). Whether satisfaction changes over time and how service satisfaction contributes to device satisfaction are unclear. It is hoped that this review will help readers understand current satisfaction measures, how various factors affect satisfaction, and how the way satisfaction is measured may be improved to yield more reliable and valid data. PMID:15004650

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing 1

PubMed Central

González-Chordá, Víctor Manuel; Maciá-Soler, María Loreto

2015-01-01

Abstract Objective: to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. Method: prospective longitudinal study conducted in a population of 60 secondyear Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. Results: nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). Conclusion: the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teachinglearning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care. PMID:26444173

Development of a screening tool to predict malnutrition among children under two years old in Zambia

PubMed Central

Hasegawa, Junko; Ito, Yoichi M; Yamauchi, Taro

2017-01-01

ABSTRACT Background: Maternal and child undernutrition is an important issue, particularly in low- and middle-income countries. Children at high risk of malnutrition should be prioritized to receive necessary interventions to minimize such risk. Several risk factors have been proposed; however, until now, there has been no appropriate evaluation method to identify these children. In sub-Saharan Africa, children commonly receive regular check-ups from community health workers. A simple and easy nutrition assessment method is therefore needed for use by semi-professional health workers. Objectives: The aim of this study was to develop and test a practical screening tool for community use in predicting growth stunting in children under two years in rural Zambia. Methods: Field research was conducted from July to August 2014 in Southern Province, Zambia. Two hundred and sixty-four mother-child pairs participated in the study. Anthropometric measurements were performed on all children and mothers, and all mothers were interviewed. Risk factors for the screening test were estimated by using least absolute shrinkage and selection operator analysis. After re-evaluating all participants using the new screening tool, a receiver operating characteristic curve was drawn to set the cut-off value. Sensitivity and specificity were also calculated. Results: The screening tool included age, weight-for-age Z-score status, birth weight, feeding status, history of sibling death, multiple birth, and maternal education level. The total score ranged from 0 to 22, and the cut-off value was eight. Sensitivity and specificity were 0.963 and 0.697 respectively. Conclusions: A screening tool was developed to predict children at high risk of malnutrition living in Zambia. Further longitudinal studies are needed to confirm the test’s validity in detecting future stunting and to investigate the effectiveness of malnutrition treatment. PMID:28730929

Rapid molecular diagnostics for multi-drug resistant tuberculosis in India.

PubMed

Ramachandran, Rajeswari; Muniyandi, M

2018-03-01

Rapid molecular diagnostic methods help in the detection of TB and Rifampicin resistance. These methods detect TB early, are accurate and play a crucial role in reducing the burden of drug resistant tuberculosis. Areas covered: This review analyses rapid molecular diagnostic tools used in the diagnosis of MDR-TB in India, such as the Line Probe Assay and GeneXpert. We have discussed the burden of MDR-TB and the impact of recent diagnostic tools on case detection and treatment outcomes. This review also discusses the costs involved in establishing these new techniques in India. Expert commentary: Molecular methods have considerable advantages for the programmatic management of drug resistant TB. These include speed, standardization of testing, potentially high throughput and reduced laboratory biosafety requirements. There is a desperate need for India to adopt modern, rapid, molecular tools with point-of-care tests being currently evaluated. New molecular diagnostic tests appear to be cost effective and also help in detecting missing cases. There is enough evidence to support the scaling up of these new tools in India.

Tools, strategies and qualitative approach in relation to suicidal attempts and ideation in the elderly.

PubMed

Cavalcante, Fátima Gonçalves; Minayo, Maria Cecília de Souza; Gutierrez, Denise Machado Duran; de Sousa, Girliani Silva; da Silva, Raimunda Magalhães; Moura, Rosylaine; Meneghel, Stela Nazareth; Grubits, Sonia; Conte, Marta; Cavalcante, Ana Célia Sousa; Figueiredo, Ana Elisa Bastos; Mangas, Raimunda Matilde do Nascimento; Fachola, María Cristina Heuguerot; Izquierdo, Giovane Mendieta

2015-06-01

The article analyses the quality and consistency of a comprehensive interview guide, adapted to study attempted suicide and its ideation among the elderly, and imparts the method followed in applying this tool. The objective is to show how the use of a semi-structured interview and the organization and data analysis set-up were tested and perfected by a network of researchers from twelve universities or research centers in Brazil, Uruguay and Colombia. The method involved application and evaluation of the tool and joint production of an instruction manual on data collection, systematization and analysis. The methodology was followed in 67 interviews with elderly people of 60 or older and in 34 interviews with health professionals in thirteen Brazilian municipalities and in Montevideo and Bogotá, allowing the consistency of the tool and the applicability of the method to be checked, during the process and at the end. The enhanced guide and the instructions for reproducing it are presented herein. The results indicate the suitability and credibility of this methodological approach, tested and certified in interdisciplinary and interinstitutional terms.

What are the most effective methods for assessment of nutritional status in outpatients with gastric and colorectal cancer?

PubMed

Abe Vicente, Mariana; Barão, Katia; Silva, Tiago Donizetti; Forones, Nora Manoukian

2013-01-01

To evaluate methods for the identification of nutrition risk and nutritional status in outpatients with colorectal (CRC) and gastric cancer (GC), and to compare the results to those obtained for patients already treated for these cancers. A cross-sectional study was conducted on 137 patients: group 1 (n = 75) consisting of patients with GC or CRC, and group 2 (n = 62) consisting of patients after treatment of GC or CRC under follow up, who were tumor free for a period longer than 3 months. Nutritional status was assessed in these patients using objective methods [body mass index (BMI), phase angle, serum albumin]; nutritional screening tools [Malnutrition Universal Screening Tool (MUST), Malnutrition Screening Tool (MST), Nutritional Risk Index (NRI)], and subjective assessment [Patient-Generated Subjective Global Assessment (PGSGA)]. The sensitivity and specificity of each method was calculated in relation to the PG-SGA used as gold standard. One hundred thirty seven patients participated in the study. Stage IV cancer patients were more common in group 1. There was no difference in BMI between groups (p = 0.67). Analysis of the association between methods of assessing nutritional status and PG-SGA showed that the nutritional screening tools provided more significant results (p < 0.05) than the objective methods in the two groups. PG-SGA detected the highest proportion of undernourished patients in group 1. The nutritional screening tools MUST, NRI and MST were more sensitive than the objective methods. Phase angle measurement was the most sensitive objective method in group 1. The nutritional screening tools showed the best association with PG-SGA and were also more sensitive than the objective methods. The results suggest the combination of MUST and PG-SGA for patients with cancer before and after treatment. Copyright © AULA MEDICA EDICIONES 2013. Published by AULA MEDICA. All rights reserved.

Middle-aged women’s decisions about body weight management: needs assessment and testing of a knowledge translation tool

PubMed Central

Stacey, Dawn; Jull, Janet; Beach, Sarah; Dumas, Alex; Strychar, Irene; Adamo, Kristi; Brochu, Martin; Prud’homme, Denis

2015-01-01

Abstract Objective This study aims to assess middle-aged women’s needs when making body weight management decisions and to evaluate a knowledge translation tool for addressing their needs. Methods A mixed-methods study used an interview-guided theory-based survey of professional women aged 40 to 65 years. The tool summarized evidence to address their needs and enabled women to monitor actions taken. Acceptability and usability were reported descriptively. Results Sixty female participants had a mean body mass index of 28.0 kg/m2 (range, 17.0-44.9 kg/m2), and half were premenopausal. Common options for losing (82%) or maintaining (18%) weight included increasing physical activity (60%), eating healthier (57%), and getting support (40%). Decision-making involved getting information on options (52%), soliciting others’ decisions/advice (20%), and being self-motivated (20%). Preferred information sources included written information (97%), counseling (90%), and social networking websites (43%). Five professionals (dietitian, personal trainer, occupational therapist, and two physicians) had similar responses. Of 53 women sent the tool, 27 provided acceptability feedback. They rated it as good to excellent for information on menopause (96%), body weight changes (85%), and managing body weight (85%). Most would tell others about it (81%). After 4 weeks of use, 25 women reported that the wording made sense (96%) and that the tool had clear instructions (92%) and was easy to use across time (88%). The amount of information was rated as just right (64%), but the tool had limited space for responding (72%). Conclusions When making decisions about body weight management, women’s needs were “getting information” and “getting support.” The knowledge translation tool was acceptable and usable, but further evaluation is required. PMID:25816120

Methods for examining data quality in healthcare integrated data repositories.

PubMed

Huser, Vojtech; Kahn, Michael G; Brown, Jeffrey S; Gouripeddi, Ramkiran

2018-01-01

This paper summarizes content of the workshop focused on data quality. The first speaker (VH) described data quality infrastructure and data quality evaluation methods currently in place within the Observational Data Science and Informatics (OHDSI) consortium. The speaker described in detail a data quality tool called Achilles Heel and latest development for extending this tool. Interim results of an ongoing Data Quality study within the OHDSI consortium were also presented. The second speaker (MK) described lessons learned and new data quality checks developed by the PEDsNet pediatric research network. The last two speakers (JB, RG) described tools developed by the Sentinel Initiative and University of Utah's service oriented framework. The workshop discussed at the end and throughout how data quality assessment can be advanced by combining best features of each network.

Heat generation in aircraft tires under free rolling conditions

NASA Technical Reports Server (NTRS)

Clark, S. K.; Dodge, R. N.

1980-01-01

Effort is directed toward construction of a rational method for evaluating internal temperatures of aircraft tires. Enhanced predictability of tire temperature buildup is a design tool in both the tire and airframe industries.

[Application of finite element method in spinal biomechanics].

PubMed

Liu, Qiang; Zhang, Jun; Sun, Shu-Chun; Wang, Fei

2017-02-25

The finite element model is one of the most important methods in study of modern spinal biomechanics, according to the needs to simulate the various states of the spine, calculate the stress force and strain distribution of the different groups in the state, and explore its principle of mechanics, mechanism of injury, and treatment effectiveness. In addition, in the study of the pathological state of the spine, the finite element is mainly used in the understanding the mechanism of lesion location, evaluating the effects of different therapeutic tool, assisting and completing the selection and improvement of therapeutic tool, in order to provide a theoretical basis for the rehabilitation of spinal lesions. Finite element method can be more provide the service for the patients suffering from spinal correction, operation and individual implant design. Among the design and performance evaluation of the implant need to pay attention to the individual difference and perfect the evaluation system. At present, how to establish a model which is more close to the real situation has been the focus and difficulty of the study of human body's finite element.Although finite element method can better simulate complex working condition, it is necessary to improve the authenticity of the model and the sharing of the group by using many kinds of methods, such as image science, statistics, kinematics and so on. Copyright© 2017 by the China Journal of Orthopaedics and Traumatology Press.

Did you have an impact? A theory-based method for planning and evaluating knowledge-transfer and exchange activities in occupational health and safety.

PubMed

Kramer, Desré M; Wells, Richard P; Carlan, Nicolette; Aversa, Theresa; Bigelow, Philip P; Dixon, Shane M; McMillan, Keith

2013-01-01

Few evaluation tools are available to assess knowledge-transfer and exchange interventions. The objective of this paper is to develop and demonstrate a theory-based knowledge-transfer and exchange method of evaluation (KEME) that synthesizes 3 theoretical frameworks: the promoting action on research implementation of health services (PARiHS) model, the transtheoretical model of change, and a model of knowledge use. It proposes a new term, keme, to mean a unit of evidence-based transferable knowledge. The usefulness of the evaluation method is demonstrated with 4 occupational health and safety knowledge transfer and exchange (KTE) implementation case studies that are based upon the analysis of over 50 pre-existing interviews. The usefulness of the evaluation model has enabled us to better understand stakeholder feedback, frame our interpretation, and perform a more comprehensive evaluation of the knowledge use outcomes of our KTE efforts.

A Synthetic Comparator Approach to Local Evaluation of School-Based Substance Use Prevention Programming.

PubMed

Hansen, William B; Derzon, James H; Reese, Eric L

2014-06-01

We propose a method for creating groups against which outcomes of local pretest-posttest evaluations of evidence-based programs can be judged. This involves assessing pretest markers for new and previously conducted evaluations to identify groups that have high pretest similarity. A database of 802 prior local evaluations provided six summary measures for analysis. The proximity of all groups using these variables is calculated as standardized proximities having values between 0 and 1. Five methods for creating standardized proximities are demonstrated. The approach allows proximity limits to be adjusted to find sufficient numbers of synthetic comparators. Several index cases are examined to assess the numbers of groups available to serve as comparators. Results show that most local evaluations would have sufficient numbers of comparators available for estimating program effects. This method holds promise as a tool for local evaluations to estimate relative effectiveness. © The Author(s) 2012.

Fault tolerant testbed evaluation, phase 1

NASA Technical Reports Server (NTRS)

Caluori, V., Jr.; Newberry, T.

1993-01-01

In recent years, avionics systems development costs have become the driving factor in the development of space systems, military aircraft, and commercial aircraft. A method of reducing avionics development costs is to utilize state-of-the-art software application generator (autocode) tools and methods. The recent maturity of application generator technology has the potential to dramatically reduce development costs by eliminating software development steps that have historically introduced errors and the need for re-work. Application generator tools have been demonstrated to be an effective method for autocoding non-redundant, relatively low-rate input/output (I/O) applications on the Space Station Freedom (SSF) program; however, they have not been demonstrated for fault tolerant, high-rate I/O, flight critical environments. This contract will evaluate the use of application generators in these harsh environments. Using Boeing's quad-redundant avionics system controller as the target system, Space Shuttle Guidance, Navigation, and Control (GN&C) software will be autocoded, tested, and evaluated in the Johnson (Space Center) Avionics Engineering Laboratory (JAEL). The response of the autocoded system will be shown to match the response of the existing Shuttle General Purpose Computers (GPC's), thereby demonstrating the viability of using autocode techniques in the development of future avionics systems.

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

PubMed

Raupach, Tobias; Schiekirka, Sarah; Münscher, Christian; Beißbarth, Tim; Himmel, Wolfgang; Burckhardt, Gerhard; Pukrop, Tobias

2012-01-01

Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical phase of a medical curriculum and address differences between the novel tool and traditional evaluation methods. Student self-assessments before and after completion of a teaching module were used to compute performance gains for specific learning objectives. Mean performance gains in each module were compared to student expectations before the module and data derived from a traditional evaluation tool using overall course ratings at the end of the module. A ranking of the 21 modules according to computed performance gains yielded entirely different results than module rankings based on overall course ratings. There was no significant correlation between performance gain and overall ratings. However, the latter were significantly correlated to student expectations before entering the module as well as structural and procedural parameters (Pearson's r 0.7-0.9). Performance gain computed from comparative self-assessments adds an important new dimension to course evaluation in medical education. In contrast to overall course ratings, the novel tool is less heavily confounded by construct-irrelevant factors. Thus, it appears to be more appropriate than overall course ratings in determining teaching quality and developing algorithms to guide performance-oriented resource allocation in medical education.

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

PubMed

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Evaluation of an educational technology regarding clinical evaluation of preterm newborns.

PubMed

Fonseca, Luciana Mara Monti; Aredes, Natália Del'Angelo; Leite, Adriana Moraes; dos Santos, Claudia Benedita; de Lima, Regina Aparecida Garcia; Scochi, Carmen Gracinda Silvan

2013-02-01

To evaluate, from the students' point of view, educational software developed as a tool to help teachers and students in neonatal nursing. The study evaluates the contents and simulations addressed in the software. A total of 57 undergraduate nursing students affiliated with five Brazilian public colleges participated. The general assessment of the software was highly satisfactory: 82.4% of the sample characterized the software as quite effective as a teaching tool. Most components were assessed as good or very good. The participants' suggestions and comments are being considered in the improvement and adaptation of the new software version. The results show that the product is adequate for use in neonatal nursing courses and nursing training on the physical examination techniques and semiology of preterm newborns, falling within the pedagogical framework of active methods.

Environmental Evaluation of Soil Salinity with Various Watering Technologies Assessment.

PubMed

Seitkaziev, Adeubay; Shilibek, Kenzhegali; Fakhrudenova, Idiya; Salybayev, Satybaldy; Zhaparova, Sayagul; Duisenbayeva, Saule; Bayazitova, Zulfia; Aliya, Maimakova; Seitkazieva, Karlygash; Aubakirov, Hamit

2018-01-01

  The purpose of this study is to develop mathematical tools for evaluating the level of environmental safety of various watering technologies. A set of indicators, was developed with regard to the natural factors, the nature of the man-induced load, degradation type, and characteristics of the disruption of humification conditions. Thermal and physical characteristics of the soil, the state of its surface, and meteorological factors, including air temperature, relative humidity, precipitation, wind speed, solar radiation, etc. were studied with a view to determining the heat and air exchange in the soil. An environmental evaluation of the methods for saline land development was conducted with regard to the heat and moisture supply. This tool can be used to determine the level of environmental safety of soil salinization during the environmental evaluation of the investigation of soil salinity with various watering technologies.

Sensory Evaluation as a Tool in Determining Acceptability of Innovative Products Developed by Undergraduate Students in Food Science and Technology at the University of Trinidad and Tobago

ERIC Educational Resources Information Center

Singh-Ackbarali, Dimple; Maharaj, Rohanie

2014-01-01

This paper discusses the comprehensive and practical training that was delivered to students in a university classroom on how sensory evaluation can be used to determine acceptability of food products. The report presents how students used their training on sensory evaluation methods and analysis and applied it to improving and predicting…

Airborne Evaluation and Demonstration of a Time-Based Airborne Inter-Arrival Spacing Tool

NASA Technical Reports Server (NTRS)

Lohr, Gary W.; Oseguera-Lohr, Rosa M.; Abbott, Terence S.; Capron, William R.; Howell, Charles T.

2005-01-01

An airborne tool has been developed that allows an aircraft to obtain a precise inter-arrival time-based spacing interval from the preceding aircraft. The Advanced Terminal Area Approach Spacing (ATAAS) tool uses Automatic Dependent Surveillance-Broadcast (ADS-B) data to compute speed commands for the ATAAS-equipped aircraft to obtain this inter-arrival spacing behind another aircraft. The tool was evaluated in an operational environment at the Chicago O'Hare International Airport and in the surrounding terminal area with three participating aircraft flying fixed route area navigation (RNAV) paths and vector scenarios. Both manual and autothrottle speed management were included in the scenarios to demonstrate the ability to use ATAAS with either method of speed management. The results on the overall delivery precision of the tool, based on a target spacing of 90 seconds, were a mean of 90.8 seconds with a standard deviation of 7.7 seconds. The results for the RNAV and vector cases were, respectively, M=89.3, SD=4.9 and M=91.7, SD=9.0.

An Experiential Approach to Clinical Supervision Training: A Mixed Methods Evaluation of Effectiveness

ERIC Educational Resources Information Center

Fisher, Amy Killen; Simmons, Christopher; Allen, Susan C.

2016-01-01

This study evaluates an intensive experiential exercise designed to facilitate the provision of high-quality supervision in social work. Data from 46 BSW and MSW students suggest that the exercise can be an effective learning tool. Both quantitative and qualitative findings indicated that the students formed a supervisory working alliance; BSW…

Evaluation of ERTS-1 data for acquiring land use data of northern Megalopolis. [New England

NASA Technical Reports Server (NTRS)

Simpson, R. B.; Lindgren, D. T.; Goldstein, W. D.

1974-01-01

State planners are increasingly becoming interested in ERTS as a possible method for acquiring land use data. An important consideration to them is whether ERTS can provide such data at a savings in both time and money over alternative systems. A preliminary evaluation of ERTS as a planning tool is given.

Development and Evaluation of a Questionnaire to Assess Physical Educators' Knowledge of Student Assessment

ERIC Educational Resources Information Center

Emmanouilidou, Kyriaki; Derri, Vassiliki; Aggelousis, Nicolaos; Vassiliadou, Olga

2012-01-01

The purpose of this pilot study was to develop and evaluate an instrument for measuring Greek elementary physical educators' knowledge of student assessment. A multiple-choice questionnaire comprised of items about concepts, methods, tools, and types of student assessment in physical education was designed and tested. The initial 35-item…

Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis.

PubMed

Wang, Karen E; Fitzpatrick, Caroline; George, David; Lane, Lindsey

2012-01-01

Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their effectiveness as evaluators. The objective is to examine affiliate faculty members' attitudes toward clinical clerkship evaluation using primarily qualitative research methods. The study used a nonexperimental research design and employed mixed methods. Data were collected through interviews, focus groups, and a questionnaire from 11 affiliate faculty members. Themes emerging from the data fell into three broad categories: (a) factors that influence grading, (b) consequences of negative evaluations, and (c) disconnections in the grading process. The quantitative portion of the study revealed important discrepancies supporting the use of qualitative methods. The study highlights faculty members' struggles with the evaluative process and emphasizes the need for improvements in evaluation tools and faculty development.

Development of a Learning-Oriented Computer Assisted Instruction Designed to Improve Skills in the Clinical Assessment of the Nutritional Status: A Pilot Evaluation

PubMed Central

García de Diego, Laura; Cuervo, Marta; Martínez, J. Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient’s nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient’s needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum. PMID:25978456

Development of a learning-oriented computer assisted instruction designed to improve skills in the clinical assessment of the nutritional status: a pilot evaluation.

PubMed

García de Diego, Laura; Cuervo, Marta; Martínez, J Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient's nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient's needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum.

Design Pattern Mining Using Distributed Learning Automata and DNA Sequence Alignment

PubMed Central

Esmaeilpour, Mansour; Naderifar, Vahideh; Shukur, Zarina

2014-01-01

Context Over the last decade, design patterns have been used extensively to generate reusable solutions to frequently encountered problems in software engineering and object oriented programming. A design pattern is a repeatable software design solution that provides a template for solving various instances of a general problem. Objective This paper describes a new method for pattern mining, isolating design patterns and relationship between them; and a related tool, DLA-DNA for all implemented pattern and all projects used for evaluation. DLA-DNA achieves acceptable precision and recall instead of other evaluated tools based on distributed learning automata (DLA) and deoxyribonucleic acid (DNA) sequences alignment. Method The proposed method mines structural design patterns in the object oriented source code and extracts the strong and weak relationships between them, enabling analyzers and programmers to determine the dependency rate of each object, component, and other section of the code for parameter passing and modular programming. The proposed model can detect design patterns better that available other tools those are Pinot, PTIDEJ and DPJF; and the strengths of their relationships. Results The result demonstrate that whenever the source code is build standard and non-standard, based on the design patterns, then the result of the proposed method is near to DPJF and better that Pinot and PTIDEJ. The proposed model is tested on the several source codes and is compared with other related models and available tools those the results show the precision and recall of the proposed method, averagely 20% and 9.6% are more than Pinot, 27% and 31% are more than PTIDEJ and 3.3% and 2% are more than DPJF respectively. Conclusion The primary idea of the proposed method is organized in two following steps: the first step, elemental design patterns are identified, while at the second step, is composed to recognize actual design patterns. PMID:25243670

Teamwork Assessment Tools in Modern Surgical Practice: A Systematic Review

PubMed Central

Whittaker, George; Abboudi, Hamid; Khan, Muhammed Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-01-01

Introduction. Deficiencies in teamwork skills have been shown to contribute to the occurrence of adverse events during surgery. Consequently, several teamwork assessment tools have been developed to evaluate trainee nontechnical performance. This paper aims to provide an overview of these instruments and review the validity of each tool. Furthermore, the present paper aims to review the deficiencies surrounding training and propose several recommendations to address these issues. Methods. A systematic literature search was conducted to identify teamwork assessment tools using MEDLINE (1946 to August 2015), EMBASE (1974 to August 2015), and PsycINFO (1806 to August 2015) databases. Results. Eight assessment tools which encompass aspects of teamwork were identified. The Nontechnical Skills for Surgeons (NOTSS) assessment was found to possess the highest level of validity from a variety of sources; reliability and acceptability have also been established for this tool. Conclusions. Deficits in current surgical training pathways have prompted several recommendations to meet the evolving requirements of surgeons. Recommendations from the current paper include integration of teamwork training and assessment into medical school curricula, standardised formal training of assessors to ensure accurate evaluation of nontechnical skill acquisition, and integration of concurrent technical and nontechnical skills training throughout training. PMID:26425732

[A computer method for the evaluation of Paramecium motor activity using video records of their movement].

PubMed

Bingi, V N; Zarutskiĭ, A A; Kapranov, S V; Kovalev, Iu M; Miliaev, V A; Tereshchenko, N A

2004-01-01

A method for the evaluation of Paramecium caudatum motility was proposed as a tool for the investigation of magnetobiological as well as other physical and chemical effects. The microscopically observed movement of paramecia is recorded and processed using a special software program. The protozoan motility is determined as a function of their mean velocity in a definite time. The main advantages of the method are that it is easily modified for determining various characteristics of the motor activity of paramecia and that the video data obtained can be reused.

Continuous Coordination Tools and their Evaluation

NASA Astrophysics Data System (ADS)

Sarma, Anita; Al-Ani, Ban; Trainer, Erik; Silva Filho, Roberto S.; da Silva, Isabella A.; Redmiles, David; van der Hoek, André

This chapter discusses a set of co-ordination tools (the Continuous Co-ordination (CC) tool suite that includes Ariadne, Workspace Activity Viewer (WAV), Lighthouse, Palantír, and YANCEES) and details of our evaluation framework for these tools. Specifically, we discuss how we assessed the usefulness and the usability of these tools within the context of a predefined evaluation framework called DESMETDESMET . For example, for visualization tools we evaluated the suitability of the level of abstraction and the mode of displaying information of each tool. Whereas for an infrastructure tool we evaluate the effort required to implement co-ordination tools based on the given tool. We conclude with pointers on factors to consider when evaluating co-ordination tools in general.

Enhancement of Chemical Entity Identification in Text Using Semantic Similarity Validation

PubMed Central

Grego, Tiago; Couto, Francisco M.

2013-01-01

With the amount of chemical data being produced and reported in the literature growing at a fast pace, it is increasingly important to efficiently retrieve this information. To tackle this issue text mining tools have been applied, but despite their good performance they still provide many errors that we believe can be filtered by using semantic similarity. Thus, this paper proposes a novel method that receives the results of chemical entity identification systems, such as Whatizit, and exploits the semantic relationships in ChEBI to measure the similarity between the entities found in the text. The method assigns a single validation score to each entity based on its similarities with the other entities also identified in the text. Then, by using a given threshold, the method selects a set of validated entities and a set of outlier entities. We evaluated our method using the results of two state-of-the-art chemical entity identification tools, three semantic similarity measures and two text window sizes. The method was able to increase precision without filtering a significant number of correctly identified entities. This means that the method can effectively discriminate the correctly identified chemical entities, while discarding a significant number of identification errors. For example, selecting a validation set with 75% of all identified entities, we were able to increase the precision by 28% for one of the chemical entity identification tools (Whatizit), maintaining in that subset 97% the correctly identified entities. Our method can be directly used as an add-on by any state-of-the-art entity identification tool that provides mappings to a database, in order to improve their results. The proposed method is included in a freely accessible web tool at www.lasige.di.fc.ul.pt/webtools/ice/. PMID:23658791

Health technology assessment. Evaluation of biomedical innovative technologies.

PubMed

Turchetti, Giuseppe; Spadoni, Enza; Geisler, Eliezer Elie

2010-01-01

This article describes health technology assessment (HTA) as an evaluation tool that applies systematic methods of inquiry to the generation and use of health technologies and new products. The focus of this article is on the contributions of HTA to the management of the new product development effort in the biomedical organization. Critical success factors (CSFs) are listed, and their role in assessing success is defined and explained. One of the conclusions of this article is that HTA is a powerful tool for managers in the biomedical sector, allowing them to better manage their innovation effort in their continuing struggle for competitiveness and survival.

Triangulation and the importance of establishing valid methods for food safety culture evaluation.

PubMed

Jespersen, Lone; Wallace, Carol A

2017-10-01

The research evaluates maturity of food safety culture in five multi-national food companies using method triangulation, specifically self-assessment scale, performance documents, and semi-structured interviews. Weaknesses associated with each individual method are known but there are few studies in food safety where a method triangulation approach is used for both data collection and data analysis. Significantly, this research shows that individual results taken in isolation can lead to wrong conclusions, resulting in potentially failing tactics and wasted investments. However, by applying method triangulation and reviewing results from a range of culture measurement tools it is possible to better direct investments and interventions. The findings add to the food safety culture paradigm beyond a single evaluation of food safety culture using generic culture surveys. Copyright © 2017. Published by Elsevier Ltd.

Mixed methods for telehealth research.

PubMed

Caffery, Liam J; Martin-Khan, Melinda; Wade, Victoria

2017-10-01

Mixed methods research is important to health services research because the integrated qualitative and quantitative investigation can give a more comprehensive understanding of complex interventions such as telehealth than can a single-method study. Further, mixed methods research is applicable to translational research and program evaluation. Study designs relevant to telehealth research are described and supported by examples. Quality assessment tools, frameworks to assist in the reporting and review of mixed methods research, and related methodologies are also discussed.

Use of Information Technology Tools in Source Selection Decision Making: A Study on USAF’s KC-X Tanker Replacement Program

DTIC Science & Technology

2008-06-01

The most common outranking methods are the preference ranking organization method for enrichment evaluation ( PROMETHEE ) and the elimination and...Brans and Ph. Vincke, “A Preference Ranking Organization Method: (The PROMETHEE Method for Multiple Criteria Decision-Making),” Management Science 31... PROMETHEE ). This method needs a preference function for each criterion to compute the degree of preference.72 “The credibility of the outranking

Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

PubMed

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Measuring ability to assess claims about treatment effects: the development of the 'Claim Evaluation Tools'.

PubMed

Austvoll-Dahlgren, Astrid; Semakula, Daniel; Nsangi, Allen; Oxman, Andrew David; Chalmers, Iain; Rosenbaum, Sarah; Guttersrud, Øystein

2017-05-17

To describe the development of the Claim Evaluation Tools, a set of flexible items to measure people's ability to assess claims about treatment effects. Methodologists and members of the community (including children) in Uganda, Rwanda, Kenya, Norway, the UK and Australia. In the iterative development of the items, we used purposeful sampling of people with training in research methodology, such as teachers of evidence-based medicine, as well as patients and members of the public from low-income and high-income countries. Development consisted of 4 processes: (1) determining the scope of the Claim Evaluation Tools and development of items; (2) expert item review and feedback (n=63); (3) cognitive interviews with children and adult end-users (n=109); and (4) piloting and administrative tests (n=956). The Claim Evaluation Tools database currently includes a battery of multiple-choice items. Each item begins with a scenario which is intended to be relevant across contexts, and which can be used for children (from age 10  and above), adult members of the public and health professionals. People with expertise in research methods judged the items to have face validity, and end-users judged them relevant and acceptable in their settings. In response to feedback from methodologists and end-users, we simplified some text, explained terms where needed, and redesigned formats and instructions. The Claim Evaluation Tools database is a flexible resource from which researchers, teachers and others can design measurement instruments to meet their own requirements. These evaluation tools are being managed and made freely available for non-commercial use (on request) through Testing Treatments interactive (testingtreatments.org). PACTR201606001679337 and PACTR201606001676150; Pre-results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Education research: evaluating the use of podcasting for residents during EEG instruction: a pilot study.

PubMed

Bensalem-Owen, Meriem; Chau, Destiny F; Sardam, Sean C; Fahy, Brenda G

2011-08-23

Educational methods for residents are shifting toward greater learner independence aided by technological advances. A Web-based program using a podcast was created for resident EEG instruction, replacing conventional didactics. The EEG curriculum also consisted of EEG interpretations under the tutelage of a neurophysiologist. This pilot study aimed to objectively evaluate the effectiveness of the podcast as a new teaching tool. A podcast for resident EEG instruction was implemented on the Web, replacing the traditional lecture. After Institutional Review Board approval, consent was obtained from the participating residents. Using 25-question evaluation tools, participants were assessed at baseline before any EEG instruction, and reassessed after podcasting and after 10 clinical EEG exposures. Each 25-item evaluation tool contained tracings used for clinical EEG interpretations. Scores after podcast training were also compared to scores after traditional didactic training from a previous study among anesthesiology trainees. Ten anesthesiology residents completed the study. The mean scores with standard deviations are 9.50 ± 2.92 at baseline, 13.40 ± 3.31 (p = 0.034) after the podcast, and 16.20 ± 1.87 (p = 0.019) after interpreting 10 EEGs. No differences were noted between the mean educational tool scores for those who underwent podcasting training compared to those who had undergone traditional didactic training. In this pilot study, podcast training was as effective as the prior conventional lecture in meeting the curricular goals of increasing EEG knowledge after 10 EEG interpretations as measured by assessment tools.

Perception, Cognition, and Effectiveness of Visualizations with Applications in Science and Engineering

NASA Astrophysics Data System (ADS)

Borkin, Michelle A.

Visualization is a powerful tool for data exploration and analysis. With data ever-increasing in quantity and becoming integrated into our daily lives, having effective visualizations is necessary. But how does one design an effective visualization? To answer this question we need to understand how humans perceive, process, and understand visualizations. Through visualization evaluation studies we can gain deeper insight into the basic perception and cognition theory of visualizations, both through domain-specific case studies as well as generalized laboratory experiments. This dissertation presents the results of four evaluation studies, each of which contributes new knowledge to the theory of perception and cognition of visualizations. The results of these studies include a deeper clearer understanding of how color, data representation dimensionality, spatial layout, and visual complexity affect a visualization's effectiveness, as well as how visualization types and visual attributes affect the memorability of a visualization. We first present the results of two domain-specific case study evaluations. The first study is in the field of biomedicine in which we developed a new heart disease diagnostic tool, and conducted a study to evaluate the effectiveness of 2D versus 3D data representations as well as color maps. In the second study, we developed a new visualization tool for filesystem provenance data with applications in computer science and the sciences more broadly. We additionally developed a new time-based hierarchical node grouping method. We then conducted a study to evaluate the effectiveness of the new tool with its radial layout versus the conventional node-link diagram, and the new node grouping method. Finally, we discuss the results of two generalized studies designed to understand what makes a visualization memorable. In the first evaluation we focused on visualization memorability and conducted an online study using Amazon's Mechanical Turk with hundreds of users and thousands of visualizations. For the second evaluation we designed an eye-tracking laboratory study to gain insight into precisely which elements of a visualization contribute to memorability as well as visualization recognition and recall.

extrap: Software to assist the selection of extrapolation methods for moving-boat ADCP streamflow measurements

USGS Publications Warehouse

Mueller, David S.

2013-01-01

profiles from the entire cross section and multiple transects to determine a mean profile for the measurement. The use of an exponent derived from normalized data from the entire cross section is shown to be valid for application of the power velocity distribution law in the computation of the unmeasured discharge in a cross section. Selected statistics are combined with empirically derived criteria to automatically select the appropriate extrapolation methods. A graphical user interface (GUI) provides the user tools to visually evaluate the automatically selected extrapolation methods and manually change them, as necessary. The sensitivity of the total discharge to available extrapolation methods is presented in the GUI. Use of extrap by field hydrographers has demonstrated that extrap is a more accurate and efficient method of determining the appropriate extrapolation methods compared with tools currently (2012) provided in the ADCP manufacturers’ software.

The use of multi-criteria decision making models in evaluating anesthesia method options in circumcision surgery.

PubMed

Hancerliogullari, Gulsah; Hancerliogullari, Kadir Oymen; Koksalmis, Emrah

2017-01-23

Determining the most suitable anesthesia method for circumcision surgery plays a fundamental role in pediatric surgery. This study is aimed to present pediatric surgeons' perspective on the relative importance of the criteria for selecting anesthesia method for circumcision surgery by utilizing the multi-criteria decision making methods. Fuzzy set theory offers a useful tool for transforming linguistic terms into numerical assessments. Since the evaluation of anesthesia methods requires linguistic terms, we utilize the fuzzy Analytic Hierarchy Process (AHP) and fuzzy Technique for Order Preference by Similarity to Ideal Solution (TOPSIS). Both mathematical decision-making methods are originated from individual judgements for qualitative factors utilizing the pair-wise comparison matrix. Our model uses four main criteria, eight sub-criteria as well as three alternatives. To assess the relative priorities, an online questionnaire was completed by three experts, pediatric surgeons, who had experience with circumcision surgery. Discussion of the results with the experts indicates that time-related factors are the most important criteria, followed by psychology, convenience and duration. Moreover, general anesthesia with penile block for circumcision surgery is the preferred choice of anesthesia compared to general anesthesia without penile block, which has a greater priority compared to local anesthesia under the discussed main-criteria and sub-criteria. The results presented in this study highlight the need to integrate surgeons' criteria into the decision making process for selecting anesthesia methods. This is the first study in which multi-criteria decision making tools, specifically fuzzy AHP and fuzzy TOPSIS, are used to evaluate anesthesia methods for a pediatric surgical procedure.

Evaluating resective surgery targets in epilepsy patients: A comparison of quantitative EEG methods.

PubMed

Müller, Michael; Schindler, Kaspar; Goodfellow, Marc; Pollo, Claudio; Rummel, Christian; Steimer, Andreas

2018-07-15

Quantitative analysis of intracranial EEG is a promising tool to assist clinicians in the planning of resective brain surgery in patients suffering from pharmacoresistant epilepsies. Quantifying the accuracy of such tools, however, is nontrivial as a ground truth to verify predictions about hypothetical resections is missing. As one possibility to address this, we use customized hypotheses tests to examine the agreement of the methods on a common set of patients. One method uses machine learning techniques to enable the predictive modeling of EEG time series. The other estimates nonlinear interrelation between EEG channels. Both methods were independently shown to distinguish patients with excellent post-surgical outcome (Engel class I) from those without improvement (Engel class IV) when assessing the electrodes associated with the tissue that was actually resected during brain surgery. Using the AND and OR conjunction of both methods we evaluate the performance gain that can be expected when combining them. Both methods' assessments correlate strongly positively with the similarity between a hypothetical resection and the corresponding actual resection in class I patients. Moreover, the Spearman rank correlation between the methods' patient rankings is significantly positive. To our best knowledge, this is the first study comparing surgery target assessments from fundamentally differing techniques. Although conceptually completely independent, there is a relation between the predictions obtained from both methods. Their broad consensus supports their application in clinical practice to provide physicians additional information in the process of presurgical evaluation. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Mobile Applications for Patient-centered Care Coordination: A Review of Human Factors Methods Applied to their Design, Development, and Evaluation

PubMed Central

Westbrook, J. I.

2015-01-01

Summary Objectives To examine if human factors methods were applied in the design, development, and evaluation of mobile applications developed to facilitate aspects of patient-centered care coordination. Methods We searched MEDLINE and EMBASE (2013-2014) for studies describing the design or the evaluation of a mobile health application that aimed to support patients’ active involvement in the coordination of their care. Results 34 papers met the inclusion criteria. Applications ranged from tools that supported self-management of specific conditions (e.g. asthma) to tools that provided coaching or education. Twelve of the 15 papers describing the design or development of an app reported the use of a human factors approach. The most frequently used methods were interviews and surveys, which often included an exploration of participants’ current use of information technology. Sixteen papers described the evaluation of a patient application in practice. All of them adopted a human factors approach, typically an examination of the use of app features and/or surveys or interviews which enquired about patients’ views of the effects of using the app on their behaviors (e.g. medication adherence), knowledge, and relationships with healthcare providers. No study in our review assessed the impact of mobile applications on health outcomes. Conclusion The potential of mobile health applications to assist patients to more actively engage in the management of their care has resulted in a large number of applications being developed. Our review showed that human factors approaches are nearly always adopted to some extent in the design, development, and evaluation of mobile applications. PMID:26293851

Study on Ultra-deep Azimuthal Electromagnetic Resistivity LWD Tool by Influence Quantification on Azimuthal Depth of Investigation and Real Signal

NASA Astrophysics Data System (ADS)

Li, Kesai; Gao, Jie; Ju, Xiaodong; Zhu, Jun; Xiong, Yanchun; Liu, Shuai

2018-05-01

This paper proposes a new tool design of ultra-deep azimuthal electromagnetic (EM) resistivity logging while drilling (LWD) for deeper geosteering and formation evaluation, which can benefit hydrocarbon exploration and development. First, a forward numerical simulation of azimuthal EM resistivity LWD is created based on the fast Hankel transform (FHT) method, and its accuracy is confirmed under classic formation conditions. Then, a reasonable range of tool parameters is designed by analyzing the logging response. However, modern technological limitations pose challenges to selecting appropriate tool parameters for ultra-deep azimuthal detection under detectable signal conditions. Therefore, this paper uses grey relational analysis (GRA) to quantify the influence of tool parameters on voltage and azimuthal investigation depth. After analyzing thousands of simulation data under different environmental conditions, the random forest is used to fit data and identify an optimal combination of tool parameters due to its high efficiency and accuracy. Finally, the structure of the ultra-deep azimuthal EM resistivity LWD tool is designed with a theoretical azimuthal investigation depth of 27.42-29.89 m in classic different isotropic and anisotropic formations. This design serves as a reliable theoretical foundation for efficient geosteering and formation evaluation in high-angle and horizontal (HA/HZ) wells in the future.

Usability of a Patient Education and Motivation Tool Using Heuristic Evaluation

PubMed Central

Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-01-01

Background Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. Objective The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. Methods PEMT was evaluated by three usability experts using Nielsen’s usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. Results A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). Conclusion We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT. PMID:19897458

Detecting and diagnosing hotspots for the enhanced management of hospital emergency departments in Queensland, Australia

PubMed Central

2013-01-01

Background Predictive tools are already being implemented to assist in Emergency Department bed management by forecasting the expected total volume of patients. Yet these tools are unable to detect and diagnose when estimates fall short. Early detection of hotspots, that is subpopulations of patients presenting in unusually high numbers, would help authorities to manage limited health resources and communicate effectively about emerging risks. We evaluate an anomaly detection tool that signals when, and in what way Emergency Departments in 18 hospitals across the state of Queensland, Australia, are significantly exceeding their forecasted patient volumes. Methods The tool in question is an adaptation of the Surveillance Tree methodology initially proposed in Sparks and Okugami (IntStatl 1:2–24, 2010). for the monitoring of vehicle crashes. The methodology was trained on presentations to 18 Emergency Departments across Queensland over the period 2006 to 2008. Artificial increases were added to simulated, in-control counts for these data to evaluate the tool’s sensitivity, timeliness and diagnostic capability. The results were compared with those from a univariate control chart. The tool was then applied to data from 2009, the year of the H1N1 (or ‘Swine Flu’) pandemic. Results The Surveillance Tree method was found to be at least as effective as a univariate, exponentially weighted moving average (EWMA) control chart when increases occurred in a subgroup of the monitored population. The method has advantages over the univariate control chart in that it allows for the monitoring of multiple disease groups while still allowing control of the overall false alarm rate. It is also able to detect changes in the makeup of the Emergency Department presentations, even when the total count remains unchanged. Furthermore, the Surveillance Tree method provides diagnostic information useful for service improvements or disease management. Conclusions Multivariate surveillance provides a useful tool in the management of hospital Emergency Departments by not only efficiently detecting unusually high numbers of presentations, but by providing information about which groups of patients are causing the increase. PMID:24313914

Fastener Recess Evaluation

DTIC Science & Technology

1978-04-01

lbs respectively. The Torx recess suffered most under the test methods adopted (as would any similar recess such as the internal hex). Zero values ...Administrationi, National Tool Center Apex Machine and Tool Co. r~. Phillips International Co.] Hi-Shear Corp. General Dynamics Corp. Defense Logistics Agency...29 6. Undersized Bits 30 7. Worn Bit Test 31 8. Stock Bit and Screw Comparison 32 9. Ribbed Bits 36 V FIELD DATA OBSERVATIONS 38 1. Torque Values 38 2

Walsh transforms and signal detection

NASA Technical Reports Server (NTRS)

Welch, L. R.

1977-01-01

The detection of signals using Walsh power spectral estimates is analyzed. In addition, a generalization of this method of estimation is evaluated. The conclusion is that Walsh transforms are not suitable tools for the detection of weak signals in noise.

Advanced composite elevator for Boeing 727 aircraft, volume 2

NASA Technical Reports Server (NTRS)

Chovil, D. V.; Grant, W. D.; Jamison, E. S.; Syder, H.; Desper, O. E.; Harvey, S. T.; Mccarty, J. E.

1980-01-01

Preliminary design activity consisted of developing and analyzing alternate design concepts and selecting the optimum elevator configuration. This included trade studies in which durability, inspectability, producibility, repairability, and customer acceptance were evaluated. Preliminary development efforts consisted of evaluating and selecting material, identifying ancillary structural development test requirements, and defining full scale ground and flight test requirements necessary to obtain Federal Aviation Administration (FAA) certification. After selection of the optimum elevator configuration, detail design was begun and included basic configuration design improvements resulting from manufacturing verification hardware, the ancillary test program, weight analysis, and structural analysis. Detail and assembly tools were designed and fabricated to support a full-scope production program, rather than a limited run. The producibility development programs were used to verify tooling approaches, fabrication processes, and inspection methods for the production mode. Quality parts were readily fabricated and assembled with a minimum rejection rate, using prior inspection methods.

Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record.

PubMed

Chrimes, Dillon; Kitos, Nicole R; Kushniruk, Andre; Mann, Devin M

2014-09-01

Usability testing can be used to evaluate human-computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a way to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in "live" clinical workflow or whether a tool is successful. Therefore, "Near-live" clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved "think-aloud" protocol analysis of eight primary care providers interacting with several scripted clinical scenarios. Phase II used "near-live" clinical simulations of five providers interacting with standardized trained patient actors enacting the clinical scenario of counseling for pre-diabetes, each of whom had a pedometer that recorded the number of steps taken over a week. In both phases, all sessions were audio-taped and motion screen-capture software was activated for onscreen recordings. Transcripts were coded using iterative qualitative content analysis methods. In Phase I, the impact of the components and layout of ADAPT on user's Navigation, Understandability, and Workflow were associated with the largest volume of negative comments (i.e. approximately 80% of end-user commentary), while Usability and Content of ADAPT were representative of more positive than negative user commentary. The heuristic category of Usability had a positive-to-negative comment ratio of 2.1, reflecting positive perception of the usability of the tool, its functionality, and overall co-productive utilization of ADAPT. However, there were mixed perceptions about content (i.e., how the information was displayed, organized and described in the tool). In Phase II, the duration of patient encounters was approximately 10 min with all of the Patient Instructions (prescriptions) and behavioral contracting being activated at the end of each visit. Upon activation, providers accepted the pathway prescribed by the tool 100% of the time and completed all the fields in the tool in the simulation cases. Only 14% of encounter time was spent using the functionality of the ADAPT tool in terms of keystrokes and entering relevant data. The rest of the time was spent on communication and dialog to populate the patient instructions. In all cases, the interaction sequence of reviewing and discussing exercise and diet of the patient was linked to the functionality of the ADAPT tool in terms of monitoring, response-efficacy, self-efficacy, and negotiation in the patient-provider dialog. There was a change from one-way dialog to two-way dialog and negotiation that ended in a behavioral contract. This change demonstrated the tool's sequence, which supported recording current exercise and diet followed by a diet and exercise goal setting procedure to reduce the risk of diabetes onset. This study demonstrated that "think-aloud" protocol analysis with "near-live" clinical simulations provided a successful usability evaluation of a new primary care pre-diabetes shared goal setting tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to show the influence of the ADAPT framework on the usability, workflow integration, and communication between the patient and provider. The think-aloud tests with the provider showed the tool can be used according to the ADAPT framework (exercise-to-diet behavior change and tool utilization), while the clinical simulations revealed the ADAPT framework to realistically support patient-provider communication to obtain behavioral change contract. SDM interactions and mechanisms affecting protocol-based care can be more completely captured by combining "near-live" clinical simulations with traditional "think-aloud analysis" which augments clinician utilization. More analysis is required to verify if the rich communication actions found in Phase II compliment clinical workflows. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Pediatric faculty and residents’ perspectives on In-Training Evaluation Reports (ITERs)

PubMed Central

Patel, Rikin; Drover, Anne; Chafe, Roger

2015-01-01

Background In-training evaluation reports (ITERs) are used by over 90% of postgraduate medical training programs in Canada for resident assessment. Our study examined the perspectives of faculty and residents in one pediatric program as a means to improve the ITER as an evaluation tool. Method Two separate focus groups were conducted, one with eight pediatric residents and one with nine clinical faculty within the pediatrics program of Memorial University’s Faculty of Medicine to discuss their perceptions of, and suggestions for improving, the use of ITERs. Results Residents and faculty shared many similar suggestions for improving the ITER as an evaluation tool. Both the faculty and residents emphasized the importance of written feedback, contextualizing the evaluation and timely follow-up. The biggest challenge appears to be the discrepancy in the quality of feedback sought by the residents and the faculty members’ ability to do so in a time effective manner. Others concerns related to the need for better engagement in setting rotation objectives and more direct observation by the faculty member completing the ITER. Conclusions The ITER is a useful tool in resident evaluations, but a number of issues relating to its actual use could improve the quality of feedback which residents receive. PMID:27004076

Evaluation of the Human IgG Antibody Response to Aedes albopictus Saliva as a New Specific Biomarker of Exposure to Vector Bites

PubMed Central

Doucoure, Souleymane; Mouchet, François; Cornelie, Sylvie; DeHecq, Jean Sébastien; Rutee, Abdul Hamid; Roca, Yelin; Walter, Annie; Hervé, Jean Pierre; Misse, Dorothée; Favier, François; Gasque, Philippe; Remoue, Franck

2012-01-01

Background The spread of Aedes albopictus, a vector for re-emergent arbovirus diseases like chikungunya and dengue, points up the need for better control strategies and new tools to evaluate transmission risk. Human antibody (Ab) responses to mosquito salivary proteins could represent a reliable biomarker for evaluating human-vector contact and the efficacy of control programs. Methodology/Principal Findings We used ELISA tests to evaluate specific immunoglobulin G (IgG) responses to salivary gland extracts (SGE) in adults exposed to Aedes albopictus in Reunion Island. The percentage of immune responders (88%) and levels of anti-SGE IgG Abs were high in exposed individuals. At an individual level, our results indicate heterogeneity of the exposure to Aedes albopictus bites. In addition, low-level immune cross-reactivity between Aedes albopictus and Aedes aegypti SGEs was observed, mainly in the highest responders. Conclusion/Significance Ab responses to saliva could be used as an immuno-epidemiological tool for evaluating exposure to Aedes albopictus bites. Combined with entomological and epidemiological methods, a “salivary” biomarker of exposure to Aedes albopictus could enhance surveillance of its spread and the risk of arbovirus transmission, and could be used as a direct tool for the evaluation of Aedes albopictus control strategies. PMID:22363823

Quantitative health impact assessment: taking stock and moving forward.

PubMed

Fehr, Rainer; Hurley, Fintan; Mekel, Odile Cecile; Mackenbach, Johan P

2012-12-01

Over the past years, application of health impact assessment has increased substantially, and there has been a strong growth of tools that allow quantification of health impacts for a range of health relevant policies. We review these developments, and conclude that further tool development is no longer a main priority, although several aspects need to be further developed, such as methods to assess impacts on health inequalities and to assess uncertainties. The main new challenges are, first, to conduct a comparative evaluation of different tools, and, second, to ensure the maintenance and continued availability of the toolkits including their data contents.

Health impact assessment – A survey on quantifying tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fehr, Rainer, E-mail: rainer.fehr@uni-bielefeld.de; Mekel, Odile C.L., E-mail: odile.mekel@lzg.nrw.de; Fintan Hurley, J., E-mail: fintan.hurley@iom-world.org

Integrating human health into prospective impact assessments is known to be challenging. This is true for both approaches: dedicated health impact assessments (HIA) as well as inclusion of health into more general impact assessments. Acknowledging the full range of participatory, qualitative, and quantitative approaches, this study focuses on the latter, especially on computational tools for quantitative health modelling. We conducted a survey among tool developers concerning the status quo of development and availability of such tools; experiences made with model usage in real-life situations; and priorities for further development. Responding toolmaker groups described 17 such tools, most of them beingmore » maintained and reported as ready for use and covering a wide range of topics, including risk & protective factors, exposures, policies, and health outcomes. In recent years, existing models have been improved and were applied in new ways, and completely new models emerged. There was high agreement among respondents on the need to further develop methods for assessment of inequalities and uncertainty. The contribution of quantitative modeling to health foresight would benefit from building joint strategies of further tool development, improving the visibility of quantitative tools and methods, and engaging continuously with actual and potential users. - Highlights: • A survey investigated computational tools for health impact quantification. • Formal evaluation of such tools has been rare. • Handling inequalities and uncertainties are priority areas for further development. • Health foresight would benefit from tool developers and users forming a community. • Joint development strategies across computational tools are needed.« less

A comparison of sampling methods for a standing tree acoustic device

Treesearch

Jerry M. Mahon, Jr.; Lewis Jordan; Lawrence R. Schimleck; Alexander Clark, III; Richard F. Daniels

2009-01-01

One method of evaluating potential product performance is the use of acoustic tools for identifying trees with high stiffness. Acoustic velocities for 100 standing loblolly pine (Pinus taeda) trees, obtained with the transmitting and receiving probes placed on the same face and opposite faces, were compared. Significant differences in velocity between the two...

A Cost-Effectiveness/Benefit Analysis Model for Postsecondary Vocational Programs. Technical Report.

ERIC Educational Resources Information Center

Kim, Jin Eun

A cost-effectiveness/benefit analysis is defined as a technique for measuring the outputs of existing and new programs in relation to their specified program objectives, against the costs of those programs. In terms of its specific use, the technique is conceptualized as a systems analysis method, an evaluation method, and a planning tool for…

Evaluation of Learning Environments for Object-Oriented Programming: Measuring Cognitive Load with a Novel Measurement Technique

ERIC Educational Resources Information Center

Uysal, Murat Pasa

2016-01-01

Various methods and tools have been proposed to overcome the learning obstacles for Object-Oriented Programming (OOP). However, it remains difficult especially for novice learners. The problem may be not only adopting an instructional method, but also an Integrated Development Environment (IDE). Learners employ IDEs as a means to solve programming…

An analysis of burn-off impact on the structure microporous of activated carbons formation

NASA Astrophysics Data System (ADS)

Kwiatkowski, Mirosław; Kopac, Türkan

2017-12-01

The paper presents the results on the application of the LBET numerical method as a tool for analysis of the microporous structure of activated carbons obtained from a bituminous coal. The LBET method was employed particularly to evaluate the impact of the burn-off on the obtained microporous structure parameters of activated carbons.

Interviews with College Students: Evaluating Computer Programming Environments for Introductory Courses

ERIC Educational Resources Information Center

Uysal, Murat Pasa

2014-01-01

Different methods, strategies, or tools have been proposed for teaching Object Oriented Programming (OOP). However, it is still difficult to introduce OOP to novice learners. The problem may be not only adopting a method or language, but also use of an appropriate integrated development environment (IDE). Therefore, the focus should be on the…

A Guide to Analyzing Message-Response Sequences and Group Interaction Patterns in Computer-Mediated Communication

ERIC Educational Resources Information Center

Jeong, Allan

2005-01-01

This paper proposes a set of methods and a framework for evaluating, modeling, and predicting group interactions in computer-mediated communication. The method of sequential analysis is described along with specific software tools and techniques to facilitate the analysis of message-response sequences. In addition, the Dialogic Theory and its…

Factors affecting nursing staff use of a communication tool to reduce potentially preventable acute care transfers in long-term care.

PubMed

Ballard, Stephanie A; Peretti, Matteo; Lungu, Ovidiu; Voyer, Philippe; Tabamo, Fruan; Alfonso, Linda; Cetin-Sahin, Deniz; Johnson, Sarasa M A; Wilchesky, Machelle

Although specialized communication tools can effectively reduce acute care transfers, few studies have assessed the factors that may influence the use of such tools by nursing staff at the individual level. We evaluated the associations between years of experience, tool-related training, nursing attitudes, and intensity of use of a communication tool developed to reduce transfers in a long-term care facility. We employed a mixed methods design using data from medical charts, electronic records, and semi-structured interviews. Experienced nurses used the tool significantly less than inexperienced nurses, and training had a significant positive impact on tool use. Nurses found the purpose of the tool to be confusing. No significant differences in attitude were observed based on years of experience or intensity of use. Project findings indicate that focused efforts to enrich training may increase intervention adherence. Experienced nurses in particular should be made aware of the benefits of utilizing communication tools. Copyright © 2017 Elsevier Inc. All rights reserved.

Young children's tool innovation across culture: Affordance visibility matters.

PubMed

Neldner, Karri; Mushin, Ilana; Nielsen, Mark

2017-11-01

Young children typically demonstrate low rates of tool innovation. However, previous studies have limited children's performance by presenting tools with opaque affordances. In an attempt to scaffold children's understanding of what constitutes an appropriate tool within an innovation task we compared tools in which the focal affordance was visible to those in which it was opaque. To evaluate possible cultural specificity, data collection was undertaken in a Western urban population and a remote Indigenous community. As expected affordance visibility altered innovation rates: young children were more likely to innovate on a tool that had visible affordances than one with concealed affordances. Furthermore, innovation rates were higher than those reported in previous innovation studies. Cultural background did not affect children's rates of tool innovation. It is suggested that new methods for testing tool innovation in children must be developed in order to broaden our knowledge of young children's tool innovation capabilities. Copyright © 2017 Elsevier B.V. All rights reserved.

Experimental Methods to Evaluate Science Utility Relative to the Decadal Survey

NASA Technical Reports Server (NTRS)

Widergren, Cynthia

2012-01-01

The driving factor for competed missions is the science that it plans on performing once it has reached its target body. These science goals are derived from the science recommended by the most current Decadal Survey. This work focuses on science goals in previous Venus mission proposals with respect to the 2013 Decadal Survey. By looking at how the goals compare to the survey and how much confidence NASA has in the mission's ability to accomplish these goals, a method was created to assess the science return utility of each mission. This method can be used as a tool for future Venus mission formulation and serves as a starting point for future development of create science utility assessment tools.

Image-based red cell counting for wild animals blood.

PubMed

Mauricio, Claudio R M; Schneider, Fabio K; Dos Santos, Leonilda Correia

2010-01-01

An image-based red blood cell (RBC) automatic counting system is presented for wild animals blood analysis. Images with 2048×1536-pixel resolution acquired on an optical microscope using Neubauer chambers are used to evaluate RBC counting for three animal species (Leopardus pardalis, Cebus apella and Nasua nasua) and the error found using the proposed method is similar to that obtained for inter observer visual counting method, i.e., around 10%. Smaller errors (e.g., 3%) can be obtained in regions with less grid artifacts. These promising results allow the use of the proposed method either as a complete automatic counting tool in laboratories for wild animal's blood analysis or as a first counting stage in a semi-automatic counting tool.

Review on pen-and-paper-based observational methods for assessing ergonomic risk factors of computer work.

PubMed

Rahman, Mohd Nasrull Abdol; Mohamad, Siti Shafika

2017-01-01

Computer works are associated with Musculoskeletal Disorders (MSDs). There are several methods have been developed to assess computer work risk factor related to MSDs. This review aims to give an overview of current techniques available for pen-and-paper-based observational methods in assessing ergonomic risk factors of computer work. We searched an electronic database for materials from 1992 until 2015. The selected methods were focused on computer work, pen-and-paper observational methods, office risk factors and musculoskeletal disorders. This review was developed to assess the risk factors, reliability and validity of pen-and-paper observational method associated with computer work. Two evaluators independently carried out this review. Seven observational methods used to assess exposure to office risk factor for work-related musculoskeletal disorders were identified. The risk factors involved in current techniques of pen and paper based observational tools were postures, office components, force and repetition. From the seven methods, only five methods had been tested for reliability. They were proven to be reliable and were rated as moderate to good. For the validity testing, from seven methods only four methods were tested and the results are moderate. Many observational tools already exist, but no single tool appears to cover all of the risk factors including working posture, office component, force, repetition and office environment at office workstations and computer work. Although the most important factor in developing tool is proper validation of exposure assessment techniques, the existing observational method did not test reliability and validity. Futhermore, this review could provide the researchers with ways on how to improve the pen-and-paper-based observational method for assessing ergonomic risk factors of computer work.

Integration of tools for the Design and Assessment of High-Performance, Highly Reliable Computing Systems (DAHPHRS), phase 1

NASA Technical Reports Server (NTRS)

Scheper, C.; Baker, R.; Frank, G.; Yalamanchili, S.; Gray, G.

1992-01-01

Systems for Space Defense Initiative (SDI) space applications typically require both high performance and very high reliability. These requirements present the systems engineer evaluating such systems with the extremely difficult problem of conducting performance and reliability trade-offs over large design spaces. A controlled development process supported by appropriate automated tools must be used to assure that the system will meet design objectives. This report describes an investigation of methods, tools, and techniques necessary to support performance and reliability modeling for SDI systems development. Models of the JPL Hypercubes, the Encore Multimax, and the C.S. Draper Lab Fault-Tolerant Parallel Processor (FTPP) parallel-computing architectures using candidate SDI weapons-to-target assignment algorithms as workloads were built and analyzed as a means of identifying the necessary system models, how the models interact, and what experiments and analyses should be performed. As a result of this effort, weaknesses in the existing methods and tools were revealed and capabilities that will be required for both individual tools and an integrated toolset were identified.

GPURFSCREEN: a GPU based virtual screening tool using random forest classifier.

PubMed

Jayaraj, P B; Ajay, Mathias K; Nufail, M; Gopakumar, G; Jaleel, U C A

2016-01-01

In-silico methods are an integral part of modern drug discovery paradigm. Virtual screening, an in-silico method, is used to refine data models and reduce the chemical space on which wet lab experiments need to be performed. Virtual screening of a ligand data model requires large scale computations, making it a highly time consuming task. This process can be speeded up by implementing parallelized algorithms on a Graphical Processing Unit (GPU). Random Forest is a robust classification algorithm that can be employed in the virtual screening. A ligand based virtual screening tool (GPURFSCREEN) that uses random forests on GPU systems has been proposed and evaluated in this paper. This tool produces optimized results at a lower execution time for large bioassay data sets. The quality of results produced by our tool on GPU is same as that on a regular serial environment. Considering the magnitude of data to be screened, the parallelized virtual screening has a significantly lower running time at high throughput. The proposed parallel tool outperforms its serial counterpart by successfully screening billions of molecules in training and prediction phases.

International funding agencies: potential leaders of impact evaluation in protected areas?

PubMed

Craigie, Ian D; Barnes, Megan D; Geldmann, Jonas; Woodley, Stephen

2015-11-05

Globally, protected areas are the most commonly used tools to halt biodiversity loss. Yet, some are failing to adequately conserve the biodiversity they contain. There is an urgent need for knowledge on how to make them function more effectively. Impact evaluation methods provide a set of tools that could yield this knowledge. However, rigorous outcome-focused impact evaluation is not yet used as extensively as it could be in protected area management. We examine the role of international protected area funding agencies in facilitating the use of impact evaluation. These agencies are influential stakeholders as they allocate hundreds of millions of dollars annually to support protected areas, creating a unique opportunity to shape how the conservation funds are spent globally. We identify key barriers to the use of impact evaluation, detail how large funders are uniquely placed to overcome many of these, and highlight the potential benefits if impact evaluation is used more extensively. © 2015 The Author(s).

Viability qPCR, a new tool for Legionella risk management.

PubMed

Lizana, X; López, A; Benito, S; Agustí, G; Ríos, M; Piqué, N; Marqués, A M; Codony, F

2017-11-01

Viability quantitative Polymerase Chain Reaction (v-qPCR) is a recent analytical approach for only detecting live microorganisms by DNA amplification-based methods This approach is based on the use of a reagent that irreversibly fixes dead cells DNA. In this study, we evaluate the utility of v-qPCR versus culture method for Legionellosis risk management. The present study was performed using 116 real samples. Water samples were simultaneously analysed by culture, v-qPCR and qPCR methods. Results were compared by means of a non-parametric test. In 11.6% of samples using both methods (culture method and v-qPCR) results were positive, in 50.0% of samples both methods gave rise to negative results. As expected, equivalence between methods was not observed in all cases, as in 32.1% of samples positive results were obtained by v-qPCR and all of them gave rise to negative results by culture. Only in 6.3% of samples, with very low Legionella levels, was culture positive and v-qPCR negative. In 3.5% of samples, overgrowth of other bacteria did not allow performing the culture. When comparing both methods, significant differences between culture and v-qPCR were in the samples belonging to the cooling towers-evaporative condensers group. The v-qPCR method detected greater presence and obtained higher concentrations of Legionella spp. (p<0.001). Otherwise, no significant differences between methods were found in the rest of the groups. The v-qPCR method can be used as a quick tool to evaluate Legionellosis risk, especially in cooling towers-evaporative condensers, where this technique can detect higher levels than culture. The combined interpretation of PCR results along with the ratio of live cells is proposed as a tool for understanding the sample context and estimating the Legionellosis risk potential according to 4 levels of hierarchy. Copyright © 2017 Elsevier GmbH. All rights reserved.

Unsupervised Segmentation of Head Tissues from Multi-modal MR Images for EEG Source Localization.

PubMed

Mahmood, Qaiser; Chodorowski, Artur; Mehnert, Andrew; Gellermann, Johanna; Persson, Mikael

2015-08-01

In this paper, we present and evaluate an automatic unsupervised segmentation method, hierarchical segmentation approach (HSA)-Bayesian-based adaptive mean shift (BAMS), for use in the construction of a patient-specific head conductivity model for electroencephalography (EEG) source localization. It is based on a HSA and BAMS for segmenting the tissues from multi-modal magnetic resonance (MR) head images. The evaluation of the proposed method was done both directly in terms of segmentation accuracy and indirectly in terms of source localization accuracy. The direct evaluation was performed relative to a commonly used reference method brain extraction tool (BET)-FMRIB's automated segmentation tool (FAST) and four variants of the HSA using both synthetic data and real data from ten subjects. The synthetic data includes multiple realizations of four different noise levels and several realizations of typical noise with a 20% bias field level. The Dice index and Hausdorff distance were used to measure the segmentation accuracy. The indirect evaluation was performed relative to the reference method BET-FAST using synthetic two-dimensional (2D) multimodal magnetic resonance (MR) data with 3% noise and synthetic EEG (generated for a prescribed source). The source localization accuracy was determined in terms of localization error and relative error of potential. The experimental results demonstrate the efficacy of HSA-BAMS, its robustness to noise and the bias field, and that it provides better segmentation accuracy than the reference method and variants of the HSA. They also show that it leads to a more accurate localization accuracy than the commonly used reference method and suggest that it has potential as a surrogate for expert manual segmentation for the EEG source localization problem.

Breadth of Coverage, Ease of Use, and Quality of Mobile Point-of-Care Tool Information Summaries: An Evaluation

PubMed Central

Ren, Jinma

2016-01-01

Background With advances in mobile technology, accessibility of clinical resources at the point of care has increased. Objective The objective of this research was to identify if six selected mobile point-of-care tools meet the needs of clinicians in internal medicine. Point-of-care tools were evaluated for breadth of coverage, ease of use, and quality. Methods Six point-of-care tools were evaluated utilizing four different devices (two smartphones and two tablets). Breadth of coverage was measured using select International Classification of Diseases, Ninth Revision, codes if information on summary, etiology, pathophysiology, clinical manifestations, diagnosis, treatment, and prognosis was provided. Quality measures included treatment and diagnostic inline references and individual and application time stamping. Ease of use covered search within topic, table of contents, scrolling, affordance, connectivity, and personal accounts. Analysis of variance based on the rank of score was used. Results Breadth of coverage was similar among Medscape (mean 6.88), Uptodate (mean 6.51), DynaMedPlus (mean 6.46), and EvidencePlus (mean 6.41) (P>.05) with DynaMed (mean 5.53) and Epocrates (mean 6.12) scoring significantly lower (P<.05). Ease of use had DynaMedPlus with the highest score, and EvidencePlus was lowest (6.0 vs 4.0, respectively, P<.05). For quality, reviewers rated the same score (4.00) for all tools except for Medscape, which was rated lower (P<.05). Conclusions For breadth of coverage, most point-of-care tools were similar with the exception of DynaMed. For ease of use, only UpToDate and DynaMedPlus allow for search within a topic. All point-of-care tools have remote access with the exception of UpToDate and Essential Evidence Plus. All tools except Medscape covered criteria for quality evaluation. Overall, there was no significant difference between the point-of-care tools with regard to coverage on common topics used by internal medicine clinicians. Selection of point-of-care tools is highly dependent on individual preference based on ease of use and cost of the application. PMID:27733328

Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor.

PubMed

Zimmerman, Kathleen N; Ledford, Jennifer R; Severini, Katherine E; Pustejovsky, James E; Barton, Erin E; Lloyd, Blair P

2018-03-03

Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional Children, What Works Clearinghouse, and Single-Case Analysis and Design Framework) were compared to determine if conclusions regarding the effectiveness of antecedent sensory-based interventions for young children changed based on choice of quality evaluation tool. Evaluation of SCD quality differed across tools, suggesting selection of quality evaluation tools impacts evaluation findings. Suggestions for selecting an appropriate quality and rigor assessment tool are provided and across-tool conclusions are drawn regarding the quality and rigor of studies. Finally, authors provide guidance for using quality evaluations in conjunction with outcome analyses when conducting syntheses of interventions evaluated in the context of SCD. Copyright © 2018 Elsevier Ltd. All rights reserved.

Interpreting wireline measurements in coal beds

DOE Office of Scientific and Technical Information (OSTI.GOV)

Johnston, D.J.

1991-06-01

When logging coal seams with wireline tools, the interpretation method needed to evaluate the coals is different from that used for conventional oil and gas reservoirs. Wireline logs identify coals easily. For an evaluation, the contribution of each coal component on the raw measurements must be considered. This paper will discuss how each log measurement is affected by each component. The components of a coal will be identified as the mineral matter, macerals, moisture content, rank, gas content, and cleat porosity. The measurements illustrated are from the resistivity, litho-density, neutron, sonic, dielectric, and geochemical tools. Once the coal component effectsmore » have been determined, an interpretation of the logs can be made. This paper will illustrate how to use these corrected logs in a coal evaluation.« less

NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare

PubMed Central

Akl, Elie A; Treweek, Shaun; Foy, Robbie; Francis, Jill; Oxman, Andrew D

2007-01-01

Background The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. Methods We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. Results NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial Conclusion NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions. PMID:17594495

In silico prediction of splice-altering single nucleotide variants in the human genome.

PubMed

Jian, Xueqiu; Boerwinkle, Eric; Liu, Xiaoming

2014-12-16

In silico tools have been developed to predict variants that may have an impact on pre-mRNA splicing. The major limitation of the application of these tools to basic research and clinical practice is the difficulty in interpreting the output. Most tools only predict potential splice sites given a DNA sequence without measuring splicing signal changes caused by a variant. Another limitation is the lack of large-scale evaluation studies of these tools. We compared eight in silico tools on 2959 single nucleotide variants within splicing consensus regions (scSNVs) using receiver operating characteristic analysis. The Position Weight Matrix model and MaxEntScan outperformed other methods. Two ensemble learning methods, adaptive boosting and random forests, were used to construct models that take advantage of individual methods. Both models further improved prediction, with outputs of directly interpretable prediction scores. We applied our ensemble scores to scSNVs from the Catalogue of Somatic Mutations in Cancer database. Analysis showed that predicted splice-altering scSNVs are enriched in recurrent scSNVs and known cancer genes. We pre-computed our ensemble scores for all potential scSNVs across the human genome, providing a whole genome level resource for identifying splice-altering scSNVs discovered from large-scale sequencing studies.

SU-E-J-12: A New Stereological Method for Tumor Volume Evaluation for Esophageal Cancer

DOE Office of Scientific and Technical Information (OSTI.GOV)

Feng, Y; Tianjin Medical University Cancer Institute and Hospital; East Carolina University

2014-06-01

Purpose: Stereological method used to obtain three dimensional quantitative information from two dimensional images is a widely used tool in the study of cells and pathology. But the feasibility of the method for quantitative evaluation of volumes with 3D image data sets for radiotherapy clinical application has not been explored. On the other hand, a quick, easy-to-use and reliable method is highly desired in image-guided-radiotherapy(IGRT) for tumor volume measurement for the assessment of response to treatment. To meet this need, a stereological method for evaluating tumor volumes for esophageal cancer is presented in this abstract. Methods: The stereology method wasmore » optimized by selecting the appropriate grid point distances and sample types. 7 patients with esophageal cancer were selected retrospectively for this study, each having pre and post treatment computed tomography (CT) scans. Stereological measurements were performed for evaluating the gross tumor volume (GTV) changes after radiotherapy and the results was compared with the ones by planimetric measurements. Two independent observers evaluated the reproducibility for volume measurement using the new stereological technique. Results: The intraobserver variation in the GTV volume estimation was 3.42±1.68cm3 (the Wilcoxon matched-pairs test Resultwas Z=−1.726,P=0.084>0.05); the interobserver variation in the GTV volume estimation was 22.40±7.23 cm3 (Z=−3.296,P=0.083>0.05), which showed the consistency in GTV volume calculation with the new method for the same and different users. The agreement level between the results from the two techniques was also evaluated. Difference between the measured GTVs was 20.10±5.35 cm3 (Z=−3.101,P=0.089>0.05). Variation of the measurement results using the two techniques was low and clinically acceptable. Conclusion: The good agreement between stereological and planimetric techniques proves the reliability of the stereological tumor volume estimations. The optimized stereological technique described in this abstract may provide a quick, unbiased and reproducible tool for tumor volume estimation for treatment response assessment. Supported by NSFC (#81041107, #81171342 and #31000784)« less

Development and First Phase Evaluation of a Maternity Leave Educational Tool for Pregnant, Working Women in California

PubMed Central

Kurtovich, Elaine; Guendelman, Sylvia; Neuhauser, Linda; Edelman, Dana; Georges, Maura; Mason-Marti, Peyton

2015-01-01

Background Despite the provision of maternity leave offered to mothers, many American women fail to take leave. Methods We developed an evidence-based maternity leave educational tool for working women in California using participatory design. We tested its short-term efficacy with a randomized controlled trial of pregnant English-speakers (n=155). Results Among intervention participants exposed to the tool, 65% reported that they learned something new; 38% were motivated to seek more information; and 49% said it helped them plan their maternity leave. Among participants who delivered at ≥ 37 weeks gestation and said the tool helped them plan their leave, 89% took more than one week of prenatal leave, a significantly higher proportion than among controls who did not receive the tool (64%, p=0.049). Other findings favored trial participants, but were not statistically significant in this small sample. More intervention participants took some prenatal leave (80%) vs. controls (74%, p=0.44). Among participants who had returned to work when surveyed (n=50), mean postnatal leave uptake was on average 1 week longer for intervention participants vs. controls (13.3 vs. 12.2 weeks, p=0.54). Conclusions The first-phase evaluation of this tool shows that it successfully informed women about maternity leave options, clarified complex regulations, encouraged women to seek further information and helped plan maternity leave. Compared to controls, trial participants who used the tool to plan their leave were far more likely to take prenatal leave close to term. Future evaluation of the tool when mediated by a health provider or employer is warranted. PMID:26107519

Evaluation of the efficacy of nutritional screening tools to predict malnutrition in the elderly at a geriatric care hospital

PubMed Central

Baek, Myoung-Ha

2015-01-01

BACKGROUND/OBJECTIVES Malnutrition in the elderly is a serious problem, prevalent in both hospitals and care homes. Due to the absence of a gold standard for malnutrition, herein we evaluate the efficacy of five nutritional screening tools developed or used for the elderly. SUBJECTS/METHODS Elected medical records of 141 elderly patients (86 men and 55 women, aged 73.5 ± 5.2 years) hospitalized at a geriatric care hospital were analyzed. Nutritional screening was performed using the following tools: Mini Nutrition Assessment (MNA), Mini Nutrition Assessment-Short Form (MNA-SF), Geriatric Nutritional Risk Index (GNRI), Malnutrition Universal Screening Tool (MUST) and Nutritional Risk Screening 2002 (NRS 2002). A combined index for malnutrition was also calculated as a reference tool. Each patient evaluated as malnourished to any degree or at risk of malnutrition according to at least four out of five of the aforementioned tools was categorized as malnourished in the combined index classification. RESULTS According to the combined index, 44.0% of the patients were at risk of malnutrition to some degree. While the nutritional risk and/or malnutrition varied greatly depending on the tool applied, ranging from 36.2% (MUST) to 72.3% (MNA-SF). MUST showed good validity (sensitivity 80.6%, specificity 98.7%) and almost perfect agreement (k = 0.81) with the combined index. In contrast, MNA-SF showed poor validity (sensitivity 100%, specificity 49.4%) and only moderate agreement (k = 0.46) with the combined index. CONCLUSIONS MNA-SF was found to overestimate the nutritional risk in the elderly. MUST appeared to be the most valid and useful screening tool to predict malnutrition in the elderly at a geriatric care hospital. PMID:26634053

Learnings From the Pilot Implementation of Mobile Medical Milestones Application.

PubMed

Page, Cristen P; Reid, Alfred; Coe, Catherine L; Carlough, Martha; Rosenbaum, Daryl; Beste, Janalynn; Fagan, Blake; Steinbacher, Erika; Jones, Geoffrey; Newton, Warren P

2016-10-01

Implementation of the educational milestones benefits from mobile technology that facilitates ready assessments in the clinical environment. We developed a point-of-care resident evaluation tool, the Mobile Medical Milestones Application (M3App), and piloted it in 8 North Carolina family medicine residency programs. We sought to examine variations we found in the use of the tool across programs and explored the experiences of program directors, faculty, and residents to better understand the perceived benefits and challenges of implementing the new tool. Residents and faculty completed presurveys and postsurveys about the tool and the evaluation process in their program. Program directors were interviewed individually. Interviews and open-ended survey responses were analyzed and coded using the constant comparative method, and responses were tabulated under themes. Common perceptions included increased data collection, enhanced efficiency, and increased perceived quality of the information gathered with the M3App. Residents appreciated the timely, high-quality feedback they received. Faculty reported becoming more comfortable with the tool over time, and a more favorable evaluation of the tool was associated with higher utilization. Program directors reported improvements in faculty knowledge of the milestones and resident satisfaction with feedback. Faculty and residents credited the M3App with improving the quality and efficiency of resident feedback. Residents appreciated the frequency, proximity, and specificity of feedback, and faculty reported the app improved their familiarity with the milestones. Implementation challenges included lack of a physician champion and competing demands on faculty time.

Use of ecological momentary assessment to determine which structural factors impact perceived teaching quality of attending rounds.

PubMed

Willett, Lisa; Houston, Thomas K; Heudebert, Gustavo R; Estrada, Carlos

2012-09-01

Providing high-quality teaching to residents during attending rounds is challenging. Reasons include structural factors that affect rounds, which are beyond the attending's teaching style and control. To develop a new evaluation tool to identify the structural components of ward rounds that most affect teaching quality in an internal medicine (IM) residency program. The authors developed a 10-item Ecological Momentary Assessment (EMA) tool and collected daily evaluations for 18 months from IM residents rotating on inpatient services. Residents ranked the quality of teaching on rounds that day, and questions related to their service (general medicine, medical intensive care unit, and subspecialty services), patient census, absenteeism of team members, call status, and number of teaching methods used by the attending. Residents completed 488 evaluation cards over 18 months. This found no association between perceived teaching quality and training level, team absenteeism, and call status. We observed differences by service (P < .001) and patient census (P  =  .009). After adjusting for type of service, census was no longer significant. Use of a larger variety of teaching methods was associated with higher perceived teaching quality, regardless of service or census (P for trend < .001). The EMA tool successfully identified that higher patient census was associated with lower perceived teaching quality, but the results were also influenced by the type of teaching service. We found that, regardless of census or teaching service, attendings can improve their teaching by diversifying the number of methods used in daily rounds.

Implementation of IMRT and VMAT using Delta4 phantom and portal dosimetry as dosimetry verification tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Daci, Lulzime, E-mail: lulzime.daci@nodlandssykehuset.no; Malkaj, Partizan, E-mail: malkaj-p@hotmail.com

2016-03-25

In this study we analyzed and compared the dose distribution of different IMRT and VMAT plans with the intent to provide pre-treatment quality assurance using two different tools. Materials/Methods: We have used the electronic portal imaging device EPID after calibration to dose and correction for the background offset signal and also the Delta4 phantom after en evaluation of angular sensitivity. The Delta4 phantom has a two-dimensional array with ionization chambers. We analyzed three plans for each anatomical site calculated by Eclipse treatment planning system. The measurements were analyzed using γ-evaluation method with passing criteria 3% absolute dose and 3 mm distancemore » to agreement (DTA). For all the plans the range of score has been from 97% to 99% for gantry fixed at 0° while for rotational planes there was a slightly decreased pass rates and above 95%. Point measurement with a ionization chamber were done in additional to see the accuracy of portal dosimetry and to evaluate the Delta4 device to various dose rates. Conclusions: Both Delt4 and Portal dosimetry shows good results between the measured and calculated doses. While Delta4 is more accurate in measurements EPID is more time efficient. We have decided to use both methods in the first steps of IMRT and VMAT implementation and later on to decide which of the tools to use depending on the complexity of plans, how much accurate we want to be and the time we have on the machine.« less

Iridology: A systematic review.

PubMed

Ernst, E

1999-02-01

Iridologists claim to be able to diagnose medical conditions through abnormalities of pigmentation in the iris. This technique is popular in many countries. Therefore it is relevant to ask whether it is valid. To systematically review all interpretable tests of the validity of iridology as a diagnostic tool. DATA SOURCE AND EXTRACTION: Three independent literature searches were performed to identify all blinded tests. Data were extracted in a predefined, standardized fashion. Four case control studies were found. The majority of these investigations suggests that iridology is not a valid diagnostic method. The validity of iridology as a diagnostic tool is not supported by scientific evaluations. Patients and therapists should be discouraged from using this method.

Advantages and limitations of the Five Domains model for assessing welfare impacts associated with vertebrate pest control.

PubMed

Beausoleil, N J; Mellor, D J

2015-01-01

Many pest control activities have the potential to impact negatively on the welfare of animals, and animal welfare is an important consideration in the development, implementation and evaluation of ethically defensible vertebrate pest control. Thus, reliable and accurate methods for assessing welfare impacts are required. The Five Domains model provides a systematic method for identifying potential or actual welfare impacts associated with an event or situation in four physical or functional domains (nutrition, environment, health or functional status, behaviour) and one mental domain (overall mental or affective state). Here we evaluate the advantages and limitations of the Five Domains model for this purpose and illustrate them using specific examples from a recent assessment of the welfare impacts of poisons used to lethally control possums in New Zealand. The model has a number of advantages which include the following: the systematic identification of a wide range of impacts associated with a variety of control tools; the production of relative rankings of tools in terms of their welfare impacts; the easy incorporation of new information into assessments; and the highlighting of additional information needed. For example, a recent analysis of sodium fluoroacetate (1080) poisoning in possums revealed the need for more information on the period from the onset of clinical signs to the point at which consciousness is lost, as well as on the level of consciousness during or after the occurrence of muscle spasms and seizures. The model is also valuable because it clearly separates physical or functional and affective impacts, encourages more comprehensive consideration of negative affective experiences than has occurred in the past, and allows development and evaluation of targeted mitigation strategies. Caution must be used in interpreting and applying the outputs of the model, most importantly because relative rankings or grades are fundamentally qualitative in nature. Certain domains are more useful for evaluating impacts associated with slower/longer-acting tools than for faster-acting methods, and it may be easier to identify impacts in some domains than others. Overall, we conclude that the Five Domains model advances evaluation of the animal welfare impacts of vertebrate pest control methods, provided users are cognisant of its limitations.

Evaluation of Arabic Language Learning Program for Non-Native Speakers in Saudi Electronic University According to Total Quality Standards

ERIC Educational Resources Information Center

Alowaydhi, Wafa Hafez

2016-01-01

The current study aimed at standardizing the program of learning Arabic for non-native speakers in Saudi Electronic University according to certain standards of total quality. To achieve its purpose, the study adopted the descriptive analytical method. The author prepared a measurement tool for evaluating the electronic learning programs in light…

Software Tools for Formal Specification and Verification of Distributed Real-Time Systems

DTIC Science & Technology

1994-07-29

time systems and to evaluate the design. The evaluation of the design includes investigation of both the capability and potential usefulness of the toolkit environment and the feasibility of its implementation....The goals of Phase 1 are to design in detail a toolkit environment based on formal methods for the specification and verification of distributed real

Efficacy of Webinar Training for Continuing Professional Education: Applications for School Personnel in K-12 Settings

ERIC Educational Resources Information Center

Covington, Julie Anne

2012-01-01

The purpose of the researcher was to evaluate the effectiveness of webinar training for K-12 school personnel in childhood obesity prevention tools and resources provided by the North Carolina Prevention Partners (NCPP). A mixed method sequential research design was used to evaluate the training across the first three levels of the Kirkpatrick…

A Novel Assessment Tool for Quantitative Evaluation of Science Literature Search Performance: Application to First-Year and Senior Undergraduate Biology Majors

ERIC Educational Resources Information Center

Blank, Jason M.; McGaughey, Karen J.; Keeling, Elena L.; Thorp, Kristen L.; Shannon, Conor C.; Scaramozzino, Jeanine M.

2016-01-01

Expertise in searching and evaluating scientific literature is a requisite skill of trained scientists and science students, yet information literacy instruction varies greatly among institutions and programs. To ensure that science students acquire information literacy skills, robust methods of assessment are needed. Here, we describe a novel…

Impact of douglas-fir tussock moth... color aerial phtography evaluates mortality

Treesearch

Steven L. Wert; Boyd E. Wickman

1970-01-01

Thorough evaluation of insect impact on forest stands is difficult and expensive on the ground. In a study of tree damage following Douglas-fir tussock moth defoliation in Modoc County, California, large-scale (1:1,584)70-mm. color aerial photography was an effective sampling tool and took lesstime and expense than ground methods. Comparison of the photo...

The Effectiveness of Student Extracurricular Activities in Evaluating Violent Behavior among Students in the Preparatory Year at Hail University

ERIC Educational Resources Information Center

Aleid, Alkhamsah Saleh

2016-01-01

This study aimed to examine the effectiveness of student extracurricular activities in evaluating violent behavior among students in the preparatory year at Hail University. The researcher used the descriptive analytical method, and used two tools for the purpose of the study, the study sample consisted of 104 (violent) female students from the…

ASSESSMENT OF GOOD PRACTICES IN HOSPITAL FOOD SERVICE BY COMPARING EVALUATION TOOLS.

PubMed

Macedo Gonçalves, Juliana; Lameiro Rodrigues, Kelly; Santiago Almeida, Ângela Teresinha; Pereira, Giselda Maria; Duarte Buchweitz, Márcia Rúbia

2015-10-01

since food service in hospitals complements medical treatment, it should be produced in proper hygienic and sanitary conditions. It is a well-known fact that food-transmitted illnesses affect with greater severity hospitalized and immunosuppressed patients. good practices in hospital food service are evaluated by comparing assessment instruments. good practices were evaluated by a verification list following Resolution of Collegiate Directory n. 216 of the Brazilian Agency for Sanitary Vigilance. Interpretation of listed items followed parameters of RCD 216 and the Brazilian Association of Collective Meals Enterprises (BACME). Fisher's exact test was applied to detect whether there were statistically significant differences. Analysis of data grouping was undertaken with Unweighted Pair-group using Arithmetic Averages, coupled to a correlation study between dissimilarity matrixes to verify disagreement between the two methods. Good Practice was classified with mean total rates above 75% by the two methods. There were statistically significant differences between services and food evaluated by BACME instrument. Hospital Food Services have proved to show conditions of acceptable good practices. the comparison of interpretation tools based on RCD n. 216 and BACME provided similar results for the two classifications. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Filtration Characterization Method as Tool to Assess Membrane Bioreactor Sludge Filterability—The Delft Experience

PubMed Central

Lousada-Ferreira, Maria; Krzeminski, Pawel; Geilvoet, Stefan; Moreau, Adrien; Gil, Jose A.; Evenblij, Herman; van Lier, Jules B.; van der Graaf, Jaap H. J. M.

2014-01-01

Prevention and removal of fouling is often the most energy intensive process in Membrane Bioreactors (MBRs), responsible for 40% to 50% of the total specific energy consumed in submerged MBRs. In the past decade, methods were developed to quantify and qualify fouling, aiming to support optimization in MBR operation. Therefore, there is a need for an evaluation of the lessons learned and how to proceed. In this article, five different methods for measuring MBR activated sludge filterability and critical flux are described, commented and evaluated. Both parameters characterize the fouling potential in full-scale MBRs. The article focuses on the Delft Filtration Characterization method (DFCm) as a convenient tool to characterize sludge properties, namely on data processing, accuracy, reproducibility, reliability, and applicability, defining the boundaries of the DFCm. Significant progress was made concerning fouling measurements in particular by using straight forward approaches focusing on the applicability of the obtained results. Nevertheless, a fouling measurement method is still to be defined which is capable of being unequivocal, concerning the fouling parameters definitions; practical and simple, in terms of set-up and operation; broad and useful, in terms of obtained results. A step forward would be the standardization of the aforementioned method to assess the sludge filtration quality. PMID:24957174

Computed tomography-based volumetric tool for standardized measurement of the maxillary sinus

PubMed Central

Giacomini, Guilherme; Pavan, Ana Luiza Menegatti; Altemani, João Mauricio Carrasco; Duarte, Sergio Barbosa; Fortaleza, Carlos Magno Castelo Branco; Miranda, José Ricardo de Arruda

2018-01-01

Volume measurements of maxillary sinus may be useful to identify diseases affecting paranasal sinuses. However, literature shows a lack of consensus in studies measuring the volume. This may be attributable to different computed tomography data acquisition techniques, segmentation methods, focuses of investigation, among other reasons. Furthermore, methods for volumetrically quantifying the maxillary sinus are commonly manual or semiautomated, which require substantial user expertise and are time-consuming. The purpose of the present study was to develop an automated tool for quantifying the total and air-free volume of the maxillary sinus based on computed tomography images. The quantification tool seeks to standardize maxillary sinus volume measurements, thus allowing better comparisons and determinations of factors that influence maxillary sinus size. The automated tool utilized image processing techniques (watershed, threshold, and morphological operators). The maxillary sinus volume was quantified in 30 patients. To evaluate the accuracy of the automated tool, the results were compared with manual segmentation that was performed by an experienced radiologist using a standard procedure. The mean percent differences between the automated and manual methods were 7.19% ± 5.83% and 6.93% ± 4.29% for total and air-free maxillary sinus volume, respectively. Linear regression and Bland-Altman statistics showed good agreement and low dispersion between both methods. The present automated tool for maxillary sinus volume assessment was rapid, reliable, robust, accurate, and reproducible and may be applied in clinical practice. The tool may be used to standardize measurements of maxillary volume. Such standardization is extremely important for allowing comparisons between studies, providing a better understanding of the role of the maxillary sinus, and determining the factors that influence maxillary sinus size under normal and pathological conditions. PMID:29304130

Graphical CONOPS Prototype to Demonstrate Emerging Methods, Processes, and Tools at ARDEC

DTIC Science & Technology

2013-07-17

Concept Engineering Framework (ICEF), an extensive literature review was conducted to discover metrics that exist for evaluating concept engineering...language to ICEF to SysML ................................................ 34 Table 5 Artifact metrics ...50 Table 6 Collaboration metrics

3PE: A Tool for Estimating Groundwater Flow Vectors

EPA Science Inventory

Evaluation of hydraulic gradients and the associated groundwater flow rates and directions is a fundamental aspect of hydrogeologic characterization. Many methods, ranging in complexity from simple three-point solution techniques to complex numerical models of groundwater flow, ...

Risk Factor Assessment Branch (RFAB)

Cancer.gov

The Risk Factor Assessment Branch (RFAB) focuses on the development, evaluation, and dissemination of high-quality risk factor metrics, methods, tools, technologies, and resources for use across the cancer research continuum, and the assessment of cancer-related risk factors in the population.

Estimating Sobol Sensitivity Indices Using Correlations

EPA Science Inventory

Sensitivity analysis is a crucial tool in the development and evaluation of complex mathematical models. Sobol's method is a variance-based global sensitivity analysis technique that has been applied to computational models to assess the relative importance of input parameters on...

Tool to assess causality of direct and indirect adverse events associated with therapeutic interventions.

PubMed

Zorzela, Liliane; Mior, Silvano; Boon, Heather; Gross, Anita; Yager, Jeromy; Carter, Rose; Vohra, Sunita

2018-03-01

To develop and test a tool to assess the causality of direct and indirect adverse events associated with therapeutic interventions. The intervention was one or more drugs and/or natural health products, a device, or practice (professional delivering the intervention). Through the assessment of causality of adverse events, we can learn about factors contributing to the harm and consider what modification may prevent its reoccurrence. Existing scales (WHO-UMC, Naranjo and Horn) were adapted to develop a tool (algorithm and table) to evaluate cases of serious harmful events reported through a national surveillance study. We also incorporated a novel approach that assesses indirect harm (caused by the delay in diagnosis/treatment) and the health provider delivering the intervention (practice). The tool was tested, revised and then implemented to assess all reported cases of serious events resulting from use of complementary therapies. The use of complementary therapies was the trigger to report the event. Each case was evaluated by two assessors, out of a panel of five, representing different health care professionals. The tool was used in assessment of eight serious adverse events. Each event was independently evaluated by two assessors. The algorithm facilitated assessment of a serious direct or indirect harm. Assessors agreed in the final score on seven of eight cases (weighted kappa coefficient of 0.75). A tool to support the assessment of causality of adverse events was developed and tested. We propose a novel method to assess direct and indirect harms related to product(s), device(s), practice or a combination of the previous. Further research will probably help evaluate this approach across different settings and interventions.

Psychometric and cognitive validation of a social capital measurement tool in Peru and Vietnam.

PubMed

De Silva, Mary J; Harpham, Trudy; Tuan, Tran; Bartolini, Rosario; Penny, Mary E; Huttly, Sharon R

2006-02-01

Social capital is a relatively new concept which has attracted significant attention in recent years. No consensus has yet been reached on how to measure social capital, resulting in a large number of different tools available. While psychometric validation methods such as factor analysis have been used by a few studies to assess the internal validity of some tools, these techniques rely on data already collected by the tool and are therefore not capable of eliciting what the questions are actually measuring. The Young Lives (YL) study includes quantitative measures of caregiver's social capital in four countries (Vietnam, Peru, Ethiopia, and India) using a short version of the Adapted Social Capital Assessment Tool (SASCAT). A range of different psychometric methods including factor analysis were used to evaluate the construct validity of SASCAT in Peru and Vietnam. In addition, qualitative cognitive interviews with 20 respondents from Peru and 24 respondents from Vietnam were conducted to explore what each question is actually measuring. We argue that psychometric validation techniques alone are not sufficient to adequately validate multi-faceted social capital tools for use in different cultural settings. Psychometric techniques show SASCAT to be a valid tool reflecting known constructs and displaying postulated links with other variables. However, results from the cognitive interviews present a more mixed picture with some questions being appropriately interpreted by respondents, and others displaying significant differences between what the researchers intended them to measure and what they actually do. Using evidence from a range of methods of assessing validity has enabled the modification of an existing instrument into a valid and low cost tool designed to measure social capital within larger surveys in Peru and Vietnam, with the potential for use in other developing countries following local piloting and cultural adaptation of the tool.

Portfolio as a tool to evaluate clinical competences of traumatology in medical students

PubMed Central

Santonja-Medina, Fernando; García-Sanz, M Paz; Martínez-Martínez, Francisco; Bó, David; García-Estañ, Joaquín

2016-01-01

This article investigates whether a reflexive portfolio is instrumental in determining the level of acquisition of clinical competences in traumatology, a subject in the 5th year of the degree of medicine. A total of 131 students used the portfolio during their clinical rotation of traumatology. The students’ portfolios were blind evaluated by four professors who annotated the existence (yes/no) of 23 learning outcomes. The reliability of the portfolio was moderate, according to the kappa index (0.48), but the evaluation scores between evaluators were very similar. Considering the mean percentage, 59.8% of the students obtained all the competences established and only 13 of the 23 learning outcomes (56.5%) were fulfilled by >50% of the students. Our study suggests that the portfolio may be an important tool to quantitatively analyze the acquisition of traumatology competences of medical students, thus allowing the implementation of methods to improve its teaching. PMID:26929675

Towards a new tool for the evaluation of the quality of ultrasound compressed images.

PubMed

Delgorge, Cécile; Rosenberger, Christophe; Poisson, Gérard; Vieyres, Pierre

2006-11-01

This paper presents a new tool for the evaluation of ultrasound image compression. The goal is to measure the image quality as easily as with a statistical criterion, and with the same reliability as the one provided by the medical assessment. An initial experiment is proposed to medical experts and represents our reference value for the comparison of evaluation criteria. Twenty-one statistical criteria are selected from the literature. A cumulative absolute similarity measure is defined as a distance between the criterion to evaluate and the reference value. A first fusion method based on a linear combination of criteria is proposed to improve the results obtained by each of them separately. The second proposed approach combines different statistical criteria and uses the medical assessment in a training phase with a support vector machine. Some experimental results are given and show the benefit of fusion.

Portfolio as a tool to evaluate clinical competences of traumatology in medical students.

PubMed

Santonja-Medina, Fernando; García-Sanz, M Paz; Martínez-Martínez, Francisco; Bó, David; García-Estañ, Joaquín

2016-01-01

This article investigates whether a reflexive portfolio is instrumental in determining the level of acquisition of clinical competences in traumatology, a subject in the 5th year of the degree of medicine. A total of 131 students used the portfolio during their clinical rotation of traumatology. The students' portfolios were blind evaluated by four professors who annotated the existence (yes/no) of 23 learning outcomes. The reliability of the portfolio was moderate, according to the kappa index (0.48), but the evaluation scores between evaluators were very similar. Considering the mean percentage, 59.8% of the students obtained all the competences established and only 13 of the 23 learning outcomes (56.5%) were fulfilled by >50% of the students. Our study suggests that the portfolio may be an important tool to quantitatively analyze the acquisition of traumatology competences of medical students, thus allowing the implementation of methods to improve its teaching.

An Intracranial Electroencephalography (iEEG) Brain Function Mapping Tool with an Application to Epilepsy Surgery Evaluation

PubMed Central

Wang, Yinghua; Yan, Jiaqing; Wen, Jianbin; Yu, Tao; Li, Xiaoli

2016-01-01

Objects: Before epilepsy surgeries, intracranial electroencephalography (iEEG) is often employed in function mapping and epileptogenic foci localization. Although the implanted electrodes provide crucial information for epileptogenic zone resection, a convenient clinical tool for electrode position registration and Brain Function Mapping (BFM) visualization is still lacking. In this study, we developed a BFM Tool, which facilitates electrode position registration and BFM visualization, with an application to epilepsy surgeries. Methods: The BFM Tool mainly utilizes electrode location registration and function mapping based on pre-defined brain models from other software. In addition, the electrode node and mapping properties, such as the node size/color, edge color/thickness, mapping method, can be adjusted easily using the setting panel. Moreover, users may manually import/export location and connectivity data to generate figures for further application. The role of this software is demonstrated by a clinical study of language area localization. Results: The BFM Tool helps clinical doctors and researchers visualize implanted electrodes and brain functions in an easy, quick and flexible manner. Conclusions: Our tool provides convenient electrode registration, easy brain function visualization, and has good performance. It is clinical-oriented and is easy to deploy and use. The BFM tool is suitable for epilepsy and other clinical iEEG applications. PMID:27199729

Ultra-thin carbon-fiber paper fabrication and carbon-fiber distribution homogeneity evaluation method

NASA Astrophysics Data System (ADS)

Zhang, L. F.; Chen, D. Y.; Wang, Q.; Li, H.; Zhao, Z. G.

2018-01-01

A preparation technology of ultra-thin Carbon-fiber paper is reported. Carbon fiber distribution homogeneity has a great influence on the properties of ultra-thin Carbon-fiber paper. In this paper, a self-developed homogeneity analysis system is introduced to assist users to evaluate the distribution homogeneity of Carbon fiber among two or more two-value images of carbon-fiber paper. A relative-uniformity factor W/H is introduced. The experimental results show that the smaller the W/H factor, the higher uniformity of the distribution of Carbon fiber is. The new uniformity-evaluation method provides a practical and reliable tool for analyzing homogeneity of materials.

Evaluation of MTANNs for eliminating false-positive with different computer aided pulmonary nodules detection software.

PubMed

Shi, Zhenghao; Ma, Jiejue; Feng, Yaning; He, Lifeng; Suzuki, Kenji

2015-11-01

MTANN (Massive Training Artificial Neural Network) is a promising tool, which applied to eliminate false-positive for thoracic CT in recent years. In order to evaluate whether this method is feasible to eliminate false-positive of different CAD schemes, especially, when it is applied to commercial CAD software, this paper evaluate the performance of the method for eliminating false-positives produced by three different versions of commercial CAD software for lung nodules detection in chest radiographs. Experimental results demonstrate that the approach is useful in reducing FPs for different computer aided lung nodules detection software in chest radiographs.

Quantitative evaluation of dental abfraction and attrition using a swept-source optical coherence tomography system.

PubMed

Marcauteanu, Corina; Bradu, Adrian; Sinescu, Cosmin; Topala, Florin Ionel; Negrutiu, Meda Lavinia; Podoleanu, Adrian Gh

2014-02-01

A fast swept-source optical coherence tomography (SS-OCT) system is employed to acquire volumes of dental tissue, in order to monitor the temporal evolution of dental wear. An imaging method is developed to evaluate the volume of tissue lost in ex vivo artificially induced abfractions and attritions. The minimal volume (measured in air) that our system could measure is 2352 μm3. A volume of 25,000 A-scans is collected in 2.5 s. All these recommend the SS-OCT method as a valuable tool for dynamic evaluation of the abfraction and attrition with remarkable potential for clinical use.

Nutritional evaluation of patients receiving dialysis for the management of protein-energy wasting: what is old and what is new?

PubMed

Riella, Miguel C

2013-05-01

Advances in the nutritional support of hospitalized patients in the early 1970s led to the recognition that tools were needed to evaluate the nutritional status of patients. The observation that malnutrition in patients receiving dialysis was associated with increased morbidity and mortality prompted many expert groups to develop nutritional scoring systems to be applied in these patients. Given the diverse and confusing terminologies that emerged from these publications, the International Society of Renal Nutritional and Metabolism convened an expert panel to recommend a new nomenclature and preferred methods to evaluate the nutritional status of patients with chronic kidney disease (CKD). The new and inclusive term protein-energy wasting (PEW) refers to a systematically defined condition based on certain criteria and reflects malnutrition and wasting caused not only by inadequate nutrient intake but also by depletion resulting from the inflammatory and noninflammatory conditions that prevail in this population. Serial assessment of nutritional status for detection and management of PEW is recommended using old and new scoring tools, including the Subjective Global Assessment (SGA), malnutrition inflammation score (MIS), Geriatric Nutritional Risk Index (GNRI), and PEW definition criteria. These tools, which are reliable methods and predictors of outcomes, are reviewed in this article. Copyright © 2013 National Kidney Foundation, Inc. Published by Elsevier Inc. All rights reserved.

Analysis and Design of Rotors at Ultra-Low Reynolds Numbers

NASA Technical Reports Server (NTRS)

Kunz, Peter J.; Strawn, Roger C.

2003-01-01

Design tools have been developed for ultra-low Reynolds number rotors, combining enhanced actuator-ring / blade-element theory with airfoil section data based on two-dimensional Navier-Stokes calculations. This performance prediction method is coupled with an optimizer for both design and analysis applications. Performance predictions from these tools have been compared with three-dimensional Navier Stokes analyses and experimental data for a 2.5 cm diameter rotor with chord Reynolds numbers below 10,000. Comparisons among the analyses and experimental data show reasonable agreement both in the global thrust and power required, but the spanwise distributions of these quantities exhibit significant deviations. The study also reveals that three-dimensional and rotational effects significantly change local airfoil section performance. The magnitude of this issue, unique to this operating regime, may limit the applicability of blade-element type methods for detailed rotor design at ultra-low Reynolds numbers, but these methods are still useful for evaluating concept feasibility and rapidly generating initial designs for further analysis and optimization using more advanced tools.

BUSCA: an integrative web server to predict subcellular localization of proteins.

PubMed

Savojardo, Castrense; Martelli, Pier Luigi; Fariselli, Piero; Profiti, Giuseppe; Casadio, Rita

2018-04-30

Here, we present BUSCA (http://busca.biocomp.unibo.it), a novel web server that integrates different computational tools for predicting protein subcellular localization. BUSCA combines methods for identifying signal and transit peptides (DeepSig and TPpred3), GPI-anchors (PredGPI) and transmembrane domains (ENSEMBLE3.0 and BetAware) with tools for discriminating subcellular localization of both globular and membrane proteins (BaCelLo, MemLoci and SChloro). Outcomes from the different tools are processed and integrated for annotating subcellular localization of both eukaryotic and bacterial protein sequences. We benchmark BUSCA against protein targets derived from recent CAFA experiments and other specific data sets, reporting performance at the state-of-the-art. BUSCA scores better than all other evaluated methods on 2732 targets from CAFA2, with a F1 value equal to 0.49 and among the best methods when predicting targets from CAFA3. We propose BUSCA as an integrated and accurate resource for the annotation of protein subcellular localization.

On-machine precision preparation and dressing of ball-headed diamond wheel for the grinding of fused silica

NASA Astrophysics Data System (ADS)

Chen, Mingjun; Li, Ziang; Yu, Bo; Peng, Hui; Fang, Zhen

2013-09-01

In the grinding of high quality fused silica parts with complex surface or structure using ball-headed metal bonded diamond wheel with small diameter, the existing dressing methods are not suitable to dress the ball-headed diamond wheel precisely due to that they are either on-line in process dressing which may causes collision problem or without consideration for the effects of the tool setting error and electrode wear. An on-machine precision preparation and dressing method is proposed for ball-headed diamond wheel based on electrical discharge machining. By using this method the cylindrical diamond wheel with small diameter is manufactured to hemispherical-headed form. The obtained ball-headed diamond wheel is dressed after several grinding passes to recover geometrical accuracy and sharpness which is lost due to the wheel wear. A tool setting method based on high precision optical system is presented to reduce the wheel center setting error and dimension error. The effect of electrode tool wear is investigated by electrical dressing experiments, and the electrode tool wear compensation model is established based on the experimental results which show that the value of wear ratio coefficient K' tends to be constant with the increasing of the feed length of electrode and the mean value of K' is 0.156. Grinding experiments of fused silica are carried out on a test bench to evaluate the performance of the preparation and dressing method. The experimental results show that the surface roughness of the finished workpiece is 0.03 μm. The effect of the grinding parameter and dressing frequency on the surface roughness is investigated based on the measurement results of the surface roughness. This research provides an on-machine preparation and dressing method for ball-headed metal bonded diamond wheel used in the grinding of fused silica, which provides a solution to the tool setting method and the effect of electrode tool wear.

Trajectories for High Specific Impulse High Specific Power Deep Space Exploration

NASA Technical Reports Server (NTRS)

Polsgrove, Tara; Adams, Robert B.; Brady, Hugh J. (Technical Monitor)

2002-01-01

Flight times and deliverable masses for electric and fusion propulsion systems are difficult to approximate. Numerical integration is required for these continuous thrust systems. Many scientists are not equipped with the tools and expertise to conduct interplanetary and interstellar trajectory analysis for their concepts. Several charts plotting the results of well-known trajectory simulation codes were developed and are contained in this paper. These charts illustrate the dependence of time of flight and payload ratio on jet power, initial mass, specific impulse and specific power. These charts are intended to be a tool by which people in the propulsion community can explore the possibilities of their propulsion system concepts. Trajectories were simulated using the tools VARITOP and IPOST. VARITOP is a well known trajectory optimization code that involves numerical integration based on calculus of variations. IPOST has several methods of trajectory simulation; the one used in this paper is Cowell's method for full integration of the equations of motion. An analytical method derived in the companion paper was also evaluated. The accuracy of this method is discussed in the paper.

Effects of training to implement new tools and working methods to reduce knee load in floor layers.

PubMed

Jensen, Lilli Kirkeskov; Friche, Claus

2007-09-01

The purpose was to measure the effect of a participatory ergonomics implementation strategy consisting of information, education, and facilitation on the use of new tools and working methods in the floor laying trade. Floor layers (n=292) were trained in using new working methods. The effects were evaluated by using questionnaires, interviews, and assessments of quality and productivity. Following the training, 43% had used the new working methods weekly/daily compared to 11% before. There was a reduction in the degree of self-reported pain in the knees among the floor layers using the new working methods weekly or daily compared to those using them never or occasionally. The musculoskeletal complaints did not increase from any other region and the quality and the productivity of the work were not decreased. This indicates that within a 3-months perspective the implementation strategy succeeded.

3D Slicer as an Image Computing Platform for the Quantitative Imaging Network

PubMed Central

Fedorov, Andriy; Beichel, Reinhard; Kalpathy-Cramer, Jayashree; Finet, Julien; Fillion-Robin, Jean-Christophe; Pujol, Sonia; Bauer, Christian; Jennings, Dominique; Fennessy, Fiona; Sonka, Milan; Buatti, John; Aylward, Stephen; Miller, James V.; Pieper, Steve; Kikinis, Ron

2012-01-01

Quantitative analysis has tremendous but mostly unrealized potential in healthcare to support objective and accurate interpretation of the clinical imaging. In 2008, the National Cancer Institute began building the Quantitative Imaging Network (QIN) initiative with the goal of advancing quantitative imaging in the context of personalized therapy and evaluation of treatment response. Computerized analysis is an important component contributing to reproducibility and efficiency of the quantitative imaging techniques. The success of quantitative imaging is contingent on robust analysis methods and software tools to bring these methods from bench to bedside. 3D Slicer is a free open source software application for medical image computing. As a clinical research tool, 3D Slicer is similar to a radiology workstation that supports versatile visualizations but also provides advanced functionality such as automated segmentation and registration for a variety of application domains. Unlike a typical radiology workstation, 3D Slicer is free and is not tied to specific hardware. As a programming platform, 3D Slicer facilitates translation and evaluation of the new quantitative methods by allowing the biomedical researcher to focus on the implementation of the algorithm, and providing abstractions for the common tasks of data communication, visualization and user interface development. Compared to other tools that provide aspects of this functionality, 3D Slicer is fully open source and can be readily extended and redistributed. In addition, 3D Slicer is designed to facilitate the development of new functionality in the form of 3D Slicer extensions. In this paper, we present an overview of 3D Slicer as a platform for prototyping, development and evaluation of image analysis tools for clinical research applications. To illustrate the utility of the platform in the scope of QIN, we discuss several use cases of 3D Slicer by the existing QIN teams, and we elaborate on the future directions that can further facilitate development and validation of imaging biomarkers using 3D Slicer. PMID:22770690

How to Assess the External Validity and Model Validity of Therapeutic Trials: A Conceptual Approach to Systematic Review Methodology

PubMed Central

2014-01-01

Background. Evidence rankings do not consider equally internal (IV), external (EV), and model validity (MV) for clinical studies including complementary and alternative medicine/integrative medicine (CAM/IM) research. This paper describe this model and offers an EV assessment tool (EVAT©) for weighing studies according to EV and MV in addition to IV. Methods. An abbreviated systematic review methodology was employed to search, assemble, and evaluate the literature that has been published on EV/MV criteria. Standard databases were searched for keywords relating to EV, MV, and bias-scoring from inception to Jan 2013. Tools identified and concepts described were pooled to assemble a robust tool for evaluating these quality criteria. Results. This study assembled a streamlined, objective tool to incorporate for the evaluation of quality of EV/MV research that is more sensitive to CAM/IM research. Conclusion. Improved reporting on EV can help produce and provide information that will help guide policy makers, public health researchers, and other scientists in their selection, development, and improvement in their research-tested intervention. Overall, clinical studies with high EV have the potential to provide the most useful information about “real-world” consequences of health interventions. It is hoped that this novel tool which considers IV, EV, and MV on equal footing will better guide clinical decision making. PMID:24734111

Solid waste management in primary healthcare centers: application of a facilitation tool 1

PubMed Central

Moreira, Ana Maria Maniero; Günther, Wanda Maria Risso

2016-01-01

Abstract Objectives: to propose a tool to facilitate diagnosis, formulation and evaluation of the Waste Management Plan in Primary Healthcare Centers and to present the results of the application in four selected units. Method: descriptive research, covering the stages of formulation /application of the proposed instrument and the evaluation of waste management performance at the units. Results: the tool consists in five forms; specific indicators of waste generation for outpatients healthcare units were proposed, and performance indicators that give scores for compliance with current legislation. In the studied units it is generated common waste (52-60%), infectious-sharps (31-42%) and recyclable (5-17%). The average rates of generation are: 0,09kg of total waste/outpatient assistance and 0,09kg of infectious-sharps waste/outpatient procedure. The compliance with regulations, initially 26-30%, then reached 30-38% a year later. Conclusion: the tool showed to be easy to use, bypassing the existence of a complex range of existing regulatory requirements, allowed to identify non-conformities, pointed out corrective measures and evaluated the performance of waste management. In this sense, it contributes to decision making and management practices relating to waste, tasks usually assigned to nurses. It is recommended that the tool be applied in similar healthcare units for comparative studies, and implementation of necessary adaptations for other medical services. PMID:27556874

freeQuant: A Mass Spectrometry Label-Free Quantification Software Tool for Complex Proteome Analysis.

PubMed

Deng, Ning; Li, Zhenye; Pan, Chao; Duan, Huilong

2015-01-01

Study of complex proteome brings forward higher request for the quantification method using mass spectrometry technology. In this paper, we present a mass spectrometry label-free quantification tool for complex proteomes, called freeQuant, which integrated quantification with functional analysis effectively. freeQuant consists of two well-integrated modules: label-free quantification and functional analysis with biomedical knowledge. freeQuant supports label-free quantitative analysis which makes full use of tandem mass spectrometry (MS/MS) spectral count, protein sequence length, shared peptides, and ion intensity. It adopts spectral count for quantitative analysis and builds a new method for shared peptides to accurately evaluate abundance of isoforms. For proteins with low abundance, MS/MS total ion count coupled with spectral count is included to ensure accurate protein quantification. Furthermore, freeQuant supports the large-scale functional annotations for complex proteomes. Mitochondrial proteomes from the mouse heart, the mouse liver, and the human heart were used to evaluate the usability and performance of freeQuant. The evaluation showed that the quantitative algorithms implemented in freeQuant can improve accuracy of quantification with better dynamic range.

Designers' unified cost model

NASA Technical Reports Server (NTRS)

Freeman, W.; Ilcewicz, L.; Swanson, G.; Gutowski, T.

1992-01-01

The Structures Technology Program Office (STPO) at NASA LaRC has initiated development of a conceptual and preliminary designers' cost prediction model. The model will provide a technically sound method for evaluating the relative cost of different composite structural designs, fabrication processes, and assembly methods that can be compared to equivalent metallic parts or assemblies. The feasibility of developing cost prediction software in a modular form for interfacing with state-of-the-art preliminary design tools and computer aided design programs is being evaluated. The goal of this task is to establish theoretical cost functions that relate geometric design features to summed material cost and labor content in terms of process mechanics and physics. The output of the designers' present analytical tools will be input for the designers' cost prediction model to provide the designer with a database and deterministic cost methodology that allows one to trade and synthesize designs with both cost and weight as objective functions for optimization. This paper presents the team members, approach, goals, plans, and progress to date for development of COSTADE (Cost Optimization Software for Transport Aircraft Design Evaluation).

What do evaluation instruments tell us about the quality of complementary medicine information on the internet?

PubMed

Breckons, Matthew; Jones, Ray; Morris, Jenny; Richardson, Janet

2008-01-22

Developers of health information websites aimed at consumers need methods to assess whether their website is of "high quality." Due to the nature of complementary medicine, website information is diverse and may be of poor quality. Various methods have been used to assess the quality of websites, the two main approaches being (1) to compare the content against some gold standard, and (2) to rate various aspects of the site using an assessment tool. We aimed to review available evaluation instruments to assess their performance when used by a researcher to evaluate websites containing information on complementary medicine and breast cancer. In particular, we wanted to see if instruments used the same criteria, agreed on the ranking of websites, were easy to use by a researcher, and if use of a single tool was sufficient to assess website quality. Bibliographic databases, search engines, and citation searches were used to identify evaluation instruments. Instruments were included that enabled users with no subject knowledge to make an objective assessment of a website containing health information. The elements of each instrument were compared to nine main criteria defined by a previous study. Google was used to search for complementary medicine and breast cancer sites. The first six results and a purposive six from different origins (charities, sponsored, commercial) were chosen. Each website was assessed using each tool, and the percentage of criteria successfully met was recorded. The ranking of the websites by each tool was compared. The use of the instruments by others was estimated by citation analysis and Google searching. A total of 39 instruments were identified, 12 of which met the inclusion criteria; the instruments contained between 4 and 43 questions. When applied to 12 websites, there was agreement of the rank order of the sites with 10 of the instruments. Instruments varied in the range of criteria they assessed and in their ease of use. Comparing the content of websites against a gold standard is time consuming and only feasible for very specific advice. Evaluation instruments offer gateway providers a method to assess websites. The checklist approach has face validity when results are compared to the actual content of "good" and "bad" websites. Although instruments differed in the range of items assessed, there was fair agreement between most available instruments. Some were easier to use than others, but these were not necessarily the instruments most widely used to date. Combining some of the better features of instruments to provide fewer, easy-to-use methods would be beneficial to gateway providers.