Developing a consumer evaluation tool of weight control strategy advertisements on the Internet.

PubMed

Luevorasirikul, Kanokrat; Gray, Nicola J; Anderson, Claire W

2008-06-01

To develop two evaluation tools for weight loss and weight gain advertisements on the Internet in order to help consumers to evaluate the quality of information within these advertisements. One hundred websites identified by Internet search engines for weight loss and weight gain strategies (50 websites each) were evaluated using two specific scoring instruments, developed by adapting questions from the 'DISCERN' tool and reviewing all related weight control guidelines and advertising regulations. The validity and reliability of the adapted tools were tested. Our evaluation tools rated the information from most websites as poor quality (70%). In the case of weight loss strategies, statements about rapid (18%) and permanent (28%) weight loss caused concern as well as lack of sensible advice about dieting and a lack of product warnings (84%). Safety concerns relating to weight gain products were the lack of warnings about side effects in products containing steroids and creatine (92%). The adapted tools exhibited acceptable validity and reliability. Quality of information within weight control advertisements on the Internet was generally poor. Problems of false claims, little advice on healthy ways to modify weight and few warnings on side effects have been highlighted in this study.

Watershed Management Optimization Support Tool (WMOST) v2: Theoretical Documentation

EPA Science Inventory

The Watershed Management Optimization Support Tool (WMOST) is a decision support tool that evaluates the relative cost-effectiveness of management practices at the local or watershed scale. WMOST models the environmental effects and costs of management decisions in a watershed c...

Creating a Minnesota Statewide SNAP-Ed Program Evaluation

ERIC Educational Resources Information Center

Gold, Abby; Barno, Trina Adler; Sherman, Shelley; Lovett, Kathleen; Hurtado, G. Ali

2013-01-01

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

Educational Effects of the Tools of the Mind Curriculum: A Randomized Trial

ERIC Educational Resources Information Center

Barnett, W.Steven; Jung, Kwanghee; Yarosz, Donald J.; Thomas, Jessica; Hornbeck, Amy; Stechuk, Robert; Burns, Susan

2008-01-01

The effectiveness of the "Tools of the Mind (Tools)" curriculum in improving the education of 3- and 4-year-old children was evaluated by means of a randomized trial. The "Tools" curriculum, based on the work of Vygotsky, focuses on the development of self-regulation at the same time as teaching literacy and mathematics skills…

Digital Discernment: An E-Commerce Web Site Evaluation Tool

ERIC Educational Resources Information Center

Sigman, Betsy Page; Boston, Brian J.

2013-01-01

Students entering the business workforce today may well share some responsibility for developing, revising, or evaluating their company's Web site. They may lack the experience, however, to critique their employer's Web presence effectively. The purpose of developing Digital Discernment, an e-commerce Web site evaluation tool, was to prepare…

Evaluation of Seeds of Science/Roots of Reading: Effective Tools for Developing Literacy through Science in the Early Grades-Light Energy Unit. CRESST Report 781

ERIC Educational Resources Information Center

Goldschmidt, Pete; Jung, Hyekyung

2011-01-01

This evaluation focuses on the Seeds of Science/Roots of Reading: Effective Tools for Developing Literacy through Science in the Early Grades ("Seeds/Roots") model of science-literacy integration. The evaluation is based on a cluster randomized design of 100 teachers, half of which were in the treatment group. Multi-level models are employed to…

Watershed Management Optimization Support Tool (WMOST) v2: User Manual and Case Studies

EPA Science Inventory

The Watershed Management Optimization Support Tool (WMOST) is a decision support tool that evaluates the relative cost-effectiveness of management practices at the local or watershed scale. WMOST models the environmental effects and costs of management decisions in a watershed c...

The Effects of Tools of the Mind on Math and Reading Scores in Kindergarten

ERIC Educational Resources Information Center

Mackay, Patricia E.

2013-01-01

Although a limited body of research has supported the positive impact of the Tools of the Mind curriculum on the development of self-regulation, research supporting a direct relationship between Tools and academic achievement is extremely limited. The purpose of this study is to evaluate the effectiveness of the Tools of the Mind curriculum…

Understanding online health information: Evaluation, tools, and strategies.

PubMed

Beaunoyer, Elisabeth; Arsenault, Marianne; Lomanowska, Anna M; Guitton, Matthieu J

2017-02-01

Considering the status of the Internet as a prominent source of health information, assessing online health material has become a central issue in patient education. We describe the strategies available to evaluate the characteristics of online health information, including readability, emotional content, understandability, usability. Popular tools used in assessment of readability, emotional content and comprehensibility of online health information were reviewed. Tools designed to evaluate both printed and online material were considered. Readability tools are widely used in online health material evaluation and are highly covariant. Assessment of emotional content of online health-related communications via sentiment analysis tools is becoming more popular. Understandability and usability tools have been developed specifically for health-related material, but each tool has important limitations and has been tested on a limited number of health issues. Despite the availability of numerous assessment tools, their overall reliability differs between readability (high) and understandability (low). Approaches combining multiple assessment tools and involving both quantitative and qualitative observations would optimize assessment strategies. Effective assessment of online health information should rely on mixed strategies combining quantitative and qualitative evaluations. Assessment tools should be selected according to their functional properties and compatibility with target material. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

FIA BioSum: a tool to evaluate financial costs, opportunities and effectiveness of fuel treatments.

Treesearch

Jeremy Fried; Glenn Christensen

2004-01-01

FIA BioSum, a tool developed by the USDA Forest Services Forest Inventory and Analysis (FIA) Program, generates reliable cost estimates, identifies opportunities and evaluates the effectiveness of fuel treatments in forested landscapes. BioSum is an analytic framework that integrates a suite of widely used computer models with a foundation of attribute-rich,...

Social Work Admission Assessment Tool for Identifying Patients in Need of Comprehensive Social Work Evaluation

ERIC Educational Resources Information Center

Boutin-Foster, Carla; Euster, Sona; Rolon, Yvette; Motal, Athena; BeLue, Rhonda; Kline, Robin; Charlson, Mary E.

2005-01-01

Early identification of patients who need a social work evaluation is integral to effective discharge planning. This article describes the development and application of the Social Work Admission Assessment Tool (SWAAT), a six-item scale that identifies patients with complicated discharge needs who require a social work evaluation. It addresses…

Conducting systematic reviews of economic evaluations.

PubMed

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other types of evidence. The updated JBI guidance will be useful for researchers wanting to synthesize evidence about economic questions, either as stand-alone reviews or part of comprehensive or mixed method evidence reviews. Although the updated methodology produced by the work of the working group has improved the JBI guidance for systematic reviews of economic evaluations, there are areas where further work is required. These include adjusting the critical appraisal tool to separate out questions addressing intervention cost and effectiveness measurement; providing more explicit guidance for assessing generalizability of findings; and offering a more robust method for evidence synthesis that facilitates achieving the more ambitious review objectives.

Development and Validation of a Standardized Tool for Prioritization of Information Sources.

PubMed

Akwar, Holy; Kloeze, Harold; Mukhi, Shamir

2016-01-01

To validate the utility and effectiveness of a standardized tool for prioritization of information sources for early detection of diseases. The tool was developed with input from diverse public health experts garnered through survey. Ten raters used the tool to evaluate ten information sources and reliability among raters was computed. The Proc mixed procedure with random effect statement and SAS Macros were used to compute multiple raters' Fleiss Kappa agreement and Kendall's Coefficient of Concordance. Ten disparate information sources evaluated obtained the following composite scores: ProMed 91%; WAHID 90%; Eurosurv 87%; MediSys 85%; SciDaily 84%; EurekAl 83%; CSHB 78%; GermTrax 75%; Google 74%; and CBC 70%. A Fleiss Kappa agreement of 50.7% was obtained for ten information sources and 72.5% for a sub-set of five sources rated, which is substantial agreement validating the utility and effectiveness of the tool. This study validated the utility and effectiveness of a standardized criteria tool developed to prioritize information sources. The new tool was used to identify five information sources suited for use by the KIWI system in the CEZD-IIR project to improve surveillance of infectious diseases. The tool can be generalized to situations when prioritization of numerous information sources is necessary.

Factors that affect micro-tooling features created by direct printing approach

NASA Astrophysics Data System (ADS)

Kumbhani, Mayur N.

Current market required faster pace production of smaller, better, and improved products in shorter amount of time. Traditional high-rate manufacturing process such as hot embossing, injection molding, compression molding, etc. use tooling to replicate feature on a products. Miniaturization of many product in the field of biomedical, electronics, optical, and microfluidic is occurring on a daily bases. There is a constant need to produce cheaper, and faster tooling, which can be utilize by existing manufacturing processes. Traditionally, in order to manufacture micron size tooling features processes such as micro-machining, Electrical Discharge Machining (EDM), etc. are utilized. Due to a higher difficulty to produce smaller size features, and longer production cycle time, various additive manufacturing approaches are proposed, e.g. selective laser sintering (SLS), inkjet printing (3DP), fused deposition modeling (FDM), etc. were proposed. Most of these approaches can produce net shaped products from different materials such as metal, ceramic, or polymers. Several attempts were made to produce tooling features using additive manufacturing approaches. Most of these produced tooling were not cost effective, and the life cycle of these tooling was reported short. In this research, a method to produce tooling features using direct printing approach, where highly filled feedstock was dispensed on a substrate. This research evaluated different natural binders, such as guar gum, xanthan gum, and sodium carboxymethyl cellulose (NaCMC) and their combinations were evaluated. The best binder combination was then use to evaluate effect of different metal (316L stainless steel (3 mum), 316 stainless steel (45 mum), and 304 stainless steel (45 mum)) particle size on feature quality. Finally, the effect of direct printing process variables such as dispensing tip internal diameter (500 mum, and 333 mum) at different printing speeds were evaluated.

Stochastic Simulation Tool for Aerospace Structural Analysis

NASA Technical Reports Server (NTRS)

Knight, Norman F.; Moore, David F.

2006-01-01

Stochastic simulation refers to incorporating the effects of design tolerances and uncertainties into the design analysis model and then determining their influence on the design. A high-level evaluation of one such stochastic simulation tool, the MSC.Robust Design tool by MSC.Software Corporation, has been conducted. This stochastic simulation tool provides structural analysts with a tool to interrogate their structural design based on their mathematical description of the design problem using finite element analysis methods. This tool leverages the analyst's prior investment in finite element model development of a particular design. The original finite element model is treated as the baseline structural analysis model for the stochastic simulations that are to be performed. A Monte Carlo approach is used by MSC.Robust Design to determine the effects of scatter in design input variables on response output parameters. The tool was not designed to provide a probabilistic assessment, but to assist engineers in understanding cause and effect. It is driven by a graphical-user interface and retains the engineer-in-the-loop strategy for design evaluation and improvement. The application problem for the evaluation is chosen to be a two-dimensional shell finite element model of a Space Shuttle wing leading-edge panel under re-entry aerodynamic loading. MSC.Robust Design adds value to the analysis effort by rapidly being able to identify design input variables whose variability causes the most influence in response output parameters.

The effective integration of analysis, modeling, and simulation tools.

DOT National Transportation Integrated Search

2013-08-01

The need for model integration arises from the recognition that both transportation decisionmaking and the tools supporting it continue to increase in complexity. Many strategies that agencies evaluate require using tools that are sensitive to supply...

Can Interactive Visualization Tools Engage and Support Pre-University Students in Exploring Non-Trivial Mathematical Concepts?

ERIC Educational Resources Information Center

Liang, Hai-Ning; Sedig, Kamran

2010-01-01

Many students find it difficult to engage with mathematical concepts. As a relatively new class of learning tools, visualization tools may be able to promote higher levels of engagement with mathematical concepts. Often, development of new tools may outpace empirical evaluations of the effectiveness of these tools, especially in educational…

Examining Interrater Agreement Analyses of a Pilot Special Education Observation Tool

ERIC Educational Resources Information Center

Johnson, Evelyn S.; Semmelroth, Carrie L.

2012-01-01

This paper reports the results of interrater agreement analyses on a pilot special education teacher evaluation instrument, the Recognizing Effective Special Education Teachers (RESET) Observation Tool (OT). Using evidence-based instructional practices as the basis for the evaluation, the RESET OT is designed for the spectrum of different…

Food Safety Practices Assessment Tool: An Innovative Way to Test Food Safety Skills among Individuals with Special Needs

ERIC Educational Resources Information Center

Carbone, Elena T.; Scarpati, Stanley E.; Pivarnik, Lori F.

2013-01-01

This article describes an innovative assessment tool designed to evaluate the effectiveness of a food safety skills curriculum for learners receiving special education services. As schools respond to the increased demand for training students with special needs about food safety, the need for effective curricula and tools is also increasing. A…

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

Model Evaluation of Continuous Data Pharmacometric Models: Metrics and Graphics

PubMed Central

Nguyen, THT; Mouksassi, M‐S; Holford, N; Al‐Huniti, N; Freedman, I; Hooker, AC; John, J; Karlsson, MO; Mould, DR; Pérez Ruixo, JJ; Plan, EL; Savic, R; van Hasselt, JGC; Weber, B; Zhou, C; Comets, E

2017-01-01

This article represents the first in a series of tutorials on model evaluation in nonlinear mixed effect models (NLMEMs), from the International Society of Pharmacometrics (ISoP) Model Evaluation Group. Numerous tools are available for evaluation of NLMEM, with a particular emphasis on visual assessment. This first basic tutorial focuses on presenting graphical evaluation tools of NLMEM for continuous data. It illustrates graphs for correct or misspecified models, discusses their pros and cons, and recalls the definition of metrics used. PMID:27884052

An end user evaluation of query formulation and results review tools in three medical meta-search engines.

PubMed

Leroy, Gondy; Xu, Jennifer; Chung, Wingyan; Eggers, Shauna; Chen, Hsinchun

2007-01-01

Retrieving sufficient relevant information online is difficult for many people because they use too few keywords to search and search engines do not provide many support tools. To further complicate the search, users often ignore support tools when available. Our goal is to evaluate in a realistic setting when users use support tools and how they perceive these tools. We compared three medical search engines with support tools that require more or less effort from users to form a query and evaluate results. We carried out an end user study with 23 users who were asked to find information, i.e., subtopics and supporting abstracts, for a given theme. We used a balanced within-subjects design and report on the effectiveness, efficiency and usability of the support tools from the end user perspective. We found significant differences in efficiency but did not find significant differences in effectiveness between the three search engines. Dynamic user support tools requiring less effort led to higher efficiency. Fewer searches were needed and more documents were found per search when both query reformulation and result review tools dynamically adjust to the user query. The query reformulation tool that provided a long list of keywords, dynamically adjusted to the user query, was used most often and led to more subtopics. As hypothesized, the dynamic result review tools were used more often and led to more subtopics than static ones. These results were corroborated by the usability questionnaires, which showed that support tools that dynamically optimize output were preferred.

Situation Awareness and Workload Measures for SAFOR

NASA Technical Reports Server (NTRS)

DeMaio, Joe; Hart, Sandra G.; Allen, Ed (Technical Monitor)

1999-01-01

The present research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale (DRAWS), and a situation awareness measurement tool in which the crews self-evaluation of performance is compared against actual performance. These two measurement tools were evaluated in the context of a test of an innovative approach to alerting the crew by way of a helmet mounted display. The DRAWS was found to be usable, but it offered no advantages over extant scales, and it had only limited resolution. The performance self-evaluation metric of situation awareness was found to be highly effective.

Improving Students' Understanding of Quantum Measurement. II. Development of Research-Based Learning Tools

ERIC Educational Resources Information Center

Zhu, Guangtian; Singh, Chandralekha

2012-01-01

We describe the development and implementation of research-based learning tools such as the Quantum Interactive Learning Tutorials and peer-instruction tools to reduce students' common difficulties with issues related to measurement in quantum mechanics. A preliminary evaluation shows that these learning tools are effective in improving students'…

Tools for Formative Evaluation: Gathering the Information Necessary for Program Improvement

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2016-01-01

New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

Ensuring Patient Safety in Care Transitions: An Empirical Evaluation of a Handoff Intervention Tool

PubMed Central

Abraham, Joanna; Kannampallil, Thomas; Patel, Bela; Almoosa, Khalid; Patel, Vimla L.

2012-01-01

Successful handoffs ensure smooth, efficient and safe patient care transitions. Tools and systems designed for standardization of clinician handoffs often focuses on ensuring the communication activity during transitions, with limited support for preparatory activities such as information seeking and organization. We designed and evaluated a Handoff Intervention Tool (HAND-IT) based on a checklist-inspired, body system format allowing structured information organization, and a problem-case narrative format allowing temporal description of patient care events. Based on a pre-post prospective study using a multi-method analysis we evaluated the effectiveness of HAND-IT as a documentation tool. We found that the use of HAND-IT led to fewer transition breakdowns, greater tool resilience, and likely led to better learning outcomes for less-experienced clinicians when compared to the current tool. We discuss the implications of our results for improving patient safety with a continuity of care-based approach. PMID:23304268

Tools to Promote Shared Decision Making in Serious Illness: A Systematic Review.

PubMed

Austin, C Adrian; Mohottige, Dinushika; Sudore, Rebecca L; Smith, Alexander K; Hanson, Laura C

2015-07-01

Serious illness impairs function and threatens survival. Patients facing serious illness value shared decision making, yet few decision aids address the needs of this population. To perform a systematic review of evidence about decision aids and other exportable tools that promote shared decision making in serious illness, thereby (1) identifying tools relevant to the treatment decisions of seriously ill patients and their caregivers, (2) evaluating the quality of evidence for these tools, and (3) summarizing their effect on outcomes and accessibility for clinicians. We searched PubMed, CINAHL, and PsychInfo from January 1, 1995, through October 31, 2014, and identified additional studies from reference lists and other systematic reviews. Clinical trials with random or nonrandom controls were included if they tested print, video, or web-based tools for advance care planning (ACP) or decision aids for serious illness. We extracted data on the study population, design, results, and risk for bias using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criteria. Each tool was evaluated for its effect on patient outcomes and accessibility. Seventeen randomized clinical trials tested decision tools in serious illness. Nearly all the trials were of moderate or high quality and showed that decision tools improve patient knowledge and awareness of treatment choices. The available tools address ACP, palliative care and goals of care communication, feeding options in dementia, lung transplant in cystic fibrosis, and truth telling in terminal cancer. Five randomized clinical trials provided further evidence that decision tools improve ACP documentation, clinical decisions, and treatment received. Clinicians can access and use evidence-based tools to engage seriously ill patients in shared decision making. This field of research is in an early stage; future research is needed to develop novel decision aids for other serious diagnoses and key decisions. Health care delivery organizations should prioritize the use of currently available tools that are evidence based and effective.

Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

ERIC Educational Resources Information Center

Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

2013-01-01

Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

Automatic Assessment of 3D Modeling Exams

ERIC Educational Resources Information Center

Sanna, A.; Lamberti, F.; Paravati, G.; Demartini, C.

2012-01-01

Computer-based assessment of exams provides teachers and students with two main benefits: fairness and effectiveness in the evaluation process. This paper proposes a fully automatic evaluation tool for the Graphic and Virtual Design (GVD) curriculum at the First School of Architecture of the Politecnico di Torino, Italy. In particular, the tool is…

Evaluating the Effectiveness of Tools for Online Database Instruction

ERIC Educational Resources Information Center

Mery, Yvonne; DeFrain, Erica; Kline, Elizabeth; Sult, Leslie

2014-01-01

The intent of this study was to evaluate the Guide on the Side (Gots), an online learning tool developed by the University of Arizona Libraries, and a screencast tutorial for teaching information literacy and database searching skills. Ninety undergraduate students were randomly assigned into three groups: group 1 completed a GotS tutorial; group…

Tools developed and disseminated by guideline producers to promote the uptake of their guidelines.

PubMed

Flodgren, Gerd; Hall, Amanda M; Goulding, Lucy; Eccles, Martin P; Grimshaw, Jeremy M; Leng, Gillian C; Shepperd, Sasha

2016-08-22

The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs. To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective. We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites. We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area. Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines. We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service. Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.

Evaluating the Effectiveness of a Large-Scale Professional Development Programme

ERIC Educational Resources Information Center

Main, Katherine; Pendergast, Donna

2017-01-01

An evaluation of the effectiveness of a large-scale professional development (PD) programme delivered to 258 schools in Queensland, Australia is presented. Formal evaluations were conducted at two stages during the programme using a tool developed from Desimone's five core features of effective PD. Descriptive statistics of 38 questions and…

Evaluating the effectiveness of five screening tools used to identify malnutrition risk in hospitalized elderly: A systematic review.

PubMed

Cascio, Brooke L; Logomarsino, John V

This systematic review investigated 5 frequently used nutrition screening tools (NSTs) used in hospitals and their effectiveness at identifying malnutrition risk in the elderly. A literature review was conducted to obtain research articles focused on malnutrition screening in hospitalized elderly and effectiveness of the NST used. Twenty six articles were reviewed and evaluated, resulting in 8 that met inclusion criteria. The Mini Nutritional Assessment-Short Form, designed for use in the elderly, resulted in overestimation of malnutrition. Four screening tools did demonstrate more effectiveness in identifying malnutrition risk; however, several different biochemical and anthropometric parameters were used, which prevented meaningful comparisons. There is a need for a universal NST "gold standard" for use in the elderly, and further research is indicated. Copyright © 2017 Elsevier Inc. All rights reserved.

Comparison of the Wii Balance Board and the BESS tool measuring postural stability in collegiate athletes.

PubMed

Guzman, Jill; Aktan, Nadine

2016-02-01

Concussions are a major health concern for athletes given the potential for these injuries in a wide range of sport activities. The leading concern for clinicians is that athletes are at risk for devastating consequences if they are not evaluated properly and cleared too early to return to play or competition. The evaluation of postural stability has been identified as an important aspect to the comprehensive management of such injuries. Clinicians are in need of a portable tool they can use in various settings to aid in decision making and health care delivery for concussed athletes. The Nintendo Wii Balance Board (Nintendo of America Inc., Redmond, Washington) is a portable, cost-effective tool that has the potential to aid in the evaluation of postural stability in concussed individuals. The purpose of this study was to evaluate the Wii Balance Board as an objective, user-friendly, cost effective, valid alternative tool for the measurement of postural stability in college athletes. This study questioned whether the Wii Balance Board, when compared to the Balance Error Scoring System (BESS), is an objective tool that can be used as an acceptable measurement of postural stability in college athletes. Copyright © 2015 Elsevier Inc. All rights reserved.

Use and clinical efficacy of standard and health information technology fall risk assessment tools.

PubMed

Teh, Ruth C; Wilson, Anne; Ranasinghe, Damith; Visvanathan, Renuka

2017-12-01

To evaluate the health information technology (HIT) compared to Fall Risk for Older Persons (FROP) tool in fall risk screening. A HIT tool trial was conducted on the geriatric evaluation and management (GEM, n = 111) and acute medical units (AMU, n = 424). Health information technology and FROP scores were higher on GEM versus AMU, with no differences between people who fell and people who did not fall. Both score completion rates were similar, and their values correlated marginally (Spearman's correlation coefficient 0.33, P < 0.01). HIT and FROP scores demonstrated similar sensitivity (80 vs 82%) and specificity (32 vs 36%) for detecting hospital falls. Hospital fall rates trended towards reduction on AMU (4.20 vs 6.96, P = 0.15) and increase on GEM (10.98 vs 6.52, P = 0.54) with HIT tool implementation. Health information technology tool acceptability and scoring were comparable to FROP screening, with mixed effects on fall rate with HIT tool implementation. Clinician partnership remains key to effective tool development. © 2017 AJA Inc.

The Personnel Effectiveness Grid (PEG): A New Tool for Estimating Personnel Department Effectiveness

ERIC Educational Resources Information Center

Petersen, Donald J.; Malone, Robert L.

1975-01-01

Examines the difficulties inherent in attempting a formal personnel evaluation system, the major formal methods currently used for evaluating personnel department accountabilities, some parameters that should be part of a valid evaluation program, and a model for conducting the evaluation. (Available from Office of Publications, Graduate School of…

Summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

Powell, Danny H; Elwood Jr, Robert H

2011-01-01

An effective risk assessment system is needed to address the threat posed by an active or passive insider who, acting alone or in collusion, could attempt diversion or theft of nuclear material. The material control and accountability (MC&A) system effectiveness tool (MSET) is a self-assessment or inspection tool utilizing probabilistic risk assessment (PRA) methodology to calculate the system effectiveness of a nuclear facility's material protection, control, and accountability (MPC&A) system. The MSET process is divided into four distinct and separate parts: (1) Completion of the questionnaire that assembles information about the operations of every aspect of the MPC&A system; (2)more » Conversion of questionnaire data into numeric values associated with risk; (3) Analysis of the numeric data utilizing the MPC&A fault tree and the SAPHIRE computer software; and (4) Self-assessment using the MSET reports to perform the effectiveness evaluation of the facility's MPC&A system. The process should lead to confirmation that mitigating features of the system effectively minimize the threat, or it could lead to the conclusion that system improvements or upgrades are necessary to achieve acceptable protection against the threat. If the need for system improvements or upgrades is indicated when the system is analyzed, MSET provides the capability to evaluate potential or actual system improvements or upgrades. A facility's MC&A system can be evaluated at a point in time. The system can be reevaluated after upgrades are implemented or after other system changes occur. The total system or specific subareas within the system can be evaluated. Areas of potential system improvement can be assessed to determine where the most beneficial and cost-effective improvements should be made. Analyses of risk importance factors show that sustainability is essential for optimal performance and reveals where performance degradation has the greatest impact on total system risk. The risk importance factors show the amount of risk reduction achievable with potential upgrades and the amount of risk reduction achieved after upgrades are completed. Applying the risk assessment tool gives support to budget prioritization by showing where budget support levels must be sustained for MC&A functions most important to risk. Results of the risk assessment are also useful in supporting funding justifications for system improvements that significantly reduce system risk. The functional model, the system risk assessment tool, and the facility evaluation questionnaire are valuable educational tools for MPC&A personnel. These educational tools provide a framework for ongoing dialogue between organizations regarding the design, development, implementation, operation, assessment, and sustainability of MPC&A systems. An organization considering the use of MSET as an analytical tool for evaluating the effectiveness of its MPC&A system will benefit from conducting a complete MSET exercise at an existing nuclear facility.« less

Evaluation of Computer Tools for Idea Generation and Team Formation in Project-Based Learning

ERIC Educational Resources Information Center

Ardaiz-Villanueva, Oscar; Nicuesa-Chacon, Xabier; Brene-Artazcoz, Oscar; Sanz de Acedo Lizarraga, Maria Luisa; Sanz de Acedo Baquedano, Maria Teresa

2011-01-01

The main objective of this research was to validate the effectiveness of Wikideas and Creativity Connector tools to stimulate the generation of ideas and originality by university students organized into groups according to their indexes of creativity and affinity. Another goal of the study was to evaluate the classroom climate created by these…

Toward a New Approach to the Evaluation of a Digital Curriculum Using Learning Analytics

ERIC Educational Resources Information Center

Rangel, Virginia Snodgrass; Bell, Elizabeth R.; Monroy, Carlos; Whitaker, J. Reid

2015-01-01

Understanding how an educational intervention is implemented is essential to evaluating its effectiveness. With the increased use of digital tools in classrooms, however, traditional methods of measuring implementation fall short. Fortunately, there is a way to learn about the interactions that users have with digital tools that are embedded into…

DOE Office of Scientific and Technical Information (OSTI.GOV)

Carpenter, Alberta; Mann, Margaret; Gelman, Rachel

In evaluating next-generation materials and processes, the supply chain can have a large impact on the life cycle energy impacts. The Materials Flow through Industry (MFI) tool was developed for the Department of Energy's Advanced Manufacturing Office to be able to evaluate the energy impacts of the U.S. supply chain. The tool allows users to perform process comparisons, material substitutions, and grid modifications, and to see the effects of implementing sector efficiency potentials (Masanet, et al. 2009). This paper reviews the methodology of the tool and provides results around specific scenarios.

Preparing for the future: a review of tools and strategies to support autonomous goal setting for children and youth with autism spectrum disorders.

PubMed

Hodgetts, Sandra; Park, Elly

2017-03-01

Despite recognized benefits, current clinical practice rarely includes direct input from children and youth with autism spectrum disorder (ASD) in setting rehabilitation goals. This study reviews tools and evidence-based strategies to assist with autonomous goal settings for children and youth with ASD. This study included two components: (1) A scoping review of existing tools and strategies to assist with autonomous goal setting in individuals with ASD and (2) a chart review of inter-disciplinary service plan goals for children and youth with ASD. Eleven data sources, evaluating five different tools to assist with autonomous goal setting for children and youth with ASD, were found. Three themes emerged from the integration of the scoping review and chart review, which are discussed in the paper: (1) generalizability of findings, (2) adaptations to support participation and (3) practice implications. Children and youth with ASD can participate in setting rehabilitation goals, but few tools to support their participation have been evaluated, and those tools that do exist do not align well with current services foci. Visual aids appear to be one effective support, but further research on effective strategies for meaningful engagement in autonomous goal setting for children and youth with ASD is warranted. Implications for rehabilitation Persons with ASD are less self-determined than their peers. Input into one's own rehabilitation goals and priorities is an important component of self-determination. Few tools exist to help engage children and youth with ASD in setting their own rehabilitation goals. An increased focus on identifying, developing and evaluating effective tools and strategies to facilitate engagement of children and youth with ASD in setting their own rehabilitation goals is warranted.

The current state of cancer family history collection tools in primary care: a systematic review.

PubMed

Qureshi, Nadeem; Carroll, June C; Wilson, Brenda; Santaguida, Pasqualina; Allanson, Judith; Brouwers, Melissa; Raina, Parminder

2009-07-01

Systematic collection of family history is a prerequisite for identifying genetic risk. This study reviewed tools applicable to the primary care assessment of family history of breast, colorectal, ovarian, and prostate cancer. MEDLINE, EMBASE, CINAHL, and Cochrane Central were searched for publications. All primary study designs were included. Characteristics of the studies, the family history collection tools, and the setting were evaluated. Of 40 eligible studies, 18 relevant family history tools were identified, with 11 developed for use in primary care. Most collected information on more than one cancer and on affected relatives used self-administered questionnaires and paper-based formats. Eleven tools had been evaluated relative to current practice, demonstrating 46-78% improvement in data recording over family history recording in patient charts and 75-100% agreement with structured genetic interviews. Few tools have been developed specifically for primary care settings. The few that have been evaluated performed well. The very limited evidence, which depends in part on extrapolation from studies in settings other than primary care, suggests that systematic tools may add significant family health information compared with current primary care practice. The effect of their use on health outcomes has not been evaluated.

Engaging stakeholders to design a comparative effectiveness trial in children with uncontrolled asthma.

PubMed

Erwin, Kim; Martin, Molly A; Flippin, Tara; Norell, Sarah; Shadlyn, Ariana; Yang, Jie; Falco, Paula; Rivera, Jaime; Ignoffo, Stacy; Kumar, Rajesh; Margellos-Anast, Helen; McDermott, Michael; McMahon, Kate; Mosnaim, Giselle; Nyenhuis, Sharmilee M; Press, Valerie G; Ramsay, Jessica E; Soyemi, Kenneth; Thompson, Trevonne M; Krishnan, Jerry A

2016-01-01

To present the methods and outcomes of stakeholder engagement in the development of interventions for children presenting to the emergency department (ED) for uncontrolled asthma. We engaged stakeholders (caregivers, physicians, nurses, administrators) from six EDs in a three-phase process to: define design requirements; prototype and refine; and evaluate. Interviews among 28 stakeholders yielded themes regarding in-home asthma management practices and ED discharge experiences. Quantitative and qualitative evaluation showed strong preference for the new discharge tool over current tools. Engaging end-users in contextual inquiry resulted in CAPE (CHICAGO Action Plan after ED discharge), a new stakeholder-balanced discharge tool, which is being tested in a multicenter comparative effectiveness trial.

PROTOTYPE TOOL FOR EVALUATING THE COST AND EFFECTIVENESS OF GREENHOUSE GAS MITIGATION TECHNOLOGIES

EPA Science Inventory

The paper introduces the structure of a tool, being developed by the U.S. EPA's Office of Research and Development, that will be able to analyze the benefits of new technologies and strategies for controlling greenhouse gas (GHG) emissions. When completed, the tool will be able ...

Experimental Evaluation of the Tools of the Mind Preschool Curriculum

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Farran, Dale C.

2012-01-01

The aim of the "Tools of the Mind" prekindergarten curriculum is to enhance children's executive function skills within an instructional context that promotes the basic academic and social skills that prepare them for kindergarten and beyond. To investigate the effectiveness of "Tools" in achieving this aim, the authors are…

Dietary Adherence Monitoring Tool for Free-living, Controlled Feeding Studies

USDA-ARS?s Scientific Manuscript database

Objective: To devise a dietary adherence monitoring tool for use in controlled human feeding trials involving free-living study participants. Methods: A scoring tool was devised to measure and track dietary adherence for an 8-wk randomized trial evaluating the effects of two different dietary patter...

Student Evaluation of CALL Tools during the Design Process

ERIC Educational Resources Information Center

Nesbitt, Dallas

2013-01-01

This article discusses the comparative effectiveness of student input at different times during the design of CALL tools for learning kanji, the Japanese characters of Chinese origin. The CALL software "package" consisted of tools to facilitate the writing, reading and practising of kanji characters in context. A pre-design questionnaire…

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

PubMed

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

Principal Evaluation: Standards, Rubrics, and Tools for Effective Performance

ERIC Educational Resources Information Center

Stronge, James H.; Xu, Xianxuan; Leeper, Lauri M.; Tonneson, Virginia C.

2013-01-01

Effective principals run effective schools--this much we know. Accurately measuring principal effectiveness, however, has long been an elusive goal for school administrators. In this indispensable book, author James H. Stronge details the steps and resources necessary for designing a comprehensive principal evaluation system that is based on sound…

Development and Early Piloting of a CanMEDS Competency-Based Feedback Tool for Surgical Grand Rounds.

PubMed

Fahim, Christine; Bhandari, Mohit; Yang, Ilun; Sonnadara, Ranil

2016-01-01

Grand rounds offer an excellent opportunity for the evaluation of medical expertise, and other competencies, such as communication and professionalism. The purpose of this study was to develop a tool that would facilitate the provision of formative feedback for grand rounds to improve learning. The resulting CanMEDS-based evaluation tool was piloted in an academic surgical department. This study employed the use of a 3-phase, qualitatively-focused, embedded mixed methods approach. In Phase 1, an intrinsic case study was conducted to identify preliminary themes. These findings were crystallized using a quantitative survey. Following interpretation of these data, a grand rounds evaluation tool was developed in Phase 2. The tool was piloted in the Phase 3 focus group. This study was piloted at an academic surgical center among members of the Department of Surgery, McMaster University, Ontario, Canada. Purposive sampling was used for this study. A total of n = 7 individuals participated in the Phase 1 interviews, and n = 24 participants completed the Phase 1 survey. Participants included a representative sample of medical students, residents, fellows, and staff. The tool was piloted among n = 19 participants. The proposed evaluation tool contains 13 Likert-scale questions and 2 open-ended questions. The tool outlines specific questions to assess grand rounds presenters within the structure of the 7 CanMEDS competency domains. "Evaluation fatigue" was identified as a major barrier in the willingness to provide effective feedback. Further, a number of factors regarding the preferred content, structure, and format of surgical grand rounds were identified. This pilot study presents a CanMEDS-specific evaluation tool that can be applied to surgical grand rounds. With the increasing adoption of competency-based medical education, comprehensive evaluation of surgical activities is required. This form provides a template for the development of competency-based evaluation tools for medical and surgical learning activities. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Systematic review of the properties of tools used to measure outcomes in anxiety intervention studies for children with autism spectrum disorders.

PubMed

Wigham, Sarah; McConachie, Helen

2014-01-01

Evidence about relevant outcomes is required in the evaluation of clinical interventions for children with autism spectrum disorders (ASD). However, to date, the variety of outcome measurement tools being used, and lack of knowledge about the measurement properties of some, compromise conclusions regarding the most effective interventions. This two-stage systematic review aimed to identify the tools used in studies evaluating interventions for anxiety for high-functioning children with ASD in middle childhood, and then to evaluate the tools for their appropriateness and measurement properties. Electronic databases including Medline, PsychInfo, Embase, and the Cochrane database and registers were searched for anxiety intervention studies for children with ASD in middle childhood. Articles examining the measurement properties of the tools used were then searched for using a methodological filter in PubMed, and the quality of the papers evaluated using the COSMIN checklist. Ten intervention studies were identified in which six tools measuring anxiety and one of overall symptom change were used as primary outcomes. One further tool was included as it is recommended for standard use in UK children's mental health services. Sixty three articles on the properties of the tools were evaluated for the quality of evidence, and the quality of the measurement properties of each tool was summarised. Overall three questionnaires were found robust in their measurement properties, the Spence Children's Anxiety Scale, its revised version - the Revised Children's Anxiety and Depression Scale, and also the Screen for Child Anxiety Related Emotional Disorders. Crucially the articles on measurement properties provided almost no evidence on responsiveness to change, nor on the validity of use of the tools for evaluation of interventions for children with ASD. CRD42012002684.

Systematic Review of the Properties of Tools Used to Measure Outcomes in Anxiety Intervention Studies for Children with Autism Spectrum Disorders

PubMed Central

Wigham, Sarah; McConachie, Helen

2014-01-01

Background Evidence about relevant outcomes is required in the evaluation of clinical interventions for children with autism spectrum disorders (ASD). However, to date, the variety of outcome measurement tools being used, and lack of knowledge about the measurement properties of some, compromise conclusions regarding the most effective interventions. Objectives This two-stage systematic review aimed to identify the tools used in studies evaluating interventions for anxiety for high-functioning children with ASD in middle childhood, and then to evaluate the tools for their appropriateness and measurement properties. Methods Electronic databases including Medline, PsychInfo, Embase, and the Cochrane database and registers were searched for anxiety intervention studies for children with ASD in middle childhood. Articles examining the measurement properties of the tools used were then searched for using a methodological filter in PubMed, and the quality of the papers evaluated using the COSMIN checklist. Results Ten intervention studies were identified in which six tools measuring anxiety and one of overall symptom change were used as primary outcomes. One further tool was included as it is recommended for standard use in UK children's mental health services. Sixty three articles on the properties of the tools were evaluated for the quality of evidence, and the quality of the measurement properties of each tool was summarised. Conclusions Overall three questionnaires were found robust in their measurement properties, the Spence Children's Anxiety Scale, its revised version – the Revised Children's Anxiety and Depression Scale, and also the Screen for Child Anxiety Related Emotional Disorders. Crucially the articles on measurement properties provided almost no evidence on responsiveness to change, nor on the validity of use of the tools for evaluation of interventions for children with ASD. PROSPERO Registration number CRD42012002684. PMID:24465519

Post-Flight Data Analysis Tool

NASA Technical Reports Server (NTRS)

George, Marina

2018-01-01

A software tool that facilitates the retrieval and analysis of post-flight data. This allows our team and other teams to effectively and efficiently analyze and evaluate post-flight data in order to certify commercial providers.

Concept mapping in a critical care orientation program: a pilot study to develop critical thinking and decision-making skills in novice nurses.

PubMed

Wahl, Stacy E; Thompson, Anita M

2013-10-01

Newly graduated registered nurses who were hired into a critical care intensive care unit showed a lack of critical thinking skills to inform their clinical decision-making abilities. This study evaluated the effectiveness of concept mapping as a teaching tool to improve critical thinking and clinical decision-making skills in novice nurses. A self-evaluation tool was administered before and after the learning intervention. The 25-item tool measured five key indicators of the development of critical thinking skills: problem recognition, clinical decision-making, prioritization, clinical implementation, and reflection. Statistically significant improvements were seen in 10 items encompassing all five indicators. Concept maps are an effective tool for educators to use in assisting novice nurses to develop their critical thinking and clinical decision-making skills. Copyright 2013, SLACK Incorporated.

Relation between different metal pollution criteria in sediments and its contribution on assessing toxicity.

PubMed

Alves, Cristina M; Ferreira, Carlos M H; Soares, Helena M V M

2018-05-14

Several tools have been developed and applied to evaluate the metal pollution status of sediments and predict their potential ecological risk assessment. To date, a comprehensive relationship between the information given by these sediment tools for predicting metal bioavailability and the effective toxicity observed is lacking. In this work, the possible inter-correlations between the data outcoming from using several qualitative evaluation tools of the sediment contamination (contamination factor, CF, the enrichment factor, EF, or the geoaccumulation index, Igeo), metal speciation on sediments (evaluated by the modified BCR sequential extraction procedure) and free metal concentrations in pore waters were studied. It was also our aim to evaluate if these assessment tools could be used for predicting the pore waters toxicity data as toxicity proxy. Principal component analysis and cluster analysis revealed that two quality indices used (CF and EF) were highly correlatable with the more labile fractions from BCR sediment speciation. However, neither of these parameters did correlate with the toxicity of pore waters measured by the chronic toxicity (72 h) in Pseudokirchneriella subcapitata. In contrast, the toxic effects of the given total metal load in sediments were better evaluated by using an additive metal approach using pore water free metal concentrations. Copyright © 2018 Elsevier Ltd. All rights reserved.

Cement bond evaluation method in horizontal wells using segmented bond tool

NASA Astrophysics Data System (ADS)

Song, Ruolong; He, Li

2018-06-01

Most of the existing cement evaluation technologies suffer from tool eccentralization due to gravity in highly deviated wells and horizontal wells. This paper proposes a correction method to lessen the effects of tool eccentralization on evaluation results of cement bond using segmented bond tool, which has an omnidirectional sonic transmitter and eight segmented receivers evenly arranged around the tool 2 ft from the transmitter. Using 3-D finite difference parallel numerical simulation method, we investigate the logging responses of centred and eccentred segmented bond tool in a variety of bond conditions. From the numerical results, we find that the tool eccentricity and channel azimuth can be estimated from measured sector amplitude. The average of the sector amplitude when the tool is eccentred can be corrected to the one when the tool is centred. Then the corrected amplitude will be used to calculate the channel size. The proposed method is applied to both synthetic and field data. For synthetic data, it turns out that this method can estimate the tool eccentricity with small error and the bond map is improved after correction. For field data, the tool eccentricity has a good agreement with the measured well deviation angle. Though this method still suffers from the low accuracy of calculating channel azimuth, the credibility of corrected bond map is improved especially in horizontal wells. It gives us a choice to evaluate the bond condition for horizontal wells using existing logging tool. The numerical results in this paper can provide aids for understanding measurements of segmented tool in both vertical and horizontal wells.

An Evaluation of the Effectiveness of Turnitin.Com as a Tool for Reducing Plagiarism in Graduate Student Term Papers

ERIC Educational Resources Information Center

Baker, Russell K.; Thornton, Barry; Adams, Michael

2008-01-01

Plagiarism is a continual problem in academia. Plagiarism-detection tools like Turnitin have been used for nearly ten years to help university faculty and administration combat this form of cheating (turnitin.com). This paper evaluates the difference in plagiarism levels in graduate-student term papers when students are not provided access to…

The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials.

PubMed

Yamato, Tie Parma; Maher, Chris; Koes, Bart; Moseley, Anne

2017-06-01

The Physiotherapy Evidence Database (PEDro) scale has been widely used to investigate methodological quality in physiotherapy randomized controlled trials; however, its validity has not been tested for pharmaceutical trials. The aim of this study was to investigate the validity and interrater reliability of the PEDro scale for pharmaceutical trials. The reliability was also examined for the Cochrane Back and Neck (CBN) Group risk of bias tool. This is a secondary analysis of data from a previous study. We considered randomized placebo controlled trials evaluating any pain medication for chronic spinal pain or osteoarthritis. Convergent validity was evaluated by correlating the PEDro score with the summary score of the CBN risk of bias tool. The construct validity was tested using a linear regression analysis to determine the degree to which the total PEDro score is associated with treatment effect sizes, journal impact factor, and the summary score for the CBN risk of bias tool. The interrater reliability was estimated using the Prevalence and Bias Adjusted Kappa coefficient and 95% confidence interval (CI) for the PEDro scale and CBN risk of bias tool. Fifty-three trials were included, with 91 treatment effect sizes included in the analyses. The correlation between PEDro scale and CBN risk of bias tool was 0.83 (95% CI 0.76-0.88) after adjusting for reliability, indicating strong convergence. The PEDro score was inversely associated with effect sizes, significantly associated with the summary score for the CBN risk of bias tool, and not associated with the journal impact factor. The interrater reliability for each item of the PEDro scale and CBN risk of bias tool was at least substantial for most items (>0.60). The intraclass correlation coefficient for the PEDro score was 0.80 (95% CI 0.68-0.88), and for the CBN, risk of bias tool was 0.81 (95% CI 0.69-0.88). There was evidence for the convergent and construct validity for the PEDro scale when used to evaluate methodological quality of pharmacological trials. Both risk of bias tools have acceptably high interrater reliability. Copyright © 2017 Elsevier Inc. All rights reserved.

Energy evaluation of protection effectiveness of anti-vibration gloves.

PubMed

Hermann, Tomasz; Dobry, Marian Witalis

2017-09-01

This article describes an energy method of assessing protection effectiveness of anti-vibration gloves on the human dynamic structure. The study uses dynamic models of the human and the glove specified in Standard No. ISO 10068:2012. The physical models of human-tool systems were developed by combining human physical models with a power tool model. The combined human-tool models were then transformed into mathematical models from which energy models were finally derived. Comparative energy analysis was conducted in the domain of rms powers. The energy models of the human-tool systems were solved using numerical simulation implemented in the MATLAB/Simulink environment. The simulation procedure demonstrated the effectiveness of the anti-vibration glove as a method of protecting human operators of hand-held power tools against vibration. The desirable effect is achieved by lowering the flow of energy in the human-tool system when the anti-vibration glove is employed.

Evaluation of targeted and untargeted effects-based monitoring tools to assess impacts of contaminants of emerging concern on fish in the South Platte River, CO

EPA Science Inventory

Rivers in the arid Western United States face increasing influences from anthropogenic contaminants due to population growth, urbanization, and drought. To better understand and more effectively track the impacts of these contaminants, biologically-based monitoring tools are incr...

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Using Simulation to Teach About Poverty in Nursing Education: A Review of Available Tools.

PubMed

Reid, Carol A; Evanson, Tracy A

2016-01-01

Poverty is one of the most significant social determinants of health, and as such, it is imperative that nurses have an understanding of the impact that living in poverty has upon one's life and health. A lack of such understanding will impede nurses from providing care that is patient centered, treats all patients fairly, and advocates for social justice. It is essential that nursing educators assure that poverty-related content and effective teaching strategies are used in nursing curricula in order to help students develop this understanding. Several poverty-simulation tools are available and may be able to assist with development of accurate knowledge, skills, and attitudes. Unfortunately, little evidence exists to evaluate most poverty simulation tools. This article will provide an introduction to several poverty-related simulation tools, discuss any related research that evaluates their effectiveness, and make recommendations for integration of such simulation tools into nursing curricula. Copyright © 2016 Elsevier Inc. All rights reserved.

Positioning Mentoring as a Coach Development Tool: Recommendations for Future Practice and Research

ERIC Educational Resources Information Center

McQuade, Sarah; Davis, Louise; Nash, Christine

2015-01-01

Current thinking in coach education advocates mentoring as a development tool to connect theory and practice. However, little empirical evidence exists to evaluate the effectiveness of mentoring as a coach development tool. Business, education, and nursing precede the coaching industry in their mentoring practice, and research findings offered in…

Chapter 13: Tools for analysis

Treesearch

William Elliot; Kevin Hyde; Lee MacDonald; James McKean

2007-01-01

This chapter presents a synthesis of current computer modeling tools that are, or could be, adopted for use in evaluating the cumulative watershed effects of fuel management. The chapter focuses on runoff, soil erosion and slope stability predictive tools. Readers should refer to chapters on soil erosion and stability for more detailed information on the physical...

Perception, Cognition, and Effectiveness of Visualizations with Applications in Science and Engineering

NASA Astrophysics Data System (ADS)

Borkin, Michelle A.

Visualization is a powerful tool for data exploration and analysis. With data ever-increasing in quantity and becoming integrated into our daily lives, having effective visualizations is necessary. But how does one design an effective visualization? To answer this question we need to understand how humans perceive, process, and understand visualizations. Through visualization evaluation studies we can gain deeper insight into the basic perception and cognition theory of visualizations, both through domain-specific case studies as well as generalized laboratory experiments. This dissertation presents the results of four evaluation studies, each of which contributes new knowledge to the theory of perception and cognition of visualizations. The results of these studies include a deeper clearer understanding of how color, data representation dimensionality, spatial layout, and visual complexity affect a visualization's effectiveness, as well as how visualization types and visual attributes affect the memorability of a visualization. We first present the results of two domain-specific case study evaluations. The first study is in the field of biomedicine in which we developed a new heart disease diagnostic tool, and conducted a study to evaluate the effectiveness of 2D versus 3D data representations as well as color maps. In the second study, we developed a new visualization tool for filesystem provenance data with applications in computer science and the sciences more broadly. We additionally developed a new time-based hierarchical node grouping method. We then conducted a study to evaluate the effectiveness of the new tool with its radial layout versus the conventional node-link diagram, and the new node grouping method. Finally, we discuss the results of two generalized studies designed to understand what makes a visualization memorable. In the first evaluation we focused on visualization memorability and conducted an online study using Amazon's Mechanical Turk with hundreds of users and thousands of visualizations. For the second evaluation we designed an eye-tracking laboratory study to gain insight into precisely which elements of a visualization contribute to memorability as well as visualization recognition and recall.

Cost Effectiveness Ratio: Evaluation Tool for Comparing the Effectiveness of Similar Extension Programs

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2015-01-01

Extension educators have been challenged to be cost effective in their educational programming. The cost effectiveness ratio is a versatile evaluation indicator for Extension educators to compare the cost of achieving a unit of outcomes or educating a client in similar educational programs. This article describes the cost effectiveness ratio and…

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

RAPID OPTICAL SCREEN TOOL (ROST™) - INNOVATIVE TECHNOLOGY EVALUATION REPORT

EPA Science Inventory

In August 1994, a demonstration of cone penetrometer-mounted sensor technologies took place to evaluate their effectiveness in sampling and analyzing the physical and chemical characteristics of subsurface soil at hazardous waste sites. The effectiveness of each technology was ev...

Knowledge translation tools for parents on child health topics: a scoping review.

PubMed

Albrecht, Lauren; Scott, Shannon D; Hartling, Lisa

2017-09-29

An emerging field of knowledge translation (KT) research has begun to focus on health consumers, particularly in child health. KT tools provide health consumers with research knowledge to inform health decision-making and may foster 'effective consumers'. Thus, the purpose of this scoping review was to describe the state of the field of previously published effectiveness research on child health-related KT tools for parents/caregivers to understand the evidence-base, identify gaps, and guide future research efforts. A health research librarian developed and implemented search strategies in 8 databases. One reviewer conducted screening using pre-determined criteria. A second reviewer verified 10% of screening decisions. Data extraction was performed by one reviewer. A descriptive analysis was conducted and included patient-important outcome classification, WIDER Recommendation checklist, and methodological quality assessment. Seven thousand nine hundred fifty two independent titles and abstracts were reviewed, 2267 full-text studies were retrieved and reviewed, and 18 articles were included in the final data set. A variety of KT tools, including single- (n = 10) and multi-component tools (n = 10), were evaluated spanning acute (n = 4), chronic (n = 5) and public/population health (n = 9) child health topics. Study designs included: cross-sectional (n = 4), before-after (n = 1), controlled before-after (n = 2), cohort (n = 1), and RCTs (n = 10). The KT tools were evaluated via single primary outcome category (n = 11) and multiple primary outcome categories (n = 7). Two studies demonstrated significant positive effects on primary outcome categories; the remaining studies demonstrated mixed effects (n = 9) and no effect (n = 3). Overall, methodological quality was poor; studies lacked a priori protocols (n = 18) and sample size calculations (n = 13). Overall, intervention reporting was also poor; KT tools lacked description of theoretical underpinnings (n = 14), end-user engagement (n = 13), and preliminary research (n = 9) to inform the current effectiveness evaluation. A number of child health-related knowledge translation tools have been developed for parents/caregivers. However, numerous outcomes were used to assess impact and there is limited evidence demonstrating their effectiveness. Moreover, the methodological rigor and reporting of effectiveness studies is limited. Careful tool development involving end-users and preliminary research, including usability testing and mixed methods, prior to large-scale studies may be important to advance the science of KT for health consumers.

Sensitivity of simulated conservation practice effectiveness to representation of field and in-stream processes in the Little River Watershed

USDA-ARS?s Scientific Manuscript database

Evaluating the effectiveness of conservation practices (CPs) is an important step to achieving efficient and successful water quality management. Watershed-scale simulation models can provide useful and convenient tools for this evaluation, but simulated conservation practice effectiveness should be...

Optimizing the ASC WAN: evaluating network performance tools for comparing transport protocols.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lydick, Christopher L.

2007-07-01

The Advanced Simulation & Computing Wide Area Network (ASC WAN), which is a high delay-bandwidth network connection between US Department of Energy National Laboratories, is constantly being examined and evaluated for efficiency. One of the current transport-layer protocols which is used, TCP, was developed for traffic demands which are different from that on the ASC WAN. The Stream Control Transport Protocol (SCTP), on the other hand, has shown characteristics which make it more appealing to networks such as these. Most important, before considering a replacement for TCP on any network, a testing tool that performs well against certain criteria needsmore » to be found. In order to try to find such a tool, two popular networking tools (Netperf v.2.4.3 & v.2.4.6 (OpenSS7 STREAMS), and Iperf v.2.0.6) were tested. These tools implement both TCP and SCTP and were evaluated using four metrics: (1) How effectively can the tool reach a throughput near the bandwidth? (2) How much of the CPU does the tool utilize during operation? (3) Is the tool freely and widely available? And, (4) Is the tool actively developed? Following the analysis of those tools, this paper goes further into explaining some recommendations and ideas for future work.« less

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

Analyzing for Individual Differences in Evaluating Compensatory Education Programs. Occasional Paper No. 27.

ERIC Educational Resources Information Center

Krus, Patricia H.

Trait-Treatment Interaction (TTI), a research method for observing experimental effects of treatments on subjects of different aptitudes and learning characteristics, is suggested as an effective evaluation tool to provide evaluators and educators in compensatory education programs with information about which program is best for different kinds…

Assessment of the Aviation Environmental Design Tool

DOT National Transportation Integrated Search

2009-06-29

A comprehensive Tools Suite to allow for : thorough evaluation of the environmental effects and impacts : of aviation is currently being developed by the U.S. This suite : consists of the Environmental Design Space (EDS), the : Aviation Environmental...

Engaging stakeholders to design a comparative effectiveness trial in children with uncontrolled asthma

PubMed Central

Erwin, Kim; Martin, Molly A; Flippin, Tara; Norell, Sarah; Shadlyn, Ariana; Yang, Jie; Falco, Paula; Rivera, Jaime; Ignoffo, Stacy; Kumar, Rajesh; Margellos-Anast, Helen; McDermott, Michael; McMahon, Kate; Mosnaim, Giselle; Nyenhuis, Sharmilee M; Press, Valerie G; Ramsay, Jessica E; Soyemi, Kenneth; Thompson, Trevonne M; Krishnan, Jerry A

2016-01-01

Aim: To present the methods and outcomes of stakeholder engagement in the development of interventions for children presenting to the emergency department (ED) for uncontrolled asthma. Methods: We engaged stakeholders (caregivers, physicians, nurses, administrators) from six EDs in a three-phase process to: define design requirements; prototype and refine; and evaluate. Results: Interviews among 28 stakeholders yielded themes regarding in-home asthma management practices and ED discharge experiences. Quantitative and qualitative evaluation showed strong preference for the new discharge tool over current tools. Conclusion: Engaging end-users in contextual inquiry resulted in CAPE (CHICAGO Action Plan after ED discharge), a new stakeholder-balanced discharge tool, which is being tested in a multicenter comparative effectiveness trial. PMID:26690579

Soak Up the Rain New England Webinar Series: National ...

EPA Pesticide Factsheets

Presenters will provide an introduction to the most recent EPA green infrastructure tools to R1 stakeholders; and their use in making decisions about implementing green infrastructure. We will discuss structuring your green infrastructure decision, finding appropriate information and tools, evaluating options and selecting the right Best Management Practices mix for your needs.WMOST (Watershed Management Optimization Support Tool)- for screening a wide range of practices for cost-effectiveness in achieving watershed or water utilities management goals.GIWiz (Green Infrastructure Wizard)- a web application connecting communities to EPA Green Infrastructure tools and resources.Opti-Tool-designed to assist in developing technically sound and optimized cost-effective Stormwater management plans. National Stormwater Calculator- a desktop application for estimating the impact of land cover change and green infrastructure controls on stormwater runoff. DASEES-GI (Decision Analysis for a Sustainable Environment, Economy, and Society) – a framework for linking objectives and measures with green infrastructure methods. Presenters will provide an introduction to the most recent EPA green infrastructure tools to R1 stakeholders; and their use in making decisions about implementing green infrastructure. We will discuss structuring your green infrastructure decision, finding appropriate information and tools, evaluating options and selecting the right Best Management Pr

Surface roughness model based on force sensors for the prediction of the tool wear.

PubMed

de Agustina, Beatriz; Rubio, Eva María; Sebastián, Miguel Ángel

2014-04-04

In this study, a methodology has been developed with the objective of evaluating the surface roughness obtained during turning processes by measuring the signals detected by a force sensor under the same cutting conditions. In this way, the surface quality achieved along the process is correlated to several parameters of the cutting forces (thrust forces, feed forces and cutting forces), so the effect that the tool wear causes on the surface roughness is evaluated. In a first step, the best cutting conditions (cutting parameters and radius of tool) for a certain quality surface requirement were found for pieces of UNS A97075. Next, with this selection a model of surface roughness based on the cutting forces was developed for different states of wear that simulate the behaviour of the tool throughout its life. The validation of this model reveals that it was effective for approximately 70% of the surface roughness values obtained.

Common Evaluation Tools across Multi-State Programs: A Study of Parenting Education and Youth Engagement Programs in Children, Youth, and Families At-Risk

ERIC Educational Resources Information Center

Payne, Pamela B.; McDonald, Daniel A.

2015-01-01

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

Improving the Efficiency and Quality of the Value Assessment Process for Companion Diagnostic Tests: The Companion test Assessment Tool (CAT).

PubMed

Canestaro, William J; Pritchard, Daryl E; Garrison, Louis P; Dubois, Robert; Veenstra, David L

2015-08-01

Companion diagnostic tests (CDTs) have emerged as a vital technology in the effective use of an increasing number of targeted drug therapies. Although CDTs can offer a multitude of potential benefits, assessing their value within a health technology appraisal process can be challenging because of a complex array of factors that influence clinical and economic outcomes. To develop a user-friendly tool to assist managed care and other health care decision makers in screening companion tests and determining whether an intensive technology review is necessary and, if so, where the review should be focused to improve efficiency. First, we conducted a systematic literature review of CDT cost-effectiveness studies to identify value drivers. Second, we conducted key informant interviews with a diverse group of stakeholders to elicit feedback and solicit any additional value drivers and identify desirable attributes for an evidence review tool. A draft tool was developed based on this information that captured value drivers, usability features, and had a particular focus on practical use by nonexperts. Finally, the tool was pilot tested with test developers and managed care evidence evaluators to assess face-validity and usability. The tool was also evaluated using several diverse examples of existing companion diagnostics and refined accordingly. We identified 65 cost-effectiveness studies of companion diagnostic technologies. The following factors were most commonly identified as value drivers from our literature review: clinical validity of testing; efficacy, safety, and cost of baseline and alternative treatments; cost and mortality of health states; and biomarker prevalence and testing cost. Stakeholders identified the following additional factors that they believed influenced the overall value of a companion test: regulatory status, actionability, utility, and market penetration. These factors were used to maximize the efficiency of the evidence review process. Stakeholders also stated that a tool should be easy to use and time efficient. Cognitive interviews with stakeholders led to minor changes in the draft tool to improve usability and relevance. The final tool consisted of 4 sections: (1) eligibility for review (2 questions), (2) prioritization of review (3 questions), (3) clinical review (3 questions), and (4) economic review (5 questions). Although the evaluation of CDTs can be challenging because of limited evidence and the added complexity of incorporating a diagnostic test into drug treatment decisions, using a pragmatic tool to identify tests that do not need extensive evaluation may improve the efficiency and effectiveness of CDT value assessments.

A Tool for the Automated Design and Evaluation of Habitat Interior Layouts

NASA Technical Reports Server (NTRS)

Simon, Matthew A.; Wilhite, Alan W.

2013-01-01

The objective of space habitat design is to minimize mass and system size while providing adequate space for all necessary equipment and a functional layout that supports crew health and productivity. Unfortunately, development and evaluation of interior layouts is often ignored during conceptual design because of the subjectivity and long times required using current evaluation methods (e.g., human-in-the-loop mockup tests and in-depth CAD evaluations). Early, more objective assessment could prevent expensive design changes that may increase vehicle mass and compromise functionality. This paper describes a new interior design evaluation method to enable early, structured consideration of habitat interior layouts. This interior layout evaluation method features a comprehensive list of quantifiable habitat layout evaluation criteria, automatic methods to measure these criteria from a geometry model, and application of systems engineering tools and numerical methods to construct a multi-objective value function measuring the overall habitat layout performance. In addition to a detailed description of this method, a C++/OpenGL software tool which has been developed to implement this method is also discussed. This tool leverages geometry modeling coupled with collision detection techniques to identify favorable layouts subject to multiple constraints and objectives (e.g., minimize mass, maximize contiguous habitable volume, maximize task performance, and minimize crew safety risks). Finally, a few habitat layout evaluation examples are described to demonstrate the effectiveness of this method and tool to influence habitat design.

Urban Transportation Planning Short Course: Evaluation of Alternative Transportation Systems.

ERIC Educational Resources Information Center

Federal Highway Administration (DOT), Washington, DC.

This urban transportation pamphlet delves into the roles of policy groups and technical staffs in evaluating alternative transportation plans, evaluation criteria, systems to evaluate, and evaluation procedures. The introduction admits the importance of subjective, but informed, judgment as an effective tool in weighing alternative transportation…

Automated Geospatial Watershed Assessment Tool (AGWA): Applications for Assessing the Impact of Urban Growth and the use of Low Impact Development Practices.

EPA Science Inventory

New tools and functionality have been incorporated into the Automated Geospatial Watershed Assessment Tool (AGWA) to assess the impact of urban growth and evaluate the effects of low impact development (LID) practices. AGWA (see: www.tucson.ars.ag.gov/agwa or http://www.epa.gov...

Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis.

PubMed

Bergeron, Mathieu; Lortie, Catherine L; Guitton, Matthieu J

2015-01-01

Classical peripheral vestibular disorders rehabilitation is a long and costly process. While virtual reality settings have been repeatedly suggested to represent possible tools to help the rehabilitation process, no systematic study had been conducted so far. We systematically reviewed the current literature to analyze the published protocols documenting the use of virtual reality settings for peripheral vestibular disorders rehabilitation. There is an important diversity of settings and protocols involving virtual reality settings for the treatment of this pathology. Evaluation of the symptoms is often not standardized. However, our results unveil a clear effect of virtual reality settings-based rehabilitation of the patients' symptoms, assessed by objectives tools such as the DHI (mean decrease of 27 points), changing symptoms handicap perception from moderate to mild impact on life. Furthermore, we detected a relationship between the duration of the exposure to virtual reality environments and the magnitude of the therapeutic effects, suggesting that virtual reality treatments should last at least 150 minutes of cumulated exposure to ensure positive outcomes. Virtual reality offers a pleasant and safe environment for the patient. Future studies should standardize evaluation tools, document putative side effects further, compare virtual reality to conventional physical therapy, and evaluate economical costs/benefits of such strategies.

Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis

PubMed Central

Bergeron, Mathieu; Lortie, Catherine L.; Guitton, Matthieu J.

2015-01-01

Classical peripheral vestibular disorders rehabilitation is a long and costly process. While virtual reality settings have been repeatedly suggested to represent possible tools to help the rehabilitation process, no systematic study had been conducted so far. We systematically reviewed the current literature to analyze the published protocols documenting the use of virtual reality settings for peripheral vestibular disorders rehabilitation. There is an important diversity of settings and protocols involving virtual reality settings for the treatment of this pathology. Evaluation of the symptoms is often not standardized. However, our results unveil a clear effect of virtual reality settings-based rehabilitation of the patients' symptoms, assessed by objectives tools such as the DHI (mean decrease of 27 points), changing symptoms handicap perception from moderate to mild impact on life. Furthermore, we detected a relationship between the duration of the exposure to virtual reality environments and the magnitude of the therapeutic effects, suggesting that virtual reality treatments should last at least 150 minutes of cumulated exposure to ensure positive outcomes. Virtual reality offers a pleasant and safe environment for the patient. Future studies should standardize evaluation tools, document putative side effects further, compare virtual reality to conventional physical therapy, and evaluate economical costs/benefits of such strategies. PMID:26556560

Handling Qualities Evaluation of Pilot Tools for Spacecraft Docking in Earth Orbit

NASA Technical Reports Server (NTRS)

Bilimoria, Karl D.; Mueller, Eric; Frost, Chad

2009-01-01

A new generation of spacecraft is now under development by NASA to replace the Space Shuttle and return astronauts to the Moon. These spacecraft will have a manual control capability for several mission tasks, and the ease and precision with which pilots can execute these tasks will have an important effect on mission risk and training costs. This paper focuses on the handling qualities of a spacecraft based on dynamics similar to that of the Crew Exploration Vehicle, during the last segment of the docking task with a space station in low Earth orbit. A previous study established that handling qualities for this task degrade significantly as the level of translation-into-rotation coupling increases. The goal of this study is to evaluate the efficacy of various pilot aids designed to mitigate the handling qualities degradation caused by this coupling. Four pilot tools were ev adluaetead:d-band box/indicator, flight-path marker, translation guidance cues, and feed-forward control. Each of these pilot tools improved handling qualities, generally with greater improvements resulting from using these tools in combination. A key result of this study is that feedforward control effectively counteracts coupling effects, providing solid Level 1 handling qualities for the spacecraft configuration evaluated.

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

The Effects of a Statewide Evaluation Initiative in Gifted Education on Practitioner Knowledge, Concerns, and Program Documentation

ERIC Educational Resources Information Center

Robinson, Ann; Cotabish, Alicia; Wood, Betty K.; O'Tuel, Fran S.

2014-01-01

When well-considered and grounded in current knowledge, program evaluations of services to gifted learners can be a powerful tool for increasing practitioners' knowledge and self-efficacy, and for effecting positive programmatic changes. The Arkansas Evaluation Initiative (AEI) in Gifted Education, a Jacob K. Javits-funded project, was implemented…

Gathering Teacher's Perceptions of Evaluator Feedback

ERIC Educational Resources Information Center

Cherasaro, Trudy L.; Brodersen, Marc

2016-01-01

In response to initiatives to increase educator effectiveness states throughout the nation are placing greater emphasis on teacher evaluation tools that differentiate teacher effectiveness and include timely and constructive feedback. One of the three principles of the Elementary and Secondary Education Act (ESEA) flexibility waivers requires that…

Measuring ability to assess claims about treatment effects: the development of the 'Claim Evaluation Tools'.

PubMed

Austvoll-Dahlgren, Astrid; Semakula, Daniel; Nsangi, Allen; Oxman, Andrew David; Chalmers, Iain; Rosenbaum, Sarah; Guttersrud, Øystein

2017-05-17

To describe the development of the Claim Evaluation Tools, a set of flexible items to measure people's ability to assess claims about treatment effects. Methodologists and members of the community (including children) in Uganda, Rwanda, Kenya, Norway, the UK and Australia. In the iterative development of the items, we used purposeful sampling of people with training in research methodology, such as teachers of evidence-based medicine, as well as patients and members of the public from low-income and high-income countries. Development consisted of 4 processes: (1) determining the scope of the Claim Evaluation Tools and development of items; (2) expert item review and feedback (n=63); (3) cognitive interviews with children and adult end-users (n=109); and (4) piloting and administrative tests (n=956). The Claim Evaluation Tools database currently includes a battery of multiple-choice items. Each item begins with a scenario which is intended to be relevant across contexts, and which can be used for children (from age 10  and above), adult members of the public and health professionals. People with expertise in research methods judged the items to have face validity, and end-users judged them relevant and acceptable in their settings. In response to feedback from methodologists and end-users, we simplified some text, explained terms where needed, and redesigned formats and instructions. The Claim Evaluation Tools database is a flexible resource from which researchers, teachers and others can design measurement instruments to meet their own requirements. These evaluation tools are being managed and made freely available for non-commercial use (on request) through Testing Treatments interactive (testingtreatments.org). PACTR201606001679337 and PACTR201606001676150; Pre-results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Application of digital human modeling and simulation for vision analysis of pilots in a jet aircraft: a case study.

PubMed

Karmakar, Sougata; Pal, Madhu Sudan; Majumdar, Deepti; Majumdar, Dhurjati

2012-01-01

Ergonomic evaluation of visual demands becomes crucial for the operators/users when rapid decision making is needed under extreme time constraint like navigation task of jet aircraft. Research reported here comprises ergonomic evaluation of pilot's vision in a jet aircraft in virtual environment to demonstrate how vision analysis tools of digital human modeling software can be used effectively for such study. Three (03) dynamic digital pilot models, representative of smallest, average and largest Indian pilot population were generated from anthropometric database and interfaced with digital prototype of the cockpit in Jack software for analysis of vision within and outside the cockpit. Vision analysis tools like view cones, eye view windows, blind spot area, obscuration zone, reflection zone etc. were employed during evaluation of visual fields. Vision analysis tool was also used for studying kinematic changes of pilot's body joints during simulated gazing activity. From present study, it can be concluded that vision analysis tool of digital human modeling software was found very effective in evaluation of position and alignment of different displays and controls in the workstation based upon their priorities within the visual fields and anthropometry of the targeted users, long before the development of its physical prototype.

A method for building evaluation competency among community-based organizations.

PubMed

Kelly, Cheryl M; LaRose, Jessi; Scharff, Darcell P

2014-05-01

Community-based organizations often lack the capacity (e.g., time, staff, skills) to effectively evaluate programs, policies, and environmental changes. Providing evaluation technical assistance and training can be an effective and feasible way to build individual evaluation competency. The purpose of this article is to present a practical approach and related tools that can be used by evaluators and others (e.g., academic partners, funders) providing assistance to build evaluation skills in community organizations. The approach described was developed in collaboration with local universities and a regional health foundation to provide intensive technical support to 19 community-based organizations awarded funding to implement obesity prevention projects. Technical assistance processes and tools were designed to be tailored to organizations' capacity and needs and can be used as templates by others who provide technical assistance. Evaluators, funders, and academic partners can use lessons learned from this experience to help shape and implement evaluation technical assistance approaches with community-based organizations.

Evaluation of work zone enhancement software programs.

DOT National Transportation Integrated Search

2009-09-01

The Missouri Department of Transportation (MoDOT) is looking for software tools that can assist in : developing effective plans to manage and communicate work zone activities. QuickZone, CA4PRS, : VISSIM, and Spreadsheet models are the tools that MoD...

A hand-ergonomics training kit: development and evaluation of a package to support improved awareness and critical thinking.

PubMed

Garmer, Karin; Sperling, Lena; Forsberg, Anette

2002-01-01

A need for a hand-ergonomics training kit has been identified to increase critical thinking concerning choice of hand tools. This study deals with the design, use and evaluation of a hand-ergonomics training kit for use in ergonomics training programmes. The effects on awareness of hand ergonomics among training course participants have been evaluated by means of a questionnaire and interviews at a car production plant in Sweden. The evaluation was carried out about one and a half years after training with the hand-ergonomics training kit. The training kit consists of a guide to practical exercises, equipment for measuring hand size and strength, examples of hand tools for use in practical exercises, equipment for testing and evaluating the hand tools and checklists and judgement forms for qualitative evaluation. In addition, the kit contains relevant scientifically based reference reports on hand ergonomics. The evaluation showed that the practical exercises with the hand-ergonomic training kit had, to a remarkable extent, increased individuals' awareness of anthropometric differences and of the importance of ergonomically well-designed hand tools. After the practical exercises with the training kit, communication within the plant when choosing hand tools seems to be based on objective criteria to a higher degree, however, the results indicate that this communication could be further improved.

Design and testing of classroom and clinical teaching evaluation tools for nursing education.

PubMed

Emerson, Roberta J; Records, Kathie

2007-01-01

Student evaluations of teaching provide administrators an overall picture of the effectiveness of personnel and contribute data for promotion and merit decisions. These evaluations must be assessed for their relevance, validity, and reliability. This paper describes the development process and psychometric testing for clinical (n = 149) and didactic (n = 148) student evaluation of teaching forms for undergraduate and graduate courses in one college of nursing. Validity and reliability results were quite strong for the instruments, both of which evidenced a one-factor solution with factor loadings ranging from .68-.88 and Cronbach's alphas of .96 (Classroom) and .95 (Clinical). The clinical and classroom evaluation tools are relatively short, decreasing the burden on students who need to complete the instruments for multiple instructors in any one semester. Initial testing of the psychometric properties of the tools supports their continued use in colleges of nursing.

Effective Tools and Resources from the MAVEN Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Mason, T.

2015-12-01

Since 2010, NASA's Mars Atmosphere and Volatile Evolution (MAVEN) Education and Public Outreach (E/PO) team has developed and implemented a robust and varied suite of projects, serving audiences of all ages and diverse backgrounds from across the country. With a program designed to reach formal K-12 educators and students, afterschool and summertime communities, museum docents, journalists, and online audiences, we have incorporated an equally varied approach to developing tools, resources, and evaluation methods to specifically reach each target population and to determine the effectiveness of our efforts. This poster will highlight some of the tools and resources we have developed to share the complex science and engineering of the MAVEN mission, as well as initial evaluation results and lessons-learned from each of our E/PO projects.

Teaching tactical combat casualty care using the TC3 sim game-based simulation: a study to measure training effectiveness.

PubMed

Sotomayor, Teresita M

2010-01-01

The effectiveness of games as instructional tools has been debated over the past several decades. This is due to the lack of empirical data to support such claims. The US ARMY developed a game-based simulation to support Tactical Combat Casualty Care (TCCC) Training. The TC3 Game based Simulation is a first person game that allows a Soldier to play the role of a combat medic during an infantry squad mission in an urban environment. This research documents results from a training effectiveness evaluation conducted at the Department of Combat Medic Training (Ft Sam Houston) in an effort to explore the capability of the game based simulation as a potential tool to support the TCCC program of instruction. Reaction to training, as well as, acquisition of knowledge and transfer of skills were explored using Kirkpatrick's Model of Training Effectiveness Evaluation. Results from the evaluation are discussed.

Development and psychometric evaluation of the "Neurosurgical Evaluation of Attitudes towards simulation Training" (NEAT) tool for use in neurosurgical education and training.

PubMed

Kirkman, Matthew A; Muirhead, William; Nandi, Dipankar; Sevdalis, Nick

2014-01-01

Neurosurgical simulation training is becoming increasingly popular. Attitudes toward simulation among residents can contribute to the effectiveness of simulation training, but such attitudes remain poorly explored in neurosurgery with no psychometrically proven measure in the literature. The aim of the present study was to evaluate prospectively a newly developed tool for this purpose: the Neurosurgical Evaluation of Attitudes towards simulation Training (NEAT). The NEAT tool was prospectively developed in 2 stages and psychometrically evaluated (validity and reliability) in 2 administrations with the same participants. The tool comprises a questionnaire with 9 Likert scale items and 2 free-text sections assessing attitudes toward simulation in neurosurgery. The evaluation was completed with 31 neurosurgery residents in London, United Kingdom, who were generally favorable toward neurosurgical simulation. The internal consistency of the questionnaire was high, as demonstrated by the overall Cronbach α values (α=0.899 and α=0.955). All but 2 questionnaire items had "substantial" or "almost perfect" test-retest reliability following repeated survey administrations (median Pearson r correlation=0.688; range, 0.248-0.841). NEAT items were well correlated with each other on both occasions, showing good validity of content within the NEAT tool. There was no significant relationship between either gender or length of neurosurgical experience and item ratings. NEAT is the first psychometrically evaluated tool for evaluating attitudes toward simulation in neurosurgery. Further implementation of NEAT is required in wider neurosurgical populations to establish whether specific population groups differ. Use of NEAT in studies of neurosurgical simulation could offer an additional outcome measure to performance metrics, permitting evaluation of the impact of neurosurgical simulation on attitudes toward simulation both between participants and within the same participants over time. Copyright © 2014 Elsevier Inc. All rights reserved.

Education research: evaluating the use of podcasting for residents during EEG instruction: a pilot study.

PubMed

Bensalem-Owen, Meriem; Chau, Destiny F; Sardam, Sean C; Fahy, Brenda G

2011-08-23

Educational methods for residents are shifting toward greater learner independence aided by technological advances. A Web-based program using a podcast was created for resident EEG instruction, replacing conventional didactics. The EEG curriculum also consisted of EEG interpretations under the tutelage of a neurophysiologist. This pilot study aimed to objectively evaluate the effectiveness of the podcast as a new teaching tool. A podcast for resident EEG instruction was implemented on the Web, replacing the traditional lecture. After Institutional Review Board approval, consent was obtained from the participating residents. Using 25-question evaluation tools, participants were assessed at baseline before any EEG instruction, and reassessed after podcasting and after 10 clinical EEG exposures. Each 25-item evaluation tool contained tracings used for clinical EEG interpretations. Scores after podcast training were also compared to scores after traditional didactic training from a previous study among anesthesiology trainees. Ten anesthesiology residents completed the study. The mean scores with standard deviations are 9.50 ± 2.92 at baseline, 13.40 ± 3.31 (p = 0.034) after the podcast, and 16.20 ± 1.87 (p = 0.019) after interpreting 10 EEGs. No differences were noted between the mean educational tool scores for those who underwent podcasting training compared to those who had undergone traditional didactic training. In this pilot study, podcast training was as effective as the prior conventional lecture in meeting the curricular goals of increasing EEG knowledge after 10 EEG interpretations as measured by assessment tools.

[Blended-learning in psychosomatics and psychotherapy - Increasing the satisfaction and knowledge of students with a web-based e-learning tool].

PubMed

Ferber, Julia; Schneider, Gudrun; Havlik, Linda; Heuft, Gereon; Friederichs, Hendrik; Schrewe, Franz-Bernhard; Schulz-Steinel, Andrea; Burgmer, Markus

2014-01-01

To improve the synergy of established methods of teaching, the Department of Psychosomatics and Psychotherapy, University Hospital Münster, developed a web-based elearning tool using video clips of standardized patients. The effect of this blended-learning approach was evaluated. A multiple-choice test was performed by a naive (without the e-learning tool) and an experimental (with the tool) cohort of medical students to test the groups' expertise in psychosomatics. In addition, participants' satisfaction with the new tool was evaluated (numeric rating scale of 0-10). The experimental cohort was more satisfied with the curriculum and more interested in psychosomatics. Furthermore, the experimental cohort scored significantly better in the multiple-choice test. The new tool proved to be an important addition to the classical curriculum as a blended-learning approach which improves students' satisfaction and knowledge in psychosomatics.

A GIS Tool for evaluating and improving NEXRAD and its application in distributed hydrologic modeling

NASA Astrophysics Data System (ADS)

Zhang, X.; Srinivasan, R.

2008-12-01

In this study, a user friendly GIS tool was developed for evaluating and improving NEXRAD using raingauge data. This GIS tool can automatically read in raingauge and NEXRAD data, evaluate the accuracy of NEXRAD for each time unit, implement several geostatistical methods to improve the accuracy of NEXRAD through raingauge data, and output spatial precipitation map for distributed hydrologic model. The geostatistical methods incorporated in this tool include Simple Kriging with varying local means, Kriging with External Drift, Regression Kriging, Co-Kriging, and a new geostatistical method that was newly developed by Li et al. (2008). This tool was applied in two test watersheds at hourly and daily temporal scale. The preliminary cross-validation results show that incorporating raingauge data to calibrate NEXRAD can pronouncedly change the spatial pattern of NEXRAD and improve its accuracy. Using different geostatistical methods, the GIS tool was applied to produce long term precipitation input for a distributed hydrologic model - Soil and Water Assessment Tool (SWAT). Animated video was generated to vividly illustrate the effect of using different precipitation input data on distributed hydrologic modeling. Currently, this GIS tool is developed as an extension of SWAT, which is used as water quantity and quality modeling tool by USDA and EPA. The flexible module based design of this tool also makes it easy to be adapted for other hydrologic models for hydrological modeling and water resources management.

Development and Evaluation of a Case-Based Digital Learning Tool about Children's Mathematical Thinking for Elementary School Teachers (L-TEST)

ERIC Educational Resources Information Center

Olkun, Sinan; Altun, Arif; Deryakulu, Deniz

2009-01-01

It is important for teachers of mathematics to know how pupils react to certain mathematical situations and what these reactions imply, in order to design more effective instructional environments based on their learning needs. This study reports the development processes of a digital learning tool (Learning Tool for Elementary School Teachers…

Multimedia educational tools for cognitive surgical skill acquisition in open and laparoscopic colorectal surgery: a randomized controlled trial.

PubMed

Shariff, U; Kullar, N; Haray, P N; Dorudi, S; Balasubramanian, S P

2015-05-01

Conventional teaching in surgical training programmes is constrained by time and cost, and has room for improvement. This study aimed to determine the effectiveness of a multimedia educational tool developed for an index colorectal surgical procedure (anterior resection) in teaching and assessment of cognitive skills and to evaluate its acceptability amongst general surgical trainees. Multimedia educational tools in open and laparoscopic anterior resection were developed by filming multiple operations which were edited into procedural steps and substeps and then integrated onto interactive navigational platforms using Adobe® Flash® Professional CS5 10.1. A randomized controlled trial was conducted on general surgical trainees to evaluate the effectiveness of online multimedia in comparison with conventional 'study day' teaching for the acquisition of cognitive skills. All trainees were assessed before and after the study period. Trainees in the multimedia group evaluated the tools by completing a survey. Fifty-nine trainees were randomized but 27% dropped out, leaving 43 trainees randomized to the multimedia group (n = 25) and study day group (n = 18) who were available for analysis. Posttest scores improved significantly in both groups (P < 0.01). The change in scores (mean ± SD) in the multimedia group was not significantly different from the study day group (6.02 ± 5.12 and 5.31 ± 3.42, respectively; P = 0.61). Twenty-five trainees completed the evaluation survey and experienced an improvement in their decision making (67%) and in factual and anatomical knowledge (88%); 96% agreed that the multimedia tool was a useful additional educational resource. Multimedia tools are effective for the acquisition of cognitive skills in colorectal surgery and are well accepted as an educational resource. Colorectal Disease © 2014 The Association of Coloproctology of Great Britain and Ireland.

Water flow algorithm decision support tool for travelling salesman problem

NASA Astrophysics Data System (ADS)

Kamarudin, Anis Aklima; Othman, Zulaiha Ali; Sarim, Hafiz Mohd

2016-08-01

This paper discuss about the role of Decision Support Tool in Travelling Salesman Problem (TSP) for helping the researchers who doing research in same area will get the better result from the proposed algorithm. A study has been conducted and Rapid Application Development (RAD) model has been use as a methodology which includes requirement planning, user design, construction and cutover. Water Flow Algorithm (WFA) with initialization technique improvement is used as the proposed algorithm in this study for evaluating effectiveness against TSP cases. For DST evaluation will go through usability testing conducted on system use, quality of information, quality of interface and overall satisfaction. Evaluation is needed for determine whether this tool can assists user in making a decision to solve TSP problems with the proposed algorithm or not. Some statistical result shown the ability of this tool in term of helping researchers to conduct the experiments on the WFA with improvements TSP initialization.

Measuring Security Effectiveness and Efficiency at U.S. Commercial Airports

DTIC Science & Technology

2013-03-01

formative program evaluation and policy analysis to investigate current airport security programs. It identifies innovative public administration and...policy-analysis tools that could provide potential benefits to airport security . These tools will complement the System Based Risk Management framework if

Mapping and spatiotemporal analysis tool for hydrological data: Spellmap

USDA-ARS?s Scientific Manuscript database

Lack of data management and analyses tools is one of the major limitations to effectively evaluate and use large datasets of high-resolution atmospheric, surface, and subsurface observations. High spatial and temporal resolution datasets better represent the spatiotemporal variability of hydrologica...

Prototype road weather performance management (RW-PM) tool and Minnesota Department of Transportation (MnDOT) field evaluation.

DOT National Transportation Integrated Search

2017-01-01

FHWAs Road Weather Management Program developed a Prototype Road Weather Management (RW-PM) Tool to help DOTs maximize the effectiveness of their maintenance resources and efficiently adjust deployments dynamically, as road conditions and traffic ...

Bearing tester data compilation, analysis, and reporting and bearing math modeling

NASA Technical Reports Server (NTRS)

1983-01-01

The Shaberth bearing analysis computer program was developed for the analysis of jet engine shaft/bearing systems operating above room temperature with normal hydrocarbon lubricants. It is also possible to use this tool to evaluate the shaft bearing systems operating in cryogenics. Effects such as fluid drag, radial temperature gradients, outer race misalignments and clearance changes were simulated and evaluated. In addition, the speed and preload effects on bearing radial stiffness was evaluated. The Shaberth program was also used to provide contact stresses from which contact geometry was calculated to support other analyses such as the determination of cryogenic fluid film thickness in the contacts and evaluation of surface and subsurface stresses necessary for bearing failure evaluation. This program was a vital tool for the thermal analysis of the bearing in that it provides the heat generation rates at the rolling element/race contacts for input into a thermal model of the bearing/shaft assembly.

A simulation model for risk assessment of turbine wheels

NASA Technical Reports Server (NTRS)

Safie, Fayssal M.; Hage, Richard T.

1991-01-01

A simulation model has been successfully developed to evaluate the risk of the Space Shuttle auxiliary power unit (APU) turbine wheels for a specific inspection policy. Besides being an effective tool for risk/reliability evaluation, the simulation model also allows the analyst to study the trade-offs between wheel reliability, wheel life, inspection interval, and rejection crack size. For example, in the APU application, sensitivity analysis results showed that the wheel life limit has the least effect on wheel reliability when compared to the effect of the inspection interval and the rejection crack size. In summary, the simulation model developed represents a flexible tool to predict turbine wheel reliability and study the risk under different inspection policies.

A simulation model for risk assessment of turbine wheels

NASA Astrophysics Data System (ADS)

Safie, Fayssal M.; Hage, Richard T.

A simulation model has been successfully developed to evaluate the risk of the Space Shuttle auxiliary power unit (APU) turbine wheels for a specific inspection policy. Besides being an effective tool for risk/reliability evaluation, the simulation model also allows the analyst to study the trade-offs between wheel reliability, wheel life, inspection interval, and rejection crack size. For example, in the APU application, sensitivity analysis results showed that the wheel life limit has the least effect on wheel reliability when compared to the effect of the inspection interval and the rejection crack size. In summary, the simulation model developed represents a flexible tool to predict turbine wheel reliability and study the risk under different inspection policies.

A decision support tool to determine cost-to-benefit of a family-centered in-home program for at-risk adolescents.

PubMed

Wilson, Fernando A; Araz, Ozgur M; Thompson, Ronald W; Ringle, Jay L; Mason, W Alex; Stimpson, Jim P

2016-06-01

Family-centered program research has demonstrated its effectiveness in improving adolescent outcomes. However, given current fiscal constraints faced by governmental agencies, a recent report from the Institute of Medicine and National Research Council highlighted the need for cost-benefit analyses to inform decision making by policymakers. Furthermore, performance management tools such as balanced scorecards and dashboards do not generally include cost-benefit analyses. In this paper, we describe the development of an Excel-based decision support tool that can be used to evaluate a selected family-based program for at-risk children and adolescents relative to a comparison program or the status quo. This tool incorporates the use of an efficient, user-friendly interface with results provided in concise tabular and graphical formats that may be interpreted without need for substantial training in economic evaluation. To illustrate, we present an application of this tool to evaluate use of Boys Town's In-Home Family Services (IHFS) relative to detention and out-of-home placement in New York City. Use of the decision support tool can help mitigate the need for programs to contract experts in economic evaluation, especially when there are financial or time constraints. Copyright © 2016 Elsevier Ltd. All rights reserved.

Non-technical skills assessment in surgery.

PubMed

Sharma, Bharat; Mishra, Amit; Aggarwal, Rajesh; Grantcharov, Teodor P

2011-09-01

Adverse events in surgery have highlighted the importance of non-technical skills, such as communication, decision-making, teamwork, situational awareness and leadership, to effective organizational performance. These skills carry particular importance to surgical oncology, as members of a multidisciplinary team must work cohesively to formulate effective patient care plans. Several non-technical skills evaluation tools have been developed for use in surgery, without adequate comparison and consensus on which should be standard for training. Eleven articles describing the use of three non-technical evaluation tools related to surgery: NOTSS (Non Technical Skills for Surgeons), NOTECHS (Non Technical Skills) and OTAS (Observational Teamwork Assessment for Surgery) were analyzed with respect to scale formulation, validity, reliability and feasibility. Furthermore, their use in training thus far and the future of non-technical rating scales in surgical curricula was discussed. Future work should focus on incorporating these assessment tools into training and into a real operating room setting to provide formative evaluations for surgical residents. Copyright © 2010 Elsevier Ltd. All rights reserved.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education.

PubMed

Mulhearn, Tyler J; Watts, Logan L; Todd, E Michelle; Medeiros, Kelsey E; Connelly, Shane; Mumford, Michael D

2017-01-01

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

What Did the Teachers Think? Teachers' Responses to the Use of Value-Added Modeling as a Tool for Evaluating Teacher Effectiveness

ERIC Educational Resources Information Center

Lee, Linda

2011-01-01

The policy discourse on improving student achievement has shifted from student outcomes to focusing on evaluating teacher effectiveness using standardized test scores. A major urban newspaper released a public database that ranked teachers' effectiveness using Value-Added Modeling. Teachers, whom are generally marginalized, were given the…

A user-friendly tool to evaluate the effectiveness of no-take marine reserves.

PubMed

Villaseñor-Derbez, Juan Carlos; Faro, Caio; Wright, Melaina; Martínez, Jael; Fitzgerald, Sean; Fulton, Stuart; Mancha-Cisneros, Maria Del Mar; McDonald, Gavin; Micheli, Fiorenza; Suárez, Alvin; Torre, Jorge; Costello, Christopher

2018-01-01

Marine reserves are implemented to achieve a variety of objectives, but are seldom rigorously evaluated to determine whether those objectives are met. In the rare cases when evaluations do take place, they typically focus on ecological indicators and ignore other relevant objectives such as socioeconomics and governance. And regardless of the objectives, the diversity of locations, monitoring protocols, and analysis approaches hinder the ability to compare results across case studies. Moreover, analysis and evaluation of reserves is generally conducted by outside researchers, not the reserve managers or users, plausibly thereby hindering effective local management and rapid response to change. We present a framework and tool, called "MAREA", to overcome these challenges. Its purpose is to evaluate the extent to which any given reserve has achieved its stated objectives. MAREA provides specific guidance on data collection and formatting, and then conducts rigorous causal inference analysis based on data input by the user, providing real-time outputs about the effectiveness of the reserve. MAREA's ease of use, standardization of state-of-the-art inference methods, and ability to analyze marine reserve effectiveness across ecological, socioeconomic, and governance objectives could dramatically further our understanding and support of effective marine reserve management.

A user-friendly tool to evaluate the effectiveness of no-take marine reserves

PubMed Central

Fitzgerald, Sean; Fulton, Stuart; Mancha-Cisneros, Maria del Mar; McDonald, Gavin; Micheli, Fiorenza; Suárez, Alvin; Torre, Jorge

2018-01-01

Marine reserves are implemented to achieve a variety of objectives, but are seldom rigorously evaluated to determine whether those objectives are met. In the rare cases when evaluations do take place, they typically focus on ecological indicators and ignore other relevant objectives such as socioeconomics and governance. And regardless of the objectives, the diversity of locations, monitoring protocols, and analysis approaches hinder the ability to compare results across case studies. Moreover, analysis and evaluation of reserves is generally conducted by outside researchers, not the reserve managers or users, plausibly thereby hindering effective local management and rapid response to change. We present a framework and tool, called “MAREA”, to overcome these challenges. Its purpose is to evaluate the extent to which any given reserve has achieved its stated objectives. MAREA provides specific guidance on data collection and formatting, and then conducts rigorous causal inference analysis based on data input by the user, providing real-time outputs about the effectiveness of the reserve. MAREA’s ease of use, standardization of state-of-the-art inference methods, and ability to analyze marine reserve effectiveness across ecological, socioeconomic, and governance objectives could dramatically further our understanding and support of effective marine reserve management. PMID:29381762

Evaluating the Implementation and Effectiveness of Reflection Writing

ERIC Educational Resources Information Center

Boutet, Isabelle; Vandette, Marie-Pier; Valiquette-Tessier, Sophie-Claire

2017-01-01

There is ample theoretical justification for incorporating reflection exercises as a tool for preparing students for life beyond university, yet the utility of such exercises needs to be documented if resources are to be devoted to their implementation. This study describes the implementation and evaluates the effectiveness of a reflection…

Decision tools in health care: focus on the problem, not the solution.

PubMed

Liu, Joseph; Wyatt, Jeremy C; Altman, Douglas G

2006-01-20

Systematic reviews or randomised-controlled trials usually help to establish the effectiveness of drugs and other health technologies, but are rarely sufficient by themselves to ensure actual clinical use of the technology. The process from innovation to routine clinical use is complex. Numerous computerised decision support systems (DSS) have been developed, but many fail to be taken up into actual use. Some developers construct technologically advanced systems with little relevance to the real world. Others did not determine whether a clinical need exists. With NHS investing 5 billion pounds sterling in computer systems, also occurring in other countries, there is an urgent need to shift from a technology-driven approach to one that identifies and employs the most cost-effective method to manage knowledge, regardless of the technology. The generic term, 'decision tool' (DT), is therefore suggested to demonstrate that these aids, which seem different technically, are conceptually the same from a clinical viewpoint. Many computerised DSSs failed for various reasons, for example, they were not based on best available knowledge; there was insufficient emphasis on their need for high quality clinical data; their development was technology-led; or evaluation methods were misapplied. We argue that DSSs and other computer-based, paper-based and even mechanical decision aids are members of a wider family of decision tools. A DT is an active knowledge resource that uses patient data to generate case specific advice, which supports decision making about individual patients by health professionals, the patients themselves or others concerned about them. The identification of DTs as a consistent and important category of health technology should encourage the sharing of lessons between DT developers and users and reduce the frequency of decision tool projects focusing only on technology. The focus of evaluation should become more clinical, with the impact of computer-based DTs being evaluated against other computer, paper- or mechanical tools, to identify the most cost effective tool for each clinical problem. We suggested the generic term 'decision tool' to demonstrate that decision-making aids, such as computerised DSSs, paper algorithms, and reminders are conceptually the same, so the methods to evaluate them should be the same.

Failure mode and effect analysis in blood transfusion: a proactive tool to reduce risks.

PubMed

Lu, Yao; Teng, Fang; Zhou, Jie; Wen, Aiqing; Bi, Yutian

2013-12-01

The aim of blood transfusion risk management is to improve the quality of blood products and to assure patient safety. We utilize failure mode and effect analysis (FMEA), a tool employed for evaluating risks and identifying preventive measures to reduce the risks in blood transfusion. The failure modes and effects occurring throughout the whole process of blood transfusion were studied. Each failure mode was evaluated using three scores: severity of effect (S), likelihood of occurrence (O), and probability of detection (D). Risk priority numbers (RPNs) were calculated by multiplying the S, O, and D scores. The plan-do-check-act cycle was also used for continuous improvement. Analysis has showed that failure modes with the highest RPNs, and therefore the greatest risk, were insufficient preoperative assessment of the blood product requirement (RPN, 245), preparation time before infusion of more than 30 minutes (RPN, 240), blood transfusion reaction occurring during the transfusion process (RPN, 224), blood plasma abuse (RPN, 180), and insufficient and/or incorrect clinical information on request form (RPN, 126). After implementation of preventative measures and reassessment, a reduction in RPN was detected with each risk. The failure mode with the second highest RPN, namely, preparation time before infusion of more than 30 minutes, was shown in detail to prove the efficiency of this tool. FMEA evaluation model is a useful tool in proactively analyzing and reducing the risks associated with the blood transfusion procedure. © 2013 American Association of Blood Banks.

"Survivor" torches "Who Wants to Be a Physician?" in the educational games ratings war.

PubMed

Howard, Mary G; Collins, Heidi L; DiCarlo, Stephen E

2002-12-01

We recently developed an educational game for reviewing respiratory physiology in a large classroom. The "Who Wants to be a Physician?" game encouraged medical students to be active participants in the learning process. An evaluation of the game documented that students enjoyed the active format, and the students reported that the game enhanced their ability to understand and retain information. However, the evaluation also revealed that the game had limitations. Specifically, the students recommended the use of multiple-choice questions to match the Medical Board Examination format and to speed up the game (i.e., cover more topics). The students also wanted to increase their level of participation and interaction. Finally, we wanted to emphasize the benefits of peer instruction as a collaborative learning tool. To address these limitations, we designed a new game, "Survivor." Survivor incorporated multiple-choice questions and emphasized peer instruction and a capacity to gather information and solve novel problems. In addition, participation was increased by including the student audience in the game. Finally, an evaluation instrument was utilized to assess the effectiveness of this instructional tool in an academic setting. As a result of these improvements, the evaluation documents that the newly developed tool is a more effective educational game that couples fun and creative excitement with proven and effective educational concepts.

Creating supportive nutrition environments for population health impact and health equity: an overview of the Nutrition and Obesity Policy Research and Evaluation Network's efforts.

PubMed

Blanck, Heidi M; Kim, Sonia A

2012-09-01

Childhood obesity is a major threat to individual health and society overall. Policies that support healthier food and beverage choices have been endorsed by many decision makers. These policies may reach a large proportion of the population or in some circumstances aim to reduce nutrition disparities to ensure health equity. The Nutrition and Obesity Policy Research and Evaluation Network (NOPREN) evaluates policy as a tool to improve food and beverage environments where Americans live, work, play, and learn. The network aspires to address research and evaluation gaps related to relevant policies, create standardized research tools, and help build the evidence base of effective policy solutions for childhood obesity prevention with a focus on reach, equity, cost effectiveness, and sustainability. Published by Elsevier Inc.

Surface Roughness Model Based on Force Sensors for the Prediction of the Tool Wear

PubMed Central

de Agustina, Beatriz; Rubio, Eva María; Sebastián, Miguel Ángel

2014-01-01

In this study, a methodology has been developed with the objective of evaluating the surface roughness obtained during turning processes by measuring the signals detected by a force sensor under the same cutting conditions. In this way, the surface quality achieved along the process is correlated to several parameters of the cutting forces (thrust forces, feed forces and cutting forces), so the effect that the tool wear causes on the surface roughness is evaluated. In a first step, the best cutting conditions (cutting parameters and radius of tool) for a certain quality surface requirement were found for pieces of UNS A97075. Next, with this selection a model of surface roughness based on the cutting forces was developed for different states of wear that simulate the behaviour of the tool throughout its life. The validation of this model reveals that it was effective for approximately 70% of the surface roughness values obtained. PMID:24714391

Measuring the effectiveness of faculty mentoring relationships.

PubMed

Berk, Ronald A; Berg, Janet; Mortimer, Rosemary; Walton-Moss, Benita; Yeo, Theresa P

2005-01-01

"Mentor" is a term widely used in academic medicine but for which there is no consensus on an operational definition. Further, criteria are rarely reported for evaluating the effectiveness of mentoring. This article presents the work of an Ad Hoc Faculty Mentoring Committee whose tasks were to define "mentorship," specify concrete characteristics and responsibilities of mentors that are measurable, and develop new tools to evaluate the effectiveness of the mentoring relationship. The committee developed two tools: the Mentorship Profile Questionnaire, which describes the characteristics and outcome measures of the mentoring relationship from the perspective of the mentee, and the Mentorship Effectiveness Scale, a 12-item six-point agree-disagree-format Likert-type rating scale, which evaluates 12 behavioral characteristics of the mentor. These instruments are explained and copies are provided. Psychometric issues, including the importance of content-related validity evidence, response bias due to acquiescence and halo effects, and limitations on collecting reliability evidence, are examined in the context of the mentor-mentee relationship. Directions for future research are suggested.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Montano, Joshua Daniel

The following report is a review of ToolingU, an online manufacturing training website. ToolingU provided the author with a trail account where a number of courses were taken and the overall program was evaluated. A review of the classes revealed that most of the offerings directly align with work at the Laboratory. Ease of use, effectiveness of the system and price all make ToolingU an attractive option for manufacturing training needs.

The effectiveness of tools used to evaluate successful critical decision making skills for applicants to healthcare graduate educational programs: a systematic review.

PubMed

Benham, Brian; Hawley, Diane

2015-05-15

Students leave healthcare academic programs for a variety of reasons. When they attrite, it is disappointing for the student as well as their faculty. Advanced practice nursing and other healthcare professions require not only extensive academic preparation, but also the ability to critically evaluate patient care situations. The ability to critically evaluate a situation is not innate. Critical decision making skills are high level skills that are difficult to assess. For the purpose of this review, critical decision making and critical thinking skills refer to the same constructs and will be referred to globally as critical decision making skills. The objective of this review was to identify the effectiveness of tools used to evaluate critical decision making skills for applicants to healthcare graduate educational programs. Adult (18 years of age or older) applicants, students enrolled and/or recent graduates (within one year from completion) of healthcare graduate educational programs. Types of interventions: This review considered studies that evaluated the utilization of unique tools as well as standard tools, such as the Graduate Record Exam or grade point average, to evaluate critical decision making skills in graduate healthcare program applicants. Types of studies: Experimental and non-experimental studies were considered for inclusion. Types of outcomes: Successful quantitative evaluations based on specific field of study standards. The search strategy aimed to find both published and unpublished studies. Studies published in English after 1969 were considered for inclusion in this review. Databases that included both published and unpublished (grey) literature were searched. Additionally, reference lists from all articles retrieved were examined for articles for inclusion. Selected papers were assessed by two independent reviewers using standardized critical appraisal instruments from Joanna Briggs Institute. Any disagreement between reviewers was resolved through discussion or with a third reviewer. Data was extracted independently by each reviewer from papers included in the review using a Microsoft Excel spreadsheet. Included data included study type, 'r' values, number of subjects and reported 'p' values. These were indexed by author, year and study title. The meta-analysis was performed using the method for effect size analysis from Hunter and Schmidt. The syntax for equations was transposed into a Microsoft Excel spreadsheet for data entry, analysis and graph creation. No articles or paper addressing unique tools for ascertaining critical decision making skills met the inclusion criteria. Standard tools, which were represented in the literature, assess critical decision making skills via prediction of academic and clinical success, which indicates the presence of critical decision making skills in graduate healthcare students. A total of 16 studies addressing standard tools were included in this review. All were retrospective case series studies. The date range for the included studies was 1970 to 2009. The strongest relationship was undergraduate grade point average's correlation to graduate grade point average (small effect size with an 'r' value of 0.27, credibility interval of 0.18-0.37). The second strongest relationship was between Graduate Record Examination’s verbal section and graduate grade point average (small effect size with an r value of 0.24, CrI of 0.11-0.37). An applicant’s undergraduate GPA has the strongest correlation with graduate healthcare program success of the indicators analyzed (r = 0.27, small effect size). The next best predictor of graduate healthcare program success was the GRE Verbal score (r = 0.24, small effect size). However, all of the variables carried positive correlations with graduate success, just of lesser effect size strength. This review supports the continued use of traditional indicators of graduate school potential in the undergraduate grade point average and the various sections of the Graduate Record Examination for the selection of graduate healthcare applicants. Primary studies should be funded and performed to assess the use of unique tools in assessing critical thinking in graduate healthcare students. The Joanna Briggs Institute.

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

An interdisciplinary framework for participatory modeling design and evaluation—What makes models effective participatory decision tools?

NASA Astrophysics Data System (ADS)

Falconi, Stefanie M.; Palmer, Richard N.

2017-02-01

Increased requirements for public involvement in water resources management (WRM) over the past century have stimulated the development of more collaborative decision-making methods. Participatory modeling (PM) uses computer models to inform and engage stakeholders in the planning process in order to influence collaborative decisions in WRM. Past evaluations of participatory models focused on process and final outcomes, yet, were hindered by diversity of purpose and inconsistent documentation. This paper presents a two-stage framework for evaluating PM based on mechanisms for improving model effectiveness as participatory tools. The five dimensions characterize the "who, when, how, and why" of each participatory effort (stage 1). Models are evaluated as "boundary objects," a concept used to describe tools that bridge understanding and translate different bodies of knowledge to improve credibility, salience, and legitimacy (stage 2). This evaluation framework is applied to five existing case studies from the literature. Though the goals of participation can be diverse, the novel contribution of the two-stage proposed framework is the flexibility it has to evaluate a wide range of cases that differ in scope, modeling approach, and participatory context. Also, the evaluation criteria provide a structured vocabulary based on clear mechanisms that extend beyond previous process-based and outcome-based evaluations. Effective models are those that take advantage of mechanisms that facilitate dialogue and resolution and improve the accessibility and applicability of technical knowledge. Furthermore, the framework can help build more complete records and systematic documentation of evidence to help standardize the field of PM.

It's LiFe! Mobile and Web-Based Monitoring and Feedback Tool Embedded in Primary Care Increases Physical Activity: A Cluster Randomized Controlled Trial.

PubMed

van der Weegen, Sanne; Verwey, Renée; Spreeuwenberg, Marieke; Tange, Huibert; van der Weijden, Trudy; de Witte, Luc

2015-07-24

Physical inactivity is a major public health problem. The It's LiFe! monitoring and feedback tool embedded in the Self-Management Support Program (SSP) is an attempt to stimulate physical activity in people with chronic obstructive pulmonary disease or type 2 diabetes treated in primary care. Our aim was to evaluate whether the SSP combined with the use of the monitoring and feedback tool leads to more physical activity compared to usual care and to evaluate the additional effect of using this tool on top of the SSP. This was a three-armed cluster randomised controlled trial. Twenty four family practices were randomly assigned to one of three groups in which participants received the tool + SSP (group 1), the SSP (group 2), or care as usual (group 3). The primary outcome measure was minutes of physical activity per day. The secondary outcomes were general and exercise self-efficacy and quality of life. Outcomes were measured at baseline after the intervention (4-6 months), and 3 months thereafter. The group that received the entire intervention (tool + SSP) showed more physical activity directly after the intervention than Group 3 (mean difference 11.73, 95% CI 6.21-17.25; P<.001), and Group 2 (mean difference 7.86, 95% CI 2.18-13.54; P=.003). Three months after the intervention, this effect was still present and significant (compared to Group 3: mean difference 10.59, 95% CI 4.94-16.25; P<.001; compared to Group 2: mean difference 9.41, 95% CI 3.70-15.11; P<.001). There was no significant difference in effect between Groups 2 and 3 on both time points. There was no interaction effect for disease type. The combination of counseling with the tool proved an effective way to stimulate physical activity. Counseling without the tool was not effective. Future research about the cost-effectiveness and application under more tailored conditions and in other target groups is recommended. ClinicalTrials.gov: NCT01867970, https://clinicaltrials.gov/ct2/show/NCT01867970 (archived by WebCite at http://www.webcitation.org/6a2qR5BSr).

Management on the Go

ERIC Educational Resources Information Center

Technology & Learning, 2005

2005-01-01

The employment of administrative tools for effective management is evaluated in this article. Using an administrative tool like a Palm[R] handheld computer and appropriate software can make the difference. For anyone running a single school or an entire district, managing data is the key to maintaining an efficient organization. Many…

Comparing two motor assessment tools to evaluate neurobehavioral intervention effects in infants with very low birth weight at 1 year.

PubMed

Van Hus, Janeline W P; Jeukens-Visser, Martine; Koldewijn, Karen; Van Sonderen, Loekie; Kok, Joke H; Nollet, Frans; Van Wassenaer-Leemhuis, Aleid G

2013-11-01

Infants with very low birth weight (VLBW) are at increased risk for motor deficits, which may be reduced by early intervention programs. For detection of motor deficits and to monitor intervention, different assessment tools are available. It is important to choose tools that are sensitive to evaluate the efficacy of intervention on motor outcome. The purpose of this study was to compare the Alberta Infant Motor Scale (AIMS) and the Psychomotor Developmental Index (PDI) of the Bayley Scales of Infant Development-Dutch Second Edition (BSID-II-NL) in their ability to evaluate effects of an early intervention, provided by pediatric physical therapists, on motor development in infants with VLBW at 12 months corrected age (CA). This was a secondary study in which data collected from a randomized controlled trial (RCT) were used. At 12 months CA, 116 of 176 infants with VLBW participating in an RCT on the effect of the Infant Behavioral Assessment and Intervention Program were assessed with both the AIMS and the PDI. Intervention effects on the AIMS and PDI were compared. Corrected for baseline differences, significant intervention effects were found for AIMS and PDI scores. The highest effect size was for the AIMS subscale sit. A significant reduction of abnormal motor development in the intervention group was found only with the AIMS. No Dutch norms are available for the AIMS. The responsiveness of the AIMS to detect intervention effects was better than that of the PDI. Therefore, caution is recommended in monitoring infants with VLBW only with the PDI, and the use of both the AIMS and the Bayley Scales of Infant Development is advised when evaluating intervention effects on motor development at 12 months CA.

Evaluating new health information technologies: expanding the frontiers of health care delivery and health promotion.

PubMed

Kreps, Gary L

2002-01-01

The modern health care system is being irrevocably changed by the development and introduction of new health information technologies (such as health information systems, decision-support tools, specialized websites, and innovative communication devices). While many of these new technologies hold the promise of revolutionizing the modern health system and facilitating improvements in health care delivery, health education, and health promotion, it is imperative to carefully examine and assess the effectiveness of these technological tools to determine which products are most useful to apply in specific contexts, as well as to learn how to best utilize these products and processes. Without good evaluative information about new technologies, we are unlikely to reap the greatest benefits from these powerful new tools. This chapter examines the demand for evaluating health information technologies and suggests several strategies for conducting rigorous and relevant evaluation research.

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Exploring Assessment Tools for Research and Evaluation in Astronomy Education and Outreach

NASA Astrophysics Data System (ADS)

Buxner, S. R.; Wenger, M. C.; Dokter, E. F. C.

2011-09-01

The ability to effectively measure knowledge, attitudes, and skills in formal and informal educational settings is an important aspect of astronomy education research and evaluation. Assessments may take the form of interviews, observations, surveys, exams, or other probes to help unpack people's understandings or beliefs. In this workshop, we discussed characteristics of a variety of tools that exist to assess understandings of different concepts in astronomy as well as attitudes towards science and science teaching; these include concept inventories, surveys, interview protocols, observation protocols, card sorting, reflection videos, and other methods currently being used in astronomy education research and EPO program evaluations. In addition, we discussed common questions in the selection of assessment tools including issues of reliability and validity, time to administer, format of implementation, analysis, and human subject concerns.

Improving a web-based employability intervention for work-disabled employees: results of a pilot economic evaluation.

PubMed

Noben, Cindy; Evers, Silvia; Genabeek, Joost van; Nijhuis, Frans; de Rijk, Angelique

2017-04-01

Purpose The purpose of this study is to improve web-based employability interventions for employees with work-related health problems for both intervention content and study design by means of a pilot economic evaluation. Methods Uptake rate analysis for the intervention elements, cost effectiveness, cost utility and subgroup analyses were conducted to identify potential content-related intervention improvements. Differences in work ability and quality-adjusted life years and overall contribution of resource items to the total costs were assessed. These were used to guide study design improvements. Results Sixty-three participants were a-select allocated to either the intervention (n = 29) or the control (n = 34) group. Uptake regarding the intervention elements ranged between 3% and 70%. Cost-effectiveness and cost-utility analyses resulted in negative effects although higher total costs. Incremental effects were marginal (work ability -0.51; QALY -0.01). Conclusions The web-based tool to enhance employability among work disabled employees requires improvements regarding targeting and intensity; outcome measures selected and collection of cost data. With respect to the studies of disability and rehabilitation, the findings and methods presented in this pilot economic evaluation could guide the assessment of future assistive "e-health" technologies. IMPLICATIONS FOR REHABILITATION The methods presented in this pilot economic evaluation have large potentials to guide the assessment of future assistive e-health technologies addressing work-disabilities. The findings show that the web-based tool requires content related improvements with respect to targeting and intensity to enhance employability among work disabled employees. The findings show that the web-based tool would benefit from improvements related to the study design by more adequately selecting and collecting both outcome measures and cost data. The burden attributable to large-scale studies and implementation issues were prevented as the outcomes of the pilot economic evaluation did not support the implementation of the web-based tool.

Novel effects-based monitoring approaches to evaluate chemicals of emerging concern in Great Lakes areas of concern

EPA Science Inventory

As part of an on-going program of research in support of the Great Lakes Restoration Initiative, we have been developing effects-based biomonitoring tools to evaluate the occurrence and potential hazards associated with Chemicals of Emerging Concern (CECs). Over three field seaso...

Novel effects-based monitoring approaches to evaluate chemicals of emerging concern in the St. Louis River estuary

EPA Science Inventory

As part of an on-going program of research in support of the Great Lakes Restoration Initiative, the US EPA MED laboratory has been developing effects-based biomonitoring tools to evaluate the occurrence and potential hazards associated with Chemicals of Emerging Concern (CECs). ...

Evaluating Effectiveness of Green Infrastructure Application of Stormwater Best Management Practices in Protecting Stream Habitat and Biotic Condition in New England

EPA Science Inventory

The US EPA is developing assessment tools to evaluate the effectiveness of green infrastructure (GI) applied in stormwater best management practices (BMPs) at the small watershed (HUC12 or finer) scale. Based on analysis of historical monitoring data using boosted regression tre...

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis

PubMed Central

2013-01-01

Background Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. Methods We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. Results In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. Conclusions There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to assess risk of bias of RCTs. Further empirical evidence on the use of individual items and the psychometric properties of risk of bias tools is needed. PMID:24044807

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis.

PubMed

Armijo-Olivo, Susan; Fuentes, Jorge; Ospina, Maria; Saltaji, Humam; Hartling, Lisa

2013-09-17

Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to assess risk of bias of RCTs. Further empirical evidence on the use of individual items and the psychometric properties of risk of bias tools is needed.

Development of computer-based analytical tool for assessing physical protection system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mardhi, Alim, E-mail: alim-m@batan.go.id; Chulalongkorn University, Faculty of Engineering, Nuclear Engineering Department, 254 Phayathai Road, Pathumwan, Bangkok Thailand. 10330; Pengvanich, Phongphaeth, E-mail: ppengvan@gmail.com

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work,more » we have developed a computer–based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system’s detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.« less

In vivo assessment of the effect of taxifolin glycoside on atopic dermatitis-like skin lesions using biomedical tools in NC/Nga mice.

PubMed

Kim, J Y; Lee, O S; Ha, S; Kim, J H; Park, G; Kim, J K; Oh, C H

2015-07-01

Noninvasive methods of assessment are widely used in clinical trials. However, such methods have not been established in atopic dermatitis (AD), which is a chronic inflammatory skin disease. To demonstrate, using biomedical tools, the benefits of a new substance, taxifolin glycoside (TAX), in an AD model, the NC/Nga mouse. We evaluated the efficacy of topical TAX for AD by measuring clinical skin severity score, cytokine expression and serum IgE level, and by using biomedical measures (vapometry and corneometry). Topical TAX was applied to AD-induced NC/Nga mice for 3 weeks. The anti-inflammatory effects of this compound were demonstrated noninvasively using biomedical tools and immunological assays. Our method of AD assessment using biomedical tools is more objective and accurate than visual inspection. The results obtained using the biomedical tools were identical to those obtained using immunological assays. In vivo biomedical tools are useful for diagnosing and monitoring treatment effects in AD. © 2014 British Association of Dermatologists.

Development of computer-based analytical tool for assessing physical protection system

NASA Astrophysics Data System (ADS)

Mardhi, Alim; Pengvanich, Phongphaeth

2016-01-01

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work, we have developed a computer-based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system's detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

A Five-Year Evaluation of Examination Structure in a Cardiovascular Pharmacotherapy Course

PubMed Central

Kolar, Claire; Janke, Kristin K.

2015-01-01

Objective. To evaluate the composition and effectiveness as an assessment tool of a criterion-referenced examination comprised of clinical cases tied to practice decisions, to examine the effect of varying audience response system (ARS) questions on student examination preparation, and to articulate guidelines for structuring examinations to maximize evaluation of student learning. Design. Multiple-choice items developed over 5 years were evaluated using Bloom’s Taxonomy classification, point biserial correlation, item difficulty, and grade distribution. In addition, examination items were classified into categories based on similarity to items used in ARS preparation. Assessment. As the number of items directly tied to clinical practice rose, Bloom’s Taxonomy level and item difficulty also rose. In examination years where Bloom’s levels were high but preparation was minimal, average grade distribution was lower compared with years in which student preparation was higher. Conclusion. Criterion-referenced examinations can benefit from systematic evaluation of their composition and effectiveness as assessment tools. Calculated design and delivery of classroom preparation is an asset in improving examination performance on rigorous, practice-relevant examinations. PMID:27168611

Continuous Coordination Tools and their Evaluation

NASA Astrophysics Data System (ADS)

Sarma, Anita; Al-Ani, Ban; Trainer, Erik; Silva Filho, Roberto S.; da Silva, Isabella A.; Redmiles, David; van der Hoek, André

This chapter discusses a set of co-ordination tools (the Continuous Co-ordination (CC) tool suite that includes Ariadne, Workspace Activity Viewer (WAV), Lighthouse, Palantír, and YANCEES) and details of our evaluation framework for these tools. Specifically, we discuss how we assessed the usefulness and the usability of these tools within the context of a predefined evaluation framework called DESMETDESMET . For example, for visualization tools we evaluated the suitability of the level of abstraction and the mode of displaying information of each tool. Whereas for an infrastructure tool we evaluate the effort required to implement co-ordination tools based on the given tool. We conclude with pointers on factors to consider when evaluating co-ordination tools in general.

E-health: an overview of the uses of the Internet, social media, apps, and websites for mood disorders.

PubMed

Parikh, Sagar V; Huniewicz, Paulina

2015-01-01

The current article defines and surveys E-health: Internet and technology-guided interventions and tools useful for mood disorders. E-health encompasses many categories, including computerized self-help strategies, online psychotherapy, websites that provide information, social media approaches including Facebook, Internet forums for health discussions, personal blogs, and videogames. Multiple tools exist to assess and document symptoms, particularly mood charts. Although all of these approaches are popular, only online psychotherapy and videogames have actually been evaluated in studies to evaluate both validity and efficacy. The face validity of social communication strategies including social media and blogs is strong, with clear implications for stigma reduction and peer support. Informational websites continue to be primary sources of psychoeducation on mental disorders. Social media sites have widespread use by the public and a profusion of health discussions and tools, but without published research evaluation of efficacy. E-health strategies, particularly online psychotherapy and tools to document symptoms, are useful and likely effective. Social communication strategies show enormous popularity, but urgently require research evaluation for impact.

Practice Evaluation Strategies Among Social Workers: Why an Evidence-Informed Dual-Process Theory Still Matters.

PubMed

Davis, Thomas D

2017-01-01

Practice evaluation strategies range in style from the formal-analytic tools of single-subject designs, rapid assessment instruments, algorithmic steps in evidence-informed practice, and computer software applications, to the informal-interactive tools of clinical supervision, consultation with colleagues, use of client feedback, and clinical experience. The purpose of this article is to provide practice researchers in social work with an evidence-informed theory that is capable of explaining both how and why social workers use practice evaluation strategies to self-monitor the effectiveness of their interventions in terms of client change. The author delineates the theoretical contours and consequences of what is called dual-process theory. Drawing on evidence-informed advances in the cognitive and social neurosciences, the author identifies among everyday social workers a theoretically stable, informal-interactive tool preference that is a cognitively necessary, sufficient, and stand-alone preference that requires neither the supplementation nor balance of formal-analytic tools. The author's delineation of dual-process theory represents a theoretical contribution in the century-old attempt to understand how and why social workers evaluate their practice the way they do.

Optimized exploration resource evaluation using the MDT tool

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zainun, K.; Trice, M.L.

1995-10-01

This paper discusses exploration cost reduction and improved resource delineation benefits that were realized by use of the MDT (Modular Formation Dynamic Tester) tool to evaluate exploration prospects in the Malay Basin of the South China Sea. Frequently, open hole logs do not clearly define fluid content due to low salinity of the connate water and the effect of shale laminae or bioturbation in the silty, shaley sandstones. Therefore, extensive pressure measurements and fluid sampling are required to define fluid type and contacts. This paper briefly describes the features of the MDT tool which were utilized to reduce rig timemore » usage while providing more representative fluid samples and illustrates usage of these features with field examples. The tool has been used on several exploration wells and a comparison of MDT pressures and samples to results obtained with earlier vintage tools and production tests is also discussed.« less

The Effect of Using Learning Strategy Mastery in the Collection of the Ninth-Grade Students in the Study of Islamic Education in Ma'an

ERIC Educational Resources Information Center

AlKhateeb, Omar; Abu-shreah, Mohammad; Al-khattab, Ahmed

2015-01-01

The educational curriculum considered as one of the main education tools in achieving its objectives, it's a tool for interaction between the teacher and the learner; therefore the civilized nations takes great importance to the design process on a sound basis, and to oversee their implementation in adequacy and effectiveness, and evaluation and…

A GIS APPLICATION AND RESOURCE TOOL FOR USE ON STUDIES OF THE LAKE TEXOMA ECOLOGICAL SYSTEM

EPA Science Inventory

Investigations are underway at Lake Texoma to develop tools and information needed to evaluate the transport and attenuation of contaminants and stressors in a lake ecosystem, and link them to observable ecological effects. The U. S. Environmental Protection Agency (USEPA),
...

Exploring the Item Order Effect in a Geoscience Concept Inventory

ERIC Educational Resources Information Center

Undersander, Molly A.; Kettler, Richard M.; Stains, Marilyne

2017-01-01

Concept inventories have been determined to be useful assessment tools for evaluating students' knowledge, particularly in the sciences. However, these assessment tools must be validated to reflect as accurately as possible students' understanding of concepts. One possible threat to this validation is what previous literature calls the item order…

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools.

PubMed

Shurtz, Suzanne; Foster, Margaret J

2011-07-01

The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed.

Transforming data into usable knowledge: the CIRC experience

NASA Astrophysics Data System (ADS)

Mote, P.; Lach, D.; Hartmann, H.; Abatzoglou, J. T.; Stevenson, J.

2017-12-01

NOAA's northwest RISA, the Climate Impacts Research Consortium, emphasizes the transformation of data into usable knowledge. This effort involves physical scientists (e.g., Abatzoglou) building web-based tools with climate and hydrologic data and model output, a team performing data mining to link crop loss claims to droughts, social scientists (eg., Lach, Hartmann) evaluating the effectiveness of such tools at communicating with end users, and two-way engagement with a wide variety of audiences who are interested in using and improving the tools. Unusual in this effort is the seamless integration across timescales past, present, and future; data mining; and the level of effort in evaluating the tools. We provide examples of agriculturally relevant climate variables (e.g. growing degree days, day of first fall freeze) and describe the iterative process of incorporating user feedback.

Evaluation of the Effectiveness of Stormwater Decision Support Tools for Infrastructure Selection and the Barriers to Implementation

NASA Astrophysics Data System (ADS)

Spahr, K.; Hogue, T. S.

2016-12-01

Selecting the most appropriate green, gray, and / or hybrid system for stormwater treatment and conveyance can prove challenging to decision markers across all scales, from site managers to large municipalities. To help streamline the selection process, a multi-disciplinary team of academics and professionals is developing an industry standard for selecting and evaluating the most appropriate stormwater management technology for different regions. To make the tool more robust and comprehensive, life-cycle cost assessment and optimization modules will be included to evaluate non-monetized and ecosystem benefits of selected technologies. Initial work includes surveying advisory board members based in cities that use existing decision support tools in their infrastructure planning process. These surveys will qualify the decisions currently being made and identify challenges within the current planning process across a range of hydroclimatic regions and city size. Analysis of social and other non-technical barriers to adoption of the existing tools is also being performed, with identification of regional differences and institutional challenges. Surveys will also gage the regional appropriateness of certain stormwater technologies based off experiences in implementing stormwater treatment and conveyance plans. In additional to compiling qualitative data on existing decision support tools, a technical review of components of the decision support tool used will be performed. Gaps in each tool's analysis, like the lack of certain critical functionalities, will be identified and ease of use will be evaluated. Conclusions drawn from both the qualitative and quantitative analyses will be used to inform the development of the new decision support tool and its eventual dissemination.

Evaluation tools for undergraduate program planning in times of financial austerity.

PubMed

O'Palka, J; Harris, P R

1990-05-01

This article describes the administration and outcome of two evaluation tools developed by faculty of the dietetic program for ongoing assessment of a Plan IV dietetic education program over a 4-year period. Interns and internship directors were asked to evaluate the level of skills and knowledge base of interns compared with their internship classmates. Interns were also asked to rate the effectiveness of undergraduate course assignments and activities for internship preparation. As a result of the surveys, the home economics core course work was deleted, credits were shifted from food science to nutrient metabolism courses, and credits in clinical nutrition were increased. Projects in clinical nutrition and food systems management were modified. The surveys justified program requirements and utilization of resources, and provided an additional, effective measure of faculty competence.

It's Selective, but Is It Effective? Exploring the Predictive Validity of Teacher Selection Tools. CEDR Brief. Policy Brief No. 2014-­9

ERIC Educational Resources Information Center

Goldhaber, Dan; Grout, Cyrus; Huntington-Klein, Nick

2014-01-01

Evidence suggests teacher hiring in public schools is ad-hoc and often does not result in good selection amongst applicants. Some districts use structured selection instruments in the hiring process, but we know little about the efficacy of such tools. In this paper we evaluate the ability of applicant selection tools used by the Spokane Public…

Reducing waste in evaluation studies on fall risk assessment tools for older people.

PubMed

Meyer, Gabriele; Möhler, Ralph; Köpke, Sascha

2018-05-18

To critically appraise the recognition of methodological challenges in evaluation studies on assessment tools and nurses' clinical judgement on fall risk in older people and suggest how to reduce respective research waste. Opinion paper and narrative review covering systematic reviews on studies assessing diagnostic accuracy and impact of assessment tools and/or nurses' clinical judgement. Eighteen reviews published in the last 15 years were analysed. Only one reflects potentially important factors threatening the accuracy of assessments using delayed verification with fall events as reference after a certain period of time, i.e. natural course, preventive measures and treatment paradox where accurate assessment leads to prevention of falls, i.e. influencing the reference standard and falsely indicating low diagnostic accuracy. Also, only one review mentions randomised controlled trials as appropriate study design for the investigation of the impact of fall risk assessment tools on patient-important outcomes. Until now, only one randomised controlled trial dealing with this question has been performed showing no effect on falls and injuries. Instead of investigating the diagnostic accuracy of fall assessment tools, the focus of future research should be on the effectiveness of the implementation of fall assessment tools at reducing falls and injuries. Copyright © 2018. Published by Elsevier Inc.

Number and type of guideline implementation tools varies by guideline, clinical condition, country of origin, and type of developer organization: content analysis of guidelines.

PubMed

Liang, Laurel; Abi Safi, Jhoni; Gagliardi, Anna R

2017-11-15

Guideline implementation tools (GI tools) can improve clinician behavior and patient outcomes. Analyses of guidelines published before 2010 found that many did not offer GI tools. Since 2010 standards, frameworks and instructions for GI tools have emerged. This study analyzed the number and types of GI tools offered by guidelines published in 2010 or later. Content analysis and a published GI tool framework were used to categorize GI tools by condition, country, and type of organization. English-language guidelines on arthritis, asthma, colorectal cancer, depression, diabetes, heart failure, and stroke management were identified in the National Guideline Clearinghouse. Screening and data extraction were in triplicate. Findings were reported with summary statistics. Eighty-five (67.5%) of 126 eligible guidelines published between 2010 and 2017 offered one or more of a total of 464 GI tools. The mean number of GI tools per guideline was 5.5 (median 4.0, range 1 to 28) and increased over time. The majority of GI tools were for clinicians (239, 51.5%), few were for patients (113, 24.4%), and fewer still were to support implementation (66, 14.3%) or evaluation (46, 9.9%). Most clinician GI tools were guideline summaries (116, 48.5%), and most patient GI tools were condition-specific information (92, 81.4%). Government agencies (patient 23.5%, clinician 28.9%, implementation 24.1%, evaluation 23.5%) and developers in the UK (patient 18.5%, clinician 25.2%, implementation 27.2%, evaluation 29.1%) were more likely to generate guidelines that offered all four types of GI tools. Professional societies were more likely to generate guidelines that included clinician GI tools. Many guidelines do not include any GI tools, or a variety of GI tools for different stakeholders that may be more likely to prompt guideline uptake (point-of-care forms or checklists for clinicians, decision-making or self-management tools for patients, implementation and evaluation tools for managers and policy-makers). While this may vary by country and type of organization, and suggests that developers could improve the range of GI tools they develop, further research is needed to identify determinants and potential solutions. Research is also needed to examine the cost-effectiveness of various types of GI tools so that developers know where to direct their efforts and scarce resources.

[The Italian instrument evaluating the nursing students clinical learning quality].

PubMed

Palese, Alvisa; Grassetti, Luca; Mansutti, Irene; Destrebecq, Anne; Terzoni, Stefano; Altini, Pietro; Bevilacqua, Anita; Brugnolli, Anna; Benaglio, Carla; Dal Ponte, Adriana; De Biasio, Laura; Dimonte, Valerio; Gambacorti, Benedetta; Fasci, Adriana; Grosso, Silvia; Mantovan, Franco; Marognolli, Oliva; Montalti, Sandra; Nicotera, Raffaela; Randon, Giulia; Stampfl, Brigitte; Tollini, Morena; Canzan, Federica; Saiani, Luisa; Zannini, Lucia

2017-01-01

. The Clinical Learning Quality Evaluation Index for nursing students. The Italian nursing programs, the need to introduce tools evaluating the quality of the clinical learning as perceived by nursing students. Several tools already exist, however, several limitations suggesting the need to develop a new tool. A national project aimed at developing and validating a new instrument capable of measuring the clinical learning quality as experience by nursing students. A validation study design was undertaken from 2015 to 2016. All nursing national programs (n=43) were invited to participate by including all nursing students attending regularly their clinical learning. The tool developed based upon a) literature, b) validated tools already established among other healthcare professionals, and c) consensus expressed by experts and nursing students, was administered to the eligible students. 9606 nursing in 27 universities (62.8%) participated. The psychometric properties of the new instrument ranged from good to excellent. According to the findings, the tool consists in 22 items and five factors: a) quality of the tutorial strategies, b) learning opportunities; c) safety and nursing care quality; d) self-direct learning; e) quality of the learning environment. The tool is already used. Its systematic adoption may support comparison among settings and across different programs; moreover, the tool may also support in accrediting new settings as well as in measuring the effects of strategies aimed at improving the quality of the clinical learning.

Evaluating Internal Communication: The ICA Communication Audit.

ERIC Educational Resources Information Center

Goldhaber, Gerald M.

1978-01-01

The ICA Communication Audit is described in detail as an effective measurement procedure that can help an academic institution to evaluate its internal communication system. Tools, computer programs, analysis, and feedback procedures are described and illustrated. (JMF)

Iranian Effective Clinical Nurse Instructor evaluation tool: Development and psychometric testing

PubMed Central

Shahsavari, Hooman; Yekta, Zohreh Parsa; Zare, Zahra; Sigaroodi, Abdolhossain Emami

2014-01-01

Background: Clinical education is the heart of the nursing education program. Effective nursing clinical instructors are needed for graduating the future qualified nurses. There is a well-developed body of knowledge about the effectiveness of clinical teaching and the instructors. However, translating this knowledge into a context-based evaluation tool for measuring the effectiveness of Iranian clinical nursing instructors remains a deficiency. The purpose of this study is to describe the development and psychometric testing process of an instrument to evaluate the characteristics of Iranian effective clinical nurse instructor. Materials and Methods: Following a precise review of Iranian literatures and expert consultation, 83 statements about the characteristics that make clinical nurse instructors effective were extracted. In the next phase, the psychometric properties of the instrument were established by looking at the content validity, face validity, and internal consistency. Content validity of the instrument was assessed based on the comments of an expert panel including 10 nursing faculty members. During this phase, 30 items of the instrument were omitted or merged. Face validity of the instrument was assured based on the advices of 10 nursing students and 10 nursing faculty members. Finally, in the pilot test, the data of 168 filled questionnaires were gathered and analyzed by an exploratory factor analysis to reduce the items and identify the factor structure of the instrument. Results: Through subsequent analyses, of the 83 items, 31 items were merged or omitted. At last, 52 retained items were divided into four subscales including student-centric behaviors, clinical performances, planning ability, and personality traits. The Cronbach's alpha level of the inventory was 0.96, with the value for each domain ranging from 0.87 to 0.94. Conclusions: Iranian Effective Clinical Nurse Instructor evaluation tool has acceptable psychometric properties and can be used in evaluating the effectiveness of clinical nursing instructors. PMID:24834081

Evaluation of an online family history tool for identifying hereditary and familial colorectal cancer.

PubMed

Kallenberg, F G J; Aalfs, C M; The, F O; Wientjes, C A; Depla, A C; Mundt, M W; Bossuyt, P M M; Dekker, E

2017-09-21

Identifying a hereditary colorectal cancer (CRC) syndrome or familial CRC (FCC) in a CRC patient may enable the patient and relatives to enroll in surveillance protocols. As these individuals are insufficiently recognized, we evaluated an online family history tool, consisting of a patient-administered family history questionnaire and an automated genetic referral recommendation, to facilitate the identification of patients with hereditary CRC or FCC. Between 2015 and 2016, all newly diagnosed CRC patients in five Dutch outpatient clinics, were included in a trial with a stepped-wedge design, when first visiting the clinic. Each hospital continued standard procedures for identifying patients at risk (control strategy) and then, after a predetermined period, switched to offering the family history tool to included patients (intervention strategy). After considering the tool-based recommendation, the health care provider could decide on and arrange the referral. Primary outcome was the relative number of CRC patients who received screening or surveillance recommendations for themselves or relatives because of hereditary CRC or FCC, provided by genetic counseling. The intervention effect was evaluated using a logit-linear model. With the tool, 46/489 (9.4%) patients received a screening or surveillance recommendation, compared to 35/292 (12.0%) in the control group. In the intention-to-treat-analysis, accounting for time trends and hospital effects, this difference was not statistically significant (p = 0.58). A family history tool does not necessarily assist in increasing the number of CRC patients and relatives enrolled in screening or surveillance recommendations for hereditary CRC or FCC. Other interventions should be considered.

Tools for Successful Weight Management in Primary Care

PubMed Central

Turer, Christy Boling

2015-01-01

Obesity is one of the most pervasive and costly public-health problems. Clinicians need effective tools to address weight management in primary care, including evaluation and communication methods, guideline-based weight-management interventions, and safe and effective weight-loss medications and surgery. The objective of this Grand-Rounds presentation is to provide practicing clinicians with the latest information regarding effective ways to care for and communicate with patients about weight loss; evidence-based guidelines for selecting weight-management therapies; and safety, efficacy, and adverse effects of weight-loss medications and surgery. PMID:26218666

Communicators' perspective on snow avalanche risk communication

NASA Astrophysics Data System (ADS)

Charriere, M. K. M.; Bogaard, T.; Mostert, E.

2014-12-01

Among all the natural hazards, snow avalanches are the only ones for which a public danger scale is globally used. It consists of 5 levels of danger displayed with a given number and colour and for each of them, behavioural advices are provided. Even though this is standardized in most of the countries affected by this natural hazard, the tools (usually websites or smartphone applications) with which the information is disseminated to the general pubic differs, particularly in terms of target audience and level of details. This study aims at gathering the perspectives of several communicators that are responsible for these communication practices. The survey was created to assess how and why choices were made in the design process of the communication tools and to determine how their effectiveness is evaluated. Along with a review of existing avalanche risk communication tools, this study provides guidelines for communication and the evaluation of its effectiveness.

Evaluating the Effect of a Web-Based E-Learning Tool for Health Professional Education on Clinical Vancomycin Use: Comparative Study.

PubMed

Bond, Stuart Evan; Crowther, Shelley P; Adhikari, Suman; Chubaty, Adriana J; Yu, Ping; Borchard, Jay P; Boutlis, Craig Steven; Yeo, Wilfred Winston; Miyakis, Spiros

2018-02-26

Internet-based learning for health professional education is increasing. It offers advantages over traditional learning approaches, as it enables learning to be completed at a time convenient to the user and improves access where facilities are geographically disparate. We developed and implemented the Vancomycin Interactive (VI) e-learning tool to improve knowledge on the clinical use of the antibiotic vancomycin, which is commonly used for treatment of infections caused by methicillin-resistant Staphylococcus aureus (MRSA). The aims of this study were to evaluate the effect of the VI e-learning tool on (1) survey knowledge scores and (2) clinical use of vancomycin among health professionals. We conducted a comparative pre-post intervention study across the 14 hospitals of two health districts in New South Wales, Australia. A knowledge survey was completed by nurses, doctors, and pharmacists before and after release of a Web-based e-learning tool. Survey scores were compared with those obtained following traditional education in the form of an email intervention. Survey questions related to dosing, administration, and monitoring of vancomycin. Outcome measures were survey knowledge scores among the three health professional groups, vancomycin plasma trough levels, and vancomycin approvals recorded on a computerized clinical decision support system. Survey response rates were low at 26.87% (577/2147) preintervention and 8.24% (177/2147) postintervention. The VI was associated with an increase in knowledge scores (maximum score=5) among nurses (median 2, IQR 1-2 to median 2, IQR 1-3; P<.001), but not among other professional groups. The comparator email intervention was associated with an increase in knowledge scores among doctors (median 3, IQR 2-4 to median 4, IQR 2-4; P=.04). Participants who referred to Web-based resources while completing the e-learning tool achieved higher overall scores than those who did not (P<.001). The e-learning tool was not shown to be significantly more effective than the comparator email in the clinical use of vancomycin, as measured by plasma levels within the therapeutic range. The e-learning tool was associated with improved knowledge scores among nurses, whereas the comparator email was associated with improved scores among doctors. This implies that different strategies may be required for optimizing the effectiveness of education among different health professional groups. Low survey response rates limited conclusions regarding the tool's effectiveness. Improvements to design and evaluation methodology may increase the likelihood of a demonstrable effect from e-learning tools in the future. ©Stuart Evan Bond, Shelley P Crowther, Suman Adhikari, Adriana J Chubaty, Ping Yu, Jay P Borchard, Craig Steven Boutlis, Wilfred Winston Yeo, Spiros Miyakis. Originally published in JMIR Medical Education (http://mededu.jmir.org), 26.02.2018.

Mobile mental health: a challenging research agenda.

PubMed

Olff, Miranda

2015-01-01

The field of mobile health ("m-Health") is evolving rapidly and there is an explosive growth of psychological tools on the market. Exciting high-tech developments may identify symptoms, help individuals manage their own mental health, encourage help seeking, and provide both preventive and therapeutic interventions. This development has the potential to be an efficient cost-effective approach reducing waiting lists and serving a considerable portion of people globally ("g-Health"). However, few of the mobile applications (apps) have been rigorously evaluated. There is little information on how valid screening and assessment tools are, which of the mobile intervention apps are effective, or how well mobile apps compare to face-to-face treatments. But how feasible is rigorous scientific evaluation with the rising demands from policy makers, business partners, and users for their quick release? In this paper, developments in m-Health tools-targeting screening, assessment, prevention, and treatment-are reviewed with examples from the field of trauma and posttraumatic stress disorder. The academic challenges in developing and evaluating m-Health tools are being addressed. Evidence-based guidance is needed on appropriate research designs that may overcome some of the public and ethical challenges (e.g., equity, availability) and the market-driven wish to have mobile apps in the "App Store" yesterday rather than tomorrow.

The Course Improvement Flowchart: A Description of a Tool and Process for the Evaluation of University Teaching

ERIC Educational Resources Information Center

Morgan, Philip

2008-01-01

The use of evaluation to examine and improve the quality of teaching and courses is now a component of most universities. However, despite the various methods and opportunities for evaluation, a lack of understanding of the processes, measures and value are some of the major impediments to effective evaluation. Evaluation requires an understanding…

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Clinical Decision-Making Tool for Safe and Effective Prescription of Exercise in Acute Exacerbations of Chronic Obstructive Pulmonary Disease: Results From an Interdisciplinary Delphi Survey and Focus Groups.

PubMed

Camp, Pat G; Reid, W Darlene; Chung, Frank; Kirkham, Ashley; Brooks, Dina; Goodridge, Donna; Marciniuk, Darcy D; Hoens, Alison M

2015-10-01

Exercise is recommended for people with an acute exacerbation of chronic obstructive pulmonary disease (AECOPD), yet there is little information to guide safe and effective mobilization and exercise for these patients. The purpose of this study was to develop a clinical decision-making tool to guide health care professionals in the assessment, prescription, monitoring, and progression of mobilization and therapeutic exercise for patients with AECOPD. A 3-round interdisciplinary Delphi panel identified and selected items based on a preselected consensus of 80%. These items were summarized in a paper-based tool titled Mobilization in Acute Exacerbations of Chronic Obstructive Pulmonary Disease (AECOPD-Mob). Focus groups and questionnaires were subsequently used to conduct a sensibility evaluation of the tool. Nine researchers, 13 clinicians, and 7 individuals with COPD identified and approved 110 parameters for safe and effective exercise in AECOPD. These parameters were grouped into 5 categories: (1) "What to Assess Prior to Mobilization," (2) "When to Consider Not Mobilizing or to Discontinue Mobilization," (3) "What to Monitor During Mobilization for Patient Safety," (4) "How to Progress Mobilization to Enhance Effectiveness," and (5) "What to Confirm Prior to Discharge." The tool was evaluated in 4 focus groups of 18 health care professionals, 90% of whom reported the tool was easy to use, was concise, and would guide a health care professional who is new to the acute care setting and working with patients with AECOPD. The tool was developed based on published evidence and expert opinion, so the applicability of the items to patients in all settings cannot be guaranteed. The Delphi panel consisted of health care professionals from Canada, so items may not be generalizable to other jurisdictions. The AECOPD-Mob provides practical and concise information on safe and effective exercise for the AECOPD population for use by the new graduate or novice acute care practitioner. © 2015 American Physical Therapy Association.

Dust control effectiveness of drywall sanding tools.

PubMed

Young-Corbett, Deborah E; Nussbaum, Maury A

2009-07-01

In this laboratory study, four drywall sanding tools were evaluated in terms of dust generation rates in the respirable and thoracic size classes. In a repeated measures study design, 16 participants performed simulated drywall finishing tasks with each of four tools: (1) ventilated sander, (2) pole sander, (3) block sander, and (4) wet sponge. Dependent variables of interest were thoracic and respirable breathing zone dust concentrations. Analysis by Friedman's Test revealed that the ventilated drywall sanding tool produced significantly less dust, of both size classes, than did the other three tools. The pole and wet sanders produced significantly less dust of both size classes than did the block sander. The block sander, the most commonly used tool in drywall finishing operations, produced significantly more dust of both size classes than did the other three tools. When compared with the block sander, the other tools offer substantial dust reduction. The ventilated tool reduced respirable concentrations by 88% and thoracic concentrations by 85%. The pole sander reduced respirable concentrations by 58% and thoracic by 50%. The wet sander produced reductions of 60% and 47% in the respirable and thoracic classes, respectively. Wet sponge sanders and pole sanders are effective at reducing breathing-zone dust concentrations; however, based on its superior dust control effectiveness, the ventilated sander is the recommended tool for drywall finishing operations.

Beyond information access: Support for complex cognitive activities in public health informatics tools.

PubMed

Sedig, Kamran; Parsons, Paul; Dittmer, Mark; Ola, Oluwakemi

2012-01-01

Public health professionals work with a variety of information sources to carry out their everyday activities. In recent years, interactive computational tools have become deeply embedded in such activities. Unlike the early days of computational tool use, the potential of tools nowadays is not limited to simply providing access to information; rather, they can act as powerful mediators of human-information discourse, enabling rich interaction with public health information. If public health informatics tools are designed and used properly, they can facilitate, enhance, and support the performance of complex cognitive activities that are essential to public health informatics, such as problem solving, forecasting, sense-making, and planning. However, the effective design and evaluation of public health informatics tools requires an understanding of the cognitive and perceptual issues pertaining to how humans work and think with information to perform such activities. This paper draws on research that has examined some of the relevant issues, including interaction design, complex cognition, and visual representations, to offer some human-centered design and evaluation considerations for public health informatics tools.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools

PubMed Central

Foster, Margaret J

2011-01-01

Objective: The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. Methods: The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Results: Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. Conclusions: As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed. PMID:21753917

Usability Evaluation of Spot and Runway Departure Advisor (SARDA) Concept in Dallas/Fort Worth Airport Tower Simulation

NASA Technical Reports Server (NTRS)

Hayashi, Miwa; Hoang, Ty; Jung, Yoon C.; Gupta, Gautam; Malik, Waqar; Dulchinos, Victoria

2013-01-01

Spot and Runway Departure Advisor (SARDA) is a proposed decision-support tool for air traffic control tower controllers for reducing taxi delay and optimizing the departure sequence. In the present study, the tool's usability was evaluated to ensure that its claimed performance benefits are not being realized at the cost of increasing the work burden on controllers. For the evaluation, workload ratings and questionnaire responses collected during a human-in-the-loop simulation experiment were analyzed to assess the SARDA advisories' effects on the controllers' ratings on cognitive resources (e.g., workload, spare attention) and satisfaction. The results showed that SARDA reduced the controllers' workload and increased their spare attention. It also made workload and attention levels less susceptible to the effects of increases in the traffic load. The questionnaire responses suggested that the controllers generally were satisfied with the ease of use of the tool and the objectives of the SARDA concept, but with some caution. To gain more trust from controllers, the the reasoning behind advisories may need to be made more transparent to them.

Using media to impact health policy-making: an integrative systematic review.

PubMed

Bou-Karroum, Lama; El-Jardali, Fadi; Hemadi, Nour; Faraj, Yasmine; Ojha, Utkarsh; Shahrour, Maher; Darzi, Andrea; Ali, Maha; Doumit, Carine; Langlois, Etienne V; Melki, Jad; AbouHaidar, Gladys Honein; Akl, Elie A

2017-04-18

Media interventions can potentially play a major role in influencing health policies. This integrative systematic review aimed to assess the effects of planned media interventions-including social media-on the health policy-making process. Eligible study designs included randomized and non-randomized designs, economic studies, process evaluation studies, stakeholder analyses, qualitative methods, and case studies. We electronically searched Medline, EMBASE, Communication and Mass Media Complete, Cochrane Central Register of Controlled Trials, and the WHO Global Health Library. We followed standard systematic review methodology for study selection, data abstraction, and risk of bias assessment. Twenty-one studies met our eligibility criteria: 10 evaluation studies using either quantitative (n = 7) or qualitative (n = 3) designs and 11 case studies. None of the evaluation studies were on social media. The findings of the evaluation studies suggest that media interventions may have a positive impact when used as accountability tools leading to prioritizing and initiating policy discussions, as tools to increase policymakers' awareness, as tools to influence policy formulation, as awareness tools leading to policy adoption, and as awareness tools to improve compliance with laws and regulations. In one study, media-generated attention had a negative effect on policy advocacy as it mobilized opponents who defeated the passage of the bills that the media intervention advocated for. We judged the confidence in the available evidence as limited due to the risk of bias in the included studies and the indirectness of the evidence. There is currently a lack of reliable evidence to guide decisions on the use of media interventions to influence health policy-making. Additional and better-designed, conducted, and reported primary research is needed to better understand the effects of media interventions, particularly social media, on health policy-making processes, and the circumstances under which media interventions are successful. PROSPERO 2015: CRD42015020243.

Evaluating an holistic assessment tool for palliative care practice.

PubMed

McIlfatrick, Sonja; Hasson, Felicity

2014-04-01

To evaluate a holistic assessment tool for palliative care practice. This included identifying patients' needs using the holistic tool and exploring the usability, applicability and barriers and facilitators towards implementation in practice. The delivery of effective holistic palliative care requires a careful assessment of the patients' needs and circumstances. Whilst holistic assessment of palliative care needs is advocated, questions exist around the appropriateness of tools to assist this process. Mixed-method research design. Data collection involved an analysis of piloted holistic assessments undertaken using the tool (n = 132) and two focus groups with healthcare professionals (n = 10). The tool enabled health professionals to identify and gain an understanding of the needs of the patients, specifically in relation to the physical healthcare needs. Differences, however, between the analysis of the tool documentation and focus group responses were identified in particular areas. For example, 59 (68·8%) respondents had discussed preferred priorities of care with the patient; however, focus group comments revealed participants had concerns around this. Similarly, whilst over half of responses (n = 50; 57·5%) had considered a prognostic clinical indicator for the patient as an action, focus group results indicated questions around healthcare professionals' knowledge and perceived usefulness of such indicators. Positive aspects of the tool were that it was easy to understand and captured the needs of individuals. Negative aspects of the tool were that it was repetitive and the experience of assessors required consideration. The tool evaluation identified questions regarding holistic assessment in palliative care practice and the importance of communication. A holistic assessment tool can support patient assessment and identification of patients' needs in the 'real world' of palliative care practice, but the 'tool' is merely an aid to assist professionals to discuss difficult and sensitive aspects of care. © 2013 John Wiley & Sons Ltd.

Mutation extraction tools can be combined for robust recognition of genetic variants in the literature

PubMed Central

Jimeno Yepes, Antonio; Verspoor, Karin

2014-01-01

As the cost of genomic sequencing continues to fall, the amount of data being collected and studied for the purpose of understanding the genetic basis of disease is increasing dramatically. Much of the source information relevant to such efforts is available only from unstructured sources such as the scientific literature, and significant resources are expended in manually curating and structuring the information in the literature. As such, there have been a number of systems developed to target automatic extraction of mutations and other genetic variation from the literature using text mining tools. We have performed a broad survey of the existing publicly available tools for extraction of genetic variants from the scientific literature. We consider not just one tool but a number of different tools, individually and in combination, and apply the tools in two scenarios. First, they are compared in an intrinsic evaluation context, where the tools are tested for their ability to identify specific mentions of genetic variants in a corpus of manually annotated papers, the Variome corpus. Second, they are compared in an extrinsic evaluation context based on our previous study of text mining support for curation of the COSMIC and InSiGHT databases. Our results demonstrate that no single tool covers the full range of genetic variants mentioned in the literature. Rather, several tools have complementary coverage and can be used together effectively. In the intrinsic evaluation on the Variome corpus, the combined performance is above 0.95 in F-measure, while in the extrinsic evaluation the combined recall performance is above 0.71 for COSMIC and above 0.62 for InSiGHT, a substantial improvement over the performance of any individual tool. Based on the analysis of these results, we suggest several directions for the improvement of text mining tools for genetic variant extraction from the literature. PMID:25285203

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017. Published by Elsevier B.V.

Evaluation of Training Effectiveness in the Spanish Health Sector

ERIC Educational Resources Information Center

Pineda-Herrero, Pilar; Belvis, Esther; Moreno, Victoria; Duran-Bellonch, Maria M.; Ucar, Xavier

2011-01-01

Purpose: The evaluation of training results in large groups with limited resources is one of the challenges of organisations. This paper aims to provide a methodological approach to facilitate evaluation of training among large groups. The paper presents the tools and the results of an evaluation of a whole training plan on the rational use of…

Using Student Evaluations at a Cambodian University to Improve Teaching Effectiveness

ERIC Educational Resources Information Center

Nash, John Lysne

2012-01-01

This is the first study done in Cambodia wherein students used the Student Evaluations of Educational Quality (SEEQ) evaluation tool to evaluate the teaching quality of their instructors. Respondents were instructors and students from the English Language Support Unit at the Royal University of Phnom Penh. This study generated data from mid- and…

Evaluating Supplemental Educational Service Providers: Suggested Strategies for States. A Guidebook Prepared for the Center on Innovation & Improvement. Second Edition

ERIC Educational Resources Information Center

Ross, Steven M.; Potter, Allison; Harmon, Jennifer

2006-01-01

This second edition of the Guidebook is designed to help state educational agencies (SEAs) create an effective system to evaluate state-approved supplemental educational service (SES) providers. The text includes tools and strategies that will help readers determine evaluation measures, identify possible evaluation methodologies, and address the…

The Effects of Survey Timing on Student Evaluation of Teaching Measures Obtained Using Online Surveys

ERIC Educational Resources Information Center

Estelami, Hooman

2015-01-01

Teaching evaluations are an important measurement tool used by business schools in gauging the level of student satisfaction with the educational services delivered by faculty. The growing use of online teaching evaluations has enabled educational administrators to expand the time period during which student evaluation of teaching (SET) surveys…

A Landscape Model (LEEMATH) to Evaluate Effects of Management Impacts on Timber and Wildlife Habitat

Treesearch

Harbin Li; David L. Gartner; Pu Mou; Carl C. Trettin

2000-01-01

Managing forest resources for sustainability requires the successful integration of economic and ecological goals. To attain such integration, land managers need decision support tools that incorporate science, land-use strategies, and policy options to assess resources sustainability at large scales. Landscape Evaluation of Effects of Management Activities on Timber...

Learning to Learn: Lessons from a Collaboration

ERIC Educational Resources Information Center

Chadha, Anita

2017-01-01

E-learning has become one of the primary ways to deliver education around the globe. Research is keeping pace with the use of various techno-aids as educators evaluate how to effectively use these aids in an ever-changing e-classroom. Adding to this body of work, and in assessing the effectiveness of techno-tools, this study evaluates meaningful…

An Experiential Approach to Clinical Supervision Training: A Mixed Methods Evaluation of Effectiveness

ERIC Educational Resources Information Center

Fisher, Amy Killen; Simmons, Christopher; Allen, Susan C.

2016-01-01

This study evaluates an intensive experiential exercise designed to facilitate the provision of high-quality supervision in social work. Data from 46 BSW and MSW students suggest that the exercise can be an effective learning tool. Both quantitative and qualitative findings indicated that the students formed a supervisory working alliance; BSW…

A Tool for Learning or a Tool for Cheating? The Many-Sided Effects of a Participatory Student Website in Mass Higher Education

ERIC Educational Resources Information Center

Stöckelová, Tereza; Virtová, Tereza

2015-01-01

This paper is a case study of the genesis, operation and, in particular, the educational effects of a participatory website established and run by students of one of the largest universities in the Czech Republic, the purpose of which is to enable students to share study materials, essays and evaluations of staff and courses. We study the rise of…

Integrating Computational Science Tools into a Thermodynamics Course

NASA Astrophysics Data System (ADS)

Vieira, Camilo; Magana, Alejandra J.; García, R. Edwin; Jana, Aniruddha; Krafcik, Matthew

2018-01-01

Computational tools and methods have permeated multiple science and engineering disciplines, because they enable scientists and engineers to process large amounts of data, represent abstract phenomena, and to model and simulate complex concepts. In order to prepare future engineers with the ability to use computational tools in the context of their disciplines, some universities have started to integrate these tools within core courses. This paper evaluates the effect of introducing three computational modules within a thermodynamics course on student disciplinary learning and self-beliefs about computation. The results suggest that using worked examples paired to computer simulations to implement these modules have a positive effect on (1) student disciplinary learning, (2) student perceived ability to do scientific computing, and (3) student perceived ability to do computer programming. These effects were identified regardless of the students' prior experiences with computer programming.

An attempt to implement tools to support examination of community-based activities for disaster mitigation: A case study in Toyokawa city, Japan

NASA Astrophysics Data System (ADS)

Karashima, Kazuki; Ohgai, Akira

2017-10-01

Japan is a country with a high risk for earthquake disasters. The measures used to promote structures' seismic safety, such as reconstruction, widening narrow roads, and the response capacities to deal with huge earthquakes are important. Techniques to support the examination of countermeasures to huge earthquakes are required. To improve this capability, the authors developed tools to: (1) evaluate fire-spread risk, (2) evaluate the difficulty of emergency response and evacuation, and (3) evaluate capacities of neighborhood communities for disaster mitigation. The usefulness of the tools was clarified by the demonstration experiments of previous studies. The next step was implementation of the tools in community-based activities for disaster mitigation. This study aimed to clarify the usability and problems of implementing the tools in community-based activities. The tools were used at several workshops in actual community-based activities for disaster mitigation for one year. After the last workshop, interviews and a questionnaire were conducted on municipal staff and consultant staff. The results found that the tools visually showed the fire-spread risk, the difficulty of evacuation under current conditions and after improvements, and the effects of each disaster mitigation activity. The users could easily explore the draft plans to promote seismic safety of urban structures and response capabilities. The tools were positively incorporated into some community-based activities for disaster mitigation. Thus, the tools have the possibility of successful use at continuing community-based activities and the possibility of implementing the tools will be promoted.

Efficacy of teaching methods used to develop critical thinking in nursing and midwifery undergraduate students: A systematic review of the literature.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2016-05-01

The value and importance of incorporating strategies that promote critical thinking in nursing and midwifery undergraduate programmes are well documented. However, relatively little is known about the effectiveness of teaching strategies in promoting CT. Evaluating effectiveness is important to promote 'best practise' in teaching. To evaluate the efficacy of teaching methods used to develop critical thinking skills in nursing and midwifery undergraduate students. The following six databases; CINAHL, Ovid Medline, ERIC, Informit, PsycINFO and Scopus were searched and resulted in the retrieval of 1315 papers. After screening for inclusion, each paper was evaluated using the Critical Appraisal Skills Programme tool. Twenty-eight studies met the inclusion criteria and quality appraisal. Twelve different teaching interventions were tested in 8 countries. Results varied, with little consistency across studies using the same type of intervention or outcome tool. Sixteen tools were used to measure the efficacy of teaching in developing critical thinking. Seventeen studies identified a significant increase in critical thinking, while nine studies found no increases, and two found unexplained decreases in CT when using a similar educational intervention. Whilst this review aimed to identify effective teaching strategies that promote and develop critical thinking, flaws in methodology and outcome measures contributed to inconsistent findings. The continued use of generalised CT tools is unlikely to help identify appropriate teaching methods that will improve CT abilities of midwifery and nursing students and prepare them for practise. The review was limited to empirical studies published in English that used measures of critical thinking with midwifery and nursing students. Discipline specific strategies and tools that measure students' abilities to apply CT in practise are needed. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

Leveraging Observation Tools for Instructional Improvement: Exploring Variability in Uptake of Ambitious Instructional Practices

ERIC Educational Resources Information Center

Cohen, Julie; Schuldt, Lorien Chambers; Brown, Lindsay; Grossman, Pamela

2016-01-01

Background/Context: Current efforts to build rigorous teacher evaluation systems has increased interest in standardized classroom observation tools as reliable measures for assessing teaching. However, many argue these instruments can also be used to effect change in classroom practice. This study investigates a model of professional development…

Evaluating the Effectiveness of College Web Sites for Prospective Students

ERIC Educational Resources Information Center

Ford, Wendy G.

2011-01-01

College Web sites are often the first structured encounter a student has with a prospective college or university. Outside of serving as a marketing tool (Williams 2000), very little literature exists on the functional purpose of a college's Web site. Almost all college sites show an informational and transactional tool for currently enrolled…

Probing the Question Order Effect While Developing a Chemistry Concept Inventory

ERIC Educational Resources Information Center

Undersander, Molly A.; Lund, Travis J.; Langdon, Laurie S.; Stains, Marilyne

2017-01-01

The design of assessment tools is critical to accurately evaluate students' understanding of chemistry. Although extensive research has been conducted on various aspects of assessment tool design, few studies in chemistry have focused on the impact of the order in which questions are presented to students on the measurement of students'…

A GIS BASED DECISION SUPPORT SYSTEM AND RESOURCE TOOL FOR USE ON STUDIES OF THE LAKE TEXOMA ECOSYSTEM

EPA Science Inventory

Investigations are underway at Lake Texoma, to develop decision support tools and information to evaluate the transport and attenuation of contaminants and stressors in a lake ecosystem, and link them to observable ecological effects. The U.S. EPA, USGS, U. S. Army Corps of Eng...

Does Copying Idioms Promote Their Recall?

ERIC Educational Resources Information Center

Stengers, Hélène; Deconinck, Julie; Boers, Frank; Eyckmans, June

2016-01-01

This paper reports an experiment designed to evaluate an attempt to improve the effectiveness of an existing L2 idiom-learning tool. In this tool, learners are helped to associate the abstract, idiomatic meaning of expressions such as "jump the gun" (act too soon) with their original, concrete meaning (e.g. associating "jump the…

A Web-Based Learning Tool Improves Student Performance in Statistics: A Randomized Masked Trial

ERIC Educational Resources Information Center

Gonzalez, Jose A.; Jover, Lluis; Cobo, Erik; Munoz, Pilar

2010-01-01

Background: e-status is a web-based tool able to generate different statistical exercises and to provide immediate feedback to students' answers. Although the use of Information and Communication Technologies (ICTs) is becoming widespread in undergraduate education, there are few experimental studies evaluating its effects on learning. Method: All…

The Use of Collaboration Tools when Teaching with Learning Content Management Systems (LCMS)

ERIC Educational Resources Information Center

Mncube-Barnes, Fatima Maria

2010-01-01

This study was designed to determine whether faculty members utilized collaboration tools within Desire2Learn Inc., in accordance with Chickering and Gamson's (1987) "Seven Principles of Good Practice: A Framework for Evaluating Effective Teaching in Undergraduate Education." The population for this study was faculty members at…

Interactive Whiteboards: A New Tool for Extension Education

ERIC Educational Resources Information Center

Schroeder, Mary M.; Burns, Connie S.; Reicks, Marla M.

2011-01-01

Use of interactive whiteboards (IWBs) in school classrooms and conference rooms is increasing. To evaluate the effectiveness of IWBs as a tool for Extension education, two groups of 3rd and 4th grade Minnesota students (n=325) were taught nutrition using traditional methods or IWBs. Significant increases in knowledge and behavior were observed in…

Laboratory, Field, and Analytical Procedures for Using Passive Sampling in the Evaluation of Contaminated Sediments: User's Manual

EPA Science Inventory

Regardless of the remedial technology invoked to address contaminated sediments in the environment, there is a critical need to have tools for assessing the effectiveness of the remedy. In the past, these tools have included chemical and biomonitoring of the water column and sedi...

Evaluation of Tools for Protection of Interest against Hacking and Cracking

NASA Astrophysics Data System (ADS)

Jahankhani, Hossein; Antonijevic, Branko; Walcott, Terry

The internet considered a tool that effectively ensures communication globally has been hindered by hackers and crackers continuously. In so doing, a multitude of network facilitated tools such as firewalls, virtual private networks (VPN) and a variety of antivirus software packages has been enabled for dealing with such predicaments. However, more often than not these facilitated tools are marketed as perfect solutions to the ever culminating problems such as loss of data and privacy in networked and world wide intercommunications. We provide a forum for addressing these perceived problems in this paper.

System analysis tools for an ELT at ESO

NASA Astrophysics Data System (ADS)

Mueller, Michael; Koch, Franz

2006-06-01

Engineering of complex, large scale systems like the ELT designs currently investigated and developed in Europe and Northern America require powerful and sophisticated tools within specific technical disciplines such as mechanics, optics and control engineering. However, even analyzing a certain component of the telescope like the telescope structure necessitates a system approach to evaluate the structural effects onto the optical performance. This paper shows several software tools developed by the European Southern Observatory (ESO) which focus onto the system approach in the analyses: Using modal results of a finite element analysis the SMI-toolbox allows an easy generation of structural models with different sizes and levels of accuracy for the control design and closed-loop simulations. The optical modeling code BeamWarrior was developed by ESO and Astrium GmbH, Germany) especially for integrated modeling and interfering with a structural model. Within BeamWarrior displacements and deformations can be applied in an arbitrary coordinate system, and hence also in the global coordinates of the FE model avoiding error prone transformations. In addition to this, a sparse state space model object was developed for Matlab to gain in computational efficiency and reduced memory requirements due to the sparsity pattern of both the structural models and the control architecture. As one result these tools allow building an integrated model in order to reliably simulate interactions, cross-coupling effects, system responses, and to evaluate global performance. In order to evaluate disturbance effects on the optical performance in openloop more efficiently, an optical evaluation toolbox was built in the FE software ANSYS which performs Zernike decomposition and best-fit computation of the deformations directly in the FE analysis.

On line biomonitors used as a tool for toxicity reduction evaluation of in situ groundwater remediation techniques.

PubMed

Küster, Eberhard; Dorusch, Falk; Vogt, Carsten; Weiss, Holger; Altenburger, Rolf

2004-07-15

Success of groundwater remediation is typically controlled via snapshot analysis of selected chemical substances or physical parameters. Biological parameters, i.e. ecotoxicological assays, are rarely employed. Hence the aim of the study was to develop a bioassay tool, which allows an on line monitoring of contaminated groundwater, as well as a toxicity reduction evaluation (TRE) of different remediation techniques in parallel and may furthermore be used as an additional tool for process control to supervise remediation techniques in a real time mode. Parallel testing of groundwater remediation techniques was accomplished for short and long time periods, by using the energy dependent luminescence of the bacterium Vibrio fischeri as biological monitoring parameter. One data point every hour for each remediation technique was generated by an automated biomonitor. The bacteria proved to be highly sensitive to the contaminated groundwater and the biomonitor showed a long standing time despite the highly corrosive groundwater present in Bitterfeld, Germany. The bacterial biomonitor is demonstrated to be a valuable tool for remediation success evaluation. Dose response relationships were generated for the six quantitatively dominant groundwater contaminants (2-chlortoluene, 1,2- and 1,4-dichlorobenzene, monochlorobenzene, ethylenbenzene and benzene). The concentrations of individual volatile organic chemicals (VOCs) could not explain the observed effects in the bacteria. An expected mixture toxicity was calculated for the six components using the concept of concentration addition. The calculated EC(50) for the mixture was still one order of magnitude lower than the observed EC(50) of the actual groundwater. The results pointed out that chemical analysis of the six most quantitative substances alone was not able to explain the effects observed with the bacteria. Thus chemical analysis alone may not be an adequate tool for remediation success evaluation in terms of toxicity reduction.

Development of a simplified urban water balance model (WABILA).

PubMed

Henrichs, M; Langner, J; Uhl, M

2016-01-01

During the last decade, water sensitive urban design (WSUD) has become more and more accepted. However, there is not any simple tool or option available to evaluate the influence of these measures on the local water balance. To counteract the impact of new settlements, planners focus on mitigating increases in runoff through installation of infiltration systems. This leads to an increasing non-natural groundwater recharge and decreased evapotranspiration. Simple software tools which evaluate or simulate the effect of WSUD on the local water balance are still needed. The authors developed a tool named WABILA (Wasserbilanz) that could support planners for optimal WSUD. WABILA is an easy-to-use planning tool that is based on simplified regression functions for established measures and land covers. Results show that WSUD has to be site-specific, based on climate conditions and the natural water balance.

Measurement properties of tools used to assess depression in adults with and without autism spectrum conditions: A systematic review.

PubMed

Cassidy, S A; Bradley, L; Bowen, E; Wigham, S; Rodgers, J

2018-01-23

Depression is the most commonly experienced mental health condition in adults with autism spectrum conditions (ASC). However, it is unclear what tools are currently being used to assess depression in ASC, or whether tools need to be adapted for this group. This systematic review therefore aimed to identify tools used to assess depression in adults with and without ASC, and then evaluate these tools for their appropriateness and measurement properties. Medline, PsychINFO and Web of Knowledge were searched for studies of depression in: (a) adults with ASC, without co-morbid intellectual disability; and (b) adults from the general population without co-morbid conditions. Articles examining the measurement properties of these tools were then searched for using a methodological filter in PubMed, and the quality of the evidence was evaluated using the COSMIN checklist. Twelve articles were identified which utilized three tools to assess depression in adults with ASC, but only one article which assessed the measurement properties of one of these tools was identified and thus evaluated. Sixty-four articles were identified which utilized five tools to assess depression in general population adults, and fourteen articles had assessed the measurement properties of these tools. Overall, two tools were found to be robust in their measurement properties in the general population-the Beck Depression Inventory (BDI-II), and the patient health questionnaire (PHQ-9). Crucially only one study was identified from the COSMIN search, which showed weak evidence in support of the measurement properties of the BDI-II in an ASC sample. Implications for effective measurement of depression in ASC are discussed. Autism Res 2018. © 2018 The Authors Autism Research published by International Society for Autism Research and Wiley Periodicals, Inc. Depression is the most common mental health problem experienced by adults with autism. However, the current study found very limited evidence regarding how useful tools developed for the general population are for adults with autism. We therefore suggest how these tools could be adapted to more effectively assess depression in adults with autism, and improve these individuals access to mental health assessment and support. © 2018 The Authors Autism Research published by International Society for Autism Research and Wiley Periodicals, Inc.

A Cost-Effectiveness Tool for Informing Policies on Zika Virus Control.

PubMed

Alfaro-Murillo, Jorge A; Parpia, Alyssa S; Fitzpatrick, Meagan C; Tamagnan, Jules A; Medlock, Jan; Ndeffo-Mbah, Martial L; Fish, Durland; Ávila-Agüero, María L; Marín, Rodrigo; Ko, Albert I; Galvani, Alison P

2016-05-01

As Zika virus continues to spread, decisions regarding resource allocations to control the outbreak underscore the need for a tool to weigh policies according to their cost and the health burden they could avert. For example, to combat the current Zika outbreak the US President requested the allocation of $1.8 billion from Congress in February 2016. Illustrated through an interactive tool, we evaluated how the number of Zika cases averted, the period during pregnancy in which Zika infection poses a risk of microcephaly, and probabilities of microcephaly and Guillain-Barré Syndrome (GBS) impact the cost at which an intervention is cost-effective. From Northeast Brazilian microcephaly incidence data, we estimated the probability of microcephaly in infants born to Zika-infected women (0.49% to 2.10%). We also estimated the probability of GBS arising from Zika infections in Brazil (0.02% to 0.06%) and Colombia (0.08%). We calculated that each microcephaly and GBS case incurs the loss of 29.95 DALYs and 1.25 DALYs per case, as well as direct medical costs for Latin America and the Caribbean of $91,102 and $28,818, respectively. We demonstrated the utility of our cost-effectiveness tool with examples evaluating funding commitments by Costa Rica and Brazil, the US presidential proposal, and the novel approach of genetically modified mosquitoes. Our analyses indicate that the commitments and the proposal are likely to be cost-effective, whereas the cost-effectiveness of genetically modified mosquitoes depends on the country of implementation. Current estimates from our tool suggest that the health burden from microcephaly and GBS warrants substantial expenditures focused on Zika virus control. Our results justify the funding committed in Costa Rica and Brazil and many aspects of the budget outlined in the US president's proposal. As data continue to be collected, new parameter estimates can be customized in real-time within our user-friendly tool to provide updated estimates on cost-effectiveness of interventions and inform policy decisions in country-specific settings.

An Integrated Approach of Fuzzy Linguistic Preference Based AHP and Fuzzy COPRAS for Machine Tool Evaluation.

PubMed

Nguyen, Huu-Tho; Md Dawal, Siti Zawiah; Nukman, Yusoff; Aoyama, Hideki; Case, Keith

2015-01-01

Globalization of business and competitiveness in manufacturing has forced companies to improve their manufacturing facilities to respond to market requirements. Machine tool evaluation involves an essential decision using imprecise and vague information, and plays a major role to improve the productivity and flexibility in manufacturing. The aim of this study is to present an integrated approach for decision-making in machine tool selection. This paper is focused on the integration of a consistent fuzzy AHP (Analytic Hierarchy Process) and a fuzzy COmplex PRoportional ASsessment (COPRAS) for multi-attribute decision-making in selecting the most suitable machine tool. In this method, the fuzzy linguistic reference relation is integrated into AHP to handle the imprecise and vague information, and to simplify the data collection for the pair-wise comparison matrix of the AHP which determines the weights of attributes. The output of the fuzzy AHP is imported into the fuzzy COPRAS method for ranking alternatives through the closeness coefficient. Presentation of the proposed model application is provided by a numerical example based on the collection of data by questionnaire and from the literature. The results highlight the integration of the improved fuzzy AHP and the fuzzy COPRAS as a precise tool and provide effective multi-attribute decision-making for evaluating the machine tool in the uncertain environment.

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Using stand replacement fires to restore southern Appalachian pine-hardwood ecosystems: effects on mass, carbon, and nutrient pools

Treesearch

James M. Vose; Wayne T. Swank; Barton D. Clinton; Jennifer D. Knoepp; Lloyd W. Swift

1999-01-01

Pine-hardwood ecosystems in the Southern Appalachians are in serious decline due to fire exclusion and insect infestations. Fire has been advanced as a tool to restore these ecosystems, yet there are few studies evaluating overall ecosystem effects. The authors’ objectives were to evaluate the effects of stand restoration burning on forest floor nitrogen (N) and carbon...

Critical evaluation of reverse engineering tool Imagix 4D!

PubMed

Yadav, Rashmi; Patel, Ravindra; Kothari, Abhay

2016-01-01

The comprehension of legacy codes is difficult to understand. Various commercial reengineering tools are available that have unique working styles, and are equipped with their inherent capabilities and shortcomings. The focus of the available tools is in visualizing static behavior not the dynamic one. Therefore, it is difficult for people who work in software product maintenance, code understanding reengineering/reverse engineering. Consequently, the need for a comprehensive reengineering/reverse engineering tool arises. We found the usage of Imagix 4D to be good as it generates the maximum pictorial representations in the form of flow charts, flow graphs, class diagrams, metrics and, to a partial extent, dynamic visualizations. We evaluated Imagix 4D with the help of a case study involving a few samples of source code. The behavior of the tool was analyzed on multiple small codes and a large code gcc C parser. Large code evaluation was performed to uncover dead code, unstructured code, and the effect of not including required files at preprocessing level. The utility of Imagix 4D to prepare decision density and complexity metrics for a large code was found to be useful in getting to know how much reengineering is required. At the outset, Imagix 4D offered limitations in dynamic visualizations, flow chart separation (large code) and parsing loops. The outcome of evaluation will eventually help in upgrading Imagix 4D and posed a need of full featured tools in the area of software reengineering/reverse engineering. It will also help the research community, especially those who are interested in the realm of software reengineering tool building.

VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems.

PubMed

Kalawsky, R S

1999-02-01

A special questionnaire (VRUSE) has been designed to measure the usability of a VR system according to the attitude and perception of its users. Important aspects of VR systems were carefully derived to produce key usability factors for the questionnaire. Unlike questionnaires designed for generic interfaces VRUSE is specifically designed to cater for evaluating virtual environments, being a diagnostic tool providing a wealth of information about a user's viewpoint of the interface. VRUSE can be used to great effect with other evaluation techniques to pinpoint problematical areas of a VR interface. Other applications include bench-marking of competitor VR systems.

Auditing and Evaluating University-Community Engagement: Lessons from a UK Case Study

ERIC Educational Resources Information Center

Hart, Angie; Northmore, Simon

2011-01-01

The growing importance of community and public engagement activities in universities has led to an increasing emphasis on auditing and evaluating university-community partnerships. However, the development of effective audit and evaluation tools is still at a formative stage. This article presents a case study of the University of Brighton's…

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

Communication Tools for End-of-Life Decision-Making in Ambulatory Care Settings: A Systematic Review and Meta-Analysis.

PubMed

Oczkowski, Simon J; Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J

2016-01-01

Patients with serious illness, and their families, state that better communication and decision-making with healthcare providers is a high priority to improve the quality of end-of-life care. Numerous communication tools to assist patients, family members, and clinicians in end-of-life decision-making have been published, but their effectiveness remains unclear. To determine, amongst adults in ambulatory care settings, the effect of structured communication tools for end-of-life decision-making on completion of advance care planning. We searched for relevant randomized controlled trials (RCTs) or non-randomized intervention studies in MEDLINE, EMBASE, CINAHL, ERIC, and the Cochrane Database of Randomized Controlled Trials from database inception until July 2014. Two reviewers independently screened articles for eligibility, extracted data, and assessed risk of bias. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was used to evaluate the quality of evidence for each of the primary and secondary outcomes. Sixty-seven studies, including 46 RCTs, were found. The majority evaluated communication tools in older patients (age >50) with no specific medical condition, but many specifically evaluated populations with cancer, lung, heart, neurologic, or renal disease. Most studies compared the use of communication tools against usual care, but several compared the tools to less-intensive advance care planning tools. The use of structured communication tools increased: the frequency of advance care planning discussions/discussions about advance directives (RR 2.31, 95% CI 1.25-4.26, p = 0.007, low quality evidence) and the completion of advance directives (ADs) (RR 1.92, 95% CI 1.43-2.59, p<0.001, low quality evidence); concordance between AD preferences and subsequent medical orders for use or non-use of life supporting treatment (RR 1.19, 95% CI 1.01-1.39, p = 0.028, very low quality evidence, 1 observational study); and concordance between the care desired and care received by patients (RR 1.17, 95% CI 1.05-1.30, p = 0.004, low quality evidence, 2 RCTs). The use of structured communication tools may increase the frequency of discussions about and completion of advance directives, and concordance between the care desired and the care received by patients. The use of structured communication tools rather than an ad-hoc approach to end-of-life decision-making should be considered, and the selection and implementation of such tools should be tailored to address local needs and context. PROSPERO CRD42014012913.

Communication Tools for End-of-Life Decision-Making in Ambulatory Care Settings: A Systematic Review and Meta-Analysis

PubMed Central

Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J.

2016-01-01

Background Patients with serious illness, and their families, state that better communication and decision-making with healthcare providers is a high priority to improve the quality of end-of-life care. Numerous communication tools to assist patients, family members, and clinicians in end-of-life decision-making have been published, but their effectiveness remains unclear. Objectives To determine, amongst adults in ambulatory care settings, the effect of structured communication tools for end-of-life decision-making on completion of advance care planning. Methods We searched for relevant randomized controlled trials (RCTs) or non-randomized intervention studies in MEDLINE, EMBASE, CINAHL, ERIC, and the Cochrane Database of Randomized Controlled Trials from database inception until July 2014. Two reviewers independently screened articles for eligibility, extracted data, and assessed risk of bias. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was used to evaluate the quality of evidence for each of the primary and secondary outcomes. Results Sixty-seven studies, including 46 RCTs, were found. The majority evaluated communication tools in older patients (age >50) with no specific medical condition, but many specifically evaluated populations with cancer, lung, heart, neurologic, or renal disease. Most studies compared the use of communication tools against usual care, but several compared the tools to less-intensive advance care planning tools. The use of structured communication tools increased: the frequency of advance care planning discussions/discussions about advance directives (RR 2.31, 95% CI 1.25–4.26, p = 0.007, low quality evidence) and the completion of advance directives (ADs) (RR 1.92, 95% CI 1.43–2.59, p<0.001, low quality evidence); concordance between AD preferences and subsequent medical orders for use or non-use of life supporting treatment (RR 1.19, 95% CI 1.01–1.39, p = 0.028, very low quality evidence, 1 observational study); and concordance between the care desired and care received by patients (RR 1.17, 95% CI 1.05–1.30, p = 0.004, low quality evidence, 2 RCTs). Conclusions The use of structured communication tools may increase the frequency of discussions about and completion of advance directives, and concordance between the care desired and the care received by patients. The use of structured communication tools rather than an ad-hoc approach to end-of-life decision-making should be considered, and the selection and implementation of such tools should be tailored to address local needs and context. Registration PROSPERO CRD42014012913 PMID:27119571

Exploring an educational assessment tool to measure registered nurses' knowledge of hearing impairment and effective communication strategies: A USA study.

PubMed

Ruesch, Amy L

2018-01-01

Poor communication between the Registered Nurse and a hearing impaired patient can affect quality of care and health outcomes. Communication skills training programs for healthcare providers are needed to improve patient centered care. A descriptive research study, using a knowledge assessment tool developed and validated by the researcher, was conducted on 339 Registered Nurses to identify knowledge deficits to be addressed in a communication skills training program being designed. The educational tool measured the Registered Nurses' knowledge across four areas - hearing impairment, hearing aids, communication strategies, and regulations regarding access to care for a person with a hearing disability. Knowledge deficits were detected in all four areas. Using this educational assessment tool may enable nurse educators to tailor communication skills training programs to specifically address the gaps identified regarding hearing impairment and how to effectively communicate with the hearing impaired patient. Post training program, nurse educators can use the tool to evaluate effectiveness. Copyright © 2017 Elsevier Ltd. All rights reserved.

TEAM-HF Cost-Effectiveness Model: A Web-Based Program Designed to Evaluate the Cost-Effectiveness of Disease Management Programs in Heart Failure

PubMed Central

Reed, Shelby D.; Neilson, Matthew P.; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H.; Polsky, Daniel E.; Graham, Felicia L.; Bowers, Margaret T.; Paul, Sara C.; Granger, Bradi B.; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara; Levy, Wayne C.

2015-01-01

Background Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. Methods We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics, use of evidence-based medications, and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model (SHFM). Projections of resource use and quality of life are modeled using relationships with time-varying SHFM scores. The model can be used to evaluate parallel-group and single-cohort designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. Results The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. Conclusion The TEAM-HF Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. PMID:26542504

Multi-criteria development and incorporation into decision tools for health technology adoption.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Waddell, Cameron D; Dixon, Elijah; Poulin, Michelle; Lafrenière, René

2013-01-01

When introducing new health technologies, decision makers must integrate research evidence with local operational management information to guide decisions about whether and under what conditions the technology will be used. Multi-criteria decision analysis can support the adoption or prioritization of health interventions by using criteria to explicitly articulate the health organization's needs, limitations, and values in addition to evaluating evidence for safety and effectiveness. This paper seeks to describe the development of a framework to create agreed-upon criteria and decision tools to enhance a pre-existing local health technology assessment (HTA) decision support program. The authors compiled a list of published criteria from the literature, consulted with experts to refine the criteria list, and used a modified Delphi process with a group of key stakeholders to review, modify, and validate each criterion. In a workshop setting, the criteria were used to create decision tools. A set of user-validated criteria for new health technology evaluation and adoption was developed and integrated into the local HTA decision support program. Technology evaluation and decision guideline tools were created using these criteria to ensure that the decision process is systematic, consistent, and transparent. This framework can be used by others to develop decision-making criteria and tools to enhance similar technology adoption programs. The development of clear, user-validated criteria for evaluating new technologies adds a critical element to improve decision-making on technology adoption, and the decision tools ensure consistency, transparency, and real-world relevance.

A Quality Improvement Activity to Promote Interprofessional Collaboration Among Health Professions Students

PubMed Central

Stevenson, Katherine; Busch, Angela; Scott, Darlene J.; Henry, Carol; Wall, Patricia A.

2009-01-01

Objectives To develop and evaluate a classroom-based curriculum designed to promote interprofessional competencies by having undergraduate students from various health professions work together on system-based problems using quality improvement (QI) methods and tools to improve patient-centered care. Design Students from 4 health care programs (nursing, nutrition, pharmacy, and physical therapy) participated in an interprofessional QI activity. In groups of 6 or 7, students completed pre-intervention and post-intervention reflection tools on attitudes relating to interprofessio nal teams, and a tool designed to evaluate group process. Assessment One hundred thirty-four students (76.6%) completed both self-reflection instruments, and 132 (74.2%) completed the post-course group evaluation instrument. Although already high prior to the activity, students' mean post-intervention reflection scores increased for 12 of 16 items. Post-intervention group evaluation scores reflected a high level of satisfaction with the experience. Conclusion Use of a quality-based case study and QI methodology were an effective approach to enhancing interprofessional experiences among students. PMID:19657497

Tribological investigations of the applicability of surface functionalization for dry extrusion processes

NASA Astrophysics Data System (ADS)

Teller, Marco; Prünte, Stephan; Ross, Ingo; Temmler, André; Schneider, Jochen M.; Hirt, Gerhard

2017-10-01

Cold extrusion processes are characterized by large relative contact stresses combined with a severe surface enlargement of the workpiece. Under these process conditions a high risk for galling of workpiece material to the tool steel occurs especially in processing of aluminum and aluminum alloys. In order to reduce adhesive wear lubricants for separation of workpiece and tool surfaces are used. As a consequence additional process steps (e.g. preparation and cleaning of workpieces) are necessary. Thus, the realization of a dry forming process is aspired from an environmental and economic perspective. In this paper a surface functionalization with self-assembled-monolayers (SAM) of the tool steels AISI D2 (DIN 1.2379) and AISI H11 (DIN 1.2343) is evaluated by a process-oriented tribological test. The tribological experiment is able to resemble and scale the process conditions of cold extrusion related to relative contact stress and surface enlargement for the forming of pure aluminum (Al99.5). The effect of reduced relative contact stress, surface enlargement and relative velocity on adhesive wear and tool lifetime is evaluated. Similar process conditions are achievable by different die designs with decreased extrusion ratios and adjusted die angles. The effect of surface functionalization critically depends on the substrate material. The different microstructure and the resulting differences in surface chemistry of the two tested tool steels appear to affect the performance of the tool surface functionalization with SAM.

The Effectiveness of Student Extracurricular Activities in Evaluating Violent Behavior among Students in the Preparatory Year at Hail University

ERIC Educational Resources Information Center

Aleid, Alkhamsah Saleh

2016-01-01

This study aimed to examine the effectiveness of student extracurricular activities in evaluating violent behavior among students in the preparatory year at Hail University. The researcher used the descriptive analytical method, and used two tools for the purpose of the study, the study sample consisted of 104 (violent) female students from the…

More effective assessment of adverse effects and comorbidities in epilepsy: results of a Phase II communication study.

PubMed

Stern, John M; Labiner, David M; Gilliam, Frank G; Penovich, Patricia E; Onofrey, Meaghan; Eagan, Corey A; Holmes, Gregory L

2011-11-01

Research was conducted to evaluate conversations about epilepsy between community-based neurologists and patients. Adverse effects of antiepileptic drugs and mood/behavioral issues were infrequently discussed, and neurologists and patients disagreed about these issues postvisit. Follow-up research was conducted to assess the impact of a previsit assessment tool on discussions of epilepsy. Twenty neurologists reviewed a tool incorporating questions from validated instruments (Adverse Events Profile [AEP] and Neurological Disorders Depression Inventory for Epilepsy [NDDI-E]). Naturally occurring interactions between neurologists and 60 patients were recorded. Neurologists and patients were interviewed separately. All components were transcribed and analyzed using sociolinguistics. Using the previsit assessment tool increased the number of discussions about adverse effects and mood/behavioral issues and increased neurologist-patient agreement about issues postvisit. Visit length did not increase significantly when the tool was used. Ten months after follow-up research, 50% of neurologists reported continuing to use the tool in everyday practice with patients with epilepsy. Copyright © 2011 Elsevier Inc. All rights reserved.

TOXCAST: A TOOL FOR THE PRIORITIZATION OF CHEMICALS FOR TOXICOLOGICAL EVALUATION

EPA Science Inventory

Due to various legislatiave mandates, the US EPA is faced with evaluating the potential of tens of thousands of chemicals (e.g., high production volume chemicals, pestididal inerts, and drinking water contaminants) to cause adverse human health & environmental effects.

Evaluation of regional real-time transit communications and data information sharing in the national capital region.

DOT National Transportation Integrated Search

2015-03-01

This final report documents transit-related enhancements to the Regional Integration Transportation Information System (RITIS), creation of the RITIS Chat Instant Messaging tool, and final project evaluation of the effectiveness of the RITIS Chat too...

Toolbox for Evaluating Residents as Teachers

ERIC Educational Resources Information Center

Coverdale, John H.; Ismail, Nadia; Mian, Ayesha; Dewey, Charlene

2010-01-01

Objective: The authors review existing assessment tools related to evaluating residents' teaching skills and teaching effectiveness. Methods: PubMed and PsycInfo databases were searched using combinations of keywords including "residents," "residents as teachers," "teaching skills," and "assessments" or "rating scales." Results: Eleven evaluation…

MEASURES OF GENETIC DIVERSITY ARE EFFECTIVE TOOLS FOR EVALUATING ENVIRONMENTAL CONDITION

EPA Science Inventory

At their core, ecological risk assessments aim to evaluate the biological integrity and long-term sustainability of natural ecosystems. These are difficult objectives that will ultimately require development of novel indicators of ecological condition that are more accurate and ...

Evaluation of the effects of the metals Cd, Cr, Pb and their mixture on the filtration and oxygen consumption rates in catarina scallop, Argopecten ventricosus juveniles.

PubMed

Sobrino-Figueroa, Alma S; Cáceres-Martinez, Carlos

2014-01-01

In this work, we evaluated the effect of sublethal concentrations ( LC25, LC10 and LC5) of cadmium, chromium, lead, and their mixture on the filtration rate and oxygen consumption rate of Catarina scallop, Argopecten ventricosus (Sowerby, 1842), juveniles, in order to evaluate the use of these biomarkers as a reliable tool in environmental monitoring studies, because these metals have been found at high levels in water and sediments in the Mexican Pacific systems. An inverse dose-response relationship was observed when metal concentration and exposure time increased, the filtration rate and oxygen consumption rate reduced. The physiological responses evaluated in this study were sufficiently sensitive to detect alterations in the organisms at 0.014 mg l(-1) Cd, 0.311 mg l(-1) Cr, 0.125 mg l(-1) Pb and 0.05 mg l(-1) Cd + Cr + Pb at 24 and 72 hrs. Cd showed the most drastic effect. The Catarina scallop juveniles were more sensitive to Cd, Cr and Pb as compared to other bivalves. The biomarkers evaluated are a reliable tool to carry out environmental monitoring studies.

A Woman in Transition: can drama deliver a cancer awareness message?

PubMed

Cheney, Lydia C; Kohler, Connie; Legge Muilenburg, Jessica

2006-01-01

Entertainment education is a field of health communication that utilizes a variety of entertainment to change health behaviors. In this article, we describe a pilot project in which we measured the effectiveness of drama as a health communication tool. Attendees completed a pretest and posttest measuring knowledge, attitudes, and behavior related to breast cancer screening. At posttest, more women indicated breast self-exam rather than mammogram to be the "best method of early detection." Researchers who use drama as a communication tool cannot be assured of the final health message delivered. Careful evaluation to monitor the effectiveness of drama as a cancer awareness tool is vital.

How can systems engineering inform the methods of programme evaluation in health professions education?

PubMed

Rojas, David; Grierson, Lawrence; Mylopoulos, Maria; Trbovich, Patricia; Bagli, Darius; Brydges, Ryan

2018-04-01

We evaluate programmes in health professions education (HPE) to determine their effectiveness and value. Programme evaluation has evolved from use of reductionist frameworks to those addressing the complex interactions between programme factors. Researchers in HPE have recently suggested a 'holistic programme evaluation' aiming to better describe and understand the implications of 'emergent processes and outcomes'. We propose a programme evaluation framework informed by principles and tools from systems engineering. Systems engineers conceptualise complexity and emergent elements in unique ways that may complement and extend contemporary programme evaluations in HPE. We demonstrate how the abstract decomposition space (ADS), an engineering knowledge elicitation tool, provides the foundation for a systems engineering informed programme evaluation designed to capture both planned and emergent programme elements. We translate the ADS tool to use education-oriented language, and describe how evaluators can use it to create a programme-specific ADS through iterative refinement. We provide a conceptualisation of emergent elements and an equation that evaluators can use to identify the emergent elements in their programme. Using our framework, evaluators can analyse programmes not as isolated units with planned processes and planned outcomes, but as unfolding, complex interactive systems that will exhibit emergent processes and emergent outcomes. Subsequent analysis of these emergent elements will inform the evaluator as they seek to optimise and improve the programme. Our proposed systems engineering informed programme evaluation framework provides principles and tools for analysing the implications of planned and emergent elements, as well as their potential interactions. We acknowledge that our framework is preliminary and will require application and constant refinement. We suggest that our framework will also advance our understanding of the construct of 'emergence' in HPE research. © 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

Different methods of image segmentation in the process of meat marbling evaluation

NASA Astrophysics Data System (ADS)

Ludwiczak, A.; Ślósarz, P.; Lisiak, D.; Przybylak, A.; Boniecki, P.; Stanisz, M.; Koszela, K.; Zaborowicz, M.; Przybył, K.; Wojcieszak, D.; Janczak, D.; Bykowska, M.

2015-07-01

The level of marbling in meat assessment based on digital images is very popular, as computer vision tools are becoming more and more advanced. However considering muscle cross sections as the data source for marbling level evaluation, there are still a few problems to cope with. There is a need for an accurate method which would facilitate this evaluation procedure and increase its accuracy. The presented research was conducted in order to compare the effect of different image segmentation tools considering their usefulness in meat marbling evaluation on the muscle anatomical cross - sections. However this study is considered to be an initial trial in the presented field of research and an introduction to ultrasonic images processing and analysis.

Literacy assessment of family health history tools for public health prevention.

PubMed

Wang, C; Gallo, R E; Fleisher, L; Miller, S M

2011-01-01

This study aimed to systematically identify and evaluate the readability and document complexity of currently available family history tools for the general public. Three steps were undertaken to identify family history tools for evaluation: (a) Internet searches, (b) expert consultation, and (c) literature searches. Tools identified were assessed for readability using the Simple Measure of Gobbledygook (SMOG) readability formula. The complexity of documents (i.e., forms collecting family history information) was assessed using the PMOSE/IKIRSCH document readability formula. A total of 78 tools were identified, 47 of which met the criteria for inclusion. SMOG reading grade levels for multimedia-based tools ranged from 10.1 to 18.3, with an average score of 13.6. For print-based tools, SMOG ranged from 8.7 to 14.1, with an average score of 12.0. Document complexity ranged from very low complexity (level 1 proficiency) to high complexity (level 4 proficiency). The majority of tools are written at a reading grade level that is beyond the 8th grade average reading level in the United States. The lack of family history tools that are easy to read or use may compromise their potential effectiveness in identifying individuals at increased risk for chronic diseases in the general population. Copyright © 2010 S. Karger AG, Basel.

Contamination and Surface Preparation Effects on Composite Bonding

NASA Technical Reports Server (NTRS)

Kutscha, Eileen O.; Vahey, Paul G.; Belcher, Marcus A.; VanVoast, Peter J.; Grace, William B.; Blohowiak, Kay Y.; Palmieri, Frank L.; Connell, John W.

2017-01-01

Results presented here demonstrate the effect of several prebond surface contaminants (hydrocarbon, machining fluid, latex, silicone, peel ply residue, release film) on bond quality, as measured by fracture toughness and failure modes of carbon fiber reinforced epoxy substrates bonded in secondary and co-bond configurations with paste and film adhesives. Additionally, the capability of various prebond surface property measurement tools to detect contaminants and potentially predict subsequent bond performance of three different adhesives is also shown. Surface measurement methods included water contact angle, Dyne solution wettability, optically stimulated electron emission spectroscopy, surface free energy, inverse gas chromatography, and Fourier transform infrared spectroscopy with chemometrics analysis. Information will also be provided on the effectiveness of mechanical and energetic surface treatments to recover a bondable surface after contamination. The benefits and drawbacks of the various surface analysis tools to detect contaminants and evaluate prebond surfaces after surface treatment were assessed as well as their ability to correlate to bond performance. Surface analysis tools were also evaluated for their potential use as in-line quality control of adhesive bonding parameters in the manufacturing environment.

The Viability of a Software Tool to Assist Students in the Review of Literature

ERIC Educational Resources Information Center

Anderson, Timothy R.

2013-01-01

Most doctoral students are novice researchers and may not possess the skills to effectively conduct a comprehensive review of the literature and frame a problem designed to conduct original research. Students need proper training and tools necessary to critically evaluate, synthesize and organize literature. The purpose of this concurrent mixed…

BlueJ Visual Debugger for Learning the Execution of Object-Oriented Programs?

ERIC Educational Resources Information Center

Bennedsen, Jens; Schulte, Carsten

2010-01-01

This article reports on an experiment undertaken in order to evaluate the effect of a program visualization tool for helping students to better understand the dynamics of object-oriented programs. The concrete tool used was BlueJ's debugger and object inspector. The study was done as a control-group experiment in an introductory programming…

Assessing the Clinical Skills of Dental Students: A Review of the Literature

ERIC Educational Resources Information Center

Taylor, Carly L.; Grey, Nick; Satterthwaite, Julian D.

2013-01-01

Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

Adaptive Comparative Judgment as a Tool for Assessing Open-Ended Design Problems and Model Eliciting Activities

ERIC Educational Resources Information Center

Bartholomew, Scott R.; Nadelson, Louis S.; Goodridge, Wade H.; Reeve, Edward M.

2018-01-01

We investigated the use of adaptive comparative judgment to evaluate the middle school student learning, engagement, and experience with the design process in an open-ended problem assigned in a technology and engineering education course. Our results indicate that the adaptive comparative judgment tool effectively facilitated the grading of the…

Analysing Instrument Mixes in Quality Assurance: The Czech and Slovak Accreditation Commissions in the Era of Mass Higher Education

ERIC Educational Resources Information Center

Kohoutek, Jan

2014-01-01

Utilising insights from policy instrument theory, the article analyses the design, functioning and effects of the tools used by the Czech Accreditation Commission (CAC) and the Slovak Accreditation Commission (SAC) in the 2000s. Aside from programme accreditation, the other tools analysed are: institutional approval, institutional evaluations,…

Dissemination Strategies: The Evolution of Learning Resources on the Evaluation of Delirium, Dementia, and Depression

ERIC Educational Resources Information Center

Horvath, Kathy J.; Tumosa, Nina; Thielke, Stephen; Moorer, Julie; Huh, Terri; Cooley, Susan; Craft, Suzanne; Burns, Theressa

2011-01-01

Clinicians experience great pressures to provide timely, effective, and evidence-based medical care. Educators can aid these clinicians through the development of new tools that can facilitate timely completion of clinical tasks. These tools should summarize evidence-based information in a convenient format that allows easy use. This article…

The Practice Profile: An All Purpose Tool for Program Communication, Staff Development, Evaluation and Improvement.

ERIC Educational Resources Information Center

Loucks, Susan F.; Crandall, David P.

The practice profile is a standardized, systematic, cost-effective tool for summarizing the components and requirements of a program in a manner that permits comparison with other programs or selection of discrete components from various programs. It provides a component checklist, a precise list of implementation requirements, and a system for…

Development of a Tool to Assess Resident Physicians' Perceived Competence for Patient-Centered Obesity Counseling

ERIC Educational Resources Information Center

Burton, Amy M.; Brezausek, Carl M.; Hendricks, Peter S.; Agne, April A.; Hankins, Shirley L.; Cherrington, Andrea L.

2015-01-01

Physicians report a number of barriers to obesity counseling, among them low perceived competence in the ability to counsel. While there is increasing recognition of the need for resident training on counseling, implementation requires residency programs to have the necessary curricula and tools to evaluate training effectiveness. This study's…

Teacher Progress Monitoring of Instructional and Behavioral Management Practices: An Evidence-Based Approach to Improving Classroom Practices

ERIC Educational Resources Information Center

Reddy, Linda A.; Dudek, Christopher M.

2014-01-01

In the era of teacher evaluation and effectiveness, assessment tools that identify and monitor educators' instruction and behavioral management practices are in high demand. The Classroom Strategies Scale (CSS) Observer Form is a multidimensional teacher progress monitoring tool designed to assess teachers' usage of instructional and behavioral…

Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

ERIC Educational Resources Information Center

Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

2017-01-01

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

Justifying the Design and Selection of Literacy and Thinking Tools

ERIC Educational Resources Information Center

Whitehead, David

2008-01-01

Criteria for the design and selection of literacy and thinking tools that allow educators to justify what they do are described within a wider framework of learning theory and research into best practice. Based on a meta-analysis of best practice, results from a three year project designed to evaluate the effectiveness of a secondary school…

Critical Thinking: Art Criticism as a Tool for Analysing and Evaluating Art, Instructional Practice and Social Justice Issues

ERIC Educational Resources Information Center

Broome, Jeffrey; Pereira, Adriane; Anderson, Tom

2018-01-01

Recent educational initiatives have emphasised the importance of fostering critical thinking skills in today's students in order to provide strategies for becoming successful problem solvers throughout life. Other scholars advocate the use of critical thinking skills on the grounds that such tools can be used effectively when considering social…

Experimental evaluation of tool run-out in micro milling

NASA Astrophysics Data System (ADS)

Attanasio, Aldo; Ceretti, Elisabetta

2018-05-01

This paper deals with micro milling cutting process focusing the attention on tool run-out measurement. In fact, among the effects of the scale reduction from macro to micro (i.e., size effects) tool run-out plays an important role. This research is aimed at developing an easy and reliable method to measure tool run-out in micro milling based on experimental tests and an analytical model. From an Industry 4.0 perspective this measuring strategy can be integrated into an adaptive system for controlling cutting forces, with the objective of improving the production quality, the process stability, reducing at the same time the tool wear and the machining costs. The proposed procedure estimates the tool run-out parameters from the tool diameter, the channel width, and the phase angle between the cutting edges. The cutting edge phase measurement is based on the force signal analysis. The developed procedure has been tested on data coming from micro milling experimental tests performed on a Ti6Al4V sample. The results showed that the developed procedure can be successfully used for tool run-out estimation.

Assessment Tools for Peripheral Neuropathy in Pediatric Oncology: A Systematic Review From the Children's Oncology Group.

PubMed

Smolik, Suzanne; Arland, Lesley; Hensley, Mary Ann; Schissel, Debra; Shepperd, Barbara; Thomas, Kristin; Rodgers, Cheryl

Peripheral neuropathy is a known side effect of several chemotherapy agents, including vinca alkaloids and platinum-based chemotherapy. Early recognition and monitoring of this side effect is an important role of the pediatric oncology nurse. There are a variety of peripheral neuropathy assessment tools currently in use, but the usefulness of these tools in identifying and grading neuropathy in children varies, and there is currently no standardized tool in place to evaluate peripheral neuropathy in pediatric oncology. A systematic review was performed to identify the peripheral neuropathy assessment tools that best evaluate the early onset and progression of peripheral neuropathy in pediatric patients receiving vincristine. Because of the limited information available in pediatric oncology, this review was extended to any pediatric patient with neuropathy. A total of 8 studies were included in the evidence synthesis. Based on available evidence, the pediatric-modified Total Neuropathy Scale (ped-m TNS) and the Total Neuropathy Score-pediatric version (TNS-PV) are recommended for the assessment of vincristine-induced peripheral neuropathy in children 6 years of age and older. In addition, several studies demonstrated that subjective symptoms alone are not adequate to assess for vincristine-induced peripheral neuropathy. Nursing assessment of peripheral neuropathy should be an integral and regular part of patient care throughout the course of chemotherapy treatment.

Tool feed influence on the machinability of CO(2) laser optics.

PubMed

Arnold, J B; Steger, P J; Saito, T T

1975-08-01

Influence of tool feed on reflectivity of diamond-machined surfaces was evaluated using materials (gold, silver, and copper) from which CO(2) laser optics are primarily produced. Fifteen specimens were machined by holding all machining parameters constant, except tool feed. Tool feed was allowed to vary by controlled amounts from one evaluation zone (or part) to another. Past experience has verified that the quality of a diamond-machined surface is not a function of the cutting velocity; therefore, this experiment was conducted on the basis that a variation in cutting velocity was not an influencing factor on the diamondturning process. Inspection results of the specimens indicated that tool feeds significantly higher than 5.1 micro/rev (200 microin./rev) produced detrimental effects on the machined surfaces. In some cases, at feeds as high as 13 microm/rev (500 microin./rev), visible scoring was evident. Those surfaces produced with tool feeds less than 5.1 microm/rev had little difference in reflectivity. Measurements indicat d that their reflectivity existed in a range from 96.7% to 99.3% at 10.6 microm.

Surveillance strategies for Classical Swine Fever in wild boar – a comprehensive evaluation study to ensure powerful surveillance

PubMed Central

Schulz, Katja; Peyre, Marisa; Staubach, Christoph; Schauer, Birgit; Schulz, Jana; Calba, Clémentine; Häsler, Barbara; Conraths, Franz J.

2017-01-01

Surveillance of Classical Swine Fever (CSF) should not only focus on livestock, but must also include wild boar. To prevent disease transmission into commercial pig herds, it is therefore vital to have knowledge about the disease status in wild boar. In the present study, we performed a comprehensive evaluation of alternative surveillance strategies for Classical Swine Fever (CSF) in wild boar and compared them with the currently implemented conventional approach. The evaluation protocol was designed using the EVA tool, a decision support tool to help in the development of an economic and epidemiological evaluation protocol for surveillance. To evaluate the effectiveness of the surveillance strategies, we investigated their sensitivity and timeliness. Acceptability was analysed and finally, the cost-effectiveness of the surveillance strategies was determined. We developed 69 surveillance strategies for comparative evaluation between the existing approach and the novel proposed strategies. Sampling only within sub-adults resulted in a better acceptability and timeliness than the currently implemented strategy. Strategies that were completely based on passive surveillance performance did not achieve the desired detection probability of 95%. In conclusion, the results of the study suggest that risk-based approaches can be an option to design more effective CSF surveillance strategies in wild boar. PMID:28266576

Surveillance strategies for Classical Swine Fever in wild boar - a comprehensive evaluation study to ensure powerful surveillance.

PubMed

Schulz, Katja; Peyre, Marisa; Staubach, Christoph; Schauer, Birgit; Schulz, Jana; Calba, Clémentine; Häsler, Barbara; Conraths, Franz J

2017-03-07

Surveillance of Classical Swine Fever (CSF) should not only focus on livestock, but must also include wild boar. To prevent disease transmission into commercial pig herds, it is therefore vital to have knowledge about the disease status in wild boar. In the present study, we performed a comprehensive evaluation of alternative surveillance strategies for Classical Swine Fever (CSF) in wild boar and compared them with the currently implemented conventional approach. The evaluation protocol was designed using the EVA tool, a decision support tool to help in the development of an economic and epidemiological evaluation protocol for surveillance. To evaluate the effectiveness of the surveillance strategies, we investigated their sensitivity and timeliness. Acceptability was analysed and finally, the cost-effectiveness of the surveillance strategies was determined. We developed 69 surveillance strategies for comparative evaluation between the existing approach and the novel proposed strategies. Sampling only within sub-adults resulted in a better acceptability and timeliness than the currently implemented strategy. Strategies that were completely based on passive surveillance performance did not achieve the desired detection probability of 95%. In conclusion, the results of the study suggest that risk-based approaches can be an option to design more effective CSF surveillance strategies in wild boar.

Forward impact extrusion of surface textured steel blanks using coated tooling

NASA Astrophysics Data System (ADS)

Hild, Rafael; Feuerhack, Andreas; Trauth, Daniel; Arghavani, Mostafa; Kruppe, Nathan C.; Brögelmann, Tobias; Bobzin, Kirsten; Klocke, Fritz

2017-10-01

A method to enable dry metal forming by the means of a self-lubricating coating and surface textures was researched using an innovative Pin-On-Cylinder-Tribometer. The experimental analysis was complemented by a numerical model of the complex contact conditions between coated tools and the surface textured specimen at the micro-level. Based on the results, the explanation of the tribological interactions between surface textured specimens and the tool in dry full forward extrusion is the objective of this work. Therefore, experimental dry extrusion tests were performed using a tool system. The extruded specimens were evaluated regarding their geometry as well as by the required punch force. Thereby, the effectiveness and the feasibility of dry metal forming on the example of full forward extrusion was evaluated. Thus, one more step towards the technical realization of dry metal forming of low alloy steels under industrial conditions was realized.

Using hybrid expert system approaches for engineering applications

NASA Technical Reports Server (NTRS)

Allen, R. H.; Boarnet, M. G.; Culbert, C. J.; Savely, R. T.

1987-01-01

In this paper, the use of hybrid expert system shells and hybrid (i.e., algorithmic and heuristic) approaches for solving engineering problems is reported. Aspects of various engineering problem domains are reviewed for a number of examples with specific applications made to recently developed prototype expert systems. Based on this prototyping experience, critical evaluations of and comparisons between commercially available tools, and some research tools, in the United States and Australia, and their underlying problem-solving paradigms are made. Characteristics of the implementation tool and the engineering domain are compared and practical software engineering issues are discussed with respect to hybrid tools and approaches. Finally, guidelines are offered with the hope that expert system development will be less time consuming, more effective, and more cost-effective than it has been in the past.

Evaluating the substantive effectiveness of SEA: Towards a better understanding

DOE Office of Scientific and Technical Information (OSTI.GOV)

Doren, D. van; Driessen, P.P.J., E-mail: p.driessen@uu.nl; Schijf, B.

Evaluating the substantive effectiveness of strategic environmental assessment (SEA) is vital in order to know to what extent the tool fulfills its purposes and produces expected results. However, the studies that have evaluated the substantive effectiveness of SEA produce varying outcomes as regards the tool's contribution to decision-making and have used a variety of approaches to appraise its effectiveness. The aim of this article is to discuss the theoretical concept of SEA substantive effectiveness and to present a new approach that can be applied for evaluation studies. The SEA effectiveness evaluation framework that will be presented is composed of conceptsmore » of, and approaches to, SEA effectiveness derived from SEA literature and planning theory. Lessons for evaluation can be learned from planning theory in particular, given its long history of analyzing and understanding how sources of information and decisions affect (subsequent) decision-making. Key concepts of this new approach are 'conformance' and 'performance'. In addition, this article presents a systematic overview of process and context factors that can explain SEA effectiveness, derived from SEA literature. To illustrate the practical value of our framework for the assessment and understanding of substantive effectiveness of SEA, three Dutch SEA case studies are examined. The case studies have confirmed the usefulness of the SEA effectiveness assessment framework. The framework proved helpful in order to describe the cumulative influence of the three SEAs on decision-making and the ultimate plan. - Highlights: Black-Right-Pointing-Pointer A new framework to evaluate the substantive effectiveness of SEA is presented. Black-Right-Pointing-Pointer The framework is based on two key concepts: 'conformance' and 'performance.' Black-Right-Pointing-Pointer The practical applicability of the framework is demonstrated by three Dutch cases. Black-Right-Pointing-Pointer The framework allows for a more systematic understanding of SEA effectiveness. Black-Right-Pointing-Pointer Finally, this paper presents explanations for SEA effectiveness.« less

A systematic review of the use and effectiveness of social media in child health.

PubMed

Hamm, Michele P; Shulhan, Jocelyn; Williams, Gillian; Milne, Andrea; Scott, Shannon D; Hartling, Lisa

2014-06-02

Social media use is highly prevalent among children, youth, and their caregivers, and its use in healthcare is being explored. The objective of this study was to conduct a systematic review to determine: 1) for what purposes social media is being used in child health and its effectiveness; and 2) the attributes of social media tools that may explain how they are or are not effective. We searched Medline, CENTRAL, ERIC, PubMed, CINAHL, Academic Search Complete, Alt Health Watch, Health Source, Communication and Mass Media Complete, Web of Knowledge, and Proquest Dissertation and Theses Database from 2000-2013. We included primary research that evaluated the use of a social media tool, and targeted children, youth, or their families or caregivers. Quality assessment was conducted on all included analytic studies using tools specific to different quantitative designs. We identified 25 studies relevant to child health. The majority targeted adolescents (64%), evaluated social media for health promotion (52%), and used discussion forums (68%). Most often, social media was included as a component of a complex intervention (64%). Due to heterogeneity in conditions, tools, and outcomes, results were not pooled across studies. Attributes of social media perceived to be effective included its use as a distraction in younger children, and its ability to facilitate communication between peers among adolescents. While most authors presented positive conclusions about the social media tool being studied (80%), there is little high quality evidence of improved outcomes to support this claim. This comprehensive review demonstrates that social media is being used for a variety of conditions and purposes in child health. The findings provide a foundation from which clinicians and researchers can build in the future by identifying tools that have been developed, describing how they have been used, and isolating components that have been effective.

A systematic review of the use and effectiveness of social media in child health

PubMed Central

2014-01-01

Background Social media use is highly prevalent among children, youth, and their caregivers, and its use in healthcare is being explored. The objective of this study was to conduct a systematic review to determine: 1) for what purposes social media is being used in child health and its effectiveness; and 2) the attributes of social media tools that may explain how they are or are not effective. Methods We searched Medline, CENTRAL, ERIC, PubMed, CINAHL, Academic Search Complete, Alt Health Watch, Health Source, Communication and Mass Media Complete, Web of Knowledge, and Proquest Dissertation and Theses Database from 2000–2013. We included primary research that evaluated the use of a social media tool, and targeted children, youth, or their families or caregivers. Quality assessment was conducted on all included analytic studies using tools specific to different quantitative designs. Results We identified 25 studies relevant to child health. The majority targeted adolescents (64%), evaluated social media for health promotion (52%), and used discussion forums (68%). Most often, social media was included as a component of a complex intervention (64%). Due to heterogeneity in conditions, tools, and outcomes, results were not pooled across studies. Attributes of social media perceived to be effective included its use as a distraction in younger children, and its ability to facilitate communication between peers among adolescents. While most authors presented positive conclusions about the social media tool being studied (80%), there is little high quality evidence of improved outcomes to support this claim. Conclusions This comprehensive review demonstrates that social media is being used for a variety of conditions and purposes in child health. The findings provide a foundation from which clinicians and researchers can build in the future by identifying tools that have been developed, describing how they have been used, and isolating components that have been effective. PMID:24886048

Are consumer surveys valuable as a service improvement tool in health services? A critical appraisal.

PubMed

Patwardhan, Anjali; Patwardhan, Prakash

2009-01-01

In the recent climate of consumerism and consumer focused care, health and social care needs to be more responsive than ever before. Consumer needs and preferences can be elicited with accepted validity and reliability only by strict methodological control, customerisation of the questionnaire and skilled interpretation. To construct, conduct, interpret and implement improved service provision, requires a trained work force and infrastructure. This article aims to appraise various aspects of consumer surveys and to assess their value as effective service improvement tools. The customer is the sole reason organisations exist. Consumer surveys are used worldwide as service and quality of care improvement tools by all types of service providers including health service providers. The article critically appraises the value of consumer surveys as service improvement tools in health services tool and its future applications. No one type of survey is the best or ideal. The key is the selection of the correct survey methodology, unique and customised for the particular type/aspect of care being evaluated. The method used should reflect the importance of the information required. Methodological rigor is essential for the effectiveness of consumer surveys as service improvement tools. Unfortunately so far there is no universal consensus on superiority of one particular methodology over another or any benefit of one specific methodology in a given situation. More training and some dedicated resource allocation is required to develop consumer surveys. More research is needed to develop specific survey methodology and evaluation techniques for improved validity and reliability of the surveys as service improvement tools. Measurement of consumer preferences/priorities, evaluation of services and key performance scores, is not easy. Consumer surveys seem impressive tools as they provide the customer a voice for change or modification. However, from a scientific point-of-view their credibility in service improvement in terms of reproducibility, reliability and validity, has remained debatable. This artcile is a critical appraisal of the value of consumer surveys as a service improvement tool in health services--a lesson which needs to be learnt.

Building clinical networks: a developmental evaluation framework.

PubMed

Carswell, Peter; Manning, Benjamin; Long, Janet; Braithwaite, Jeffrey

2014-05-01

Clinical networks have been designed as a cross-organisational mechanism to plan and deliver health services. With recent concerns about the effectiveness of these structures, it is timely to consider an evidence-informed approach for how they can be developed and evaluated. To document an evaluation framework for clinical networks by drawing on the network evaluation literature and a 5-year study of clinical networks. We searched literature in three domains: network evaluation, factors that aid or inhibit network development, and on robust methods to measure network characteristics. This material was used to build a framework required for effective developmental evaluation. The framework's architecture identifies three stages of clinical network development; partner selection, network design and network management. Within each stage is evidence about factors that act as facilitators and barriers to network growth. These factors can be used to measure progress via appropriate methods and tools. The framework can provide for network growth and support informed decisions about progress. For the first time in one place a framework incorporating rigorous methods and tools can identify factors known to affect the development of clinical networks. The target user group is internal stakeholders who need to conduct developmental evaluation to inform key decisions along their network's developmental pathway.

Applying a Framework to Evaluate Assignment Marking Software: A Case Study on Lightwork

ERIC Educational Resources Information Center

Heinrich, Eva; Milne, John

2012-01-01

This article presents the findings of a qualitative evaluation on the effect of a specialised software tool on the efficiency and quality of assignment marking. The software, Lightwork, combines with the Moodle learning management system and provides support through marking rubrics and marker allocations. To enable the evaluation a framework has…

Handbook for Evaluating Drug and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention Programs (STEPP).

ERIC Educational Resources Information Center

Hawkins, J. David; Nederhood, Britt

This handbook was developed for the purpose of providing drug and alcohol prevention program managers with a comprehensive yet easy-to-use tool to help their evaluation efforts. The handbook emphasizes program staff members working together as a team. It provides instruments and activities for determining program effectiveness, as well as…

Finding the Forest Amid the Trees: Tools for Evaluating Astronomy Education and Public Outreach Projects

ERIC Educational Resources Information Center

Bailey, Janelle M.; Slater, Timothy F.

2004-01-01

The effective evaluation of educational projects is becoming increasingly important to funding agencies and to the individuals and organizations involved in the projects. This brief "how-to" guide provides an introductory description of the purpose and basic ideas of project evaluation, and uses authentic examples from four different astronomy and…

Do Global Indicators of Protected Area Management Effectiveness Make Sense? A Case Study from Siberia

NASA Astrophysics Data System (ADS)

Anthony, Brandon P.; Shestackova, Elena

2015-07-01

Driven by the underperformance of many protected areas (PAs), protected area management effectiveness (PAME) evaluations are increasingly being conducted to assess PAs in meeting specified objectives. A number of PAME tools have been developed, many of which are based on the IUCN-WCPA framework constituting six evaluative elements (context, planning, input, process, output, and outcomes). In a quest for a more universal tool and using this framework, Leverington et al. (Environ Manag 46(5):685-698, 2010) developed a common scale and list of 33 headline indicators, purported to be representative across a wide range of management effectiveness evaluation tools. The usefulness of such composite tools and the relative weighting of indicators are still being debated. Here, we utilize these headline indicators as a benchmark to assess PAME in 37 PAs of four types in Krasnoyarsk Kray, Russia, and compare these with global results. Moreover, we review the usefulness of these indicators in the Krasnoyarsk context based on the opinions of local PA management teams. Overall, uncorrected management scores for studied PAs were slightly better (mean = 5.66 ± 0.875) than the global average, with output and outcome elements being strongest, and planning and process scores lower. Score variability is influenced by PA size, location, and type. When scores were corrected based on indicator importance, the mean score significantly increased to 5.75 ± 0.858. We emphasize idiosyncrasies of Russian PA management, including the relative absence of formal management plans and limited efforts toward local community beneficiation, and how such contextual differences may confound PAME scores when indicator weights are treated equal.

Midwifery education and technology enhanced learning: Evaluating online story telling in preregistration midwifery education.

PubMed

Scamell, Mandie; Hanley, Thomas

2018-03-01

A major issue regarding the implementation of blended learning for preregistration health programmes is the analysis of students' perceptions and attitudes towards their learning. It is the extent of the embedding of Technology Enhanced Learning (TEL) into the higher education curriculum that makes this analysis so vital. This paper reports on the quantitative results of a UK based study that was set up to respond to the apparent disconnect between technology enhanced education provision and reliable student evaluation of this mode of learning. Employing a mixed methods research design, the research described here was carried to develop a reliable and valid evaluation tool to measure acceptability of and satisfaction with a blended learning approach, specifically designed for a preregistration midwifery module offered at level 4. Feasibility testing of 46 completed blended learning evaluation questionnaires - Student Midwife Evaluation of Online Learning Effectiveness (SMEOLE) - using descriptive statistics, reliability and internal consistency tests. Standard deviations and mean scores all followed predicted pattern. Results from the reliability and internal consistency testing confirm the feasibility of SMEOLE as an effective tool for measuring student satisfaction with a blended learning approach to preregistration learning. The analysis presented in this paper suggests that we have been successful in our aim to produce an evaluation tool capable of assessing the quality of technology enhanced, University level learning in Midwifery. This work can provide future benchmarking against which midwifery, and other health, blended learning curriculum planning could be structured and evaluated. Copyright © 2017 Elsevier Ltd. All rights reserved.

Air traffic management evaluation tool

NASA Technical Reports Server (NTRS)

Sheth, Kapil S. (Inventor); Sridhar, Banavar (Inventor); Bilimoria, Karl D. (Inventor); Grabbe, Shon (Inventor); Chatterji, Gano Broto (Inventor); Schipper, John F. (Inventor)

2010-01-01

Method and system for evaluating and implementing air traffic management tools and approaches for managing and avoiding an air traffic incident before the incident occurs. The invention provides flight plan routing and direct routing or wind optimal routing, using great circle navigation and spherical Earth geometry. The invention provides for aircraft dynamics effects, such as wind effects at each altitude, altitude changes, airspeed changes and aircraft turns to provide predictions of aircraft trajectory (and, optionally, aircraft fuel use). A second system provides several aviation applications using the first system. These applications include conflict detection and resolution, miles-in trail or minutes-in-trail aircraft separation, flight arrival management, flight re-routing, weather prediction and analysis and interpolation of weather variables based upon sparse measurements.

Application of Quality Management Tools for Evaluating the Failure Frequency of Cutter-Loader and Plough Mining Systems

NASA Astrophysics Data System (ADS)

Biały, Witold

2017-06-01

Failure frequency in the mining process, with a focus on the mining machine, has been presented and illustrated by the example of two coal-mines. Two mining systems have been subjected to analysis: a cutter-loader and a plough system. In order to reduce costs generated by failures, maintenance teams should regularly make sure that the machines are used and operated in a rational and effective way. Such activities will allow downtimes to be reduced, and, in consequence, will increase the effectiveness of a mining plant. The evaluation of mining machines' failure frequency contained in this study has been based on one of the traditional quality management tools - the Pareto chart.

ED leadership competency matrix: an administrative management tool.

PubMed

Propp, Douglas A; Glickman, Seth; Uehara, Dennis T

2003-10-01

A successful ED relies on its leaders to master and demonstrate core competencies to be effective in the many arenas in which they interact and are responsible. A unique matrix model for the assessment of an ED leadership's key administrative skill sets is presented. The model incorporates capabilities related to the individual's cognitive aptitude, experience, acquired technical skills, behavioral characteristics, as well as the ability to manage relationships effectively. Based on the personnel inventory using the matrix, focused evaluation, development, and recruitment of ED key leaders occurs. This dynamic tool has provided a unique perspective for the evaluation and enhancement of overall ED leadership performance. It is hoped that incorporation of such a model will similarly improve the accomplishments of EDs at other institutions.

The Effects of "Handwriting without Tears®" on the Handwriting Skills of Appropriate Size, Form, and Tool for a Four Year-Old Boy with a Developmental Delay

ERIC Educational Resources Information Center

Meyers, Colleen; McLaughlin, T. F.; Derby, Mark; Weber, Kimberly P.; Robison, Milena

2015-01-01

The ability to write one's own name legibly is a critical lifelong skill for academic success. The purpose of the present study was to evaluate the effects of the Handwriting Without Tears® program on teaching a four year-old how to write his first name using proper size, form, and tool. The participant was a four year-old boy in a self-contained…

Electronic self-monitoring of mood using IT platforms in adult patients with bipolar disorder: A systematic review of the validity and evidence.

PubMed

Faurholt-Jepsen, Maria; Munkholm, Klaus; Frost, Mads; Bardram, Jakob E; Kessing, Lars Vedel

2016-01-15

Various paper-based mood charting instruments are used in the monitoring of symptoms in bipolar disorder. During recent years an increasing number of electronic self-monitoring tools have been developed. The objectives of this systematic review were 1) to evaluate the validity of electronic self-monitoring tools as a method of evaluating mood compared to clinical rating scales for depression and mania and 2) to investigate the effect of electronic self-monitoring tools on clinically relevant outcomes in bipolar disorder. A systematic review of the scientific literature, reported according to the Preferred Reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines was conducted. MEDLINE, Embase, PsycINFO and The Cochrane Library were searched and supplemented by hand search of reference lists. Databases were searched for 1) studies on electronic self-monitoring tools in patients with bipolar disorder reporting on validity of electronically self-reported mood ratings compared to clinical rating scales for depression and mania and 2) randomized controlled trials (RCT) evaluating electronic mood self-monitoring tools in patients with bipolar disorder. A total of 13 published articles were included. Seven articles were RCTs and six were longitudinal studies. Electronic self-monitoring of mood was considered valid compared to clinical rating scales for depression in six out of six studies, and in two out of seven studies compared to clinical rating scales for mania. The included RCTs primarily investigated the effect of heterogeneous electronically delivered interventions; none of the RCTs investigated the sole effect of electronic mood self-monitoring tools. Methodological issues with risk of bias at different levels limited the evidence in the majority of studies. Electronic self-monitoring of mood in depression appears to be a valid measure of mood in contrast to self-monitoring of mood in mania. There are yet few studies on the effect of electronic self-monitoring of mood in bipolar disorder. The evidence of electronic self-monitoring is limited by methodological issues and by a lack of RCTs. Although the idea of electronic self-monitoring of mood seems appealing, studies using rigorous methodology investigating the beneficial as well as possible harmful effects of electronic self-monitoring are needed.

Effectiveness of classroom response systems within an active learning environment.

PubMed

Welch, Susan

2013-11-01

In nursing education, the inclusion of pedagogical tools is necessary to transform Millennial classrooms. One such pedagogical tool currently offered is classroom response systems (CRS). The purpose of this study was to evaluate the effectiveness of CRS as a pedagogical tool in improving nursing students' examination performance within an active learning environment. A pretest-posttest design was used to determine whether there was a relationship between the use of CRS (independent variable) and nursing students' examination performance in a first-year Professional Practice course (dependent variable). Paired t tests revealed no greater improvement in posttest scores. Therefore, the use of CRS technology was not effective in increasing nursing students' examination scores in the Professional Practice course. Additional research is needed to provide adequate understanding of the effectiveness of CRS within the nursing education classroom. Copyright 2013, SLACK Incorporated.

Evaluation of Process Performance for Sustainable Hard Machining

NASA Astrophysics Data System (ADS)

Rotella, Giovanna; Umbrello, Domenico; , Oscar W. Dillon, Jr.; Jawahir, I. S.

This paper aims to evaluate the sustainability performance of machining operation of through-hardening steel, AISI 52100, taking into account the impact of the material removal process in its various aspects. Experiments were performed for dry and cryogenic cutting conditions using chamfered cubic boron nitride (CBN) tool inserts at varying cutting conditions (cutting speed and feed rate). Cutting forces, mechanical power, tool wear, white layer thickness, surface roughness and residual stresses were investigated in order to evaluate the effects of extreme in-process cooling on the machined surface. The results indicate that cryogenic cooling has the potential to be used for surface integrity enhancement for improved product life and more sustainable functional performance.

Development, implementation and evaluation of a patient handoff tool to improve safety in orthopaedic surgery.

PubMed

Gagnier, Joel J; Derosier, Joseph M; Maratt, Joseph D; Hake, Mark E; Bagian, James P

2016-06-01

To develop, implement and test the effect of a handoff tool for orthopaedic trauma residents that reduces adverse events associated with the omission of critical information and the transfer of erroneous information. Components of this project included a literature review, resident surveys and observations, checklist development and refinement, implementation and evaluation of impact on adverse events through a chart review of a prospective cohort compared with a historical control group. Large teaching hospital. Findings of a literature review were presented to orthopaedic residents, epidemiologists, orthopaedic surgeons and patient safety experts in face-to-face meetings, during which we developed and refined the contents of a resident handoff tool. The tool was tested in an orthopaedic trauma service and its impact on adverse events was evaluated through a chart review. The handoff tool was developed and refined during the face-to-face meetings and a pilot implementation. Adverse event data were collected on 127 patients (n = 67 baseline period; n = 60 test period). A handoff tool for use by orthopaedic residents. Adverse events in patients handed off by orthopaedic trauma residents. After controlling for age, gender and comorbidities, testing resulted in fewer events per person (25-27% reduction; P < 0.10). Preliminary evidence suggests that our resident handoff tool may contribute to a decrease in adverse events in orthopaedic patients. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

International funding agencies: potential leaders of impact evaluation in protected areas?

PubMed Central

Craigie, Ian D.; Barnes, Megan D.; Geldmann, Jonas; Woodley, Stephen

2015-01-01

Globally, protected areas are the most commonly used tools to halt biodiversity loss. Yet, some are failing to adequately conserve the biodiversity they contain. There is an urgent need for knowledge on how to make them function more effectively. Impact evaluation methods provide a set of tools that could yield this knowledge. However, rigorous outcome-focused impact evaluation is not yet used as extensively as it could be in protected area management. We examine the role of international protected area funding agencies in facilitating the use of impact evaluation. These agencies are influential stakeholders as they allocate hundreds of millions of dollars annually to support protected areas, creating a unique opportunity to shape how the conservation funds are spent globally. We identify key barriers to the use of impact evaluation, detail how large funders are uniquely placed to overcome many of these, and highlight the potential benefits if impact evaluation is used more extensively. PMID:26460135

Generation of GHS Scores from TEST and online sources

EPA Science Inventory

Alternatives assessment frameworks such as DfE (Design for the Environment) evaluate chemical alternatives in terms of human health effects, ecotoxicity, and fate. T.E.S.T. (Toxicity Estimation Software Tool) can be utilized to evaluate human health in terms of acute oral rat tox...

Evaluating Magnet Schools Effectively: Challenges and Cautions.

ERIC Educational Resources Information Center

Gaines, Margie L.

Magnet schools have become increasingly popular as alternatives to traditional curriculum offerings and as tools to promote voluntary desegregation in urban school districts. Most evaluations of magnet schools have been concerned with monitoring objectives and compliance with regulations. Few reports assess the impact of magnet curricula on…

Good Teaching: What Matters to University Students

ERIC Educational Resources Information Center

Lee, Hwee Hoon; Kim, Grace May Lin; Chan, Ling Ling

2015-01-01

Institutions assess teaching effectiveness in various ways, such as classroom observation, peer evaluation and self-assessment. In higher education, student feedback continues to be the main teaching evaluation tool. However, most of such forms include characteristics of good teaching that the institutions deem important and may not adequately…

A Comprehensive Look at Polypharmacy and Medication Screening Tools for the Older Cancer Patient

PubMed Central

DeGregory, Kathlene A.; Morris, Amy L.; Ramsdale, Erika E.

2016-01-01

Inappropriate medication use and polypharmacy are extremely common among older adults. Numerous studies have discussed the importance of a comprehensive medication assessment in the general geriatric population. However, only a handful of studies have evaluated inappropriate medication use in the geriatric oncology patient. Almost a dozen medication screening tools exist for the older adult. Each available tool has the potential to improve aspects of the care of older cancer patients, but no single tool has been developed for this population. We extensively reviewed the literature (MEDLINE, PubMed) to evaluate and summarize the most relevant medication screening tools for older patients with cancer. Findings of this review support the use of several screening tools concurrently for the elderly patient with cancer. A deprescribing tool should be developed and included in a comprehensive geriatric oncology assessment. Finally, prospective studies are needed to evaluate such a tool to determine its feasibility and impact in older patients with cancer. Implications for Practice: The prevalence of polypharmacy increases with advancing age. Older adults are more susceptible to adverse effects of medications. “Prescribing cascades” are common, whereas “deprescribing” remains uncommon; thus, older patients tend to accumulate medications over time. Older patients with cancer are at high risk for adverse drug events, in part because of the complexity and intensity of cancer treatment. Additionally, a cancer diagnosis often alters assessments of life expectancy, clinical status, and competing risk. Screening for polypharmacy and potentially inappropriate medications could reduce the risk for adverse drug events, enhance quality of life, and reduce health care spending for older cancer patients. PMID:27151653

The Ethics of Setting Course Expectations to Manipulate Student Evaluations of Teaching Effectiveness in Higher Education: An Examination of the Ethical Dilemmas Created by the Use of SETEs and a Proposal for Further Study and Analysis

ERIC Educational Resources Information Center

Neal, Catherine S.; Elliott, Teressa

2009-01-01

Because student evaluations of teaching effectiveness (SETEs) are an important and widely used tool used in the evaluation and reward systems for faculty members in higher education, a discussion and analysis of the ethical problems that may arise as a result of the conflict created by expectations of performance is provided. This discussion…

An Integrated Approach of Fuzzy Linguistic Preference Based AHP and Fuzzy COPRAS for Machine Tool Evaluation

PubMed Central

Nguyen, Huu-Tho; Md Dawal, Siti Zawiah; Nukman, Yusoff; Aoyama, Hideki; Case, Keith

2015-01-01

Globalization of business and competitiveness in manufacturing has forced companies to improve their manufacturing facilities to respond to market requirements. Machine tool evaluation involves an essential decision using imprecise and vague information, and plays a major role to improve the productivity and flexibility in manufacturing. The aim of this study is to present an integrated approach for decision-making in machine tool selection. This paper is focused on the integration of a consistent fuzzy AHP (Analytic Hierarchy Process) and a fuzzy COmplex PRoportional ASsessment (COPRAS) for multi-attribute decision-making in selecting the most suitable machine tool. In this method, the fuzzy linguistic reference relation is integrated into AHP to handle the imprecise and vague information, and to simplify the data collection for the pair-wise comparison matrix of the AHP which determines the weights of attributes. The output of the fuzzy AHP is imported into the fuzzy COPRAS method for ranking alternatives through the closeness coefficient. Presentation of the proposed model application is provided by a numerical example based on the collection of data by questionnaire and from the literature. The results highlight the integration of the improved fuzzy AHP and the fuzzy COPRAS as a precise tool and provide effective multi-attribute decision-making for evaluating the machine tool in the uncertain environment. PMID:26368541

Simulation Evaluation of Controller-Managed Spacing Tools under Realistic Operational Conditions

NASA Technical Reports Server (NTRS)

Callantine, Todd J.; Hunt, Sarah M.; Prevot, Thomas

2014-01-01

Controller-Managed Spacing (CMS) tools have been developed to aid air traffic controllers in managing high volumes of arriving aircraft according to a schedule while enabling them to fly efficient descent profiles. The CMS tools are undergoing refinement in preparation for field demonstration as part of NASA's Air Traffic Management (ATM) Technology Demonstration-1 (ATD-1). System-level ATD-1 simulations have been conducted to quantify expected efficiency and capacity gains under realistic operational conditions. This paper presents simulation results with a focus on CMS-tool human factors. The results suggest experienced controllers new to the tools find them acceptable and can use them effectively in ATD-1 operations.

Application of Heart Rate Variability in Diagnosis and Prognosis of Individuals with Diabetes Mellitus: Systematic Review.

PubMed

França da Silva, Anne Kastelianne; Penachini da Costa de Rezende Barbosa, Marianne; Marques Vanderlei, Franciele; Destro Christofaro, Diego Giuliano; Marques Vanderlei, Luiz Carlos

2016-05-01

The use of heart rate variability as a tool capable of discriminating individuals with diabetes mellitus is still little explored, as its use has been limited to comparing those with and without the disease. Thus, the purpose of this study was to verify the use of heart rate variability as a tool for diagnostic and prognostic evaluation in person with diabetes and to identify whether there are cutoff points generated from the use of this tool in these individuals. A search was conducted in the electronic databases MEDLINE, Cochrane Library, Web of Science, EMBASE, and LILACS starting from the oldest records until January 2015, by means of descriptors related to the target condition, evaluated tool, and evaluation method. All the studies were evaluated for methodological quality using the QUADAS-2 instrument. Eight studies were selected. In general, the studies showed that the heart rate variability is useful to discriminate cardiac autonomic neuropathy in person with diabetes, and the sample entropy, SD1/SD2 indices, SDANN, HF, and slope of TFC have better discriminatory power to detect autonomic dysfunction, with sensitivity and specificity values ranging from 72% to 100% and 71% to 97%, respectively. Although there are methodological differences in indices used, in general, this tool demonstrated good sensitivity and specificity and can be used as an additional and/or complementary tool to the conventional autonomic tests, in order to obtain safer and more effective diagnostic, collaborating for better risk stratification conditions of these patients. © 2016 Wiley Periodicals, Inc.

A Study on Tooling and Its Effect on Heat Generation and Mechanical Properties of Welded Joints in Friction Stir Welding

NASA Astrophysics Data System (ADS)

Tikader, Sujoy; Biswas, Pankaj; Puri, Asit Baran

2018-04-01

Friction stir welding (FSW) has been the most attracting solid state welding process as it serves numerous advantages like good mechanical, metallurgical properties etc. Non weldable aluminium alloys like 5XXX, 7XXX series can be simply joined by this process. In this present study a mathematical model has been developed and experiments were successfully performed to evaluate mechanical properties of FSW on similar aluminium alloys i.e. AA1100 for different process parameters and mainly two kind of tool geometry (straight cylindrical and conical or cylindrical tapered shaped pin with flat shoulder). Tensile strength and micro hardness for different process parameters are reported of the welded plate sample. It was noticed that in FSW of similar alloy with tool made of SS-310 tool steel, friction is the major contributor for the heat generation. It was seen that tool geometry, tool rotational speed, plunging force by the tool and traverse speed have significant effect on tensile strength and hardness of friction stir welded joints.

Development of a tailored strategy to improve postpartum hemorrhage guideline adherence.

PubMed

de Visser, Suzan M; Woiski, Mallory D; Grol, Richard P; Vandenbussche, Frank P H A; Hulscher, Marlies E J L; Scheepers, Hubertina C J; Hermens, Rosella P M G

2018-02-08

Despite the introduction of evidence based guidelines and practical courses, the incidence of postpartum hemorrhage shows an increasing trend in developed countries. Substandard care is often found, which implies an inadequate implementation in high resource countries. We aimed to reduce the gap between evidence-based guidelines and clinical application, by developing a strategy, tailored to current barriers for implementation. The development of the implementation strategy consisted of three phases, supervised by a multidisciplinary expert panel. In the first phase a framework of the strategy was created, based on barriers to optimal adherence identified among professionals and patients together with evidence on effectiveness of strategies found in literature. In the second phase, the tools within the framework were developed, leading to a first draft. In the third phase the strategy was evaluated among professionals and patients. The professionals were asked to give written feedback on tool contents, clinical usability and inconsistencies with current evidence care. Patients evaluated the tools on content and usability. Based on the feedback of both professionals and patients the tools were adjusted. We developed a tailored strategy to improve guideline adherence, covering the trajectory of the third trimester of pregnancy till the end of the delivery. The strategy, directed at professionals, comprehending three stop moments includes a risk assessment checklist, care bundle and time-out procedure. As patient empowerment tools, a patient passport and a website with patient information was developed. The evaluation among the expert panel showed all professionals to be satisfied with the content and usability and no discrepancies or inconsistencies with current evidence was found. Patients' evaluation revealed that the information they received through the tools was incomplete. The tools were adjusted accordingly to the missing information. A usable, tailored strategy to implement PPH guidelines and practical courses was developed. The next step is the evaluation of the strategy in a feasibility trial. Clinical trial registration: The Fluxim study, registration number: NCT00928863 .

THE ATMOSPHERIC MODEL EVALUATION TOOL

EPA Science Inventory

This poster describes a model evaluation tool that is currently being developed and applied for meteorological and air quality model evaluation. The poster outlines the framework and provides examples of statistical evaluations that can be performed with the model evaluation tool...

Novel integrative genomic tool for interrogating lithium response in bipolar disorder

PubMed Central

Hunsberger, J G; Chibane, F L; Elkahloun, A G; Henderson, R; Singh, R; Lawson, J; Cruceanu, C; Nagarajan, V; Turecki, G; Squassina, A; Medeiros, C D; Del Zompo, M; Rouleau, G A; Alda, M; Chuang, D-M

2015-01-01

We developed a novel integrative genomic tool called GRANITE (Genetic Regulatory Analysis of Networks Investigational Tool Environment) that can effectively analyze large complex data sets to generate interactive networks. GRANITE is an open-source tool and invaluable resource for a variety of genomic fields. Although our analysis is confined to static expression data, GRANITE has the capability of evaluating time-course data and generating interactive networks that may shed light on acute versus chronic treatment, as well as evaluating dose response and providing insight into mechanisms that underlie therapeutic versus sub-therapeutic doses or toxic doses. As a proof-of-concept study, we investigated lithium (Li) response in bipolar disorder (BD). BD is a severe mood disorder marked by cycles of mania and depression. Li is one of the most commonly prescribed and decidedly effective treatments for many patients (responders), although its mode of action is not yet fully understood, nor is it effective in every patient (non-responders). In an in vitro study, we compared vehicle versus chronic Li treatment in patient-derived lymphoblastoid cells (LCLs) (derived from either responders or non-responders) using both microRNA (miRNA) and messenger RNA gene expression profiling. We present both Li responder and non-responder network visualizations created by our GRANITE analysis in BD. We identified by network visualization that the Let-7 family is consistently downregulated by Li in both groups where this miRNA family has been implicated in neurodegeneration, cell survival and synaptic development. We discuss the potential of this analysis for investigating treatment response and even providing clinicians with a tool for predicting treatment response in their patients, as well as for providing the industry with a tool for identifying network nodes as targets for novel drug discovery. PMID:25646593

Novel integrative genomic tool for interrogating lithium response in bipolar disorder.

PubMed

Hunsberger, J G; Chibane, F L; Elkahloun, A G; Henderson, R; Singh, R; Lawson, J; Cruceanu, C; Nagarajan, V; Turecki, G; Squassina, A; Medeiros, C D; Del Zompo, M; Rouleau, G A; Alda, M; Chuang, D-M

2015-02-03

We developed a novel integrative genomic tool called GRANITE (Genetic Regulatory Analysis of Networks Investigational Tool Environment) that can effectively analyze large complex data sets to generate interactive networks. GRANITE is an open-source tool and invaluable resource for a variety of genomic fields. Although our analysis is confined to static expression data, GRANITE has the capability of evaluating time-course data and generating interactive networks that may shed light on acute versus chronic treatment, as well as evaluating dose response and providing insight into mechanisms that underlie therapeutic versus sub-therapeutic doses or toxic doses. As a proof-of-concept study, we investigated lithium (Li) response in bipolar disorder (BD). BD is a severe mood disorder marked by cycles of mania and depression. Li is one of the most commonly prescribed and decidedly effective treatments for many patients (responders), although its mode of action is not yet fully understood, nor is it effective in every patient (non-responders). In an in vitro study, we compared vehicle versus chronic Li treatment in patient-derived lymphoblastoid cells (LCLs) (derived from either responders or non-responders) using both microRNA (miRNA) and messenger RNA gene expression profiling. We present both Li responder and non-responder network visualizations created by our GRANITE analysis in BD. We identified by network visualization that the Let-7 family is consistently downregulated by Li in both groups where this miRNA family has been implicated in neurodegeneration, cell survival and synaptic development. We discuss the potential of this analysis for investigating treatment response and even providing clinicians with a tool for predicting treatment response in their patients, as well as for providing the industry with a tool for identifying network nodes as targets for novel drug discovery.

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

PubMed

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

Using an evaluative tool to develop effective mathscasts

NASA Astrophysics Data System (ADS)

Galligan, Linda; Hobohm, Carola; Peake, Katherine

2017-09-01

This study is situated in a course designed for both on-campus and online pre-service and in-service teachers, where student-created mathscasts provide a way for university lecturers to assess students' quality of teaching, and understanding of mathematics. Teachers and pre-service teachers, in a university course with 90% online enrolment, were asked to create mathscasts to explain mathematics concepts at middle school level. This paper describes the process of developing and refining a tool for the creation and evaluation of quality student-produced mathscasts. The study then investigates the usefulness of the tool within the context of pedagogy and mathematical understanding. Despite an abundance of mathscasts already available on the web, there is merit in creating mathscasts, not only as a tool for teaching, but also as a means of learning by doing. The premise for creating student-produced mathscasts was to capture the creators' mathematical understanding and pedagogical approach to teaching a mathematical concept, which were then peer-assessed and graded. The analysis included surveys, practice mathscasts with peer- and self-reviews, and students' final assessed mathscasts. The results indicate that the use of the evaluative tool resulted in an improvement in quality of student-created mathscasts and critiques thereof. The paper concludes with a discussion on future directions of student-produced mathscasts.

A Systematic Literature Review on Evaluation of Digital Tools for Authoring Evidence-Based Clinical Guidelines.

PubMed

Khodambashi, Soudabeh; Nytrø, Øystein

2017-01-01

To facilitate the clinical guideline (GL) development process, different groups of researchers have proposed tools that enable computer-supported tools for authoring and publishing GLs. In a previous study we interviewed GL authors in different Norwegian institutions and identified tool shortcomings. In this follow-up study our goal is to explore to what extent GL authoring tools have been evaluated by researchers, guideline organisations, or GL authors. This article presents results from a systematic literature review of evaluation (including usability) of GL authoring tools. A controlled database search and backward snow-balling were used to identify relevant articles. From the 12692 abstracts found, 188 papers were fully reviewed and 26 papers were identified as relevant. The GRADEPro tool has attracted some evaluation, however popular tools and platforms such as DECIDE, Doctor Evidence, JBI-SUMARI, G-I-N library have not been subject to specific evaluation from an authoring perspective. Therefore, we found that little attention was paid to the evaluation of the tools in general. We could not find any evaluation relevant to how tools integrate and support the complex GL development workflow. The results of this paper are highly relevant to GL authors, tool developers and GL publishing organisations in order to improve and control the GL development and maintenance process.

UNICOR Users Manual

Treesearch

E. L. Landguth; B. K. Hand; J. M. Glassy; S. A. Cushman; R. T. Carlson

2011-01-01

Habitat loss and its effects on populations of vulnerable species is among the most urgent problems in conservation ecology. It is critical that managers and scientists have effective tools to evaluate the effects of landuse and climate change on the extent and connectivity of populations. To address this need, we introduce UNIversal CORridor network simulator (UNICOR...

Should Students Be Allowed to Miss?

ERIC Educational Resources Information Center

Paredes, Ricardo D.; Ugarte, Gabriel A.

2011-01-01

Many educational policymakers consider attendance as a tool to induce learning. Researchers also agree that attendance has a positive effect on learning; however, there are few empirical studies that measure the nature and significance of that effect. The authors analyzed the effect of class attendance on academic performance and evaluated the…

USEPA Waste Disposal Shareware: Purdue University and USEPA (1988-1989).

ERIC Educational Resources Information Center

Rubleske, Joseph B.; Lindsey, Greg

1997-01-01

Describes and evaluates two USEPA shareware programs called Principles of On-Site Wastewater Treatment (ONSITE) and Residential Waste Treatment Evaluation (RWASTE). ONSITE, a tutorial, provides an overview of septic systems and their relationship to soils. RWASTE builds on ONSITE. Both are effective tools for persons interested in acquiring…

Generation of Alternative Assessment Scores using TEST and online data sources

EPA Science Inventory

Alternatives assessment frameworks such as DfE (Design for the Environment) evaluate chemical alternatives in terms of human health effects, ecotoxicity, and fate. T.E.S.T. (Toxicity Estimation Software Tool) can be utilized to evaluate human health in terms of acute oral rat tox...

Exploring Non-Instructional Factors in Student Evaluations

ERIC Educational Resources Information Center

Ali, Holi Ibrahim Holi; Al Ajmi, Ahmed Ali Saleh

2013-01-01

The use of student ratings to measure instructors' teaching performance and effectiveness in tertiary education has been an important but controversial tool in the improvement of teaching quality during the past few decades. This is an attempt to explore non-instructional factors of student evaluations by discussing and reviewing relevant…

Tools For Evaluating The Benefits Of Green Infrastructure For Urban Water Management: Informational Brief (WERF Report INFR5SG09b)

EPA Science Inventory

This report identifies the practical challenges for evaluating the benefits of green infrastructure. It also discusses a more systematic approach to integrate cost-effective, high-performance urban water infrastructure practices with other environmental, social, and economic goa...

Drug Abuse Films, Second Edition.

ERIC Educational Resources Information Center

National Coordinating Council on Drug Education, Washington, DC.

This second edition updates and expands a 1971 evaluation of films and audiovisuals related to drug education performed by the National Coordinating Council on Drug Education. Materials in this edition are evaluated both for accuracy and effectiveness as a communications tool. They are separated into two sections--films and other audiovisuals…

Evaluation of the constituents of vetiver oil against Anopheles minimus (Diptera: Culicidae), a malaria vector in Thailand

USDA-ARS?s Scientific Manuscript database

The development of resistance by mosquitoes to current synthetic compounds has resulted in reduced effectiveness of prevention and control methods worldwide. An alternative non-chemical based control tools are needed to be evaluated particularly plant-derived essential oils. Several components of ve...

Effectiveness of an e-learning tool for education on pressure ulcer evaluation.

PubMed

Morente, Laura; Morales-Asencio, José M; Veredas, Francisco J

2014-07-01

To evaluate the effectiveness of information and communication technologies in the undergraduate students' pressure ulcer training as a learning tool, compared with traditional teaching methods. Pressure ulcers constitute one of the great challenges faced by nursing professionals. Currently, pressure ulcer training is based on traditional on-campus teaching, involving lecture-style classes with frequent use of photographs of the wounds. This traditional training has some important weaknesses that can put the efficacy of the training at risk. A randomised controlled trial was developed including undergraduate nursing students. The intervention group used an adaptive self-learning e-learning tool developed by the research team (ePULab) for pressure ulcer assessment and treatment. The control group received a traditional on-campus class on the same topic. Pretest and post-test questionnaires were designed to assess the students' ability in pressure ulcer diagnosis and treatment. The educational intervention based on the use of the ePULab tool produced significantly better learning acquisition results than those obtained by traditional lecture-style classes: the total score improved in the control group from 8·23 (SD 1·23)-11·6 (SD 2·52) after the lecture, whereas in the intervention group, the knowledge score changed from 8·27 (SD 1·39)-15·83 (SD 2·52) (p = 0·01) with the use of ePULab. The results show a higher effectiveness of the devised e-learning approach for education on management of pressure ulcers. Our results reveal the suitability of the ePULab e-learning tool as an effective instrument for training on assessment of and treatment for pressure ulcers and its potential impact on clinical decision-making. © 2013 John Wiley & Sons Ltd.

Comparison of in silico models for prediction of mutagenicity.

PubMed

Bakhtyari, Nazanin G; Raitano, Giuseppa; Benfenati, Emilio; Martin, Todd; Young, Douglas

2013-01-01

Using a dataset with more than 6000 compounds, the performance of eight quantitative structure activity relationships (QSAR) models was evaluated: ACD/Tox Suite, Absorption, Distribution, Metabolism, Elimination, and Toxicity of chemical substances (ADMET) predictor, Derek, Toxicity Estimation Software Tool (T.E.S.T.), TOxicity Prediction by Komputer Assisted Technology (TOPKAT), Toxtree, CEASAR, and SARpy (SAR in python). In general, the results showed a high level of performance. To have a realistic estimate of the predictive ability, the results for chemicals inside and outside the training set for each model were considered. The effect of applicability domain tools (when available) on the prediction accuracy was also evaluated. The predictive tools included QSAR models, knowledge-based systems, and a combination of both methods. Models based on statistical QSAR methods gave better results.

A Decision Support System for Evaluating Systems of Undersea Sensors and Weapons

DTIC Science & Technology

2015-12-01

distribution is unlimited A DECISION SUPPORT SYSTEM FOR EVALUATING SYSTEMS OF UNDERSEA SENSORS AND WEAPONS by Team Mental Focus Cohort 142O...A DECISION SUPPORT SYSTEM FOR EVALUATING SYSTEMS OF UNDERSEA SENSORS AND WEAPONS 5. FUNDING NUMBERS 6. AUTHOR(S) Systems Engineering Cohort...undersea weapons, it requires the supporting tools to evaluate and predict the effectiveness of these system concepts. While current naval minefield

Monitoring and evaluation of strategic change programme implementation-Lessons from a case analysis.

PubMed

Neumann, Jan; Robson, Andrew; Sloan, Diane

2018-02-01

This study considered the monitoring and evaluation of a large-scale and domestic and global strategic change programme implementation. It considers the necessary prerequisites to overcome challenges and barriers that prevent systematic and effective monitoring and evaluation to take place alongside its operationalisation. The work involves a case study based on a major industrial company from the energy sector. The change programme makes particular reference to changes in business models, business processes, organisation structures as well as Enterprise Resource Planning infrastructure. The case study focussed on the summative evaluation of the programme post-implementation. This assessment involved 25 semi-structured interviews with employees across a range of managerial strata capturing more than 65 roles within the change programme at both local and global levels. Data relating to their perception of evaluation effectiveness and shortcomings were analysed by means of template analysis. The study identifies responsibilities for executing an evaluation alongside various methods and tools that are appropriate, thereby focussing on the "Who" (roles, responsibility for particular activities) and "How" (methods and tools) rather than "What" to monitor and evaluate. The findings are presented generically so they offer new insights and transferability for practitioners involved in managing strategic change and its associated evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Metadata Evaluation and Improvement: Evolving Analysis and Reporting

NASA Technical Reports Server (NTRS)

Habermann, Ted; Kozimor, John; Gordon, Sean

2017-01-01

ESIP Community members create and manage a large collection of environmental datasets that span multiple decades, the entire globe, and many parts of the solar system. Metadata are critical for discovering, accessing, using and understanding these data effectively and ESIP community members have successfully created large collections of metadata describing these data. As part of the White House Big Earth Data Initiative (BEDI), ESDIS has developed a suite of tools for evaluating these metadata in native dialects with respect to recommendations from many organizations. We will describe those tools and demonstrate evolving techniques for sharing results with data providers.

An Evaluation of the Performance Diagnostic Checklist-Human Services (PDC-HS) Across Domains.

PubMed

Wilder, David A; Lipschultz, Joshua; Gehrman, Chana

2018-06-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to assess the environmental variables that contribute to poor employee performance in human service settings. Although the PDC-HS has been shown to effectively identify variables contributing to problematic performance, interventions based on only two of the four PDC-HS domains have been evaluated to date. In addition, the extent to which PDC-HS-indicated interventions are more effective than nonindicated interventions for two domains remains unclear. In the current study, we administered the PDC-HS to supervisors to assess the variables contributing to infrequent teaching of verbal operants and use of a timer by therapists at a center-based autism treatment program. Each of the four PDC-HS domains was identified as contributing to poor performance for at least one therapist. We then evaluated PDC-HS-indicated interventions for each domain. In addition, to assess the predictive validity of the tool, we evaluated various nonindicated interventions prior to implementing a PDC-HS-indicated intervention for two of the four domains. Results suggest that the PDC-HS-indicated interventions were effective across all four domains and were more effective than the nonindicated interventions for the two domains for which they were evaluated. Results are discussed in terms of the utility of the PDC-HS to identify appropriate interventions to manage therapist performance in human service settings.

Effects of structured written feedback by cards on medical students' performance at Mini Clinical Evaluation Exercise (Mini-CEX) in an outpatient clinic.

PubMed

Haghani, Fariba; Hatef Khorami, Mohammad; Fakhari, Mohammad

2016-07-01

Feedback cards are recommended as a feasible tool for structured written feedback delivery in clinical education while effectiveness of this tool on the medical students' performance is still questionable.  The purpose of this study was to compare the effects of structured written feedback by cards as well as verbal feedback versus verbal feedback alone on the clinical performance of medical students at the Mini Clinical Evaluation Exercise (Mini-CEX) test in an outpatient clinic. This is a quasi-experimental study with pre- and post-test comprising four groups in two terms of medical students' externship. The students' performance was assessed through the Mini-Clinical Evaluation Exercise (Mini-CEX) as a clinical performance evaluation tool. Structured written feedbacks were given to two experimental groups by designed feedback cards as well as verbal feedback, while in the two control groups feedback was delivered verbally as a routine approach in clinical education. By consecutive sampling method, 62 externship students were enrolled in this study and seven students were excluded from the final analysis due to their absence for three days. According to the ANOVA analysis and Post Hoc Tukey test,  no statistically significant difference was observed among the four groups at the pre-test, whereas a statistically significant difference was observed between the experimental and control groups at the post-test  (F = 4.023, p =0.012). The effect size of the structured written feedbacks on clinical performance was 0.19. Structured written feedback by cards could improve the performance of medical students in a statistical sense. Further studies must be conducted in other clinical courses with longer durations.

Six sigma tools in integrating internal operations of a retail pharmacy: a case study.

PubMed

Kumar, Sameer; Kwong, Anthony M

2011-01-01

This study was initiated to integrate information and enterprise-wide healthcare delivery system issues specifically within an inpatient retail pharmacy operation in a U.S. community hospital. Six Sigma tools were used to examine the effects to an inpatient retail pharmacy service process. Some of the tools used include service blueprints, cause-effect diagram, gap analysis derived from customer and employee surveys, mistake proofing was applied in various business situations and results were analyzed to identify and propose process improvements and integration. The research indicates that the Six Sigma tools in this discussion are very applicable and quite effective in helping to streamline and integrate the pharmacy process flow. Additionally, gap analysis derived from two different surveys was used to estimate the primary areas of focus to increase customer and employee satisfaction. The results of this analysis were useful in initiating discussions of how to effectively narrow these service gaps. This retail pharmaceutical service study serves as a framework for the process that should occur for successful process improvement tool evaluation and implementation. Pharmaceutical Service operations in the U.S. that use this integration framework must tailor it to their individual situations to maximize their chances for success.

ASCI visualization tool evaluation, Version 2.0

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kegelmeyer, P.

1997-04-01

The charter of the ASCI Visualization Common Tools subgroup was to investigate and evaluate 3D scientific visualization tools. As part of that effort, a Tri-Lab evaluation effort was launched in February of 1996. The first step was to agree on a thoroughly documented list of 32 features against which all tool candidates would be evaluated. These evaluation criteria were both gleaned from a user survey and determined from informed extrapolation into the future, particularly as concerns the 3D nature and extremely large size of ASCI data sets. The second step was to winnow a field of 41 candidate tools downmore » to 11. The selection principle was to be as inclusive as practical, retaining every tool that seemed to hold any promise of fulfilling all of ASCI`s visualization needs. These 11 tools were then closely investigated by volunteer evaluators distributed across LANL, LLNL, and SNL. This report contains the results of those evaluations, as well as a discussion of the evaluation philosophy and criteria.« less

A Two-Level Structural Equation Model for Evaluating the External Effectiveness of PhD

ERIC Educational Resources Information Center

Chiandotto, Bruno; Masserini, Lucio

2011-01-01

In recent years the number of PhDs in Italy has significantly grown and purposes of PhD courses have expanded from the traditional ones. The analysis of the contribution of PhD title for job placement and employment condition of PhDs is an important tool for evaluating the quality and the effectiveness of PhD courses. For this reason, knowledge of…

The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP)

PubMed Central

Moodie, Sheila T.; Malandrino, April C.; Richert, Frances M.; Clench, Debbie A.; Scollie, Susan D.

2011-01-01

This study proposed and evaluated a guideline for outcome evaluation for infants and children with hearing loss who wear hearing aids. The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP) was developed following a critical review of pediatric outcome evaluation tools and was systematically examined by the Network of Pediatric Audiologists of Canada. It consists of tools to gather clinical process outcomes as well as functional caregiver reports. The UWO PedAMP was administered to a clinical population of infants and children with hearing aids. Sixty-eight children were administered the functional outcome evaluation tools (i.e., caregiver reports) a total of 133 times. Clinical process outcomes of hearing aid verification (e.g., real-ear-to-coupler difference) revealed typical aided audibility (e.g., Speech Intelligibility Index). Results for the LittlEARS® questionnaire revealed that typically developing children with hearing loss who wear hearing aids are meeting auditory development milestones. Children with mild to moderate comorbidities displayed typical auditory development during the 1st year of life after which development began to decline. Children with complex factors related to hearing aid use had lower scores on the LittlEARS, but auditory development was in parallel to norms. Parents’ Evaluation of Aural/Oral Performance (PEACH) results indicated no age effect on scoring for children above 2 years of age; however, the effect of degree of hearing loss was significant. This work provides clinicians with a systematic, evidence-based outcome evaluation protocol to implement as part of a complete pediatric hearing aid fitting. PMID:22194316

Non-destructive evaluation of porosity and its effect on mechanical properties of carbon fiber reinforced polymer composite materials

NASA Astrophysics Data System (ADS)

Bhat, M. R.; Binoy, M. P.; Surya, N. M.; Murthy, C. R. L.; Engelbart, R. W.

2012-05-01

In this work, an attempt is made to induce porosity of varied levels in carbon fiber reinforced epoxy based polymer composite laminates fabricated using prepregs by varying the fabrication parameters such as applied vacuum, autoclave pressure and curing temperature. Different NDE tools have been utilized to evaluate the porosity content and correlate with measurable parameters of different NDE techniques. Primarily, ultrasonic imaging and real time digital X-ray imaging have been tried to obtain a measurable parameter which can represent or reflect the amount of porosity contained in the composite laminate. Also, effect of varied porosity content on mechanical properties of the CFRP composite materials is investigated through a series of experimental investigations. The outcome of the experimental approach has yielded interesting and encouraging trend as a first step towards developing an NDE tool for quantification of effect of varied porosity in the polymer composite materials.

The artificial membrane insert system as predictive tool for formulation performance evaluation.

PubMed

Berben, Philippe; Brouwers, Joachim; Augustijns, Patrick

2018-02-15

In view of the increasing interest of pharmaceutical companies for cell- and tissue-free models to implement permeation into formulation testing, this study explored the capability of an artificial membrane insert system (AMI-system) as predictive tool to evaluate the performance of absorption-enabling formulations. Firstly, to explore the usefulness of the AMI-system in supersaturation assessment, permeation was monitored after induction of different degrees of loviride supersaturation. Secondly, to explore the usefulness of the AMI-system in formulation evaluation, a two-stage dissolution test was performed prior to permeation assessment. Different case examples were selected based on the availability of in vivo (intraluminal and systemic) data: (i) a suspension of posaconazole (Noxafil ® ), (ii) a cyclodextrin-based formulation of itraconazole (Sporanox ® ), and (iii) a micronized (Lipanthyl ® ) and nanosized (Lipanthylnano ® ) formulation of fenofibrate. The obtained results demonstrate that the AMI-system is able to capture the impact of loviride supersaturation on permeation. Furthermore, the AMI-system correctly predicted the effects of (i) formulation pH on posaconazole absorption, (ii) dilution on cyclodextrin-based itraconazole absorption, and (iii) food intake on fenofibrate absorption. Based on the applied in vivo/in vitro approach, the AMI-system combined with simple dissolution testing appears to be a time- and cost-effective tool for the early-stage evaluation of absorption-enabling formulations. Copyright © 2017 Elsevier B.V. All rights reserved.

Hearing Aid Satisfaction: What Does Research from the Past 20 Years Say?

PubMed Central

Wong, Lena L. N.; Hickson, Louise; McPherson, Bradley

2003-01-01

Hearing aid satisfaction is a pleasurable emotional experience as an outcome of an evaluation of performance. Many tools have been designed to measure the degree of satisfaction overall, or along the dimensions of cost, appearance, acoustic benefit, comfort, and service. Various studies have used these tools to examine the relationships between satisfaction and other factors. Findings are not always consistent across studies, but in general, hearing aid satisfaction has been found to be related to experience, expectation, personality and attitude, usage, type of hearing aids, sound quality, listening situations, and problems in hearing aid use. Inconsistent findings across studies and difficulties in evaluating the underlying relationships are probably caused by problems with the tools (eg, lack of validity) and the methods used to evaluate relationships (eg, correlation analyses evaluate association and not causal effect). Whether satisfaction changes over time and how service satisfaction contributes to device satisfaction are unclear. It is hoped that this review will help readers understand current satisfaction measures, how various factors affect satisfaction, and how the way satisfaction is measured may be improved to yield more reliable and valid data. PMID:15004650

Modeling Cover Crop Effectiveness on Maryland's Eastern Shore

USDA-ARS?s Scientific Manuscript database

The value of watershed-scale, hydrologic/water quality models to ecosystem management is increasingly evident as more programs adopt these tools to evaluate the effectiveness of different management scenarios and their impact on the environment. Quality of precipitation data is critical for appropri...

Designing Tools for Supporting User Decision-Making in e-Commerce

NASA Astrophysics Data System (ADS)

Sutcliffe, Alistair; Al-Qaed, Faisal

The paper describes a set of tools designed to support a variety of user decision-making strategies. The tools are complemented by an online advisor so they can be adapted to different domains and users can be guided to adopt appropriate tools for different choices in e-commerce, e.g. purchasing high-value products, exploring product fit to users’ needs, or selecting products which satisfy requirements. The tools range from simple recommenders to decision support by interactive querying and comparison matrices. They were evaluated in a scenario-based experiment which varied the users’ task and motivation, with and without an advisor agent. The results show the tools and advisor were effective in supporting users and agreed with the predictions of ADM (adaptive decision making) theory, on which the design of the tools was based.

Family history tools in primary care: does one size fit all?

PubMed

Wilson, B J; Carroll, J C; Allanson, J; Little, J; Etchegary, H; Avard, D; Potter, B K; Castle, D; Grimshaw, J M; Chakraborty, P

2012-01-01

Family health history (FHH) has potential value in many health care settings. This review discusses the potential uses of FHH information in primary care and the need for tools to be designed accordingly. We developed a framework in which the attributes of FHH tools are mapped against these different purposes. It contains 7 attributes mapped against 5 purposes. In considering different FHH tool purposes, it is apparent that different attributes become more or less important, and that tools for different purposes require different implementation and evaluation strategies. The context in which a tool is used is also relevant to its effectiveness. For FHH tools, it is unlikely that 'one size fits all', although appreciation of different purposes, users and contexts should facilitate the development of different applications from single FHH platforms. Copyright © 2012 S. Karger AG, Basel.

Porous tooling process for manufacture of graphite/polyimide composites

NASA Technical Reports Server (NTRS)

Smiser, L. W.; Orr, K. K.; Araujo, S. M.

1981-01-01

A porous tooling system was selected for the processing of Graphite/PMR-15 Polyimide laminates in thickness up to 3.2 mm. (0.125 inch). This tool system must have a reasonable strength, permeability dimensional stability, and thermal conductivity to accomplish curing at 600 F and 200 psi and 200 psi autoclave temperature and pressure. A permeability measuring apparatus was constructed and permeability vs. casting water level determined to produce tools at three different permeability levels. On these tools, laminates of 5, 11, and 22 plies (.027, .060, and 0.121 inch) were produced and evaluated by ultrasonic, mechanical, and thermal tests to determine the effect of the tool permeability on the cured laminates. All tools produced acceptable laminates at 5 and 11 plies but only the highest permeability produced acceptable clear ultrasonic C-Scans. Recommendations are made for future investigations of design geometry, and strengthening techniques for porous ceramic tooling.

Construction and Validation of a Holistic Education School Evaluation Tool Using Montessori Erdkinder Principles

ERIC Educational Resources Information Center

Setari, Anthony Philip

2016-01-01

The purpose of this study was to construct a holistic education school evaluation tool using Montessori Erdkinder principles, and begin the validation process of examining the proposed tool. This study addresses a vital need in the holistic education community for a school evaluation tool. The tool construction process included using Erdkinder…

Enroute flight planning: Evaluating design concepts for the development of cooperative problem-solving concepts

NASA Technical Reports Server (NTRS)

Smith, Philip J.; Mccoy, C. Elaine

1991-01-01

The goals of this research were to develop design concepts to support the task of enroute flight planning. And within this context, to explore and evaluate general design concepts and principles to guide the development of cooperative problem solving systems. A detailed model is to be developed of the cognitive processes involved in flight planning. Included in this model will be the identification of individual differences of subjects. Of particular interest will be differences between pilots and dispatchers. The effect will be studied of the effect on performance of tools that support planning at different levels of abstraction. In order to conduct this research, the Flight Planning Testbed (FPT) was developed, a fully functional testbed environment for studying advanced design concepts for tools to aid in flight planning.

Development of a Learning-Oriented Computer Assisted Instruction Designed to Improve Skills in the Clinical Assessment of the Nutritional Status: A Pilot Evaluation

PubMed Central

García de Diego, Laura; Cuervo, Marta; Martínez, J. Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient’s nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient’s needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum. PMID:25978456

Development of a learning-oriented computer assisted instruction designed to improve skills in the clinical assessment of the nutritional status: a pilot evaluation.

PubMed

García de Diego, Laura; Cuervo, Marta; Martínez, J Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient's nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient's needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum.

User Perceptions and Reactions to an Online Cancer Risk Assessment Tool: a Process Evaluation of Cancer Risk Check.

PubMed

Hovick, Shelly R; Bevers, Therese B; Vidrine, Jennifer Irvin; Kim, Stephanie; Dailey, Phokeng M; Jones, Lovell A; Peterson, Susan K

2017-03-01

Online cancer risk assessment tools, which provide personalized cancer information and recommendations based on personal data input by users, are a promising cancer education approach; however, few tools have been evaluated. A randomized controlled study was conducted to compare user impressions of one tool, Cancer Risk Check (CRC), to non-personalized educational information delivered online as series of self-advancing slides (the control). CRC users (N = 1452) rated the tool to be as interesting as the control (p > .05), but users were more likely to report that the information was difficult to understand and not applicable to them (p < .05). Information seeking and sharing also were lower among CRC users; thus, although impressions of CRC were favorable, it was not shown to be superior to existing approaches. We hypothesized CRC was less effective because it contained few visual and graphical elements; therefore, CRC was compared to a text-based control (online PDF file) post hoc. CRC users rated the information to be more interesting, less difficult to understand, and better able to hold their attention (p < .05). Post hoc results suggest the visual presentation of risk is critical to tool success.

"Evo in the News": A Pedagogical Tool to Enhance Students' Perceptions of the Relevance of Evolutionary Biology

ERIC Educational Resources Information Center

Infanti, Lynn M.

2012-01-01

This investigation evaluated the effects of the use of the pedagogical tool "Evo in the News" on the attitudes toward and knowledge of biological evolution in a sample of undergraduate non-major biology students at a large, private research university. In addition, this study looked at the initial attitudes of the students and their…

Computer Simulation in Mass Emergency and Disaster Response: An Evaluation of Its Effectiveness as a Tool for Demonstrating Strategic Competency in Emergency Department Medical Responders

ERIC Educational Resources Information Center

O'Reilly, Daniel J.

2011-01-01

This study examined the capability of computer simulation as a tool for assessing the strategic competency of emergency department nurses as they responded to authentically computer simulated biohazard-exposed patient case studies. Thirty registered nurses from a large, urban hospital completed a series of computer-simulated case studies of…

Evaluation of a simple method for the automatic assignment of MeSH descriptors to health resources in a French online catalogue.

PubMed

Névéol, Aurélie; Pereira, Suzanne; Kerdelhué, Gaetan; Dahamna, Badisse; Joubert, Michel; Darmoni, Stéfan J

2007-01-01

The growing number of resources to be indexed in the catalogue of online health resources in French (CISMeF) calls for curating strategies involving automatic indexing tools while maintaining the catalogue's high indexing quality standards. To develop a simple automatic tool that retrieves MeSH descriptors from documents titles. In parallel to research on advanced indexing methods, a bag-of-words tool was developed for timely inclusion in CISMeF's maintenance system. An evaluation was carried out on a corpus of 99 documents. The indexing sets retrieved by the automatic tool were compared to manual indexing based on the title and on the full text of resources. 58% of the major main headings were retrieved by the bag-of-words algorithm and the precision on main heading retrieval was 69%. Bag-of-words indexing has effectively been used on selected resources to be included in CISMeF since August 2006. Meanwhile, on going work aims at improving the current version of the tool.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Automatic Single Event Effects Sensitivity Analysis of a 13-Bit Successive Approximation ADC

NASA Astrophysics Data System (ADS)

Márquez, F.; Muñoz, F.; Palomo, F. R.; Sanz, L.; López-Morillo, E.; Aguirre, M. A.; Jiménez, A.

2015-08-01

This paper presents Analog Fault Tolerant University of Seville Debugging System (AFTU), a tool to evaluate the Single-Event Effect (SEE) sensitivity of analog/mixed signal microelectronic circuits at transistor level. As analog cells can behave in an unpredictable way when critical areas interact with the particle hitting, there is a need for designers to have a software tool that allows an automatic and exhaustive analysis of Single-Event Effects influence. AFTU takes the test-bench SPECTRE design, emulates radiation conditions and automatically evaluates vulnerabilities using user-defined heuristics. To illustrate the utility of the tool, the SEE sensitivity of a 13-bits Successive Approximation Analog-to-Digital Converter (ADC) has been analysed. This circuit was selected not only because it was designed for space applications, but also due to the fact that a manual SEE sensitivity analysis would be too time-consuming. After a user-defined test campaign, it was detected that some voltage transients were propagated to a node where a parasitic diode was activated, affecting the offset cancelation, and therefore the whole resolution of the ADC. A simple modification of the scheme solved the problem, as it was verified with another automatic SEE sensitivity analysis.

An evaluation of liquid ammonia (ammonium hydroxide) as a candidate piscicide

USGS Publications Warehouse

Ward, David L.; Morton-Starner, R.; Hedwall, Shaula J.

2013-01-01

Eradication of populations of nonnative aquatic species for the purpose of reintroducing native fish is often difficult because very few effective tools are available for removing aquatic organisms. This creates the need to evaluate new chemicals that could be used as management tools for native fish conservation. Ammonia is a natural product of fish metabolism and is naturally present in the environment at low levels, yet is known to be toxic to most aquatic species. Our objective was to determine the feasibility of using liquid ammonia as a fisheries management tool by evaluating its effectiveness at killing undesirable aquatic species and its persistence in a pond environment. A suite of invasive aquatic species commonly found in the southwestern USA were introduced into two experimental outdoor ponds located at the Rocky Mountain Research Station in Flagstaff, Arizona. Each pond was treated with ammonium hydroxide (29%) at 38 ppm. This target concentration was chosen because previous studies using anhydrous ammonia reported incomplete fish kills in ponds at concentrations less than 30 ppm. Water quality was monitored for 49 d to determine how quickly the natural bacteria in the environment converted the ammonia to nitrate. Ammonia levels remained above 8 ppm for 24 and 18 d, respectively, in ponds 1 and 2. Nitrite levels in each pond began to rise approximately 14 d after dosing with ammonia and stayed above 5 ppm for an additional 21 d in pond 1 and 18 d in pond 2. After 49 d all water in both ponds was drained and no fish, crayfish, or tadpoles were found to have survived the treatment, but aquatic turtles remained alive and appeared unaffected. Liquid ammonia appears to be an effective tool for removing many problematic invasive aquatic species and may warrant further investigation as a piscicide.

REACH-ER: a tool to evaluate river basin remediation measures for contaminants at the catchment scale

NASA Astrophysics Data System (ADS)

van Griensven, Ann; Haest, Pieter Jan; Broekx, Steven; Seuntjens, Piet; Campling, Paul; Ducos, Geraldine; Blaha, Ludek; Slobodnik, Jaroslav

2010-05-01

The European Union (EU) adopted the Water Framework Directive (WFD) in 2000 ensuring that all aquatic ecosystems meet ‘good status' by 2015. However, it is a major challenge for river basin managers to meet this requirement in river basins with a high population density as well as intensive agricultural and industrial activities. The EU financed AQUAREHAB project (FP7) specifically examines the ecological and economic impact of innovative rehabilitation technologies for multi-pressured degraded water bodies. For this purpose, a generic collaborative management tool ‘REACH-ER' is being developed that can be used by stakeholders, citizens and water managers to evaluate the ecological and economical effects of different remedial actions on waterbodies. The tool is built using databases from large scale models simulating the hydrological dynamics of the river basing and sub-basins, the costs of the measures and the effectiveness of the measures in terms of ecological impact. Knowledge rules are used to describe the relationships between these data in order to compute the flux concentrations or to compute the effectiveness of measures. The management tool specifically addresses nitrate pollution and pollution by organic micropollutants. Detailed models are also used to predict the effectiveness of site remedial technologies using readily available global data. Rules describing ecological impacts are derived from ecotoxicological data for (mixtures of) specific contaminants (msPAF) and ecological indices relating effects to the presence of certain contaminants. Rules describing the cost-effectiveness of measures are derived from linear programming models identifying the least-cost combination of abatement measures to satisfy multi-pollutant reduction targets and from multi-criteria analysis.

Friction Stir Welding of Al-B4C Composite Fabricated by Accumulative Roll Bonding: Evaluation of Microstructure and Mechanical Behavior

NASA Astrophysics Data System (ADS)

Moradi Faradonbeh, Alireza; Shamanian, Morteza; Edris, Hossein; Paidar, Moslem; Bozkurt, Yahya

2018-02-01

In this investigation, friction stir welding (FSW) of Al-B4C composite fabricated by 10 cycles accumulative roll bonding was conducted. In order to investigate the influences of pin geometry on microstructure and mechanical properties, four different pin geometries (cylindrical, square, triangular and hexagonal) were selected. It was found that FSW parameters had a major effect on the fragmentation and distribution of reinforcement particles in stir zone. When the tool travel speed was increased, the distribution of B4C particles was become gradually uniform in the aluminum matrix. The effect of tool rotational speed on the peak temperature was determined to be greater than the tool travel speed. The attained data of tensile properties and microhardness tests showed that the tool travel speed had bilateral effect on the tensile strength. The maximum tensile joint efficiency was obtained as 238% for FSWed of Al-2%B4C composite to annealed base Al sheet.

Understanding the Delamination Risk of a Trilayer Tablet Using Minipiloting Tools.

PubMed

Tao, Jing; Robertson-Lavalle, Sophia; Pandey, Preetanshu; Badawy, Sherif

2017-11-01

A multilayer tablet is one of the formulation options used to mitigate chemical and physical incompatibility between different drug substances. Feasibility studies of multilayer tablets are often conducted using round flat-faced punch tooling. However, the link between different tooling designs and multilayer tablet performance is not well established. This study uses a prototype trilayer tablet and examines tooling design considerations when conducting small-scale studies to gauge the risk of interfacial defects. The impact of tablet weight and dimensions was evaluated to gain understanding of the effect of scale-up/down of tablet size. The factors in tooling selection, including tablet shape, cup depth, and size of embossing were evaluated to gain insight on the impact of tooling design on the interfacial strength of the trilayer tablet. It was found that tablet weight and dimensions can significantly affect the interfacial strength due to their impact on force transmission during compression and the retardation force from the die wall during ejection. Round flat-faced tooling generated trilayer tablets of the strongest interfacial strength compared to typical commercial tablets-oval shaped with concave surfaces. These factors should be accounted for when using round flat compacts to assess the interface risks of a multilayer tablet. Copyright © 2017 American Pharmacists Association®. Published by Elsevier Inc. All rights reserved.

Mechanics and energetics in tool manufacture and use: a synthetic approach.

PubMed

Wang, Liyu; Brodbeck, Luzius; Iida, Fumiya

2014-11-06

Tool manufacture and use are observed not only in humans but also in other animals such as mammals, birds and insects. Manufactured tools are used for biomechanical functions such as effective control of fluids and small solid objects and extension of reaching. These tools are passive and used with gravity and the animal users' own energy. From the perspective of evolutionary biology, manufactured tools are extended phenotypes of the genes of the animal and exhibit phenotypic plasticity. This incurs energetic cost of manufacture as compared to the case with a fixed tool. This paper studies mechanics and energetics aspects of tool manufacture and use in non-human beings. Firstly, it investigates possible mechanical mechanisms of the use of passive manufactured tools. Secondly, it formulates the energetic cost of manufacture and analyses when phenotypic plasticity benefits an animal tool maker and user. We take a synthetic approach and use a controlled physical model, i.e. a robot arm. The robot is capable of additively manufacturing scoop and gripper structures from thermoplastic adhesives to pick and place fluid and solid objects, mimicking primates and birds manufacturing tools for a similar function. We evaluate the effectiveness of tool use in pick-and-place and explain the mechanism for gripper tools picking up solid objects with a solid-mechanics model. We propose a way to formulate the energetic cost of tool manufacture that includes modes of addition and reshaping, and use it to analyse the case of scoop tools. Experiment results show that with a single motor trajectory, the robot was able to effectively pick and place water, rice grains, a pebble and a plastic box with a scoop tool or gripper tools that were manufactured by itself. They also show that by changing the dimension of scoop tools, the energetic cost of tool manufacture and use could be reduced. The work should also be interesting for engineers to design adaptive machines. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

Mechanics and energetics in tool manufacture and use: a synthetic approach

PubMed Central

Wang, Liyu; Brodbeck, Luzius; Iida, Fumiya

2014-01-01

Tool manufacture and use are observed not only in humans but also in other animals such as mammals, birds and insects. Manufactured tools are used for biomechanical functions such as effective control of fluids and small solid objects and extension of reaching. These tools are passive and used with gravity and the animal users' own energy. From the perspective of evolutionary biology, manufactured tools are extended phenotypes of the genes of the animal and exhibit phenotypic plasticity. This incurs energetic cost of manufacture as compared to the case with a fixed tool. This paper studies mechanics and energetics aspects of tool manufacture and use in non-human beings. Firstly, it investigates possible mechanical mechanisms of the use of passive manufactured tools. Secondly, it formulates the energetic cost of manufacture and analyses when phenotypic plasticity benefits an animal tool maker and user. We take a synthetic approach and use a controlled physical model, i.e. a robot arm. The robot is capable of additively manufacturing scoop and gripper structures from thermoplastic adhesives to pick and place fluid and solid objects, mimicking primates and birds manufacturing tools for a similar function. We evaluate the effectiveness of tool use in pick-and-place and explain the mechanism for gripper tools picking up solid objects with a solid-mechanics model. We propose a way to formulate the energetic cost of tool manufacture that includes modes of addition and reshaping, and use it to analyse the case of scoop tools. Experiment results show that with a single motor trajectory, the robot was able to effectively pick and place water, rice grains, a pebble and a plastic box with a scoop tool or gripper tools that were manufactured by itself. They also show that by changing the dimension of scoop tools, the energetic cost of tool manufacture and use could be reduced. The work should also be interesting for engineers to design adaptive machines. PMID:25209405

Evaluation of a Remote Training Approach for Teaching Seniors to Use a Telehealth System

PubMed Central

Lai, Albert M.; Kaufman, David R.; Starren, Justin; Shea, Steven

2009-01-01

Objective There has been a growth of home health care technology in rural areas. However, a significant limitation has been the need for costly and repetitive training in order for patients to efficiently use their home telemedicine unit (HTU). This research describes the evaluation of an architecture for remote training of patients in a telemedicine environment. This work examines the viability of a remote training architecture called REmote Patient Education in a Telemedicine Environment (REPETE). REPETE was implemented and evaluated in the context of the IDEATel project, a large-scale telemedicine project, focusing on Medicare beneficiaries with diabetes in New York State. Methods A number of qualitative and quantitative evaluation tools were developed and used to study the effectiveness of the remote training sessions evaluating: a) task complexity, b) changes in patient performance and c) the communication between trainer and patient. Specifically, the effectiveness of the training was evaluated using a measure of web skills competency, a user satisfaction survey, a cognitive task analysis and an interaction analysis. Results Patients not only reported that the training was beneficial, but also showed significant improvements in their ability to effectively perform tasks. Our qualitative evaluations scrutinizing the interaction between the trainer and patient showed that while there was a learning curve for both the patient and trainer when negotiating the shared workspace, the mutually visible pointer used in REPETE enhanced the computer-mediated instruction. Conclusions REPETE is an effective remote training tool for older adults in the telemedicine environment. Patients demonstrated significant improvements in their ability to perform tasks on their home telemedicine unit. PMID:19620023

Evaluation of a remote training approach for teaching seniors to use a telehealth system.

PubMed

Lai, Albert M; Kaufman, David R; Starren, Justin; Shea, Steven

2009-11-01

There has been a growth of home healthcare technology in rural areas. However, a significant limitation has been the need for costly and repetitive training in order for patients to efficiently use their home telemedicine unit (HTU). This research describes the evaluation of an architecture for remote training of patients in a telemedicine environment. This work examines the viability of a remote training architecture called REmote Patient Education in a Telemedicine Environment (REPETE). REPETE was implemented and evaluated in the context of the IDEATel project, a large-scale telemedicine project, focusing on Medicare beneficiaries with diabetes in New York State. A number of qualitative and quantitative evaluation tools were developed and used to study the effectiveness of the remote training sessions evaluating: (a) task complexity, (b) changes in patient performance and (c) the communication between trainer and patient. Specifically, the effectiveness of the training was evaluated using a measure of web skills competency, a user satisfaction survey, a cognitive task analysis and an interaction analysis. Patients not only reported that the training was beneficial, but also showed significant improvements in their ability to effectively perform tasks. Our qualitative evaluations scrutinizing the interaction between the trainer and patient showed that while there was a learning curve for both the patient and trainer when negotiating the shared workspace, the mutually visible pointer used in REPETE enhanced the computer-mediated instruction. REPETE is an effective remote training tool for older adults in the telemedicine environment. Patients demonstrated significant improvements in their ability to perform tasks on their home telemedicine unit.

Assumption-aware tools and agency; an interrogation of the primary artifacts of the program evaluation and design profession in working with complex evaluands and complex contexts.

PubMed

Morrow, Nathan; Nkwake, Apollo M

2016-12-01

Like artisans in a professional guild, we evaluators create tools to suit our ever evolving practice. The tools we use as evaluators are the primary artifacts of our profession, reflect our practice and embody an amalgamation of paradigms and assumptions. With the increasing shifts in evaluation purposes from judging program worth to understanding how programs work, the evaluator's role is changing to that of facilitating stakeholders in a learning process. This involves clarifying purposes and choices, as well as unearthing critical assumptions. In such a role, evaluators become major tool-users and begin to innovate with small refinements or produce completely new tools to fit a specific challenge or context. We interrogate the form and function of 12 tools used by evaluators when working with complex evaluands and complex contexts. The form is described in terms of traditional qualitative techniques and particular characteristics of the elements, use and presentation of each tool. Then the function of each tool is analyzed with respect to articulating assumptions and affecting the agency of evaluators and stakeholders in complex contexts. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using the arthroscopic surgery skill evaluation tool as a pass-fail examination.

PubMed

Koehler, Ryan J; Nicandri, Gregg T

2013-12-04

Examination of arthroscopic skill requires evaluation tools that are valid and reliable with clear criteria for passing. The Arthroscopic Surgery Skill Evaluation Tool was developed as a video-based assessment of technical skill with criteria for passing established by a panel of experts. The purpose of this study was to test the validity and reliability of the Arthroscopic Surgery Skill Evaluation Tool as a pass-fail examination of arthroscopic skill. Twenty-eight residents and two sports medicine faculty members were recorded performing diagnostic knee arthroscopy on a left and right cadaveric specimen in our arthroscopic skills laboratory. Procedure videos were evaluated with use of the Arthroscopic Surgery Skill Evaluation Tool by two raters blind to subject identity. Subjects were considered to pass the Arthroscopic Surgery Skill Evaluation Tool when they attained scores of ≥ 3 on all eight assessment domains. The raters agreed on a pass-fail rating for fifty-five of sixty videos rated with an interclass correlation coefficient value of 0.83. Ten of thirty participants were assigned passing scores by both raters for both diagnostic arthroscopies performed in the laboratory. Receiver operating characteristic analysis demonstrated that logging more than eighty arthroscopic cases or performing more than thirty-five arthroscopic knee cases was predictive of attaining a passing Arthroscopic Surgery Skill Evaluation Tool score on both procedures performed in the laboratory. The Arthroscopic Surgery Skill Evaluation Tool is valid and reliable as a pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. This study demonstrates that the Arthroscopic Surgery Skill Evaluation Tool may be a useful tool for pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. Further study is necessary to determine whether the Arthroscopic Surgery Skill Evaluation Tool can be used for the assessment of multiple arthroscopic procedures and whether it can be used to evaluate arthroscopic procedures performed in the operating room.

Analytical framework and tool kit for SEA follow-up

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nilsson, Mans; Wiklund, Hans; Finnveden, Goeran

2009-04-15

Most Strategic Environmental Assessment (SEA) research and applications have so far neglected the ex post stages of the process, also called SEA follow-up. Tool kits and methodological frameworks for engaging effectively with SEA follow-up have been conspicuously missing. In particular, little has so far been learned from the much more mature evaluation literature although many aspects are similar. This paper provides an analytical framework and tool kit for SEA follow-up. It is based on insights and tools developed within programme evaluation and environmental systems analysis. It is also grounded in empirical studies into real planning and programming practices at themore » regional level, but should have relevance for SEA processes at all levels. The purpose of the framework is to promote a learning-oriented and integrated use of SEA follow-up in strategic decision making. It helps to identify appropriate tools and their use in the process, and to systematise the use of available data and knowledge across the planning organization and process. It distinguishes three stages in follow-up: scoping, analysis and learning, identifies the key functions and demonstrates the informational linkages to the strategic decision-making process. The associated tool kit includes specific analytical and deliberative tools. Many of these are applicable also ex ante, but are then used in a predictive mode rather than on the basis of real data. The analytical element of the framework is organized on the basis of programme theory and 'DPSIR' tools. The paper discusses three issues in the application of the framework: understanding the integration of organizations and knowledge; understanding planners' questions and analytical requirements; and understanding interests, incentives and reluctance to evaluate.« less

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

PubMed

Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

2016-07-01

To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

Erosion and runoff evaluation using the SWAT-T model

USDA-ARS?s Scientific Manuscript database

Agricultural terraces are an effective conservation practice to reduce concentrated flow erosion. Researchers have simulated terrace effects using the Soil and Water Assessment Tool (SWAT) by adjusting the slope length and the USLE Practice P-factor. An algorithm was incorporated into SWAT (SWAT-Ter...

Cockpit System Situational Awareness Modeling Tool

NASA Technical Reports Server (NTRS)

Keller, John; Lebiere, Christian; Shay, Rick; Latorella, Kara

2004-01-01

This project explored the possibility of predicting pilot situational awareness (SA) using human performance modeling techniques for the purpose of evaluating developing cockpit systems. The Improved Performance Research Integration Tool (IMPRINT) was combined with the Adaptive Control of Thought-Rational (ACT-R) cognitive modeling architecture to produce a tool that can model both the discrete tasks of pilots and the cognitive processes associated with SA. The techniques for using this tool to predict SA were demonstrated using the newly developed Aviation Weather Information (AWIN) system. By providing an SA prediction tool to cockpit system designers, cockpit concepts can be assessed early in the design process while providing a cost-effective complement to the traditional pilot-in-the-loop experiments and data collection techniques.

Evaluation of two communication strategies to improve udder health management.

PubMed

Jansen, J; Renes, R J; Lam, T J G M

2010-02-01

Worldwide, programs to improve udder health are implemented using communication tools and methods that inform and persuade dairy farmers. This study evaluated 2 communication strategies used in a mastitis control program in the Netherlands. To improve farmers' udder health management, tools such as instruction cards, treatment plans, checklists and software were developed following an argument-based comprehensive "central route." These tools were used during on-farm study group meetings for farmers organized by veterinarians and also during individual veterinarian-farmer interactions. The second strategy aimed at adopting a single management practice to increase the use of milking gloves during milking. This approach followed a straightforward "peripheral" route that used implicit persuasion techniques. Results of an online survey of 374 Dutch dairy farmers showed that most farmers were able and willing to use the educational management tools to increase udder health on their farms. They evaluated the tools positively regardless of the mastitis problems on their farms. This seems to indicate that the central route of communication is most effective when farmers are motivated to work on udder health in general. Results of repeated random telephone surveys before, during, and after the campaign on the use of milking gloves showed that the use of gloves increased from 20.9 to 42.0% of the respondents. Respondents' opinions about milking gloves also changed favorably, indicating that a relatively short peripheral campaign on a single action can have a sustained effect on farmers' behavior. Both communication strategies seem to be potentially successful in disseminating knowledge to a specific target group of farmers and in changing that group's behavior. However, to reach as many farmers as possible, the strategies should be combined. When optimizing these strategies, both the farmers' motivation to work on udder health and the aim of the campaign should be considered. When aiming to improve general udder health management, the central route seems to be effective if farmers are already motivated to optimize their udder health management. For farmers who are less motivated to work on udder health, the peripheral route seems to be most effective when aiming to change a single management practice. The evaluated communication strategies are examples of how management practices to control mastitis can be effectively communicated to farmers. As such, this study contributes to optimizing future programs to control and prevent diseases. Copyright 2010 American Dairy Science Association. Published by Elsevier Inc. All rights reserved.

Pediatric faculty and residents’ perspectives on In-Training Evaluation Reports (ITERs)

PubMed Central

Patel, Rikin; Drover, Anne; Chafe, Roger

2015-01-01

Background In-training evaluation reports (ITERs) are used by over 90% of postgraduate medical training programs in Canada for resident assessment. Our study examined the perspectives of faculty and residents in one pediatric program as a means to improve the ITER as an evaluation tool. Method Two separate focus groups were conducted, one with eight pediatric residents and one with nine clinical faculty within the pediatrics program of Memorial University’s Faculty of Medicine to discuss their perceptions of, and suggestions for improving, the use of ITERs. Results Residents and faculty shared many similar suggestions for improving the ITER as an evaluation tool. Both the faculty and residents emphasized the importance of written feedback, contextualizing the evaluation and timely follow-up. The biggest challenge appears to be the discrepancy in the quality of feedback sought by the residents and the faculty members’ ability to do so in a time effective manner. Others concerns related to the need for better engagement in setting rotation objectives and more direct observation by the faculty member completing the ITER. Conclusions The ITER is a useful tool in resident evaluations, but a number of issues relating to its actual use could improve the quality of feedback which residents receive. PMID:27004076

Evaluation of an educational technology regarding clinical evaluation of preterm newborns.

PubMed

Fonseca, Luciana Mara Monti; Aredes, Natália Del'Angelo; Leite, Adriana Moraes; dos Santos, Claudia Benedita; de Lima, Regina Aparecida Garcia; Scochi, Carmen Gracinda Silvan

2013-02-01

To evaluate, from the students' point of view, educational software developed as a tool to help teachers and students in neonatal nursing. The study evaluates the contents and simulations addressed in the software. A total of 57 undergraduate nursing students affiliated with five Brazilian public colleges participated. The general assessment of the software was highly satisfactory: 82.4% of the sample characterized the software as quite effective as a teaching tool. Most components were assessed as good or very good. The participants' suggestions and comments are being considered in the improvement and adaptation of the new software version. The results show that the product is adequate for use in neonatal nursing courses and nursing training on the physical examination techniques and semiology of preterm newborns, falling within the pedagogical framework of active methods.

Designing and evaluating a STEM teacher learning opportunity in the research university.

PubMed

Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D

2014-04-01

This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.

Communicating risk of hereditary breast and ovarian cancer with an interactive decision support tool.

PubMed

Rupert, Douglas J; Squiers, Linda B; Renaud, Jeanette M; Whitehead, Nedra S; Osborn, Roger J; Furberg, Robert D; Squire, Claudia M; Tzeng, Janice P

2013-08-01

Women with hereditary breast and ovarian cancer syndrome (HBOC) face a higher risk of earlier, more aggressive cancer. Because of HBOC's rarity, screening is recommended only for women with strong cancer family histories. However, most patients do not have accurate history available and struggle to understand genetic concepts. Cancer in the Family, an online clinical decision support tool, calculated women's HBOC risk and promoted shared patient-provider decisions about screening. A pilot evaluation (n=9 providers, n=48 patients) assessed the tool's impact on knowledge, attitudes, and screening decisions. Patients used the tool before wellness exams and completed three surveys. Providers accessed the tool during exams, completed exam checklists, and completed four surveys. Patients entered complete family histories (67%), calculated personal risk (96%), and shared risk printouts with providers (65%). HBOC knowledge increased dramatically for patients and providers, and many patients (75%) perceived tool results as valid. The tool prompted patient-provider discussions about HBOC risk and cancer family history (88%). The tool was effective in increasing knowledge, collecting family history, and sparking patient-provider discussions about HBOC screening. Interactive tools can effectively communicate personalized risk and promote shared decisions, but they are not a substitute for patient-provider discussions. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Student Perceptions and Effectiveness of an Innovative Learning Tool: Anatomy Glove Learning System

ERIC Educational Resources Information Center

Lisk, Kristina; McKee, Pat; Baskwill, Amanda; Agur, Anne M. R.

2015-01-01

A trend in anatomical education is the development of alternative pedagogical approaches to replace or complement experiences in a cadaver laboratory; however, empirical evidence on their effectiveness is often not reported. This study aimed to evaluate the effectiveness of Anatomy Glove Learning System (AGLS), which enables students to learn the…

The Production Effect: Costs and Benefits in Free Recall

ERIC Educational Resources Information Center

Jones, Angela C.; Pyc, Mary A.

2014-01-01

The production effect, the memorial benefit for information read aloud versus silently, has been touted as a simple memory improvement tool. The current experiments were designed to evaluate the relative costs and benefits of production using a free recall paradigm. Results extend beyond prior work showing a production effect only when production…

Phonetic Training in the Foreign Language Curriculum

ERIC Educational Resources Information Center

Burnham, Kevin R.

2014-01-01

In this experiment we evaluate phonetic training as a tool for language learning. Specifically, we take a group of native speakers (NS) of English (n=24) currently enrolled in Arabic classes at American universities, and evaluate the effectiveness of a high variability phonetic training program (HVPT) to improve their perception of a difficult…

Phonetic Training in the Foreign Language Curriculum

ERIC Educational Resources Information Center

Burnham, Kevin R.

2014-01-01

In this experiment we evaluate phonetic training as a tool for language learning. Specifically, we take a group of native speakers (NS) of English (n = 24) currently enrolled in Arabic classes at American universities, and evaluate the effectiveness of a high variability phonetic training program (HVPT) to improve their perception of a difficult…

A Bayesian approach to evaluating habitat for woodland caribou in north-central British Columbia.

Treesearch

R.S. McNay; B.G. Marcot; V. Brumovsky; R. Ellis

2006-01-01

Woodland caribou (Rangifer tarandus caribou) populations are in decline throughout much of their range. With increasing development of caribou habitat, tools are required to make management decisions to support effective conservation of caribou and their range. We developed a series of Bayesian belief networks to evaluate conservation policy...

Simulating forage crop production in a northern climate with the Integrated Farm System Model

USDA-ARS?s Scientific Manuscript database

Whole-farm simulation models are useful tools for evaluating the effect of management practices and climate variability on the agro-environmental and economic performance of farms. A few process-based farm-scale models have been developed, but none have been evaluated in a northern region with a sho...

Development of Usability Criteria for E-Learning Content Development Software

ERIC Educational Resources Information Center

Celik, Serkan

2012-01-01

Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step…

Mobile Formative Assessment Tool Based on Data Mining Techniques for Supporting Web-Based Learning

ERIC Educational Resources Information Center

Chen, Chih-Ming; Chen, Ming-Chuan

2009-01-01

Current trends clearly indicate that online learning has become an important learning mode. However, no effective assessment mechanism for learning performance yet exists for e-learning systems. Learning performance assessment aims to evaluate what learners learned during the learning process. Traditional summative evaluation only considers final…

Improving Reference Service: The Case for Using a Continuous Quality Improvement Method.

ERIC Educational Resources Information Center

Aluri, Rao

1993-01-01

Discusses the evaluation of library reference service; examines problems with past evaluations, including the lack of long-term planning and a systems perspective; and suggests a method for continuously monitoring and improving reference service using quality improvement tools such as checklists, cause and effect diagrams, Pareto charts, and…

A potential tool for clinicians; evaluating a computer-led dietary assessment method in overweight and obese women during weight loss

USDA-ARS?s Scientific Manuscript database

Background: Dietary assessment methods used in overweight/obese participants have been scrutinized for underreporting energy. Objective: Evaluate the effectiveness of a computer-administered, 24-hour recall method (ASA24) to measure energy and nutrient intake in overweight/obese women and to further...

Land cover changes in central Sonora Mexico

Treesearch

Diego Valdez-Zamudio; Alejandro Castellanos-Villegas; Stuart Marsh

2000-01-01

Remote sensing techniques have been demonstrated to be very effective tools to help detect, analyze, and evaluate land cover changes in natural areas of the world. Changes in land cover can generally be attributed to either natural or anthropogenic forces. Multitemporal satellite imagery and airborne videography were used to detect, analyze, and evaluate land cover...

More than a Conversation: Using Cogenerative Dialogues in the Professional Development of High School Chemistry Teachers

ERIC Educational Resources Information Center

Martin, Sonya N.; Scantlebury, Kathryn

2009-01-01

This paper focuses on content-based and pedagogical instructors' use of cogenerative dialogues to improve instructional practice and to evaluate program effectiveness in a professional development program for high school chemistry teachers. We share our research findings from using cogenerative dialogues as an evaluative tool for general…

Evaluating COCA--What Do Teachers Think?

ERIC Educational Resources Information Center

Major, Nigel

COCA, which consists of both authoring tools and a runtime shell, is a system intended to provide teachers with genuine access to intelligent tutoring system (ITS) technology and to give them control over domain material and teaching strategies. To evaluate the effectiveness of COCA, 10 subjects (five university teachers and five school teachers)…

Portfolio Based Faculty Development Conversations: A Model for Increasing Teaching Efficacy

ERIC Educational Resources Information Center

Crawford, Sabrina

2017-01-01

A shift in higher education towards increasing accountability for teaching effectiveness has institutions reevaluating how they utilize faculty evaluation tools. The purpose of this case study was to probe perceptions on the value of using teaching portfolios, supported by PLC conversations between faculty and deans, as an evaluation strategy that…

Cost effectiveness of pediatric pneumococcal conjugate vaccines: a comparative assessment of decision-making tools.

PubMed

Chaiyakunapruk, Nathorn; Somkrua, Ratchadaporn; Hutubessy, Raymond; Henao, Ana Maria; Hombach, Joachim; Melegaro, Alessia; Edmunds, John W; Beutels, Philippe

2011-05-12

Several decision support tools have been developed to aid policymaking regarding the adoption of pneumococcal conjugate vaccine (PCV) into national pediatric immunization programs. The lack of critical appraisal of these tools makes it difficult for decision makers to understand and choose between them. With the aim to guide policymakers on their optimal use, we compared publicly available decision-making tools in relation to their methods, influential parameters and results. The World Health Organization (WHO) requested access to several publicly available cost-effectiveness (CE) tools for PCV from both public and private provenance. All tools were critically assessed according to the WHO's guide for economic evaluations of immunization programs. Key attributes and characteristics were compared and a series of sensitivity analyses was performed to determine the main drivers of the results. The results were compared based on a standardized set of input parameters and assumptions. Three cost-effectiveness modeling tools were provided, including two cohort-based (Pan-American Health Organization (PAHO) ProVac Initiative TriVac, and PneumoADIP) and one population-based model (GlaxoSmithKline's SUPREMES). They all compared the introduction of PCV into national pediatric immunization program with no PCV use. The models were different in terms of model attributes, structure, and data requirement, but captured a similar range of diseases. Herd effects were estimated using different approaches in each model. The main driving parameters were vaccine efficacy against pneumococcal pneumonia, vaccine price, vaccine coverage, serotype coverage and disease burden. With a standardized set of input parameters developed for cohort modeling, TriVac and PneumoADIP produced similar incremental costs and health outcomes, and incremental cost-effectiveness ratios. Vaccine cost (dose price and number of doses), vaccine efficacy and epidemiology of critical endpoint (for example, incidence of pneumonia, distribution of serotypes causing pneumonia) were influential parameters in the models we compared. Understanding the differences and similarities of such CE tools through regular comparisons could render decision-making processes in different countries more efficient, as well as providing guiding information for further clinical and epidemiological research. A tool comparison exercise using standardized data sets can help model developers to be more transparent about their model structure and assumptions and provide analysts and decision makers with a more in-depth view behind the disease dynamics. Adherence to the WHO guide of economic evaluations of immunization programs may also facilitate this process. Please see related article: http://www.biomedcentral.com/1741-7007/9/55.

Program audit, A management tool

NASA Technical Reports Server (NTRS)

Miller, T. J.

1971-01-01

Program gives in-depth view of organizational performance at all levels of the management structure, and provides means by which managers can effectively and efficiently evaluate adequacy of management direction, policies, and procedures.

Development of a Subjective Evaluation Tool for Assessing Marksmanship Training Effectiveness

DTIC Science & Technology

2013-01-28

used to break down the marksmanship domain, as presented in the USMC Rifle Marksmanship Manual, into sub-tasks that were converted into training-task... Mangos for his expertise in survey development and, along with Dr. Joseph Chandler, for guidance on the analysis of a complicated data set; Mr. Clarke...alternative to lengthy and resource-demanding training effectiveness evaluations. A task analytic approach was used to break down the marksmanship domain, as

The Cost-Effective Evaluation of Syncope.

PubMed

Angus, Steven

2016-09-01

Syncope is a common clinical problem that carries a high socioeconomic burden. A structured approach in the evaluation of syncope with special emphasis on a detailed history, comprehensive physical examination that includes orthostatic vital signs, and an electrocardiogram, proves to be the most cost-effective approach. The need for additional testing and hospital admission should be based on the results of the initial evaluation and use of risk-stratification tools that help identify those syncope patients at highest risk for poor outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

Analysis and evaluation for consumer goods containing NORM in Korea.

PubMed

Jang, Mee; Chung, Kun Ho; Lim, Jong Myoung; Ji, Young Yong; Kim, Chang Jong; Kang, Mun Ja

2017-08-01

We analyzed the consumer goods containing NORM by ICP-MS and evaluated the external dose. To evaluate the external dose, we assumed the small room model as irradiation scenario and calculated the specific effective dose rate using MCNPX code. The external doses for twenty goods are less than 1 mSv considering the specific effective dose rates and usage quantities. However, some of them have relatively high dose and the activity concentration limits are necessary as a screening tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Pyrotechnic hazards classification and evaluation program test report. Heat flux study of deflagrating pyrotechnic munitions

NASA Technical Reports Server (NTRS)

Fassnacht, P. O.

1971-01-01

A heat flux study of deflagrating pyrotechnic munitions is presented. Three tests were authorized to investigate whether heat flux measurements may be used as effective hazards evaluation criteria to determine safe quantity distances for pyrotechnics. A passive sensor study was conducted simultaneously to investigate their usefulness in recording events and conditions. It was concluded that heat flux measurements can effectively be used to evaluate hazards criteria and that passive sensors are an inexpensive tool to record certain events in the vicinity of deflagrating pyrotechnic stacks.

Operation Reliability Assessment for Cutting Tools by Applying a Proportional Covariate Model to Condition Monitoring Information

PubMed Central

Cai, Gaigai; Chen, Xuefeng; Li, Bing; Chen, Baojia; He, Zhengjia

2012-01-01

The reliability of cutting tools is critical to machining precision and production efficiency. The conventional statistic-based reliability assessment method aims at providing a general and overall estimation of reliability for a large population of identical units under given and fixed conditions. However, it has limited effectiveness in depicting the operational characteristics of a cutting tool. To overcome this limitation, this paper proposes an approach to assess the operation reliability of cutting tools. A proportional covariate model is introduced to construct the relationship between operation reliability and condition monitoring information. The wavelet packet transform and an improved distance evaluation technique are used to extract sensitive features from vibration signals, and a covariate function is constructed based on the proportional covariate model. Ultimately, the failure rate function of the cutting tool being assessed is calculated using the baseline covariate function obtained from a small sample of historical data. Experimental results and a comparative study show that the proposed method is effective for assessing the operation reliability of cutting tools. PMID:23201980

Safety of Rural Nursing Home-to-Emergency Department Transfers: Improving Communication and Patient Information Sharing Across Settings.

PubMed

Tupper, Judith B; Gray, Carolyn E; Pearson, Karen B; Coburn, Andrew F

2015-01-01

The "siloed" approach to healthcare delivery contributes to communication challenges and to potential patient harm when patients transfer between settings. This article reports on the evaluation of a demonstration in 10 rural communities to improve the safety of nursing facility (NF) transfers to hospital emergency departments by forming interprofessional teams of hospital, emergency medical service, and NF staff to develop and implement tools and protocols for standardizing critical interfacility communication pathways and information sharing. We worked with each of the 10 teams to document current communication processes and information sharing tools and to design, implement, and evaluate strategies/tools to increase effective communication and sharing of patient information across settings. A mixed methods approach was used to evaluate changes from baseline in documentation of patient information shared across settings during the transfer process. Study findings showed significant improvement in key areas across the three settings, including infection status and baseline mental functioning. Improvement strategies and performance varied across settings; however, accurate and consistent information sharing of advance directives and medication lists remains a challenge. Study results demonstrate that with neutral facilitation and technical support, collaborative interfacility teams can assess and effectively address communication and information sharing problems that threaten patient safety.

Web tools for effective retrieval, visualization, and evaluation of cardiology medical images and records

NASA Astrophysics Data System (ADS)

Masseroli, Marco; Pinciroli, Francesco

2000-12-01

To provide easy retrieval, integration and evaluation of multimodal cardiology images and data in a web browser environment, distributed application technologies and java programming were used to implement a client-server architecture based on software agents. The server side manages secure connections and queries to heterogeneous remote databases and file systems containing patient personal and clinical data. The client side is a Java applet running in a web browser and providing a friendly medical user interface to perform queries on patient and medical test dat and integrate and visualize properly the various query results. A set of tools based on Java Advanced Imaging API enables to process and analyze the retrieved cardiology images, and quantify their features in different regions of interest. The platform-independence Java technology makes the developed prototype easy to be managed in a centralized form and provided in each site where an intranet or internet connection can be located. Giving the healthcare providers effective tools for querying, visualizing and evaluating comprehensively cardiology medical images and records in all locations where they can need them- i.e. emergency, operating theaters, ward, or even outpatient clinics- the developed prototype represents an important aid in providing more efficient diagnoses and medical treatments.

Universal versus tailored solutions for alleviating disruptive behavior in hospitals.

PubMed

Berman-Kishony, Talia; Shvarts, Shifra

2015-01-01

Disruptive behavior among hospital staff can negatively affect quality of care. Motivated by a standard on disruptive behavior issued by The Joint Commission (LD 3.10), as well as the desire to improve patient care, minimize liability, and improve staff retention, hospitals are setting policies to prevent and resolve disruptive behaviors. However, it is unknown whether uniform conflict management tools are equally effective among different hospital settings. We surveyed residents and nurses to identify similarities and differences among hospital departments in the antecedents, characteristics, and outcomes of disruptive behaviors, and in the effectiveness of conflict management tools. We used a quantitative questionnaire-based assessment to examine conflict perceptions in eight different hospital departments at Rambam Medical Center in Haifa, Israel. Most participants (89 %) reported witnessing disruptive behavior either directly or in other parties; the most significant causes were identified as intense work, miscommunication, and problematic personalities. The forms of these behaviors, however, varied significantly between departments, with some more prone to expressed conflicts, while others were characterized by hidden disruptive behaviors. These outcomes were correlated by the antecedents to disruptive behavior, which in turn affected the effectiveness of alleviating strategies and tools. Some tools, such as processes for evaluating complaints, teamwork and conflict management courses, and introducing a behavioral mission statement, are effective across many antecedents. Other tools, however, are antecedent-specific, falling into two principal categories: tools directly removing a specific problem and tools that offer a way to circumvent the problem. Conflict resolution tools and strategies, based on residents and nurse perceptions, may be more effective if tailored to the specific situation, rather than using a "one-size-fits-all" approach.

The development of an observational screening tool to assess safe, effective and appropriate walking aid use in people with multiple sclerosis.

PubMed

Eitzen, Abby; Finlayson, Marcia; Carolan-Laing, Leanne; Nacionales, Arthur Junn; Walker, Christie; O'Connor, Josephine; Asano, Miho; Coote, Susan

2017-08-01

The purpose of this study was to identify potential items for an observational screening tool to assess safe, effective and appropriate walking aid use among people with multiple sclerosis (MS). Such a tool is needed because of the association between fall risk and mobility aid use in this population. Four individuals with MS were videotaped using a one or two straight canes, crutches or a rollator in different settings. Seventeen health care professionals from Canada, Ireland and the United States were recruited, and viewed the videos, and were then interviewed about the use of the devices by the individuals in the videos. Interview questions addressed safety, effectiveness and appropriateness of the device in the setting. Data were analyzed qualitatively. Coding consistency across raters was evaluated and confirmed. Nineteen codes were identified as possible items for the screening tool. The most frequent issues raised regardless of setting and device were "device used for duration/abandoned", "appropriate device", "balance and stability", "device technique", "environmental modification" and "hands free." With the identification of a number of potential tool items, researchers can now move forward with the development of the tool. This will involve consultation with both healthcare professionals and people with MS. Implications for rehabilitation Falls among people with multiple sclerosis are associated with mobility device use and use of multiple devices is associated with greater falls risk. The ability to assess for safe, effective and efficient use of walking aids is therefore important, no tools currently exist for this purpose. The codes arising from this study will be used to develop a screening tool for safe, effective and efficient walking aid use with the aim of reducing falls risk.

Acceptability and potential effectiveness of commercial portion control tools amongst people with obesity.

PubMed

Almiron-Roig, Eva; Domínguez, Angélica; Vaughan, David; Solis-Trapala, Ivonne; Jebb, Susan A

2016-12-01

Exposure to large portion sizes is a risk factor for obesity. Specifically designed tableware may modulate how much is eaten and help with portion control. We examined the experience of using a guided crockery set (CS) and a calibrated serving spoon set (SS) by individuals trying to manage their weight. Twenty-nine obese adults who had completed 7-12 weeks of a community weight-loss programme were invited to use both tools for 2 weeks each, in a crossover design, with minimal health professional contact. A paper-based questionnaire was used to collect data on acceptance, perceived changes in portion size, frequency, and type of meal when the tool was used. Scores describing acceptance, ease of use and perceived effectiveness were derived from five-point Likert scales from which binary indicators (high/low) were analysed using logistic regression. Mean acceptance, ease of use and perceived effectiveness were moderate to high (3·7-4·4 points). Tool type did not have an impact on indicators of acceptance, ease of use and perceived effectiveness (P>0·32 for all comparisons); 55 % of participants used the CS on most days v. 21 % for the SS. The CS was used for all meals, whereas the SS was mostly used for evening meals. Self-selected portion sizes increased for vegetables and decreased for chips and potatoes with both tools. Participants rated both tools as equally acceptable, easy to use and with similar perceived effectiveness. Formal trials to evaluate the impact of such tools on weight control are warranted.

Design, construction, and technical implementation of a web-based interdisciplinary symptom evaluation (WISE) - a heuristic proposal for orofacial pain and temporomandibular disorders.

PubMed

Ettlin, Dominik A; Sommer, Isabelle; Brönnimann, Ben; Maffioletti, Sergio; Scheidt, Jörg; Hou, Mei-Yin; Lukic, Nenad; Steiger, Beat

2016-12-01

Medical symptoms independent of body location burden individuals to varying degrees and may require care by more than one expert. Various paper and computer-based tools exist that aim to comprehensively capture data for optimal clinical management and research. A web-based interdisciplinary symptom evaluation (WISE) was newly designed, constructed, and technically implemented. For worldwide applicability and to avoid copyright infringements, open source software tools and free validated questionnaires available in multiple languages were used. Highly secure data storage limits access strictly to those who use the tool for collecting, storing, and evaluating their data. Concept and implementation is illustrated by a WISE sample tailored for the requirements of a single center in Switzerland providing interdisciplinary care to orofacial pain and temporomandibular disorder patients. By combining a symptom- burden checklist with in-depth questionnaires serving as case-finding instruments, an algorithm was developed that assists in clarifying case complexity and need for targeted expert evaluation. This novel modular approach provides a personalized, response-tailored instrument for the time- and cost-effective collection of symptom-burden focused quantitative data. The tool includes body drawing options and instructional videos. It is applicable for biopsychosocial evaluation in a variety of clinical settings and offers direct feedback by a case report summary. In clinical practice, the new instrument assists in clarifying case complexity and referral need, based on symptom burden and response -tailored case finding. It provides single-case summary reports from a biopsychosocial perspective and includes graphical symptom maps. Secure, centrally stored data collection of anonymous data is possible. The tool enables personalized medicine, facilitates interprofessional education and collaboration, and allows for multicenter patient-reported outcomes research.

Evaluation of Phosphorus Site Assessment Tools: Lessons from the USA.

PubMed

Sharpley, Andrew; Kleinman, Peter; Baffaut, Claire; Beegle, Doug; Bolster, Carl; Collick, Amy; Easton, Zachary; Lory, John; Nelson, Nathan; Osmond, Deanna; Radcliffe, David; Veith, Tamie; Weld, Jennifer

2017-11-01

Critical source area identification through phosphorus (P) site assessment is a fundamental part of modern nutrient management planning in the United States, yet there has been only sparse testing of the many versions of the P Index that now exist. Each P site assessment tool was developed to be applicable across a range of field conditions found in a given geographic area, making evaluation extremely difficult. In general, evaluation with in-field monitoring data has been limited, focusing primarily on corroborating manure and fertilizer "source" factors. Thus, a multiregional effort (Chesapeake Bay, Heartland, and Southern States) was undertaken to evaluate P Indices using a combination of limited field data, as well as output from simulation models (i.e., Agricultural Policy Environmental eXtender, Annual P Loss Estimator, Soil and Water Assessment Tool [SWAT], and Texas Best Management Practice Evaluation Tool [TBET]) to compare against P Index ratings. These comparisons show promise for advancing the weighting and formulation of qualitative P Index components but require careful vetting of the simulation models. Differences among regional conclusions highlight model strengths and weaknesses. For example, the Southern States region found that, although models could simulate the effects of nutrient management on P runoff, they often more accurately predicted hydrology than total P loads. Furthermore, SWAT and TBET overpredicted particulate P and underpredicted dissolved P, resulting in correct total P predictions but for the wrong reasons. Experience in the United States supports expanded regional approaches to P site assessment, assuming closely coordinated efforts that engage science, policy, and implementation communities, but limited scientific validity exists for uniform national P site assessment tools at the present time. Copyright © by the American Society of Agronomy, Crop Science Society of America, and Soil Science Society of America, Inc.

Market value: an underused financial planning tool.

PubMed

Harris, J P; Schimmel, V E

1987-04-01

Two issues facing CFOs are capital formation and the long-range financial impact of strategic planning decisions. For not-for-profit organizations, debt capacity is the main determining factor of capital formation while investment analysis is the key to the financial evaluation of strategic planning options. And, the market, or sale, value of the organization can serve as an effective tool to manage current debt capacity and future investment decisions.

Implementing a Quantitative Analysis Design Tool for Future Generation Interfaces

DTIC Science & Technology

2012-03-01

with Remotely Piloted Aircraft (RPA) has resulted in the need of a platform to evaluate interface design. The Vigilant Spirit Control Station ( VSCS ...Spirit interface. A modified version of the HCI Index was successfully applied to perform a quantitative analysis of the baseline VSCS interface and...time of the original VSCS interface. These results revealed the effectiveness of the tool and demonstrated in the design of future generation

Demystifying Results-Based Performance Measurement.

ERIC Educational Resources Information Center

Jorjani, Hamid

Many evaluators are convinced that Results-based Performance Measurement (RBPM) is an effective tool to improve service delivery and cost effectiveness in both public and private sectors. Successful RBPM requires self-directed and cross-functional work teams and the supporting infrastructure to make it work. There are many misconceptions and…

Designing Effective Curricula with an Interactive Collaborative Curriculum Design Tool (CCDT)

ERIC Educational Resources Information Center

Khadimally, Seda

2015-01-01

Guided by the principles of the Analysis, Design, Development, Implementation, and Evaluation (ADDIE) instructional design (ID) model, this creative instructional product presents a learning/teaching approach that is fundamentally constructivist. For the purposes of designing effective instruction in an academic preparation course, a…

Capturing the Dimensions of Effective Teaching

ERIC Educational Resources Information Center

Kane, Thomas J.

2012-01-01

In the largest study of instructional practice ever undertaken, the Bill & Melinda Gates Foundation's Measures of Effective Teaching (MET) project is searching for tools to save the world from perfunctory teacher evaluations. The first report (released in December 2010) described the potential usefulness of student surveys for providing…

Factors affecting nursing staff use of a communication tool to reduce potentially preventable acute care transfers in long-term care.

PubMed

Ballard, Stephanie A; Peretti, Matteo; Lungu, Ovidiu; Voyer, Philippe; Tabamo, Fruan; Alfonso, Linda; Cetin-Sahin, Deniz; Johnson, Sarasa M A; Wilchesky, Machelle

Although specialized communication tools can effectively reduce acute care transfers, few studies have assessed the factors that may influence the use of such tools by nursing staff at the individual level. We evaluated the associations between years of experience, tool-related training, nursing attitudes, and intensity of use of a communication tool developed to reduce transfers in a long-term care facility. We employed a mixed methods design using data from medical charts, electronic records, and semi-structured interviews. Experienced nurses used the tool significantly less than inexperienced nurses, and training had a significant positive impact on tool use. Nurses found the purpose of the tool to be confusing. No significant differences in attitude were observed based on years of experience or intensity of use. Project findings indicate that focused efforts to enrich training may increase intervention adherence. Experienced nurses in particular should be made aware of the benefits of utilizing communication tools. Copyright © 2017 Elsevier Inc. All rights reserved.

THE ATMOSPHERIC MODEL EVALUATION TOOL (AMET); AIR QUALITY MODULE

EPA Science Inventory

This presentation reviews the development of the Atmospheric Model Evaluation Tool (AMET) air quality module. The AMET tool is being developed to aid in the model evaluation. This presentation focuses on the air quality evaluation portion of AMET. Presented are examples of the...

Development of a StandAlone Surgical Haptic Arm.

PubMed

Jones, Daniel; Lewis, Andrew; Fischer, Gregory S

2011-01-01

When performing telesurgery with current commercially available Minimally Invasive Robotic Surgery (MIRS) systems, a surgeon cannot feel the tool interactions that are inherent in traditional laparoscopy. It is proposed that haptic feedback in the control of MIRS systems could improve the speed, safety and learning curve of robotic surgery. To test this hypothesis, a standalone surgical haptic arm (SASHA) capable of manipulating da Vinci tools has been designed and fabricated with the additional ability of providing information for haptic feedback. This arm was developed as a research platform for developing and evaluating approaches to telesurgery, including various haptic mappings between master and slave and evaluating the effects of latency.

International funding agencies: potential leaders of impact evaluation in protected areas?

PubMed

Craigie, Ian D; Barnes, Megan D; Geldmann, Jonas; Woodley, Stephen

2015-11-05

Globally, protected areas are the most commonly used tools to halt biodiversity loss. Yet, some are failing to adequately conserve the biodiversity they contain. There is an urgent need for knowledge on how to make them function more effectively. Impact evaluation methods provide a set of tools that could yield this knowledge. However, rigorous outcome-focused impact evaluation is not yet used as extensively as it could be in protected area management. We examine the role of international protected area funding agencies in facilitating the use of impact evaluation. These agencies are influential stakeholders as they allocate hundreds of millions of dollars annually to support protected areas, creating a unique opportunity to shape how the conservation funds are spent globally. We identify key barriers to the use of impact evaluation, detail how large funders are uniquely placed to overcome many of these, and highlight the potential benefits if impact evaluation is used more extensively. © 2015 The Author(s).

Performance evaluation of inpatient service in Beijing: a horizontal comparison with risk adjustment based on Diagnosis Related Groups.

PubMed

Jian, Weiyan; Huang, Yinmin; Hu, Mu; Zhang, Xiumei

2009-04-30

The medical performance evaluation, which provides a basis for rational decision-making, is an important part of medical service research. Current progress with health services reform in China is far from satisfactory, without sufficient regulation. To achieve better progress, an effective tool for evaluating medical performance needs to be established. In view of this, this study attempted to develop such a tool appropriate for the Chinese context. Data was collected from the front pages of medical records (FPMR) of all large general public hospitals (21 hospitals) in the third and fourth quarter of 2007. Locally developed Diagnosis Related Groups (DRGs) were introduced as a tool for risk adjustment and performance evaluation indicators were established: Charge Efficiency Index (CEI), Time Efficiency Index (TEI) and inpatient mortality of low-risk group cases (IMLRG), to reflect respectively work efficiency and medical service quality. Using these indicators, the inpatient services' performance was horizontally compared among hospitals. Case-mix Index (CMI) was used to adjust efficiency indices and then produce adjusted CEI (aCEI) and adjusted TEI (aTEI). Poisson distribution analysis was used to test the statistical significance of the IMLRG differences between different hospitals. Using the aCEI, aTEI and IMLRG scores for the 21 hospitals, Hospital A and C had relatively good overall performance because their medical charges were lower, LOS shorter and IMLRG smaller. The performance of Hospital P and Q was the worst due to their relatively high charge level, long LOS and high IMLRG. Various performance problems also existed in the other hospitals. It is possible to develop an accurate and easy to run performance evaluation system using Case-Mix as the tool for risk adjustment, choosing indicators close to consumers and managers, and utilizing routine report forms as the basic information source. To keep such a system running effectively, it is necessary to improve the reliability of clinical information and the risk-adjustment ability of Case-Mix.

The effectiveness of celebrities in conservation marketing.

PubMed

Duthie, Elizabeth; Veríssimo, Diogo; Keane, Aidan; Knight, Andrew T

2017-01-01

Celebrities are frequently used in conservation marketing as a tool to raise awareness, generate funding and effect behaviour change. The importance of evaluating effectiveness is widely recognised in both marketing and conservation but, to date, little research into the effectiveness of celebrity endorsement as a tool for conservation marketing has been published. Using a combination of interviews and an online choice survey instrument, we investigated the extent to which a sample of UK-based conservation organisations, and other charities, evaluate their own usage of celebrity endorsement, and then carried out an experimental evaluation of a hypothetical marketing campaign. This experiment compared participants' willingness-to-engage (WTE) with, and recall of, a conservation message presented in versions of an advert featuring one of three prominent UK celebrities (David Beckham, Chris Packham or HRH Prince William) or a non-celebrity control treatment (featuring Crawford Allan, a director of TRAFFIC USA). We find that the organisations we interviewed did not routinely evaluate their marketing campaigns featuring celebrities. Furthermore, our experiment provides evidence that celebrity endorsement can produce both positive and negative effects. Participants were more willing to engage when presented with an advert featuring one of the three celebrities than the non-celebrity control, and WTE varied according to the characteristics of the celebrity and the respondent. However, celebrities were less effective at generating campaign message recall than non-celebrities. These findings suggest that celebrity endorsement should be used carefully. Further work is required to fully understand the role celebrity endorsers can play in conservation but, drawing on best practice from the field of marketing, this study introduces an approach to evaluation which could be applied more widely to improve the effectiveness of conservation marketing.

The effectiveness of celebrities in conservation marketing

PubMed Central

Veríssimo, Diogo; Keane, Aidan; Knight, Andrew T.

2017-01-01

Celebrities are frequently used in conservation marketing as a tool to raise awareness, generate funding and effect behaviour change. The importance of evaluating effectiveness is widely recognised in both marketing and conservation but, to date, little research into the effectiveness of celebrity endorsement as a tool for conservation marketing has been published. Using a combination of interviews and an online choice survey instrument, we investigated the extent to which a sample of UK-based conservation organisations, and other charities, evaluate their own usage of celebrity endorsement, and then carried out an experimental evaluation of a hypothetical marketing campaign. This experiment compared participants' willingness-to-engage (WTE) with, and recall of, a conservation message presented in versions of an advert featuring one of three prominent UK celebrities (David Beckham, Chris Packham or HRH Prince William) or a non-celebrity control treatment (featuring Crawford Allan, a director of TRAFFIC USA). We find that the organisations we interviewed did not routinely evaluate their marketing campaigns featuring celebrities. Furthermore, our experiment provides evidence that celebrity endorsement can produce both positive and negative effects. Participants were more willing to engage when presented with an advert featuring one of the three celebrities than the non-celebrity control, and WTE varied according to the characteristics of the celebrity and the respondent. However, celebrities were less effective at generating campaign message recall than non-celebrities. These findings suggest that celebrity endorsement should be used carefully. Further work is required to fully understand the role celebrity endorsers can play in conservation but, drawing on best practice from the field of marketing, this study introduces an approach to evaluation which could be applied more widely to improve the effectiveness of conservation marketing. PMID:28686595

Pilot evaluation of a continuing professional development tool for developing leadership skills.

PubMed

Patterson, Brandon J; Chang, Elizabeth H; Witry, Matthew J; Garza, Oscar W; Trewet, CoraLynn B

2013-01-01

Strategies are needed to assure essential nonclinical competencies, such as leadership, can be gained using a continuing professional development (CPD) framework. The objective of this study was to explore student pharmacists' utilization and perceived effectiveness of a CPD tool for leadership development in an elective course. Students completed 2 CPD cycles during a semester-long leadership elective using a CPD tool. A questionnaire was used to measure students' perceptions of utility, self-efficacy, and satisfaction in completing CPD cycles when using a tool to aid in this process. The CPD tool was completed twice by 7 students. On average, students spent nearly 5 hours per CPD cycle. More than half (57.1%) scored themselves as successful or very successful in achieving their learning plans, and most (71.4%) found the tool somewhat useful in developing their leadership skills. Some perceived that the tool provided a systematic way to engage in leadership development, whereas others found it difficult to use. In this pilot study, most student pharmacists successfully achieved a leadership development plan and found the CPD tool useful. Providing students with more guidance may help facilitate use and effectiveness of CPD tools. There is a need to continue to develop and refine tools that assist in the CPD of pharmacy practitioners at all levels. Copyright © 2013 Elsevier Inc. All rights reserved.

Evaluation of the Families SHARE workbook: an educational tool outlining disease risk and healthy guidelines to reduce risk of heart disease, diabetes, breast cancer and colorectal cancer.

PubMed

Koehly, Laura M; Morris, Bronwyn A; Skapinsky, Kaley; Goergen, Andrea; Ludden, Amanda

2015-11-13

Common diseases such as heart disease, diabetes, and cancer are etiologically complex with multiple risk factors (e.g., environment, genetic, lifestyle). These risk factors tend to cluster in families, making families an important social context for intervention and lifestyle-focused disease prevention. The Families Sharing Health Assessment and Risk Evaluation (SHARE) workbook was designed as an educational tool outlining family health history based risk of heart disease, type 2 diabetes, breast cancer, and colorectal cancer. The current paper describes the steps taken to develop and evaluate the workbook employing a user-centered design approach. The workbook was developed in four steps, culminating in an evaluation focusing on understanding and usability of the tool. The evaluation was based on two Phases of data collected from a sample of mothers of young children in the Washington, D.C., area. A baseline assessment and follow-up approximately two weeks after receipt of the workbook were conducted, as well as focus groups with participants. The design of the workbook was refined in response to participant feedback from the first evaluation Phase and subsequently re-evaluated with a new sample. After incorporating user-based feedback and revising the workbook, Phase 2 evaluation results indicated that understanding of the workbook components improved for all sections (from 6.26 to 6.81 on a 7-point scale). In addition, 100% of users were able to use the algorithm to assess their disease risk and over 60% used the algorithm to assess family members' disease risk. At follow-up, confidence to increase fruit, vegetable and fiber intake improved significantly, as well. The Families SHARE workbook was developed and evaluated resulting in a family health history tool that is both understandable and usable by key stakeholders. This educational tool will be used in intervention studies assessing the effectiveness of family genomics health educators who use the Families SHARE workbook to disseminate family risk information and encourage risk reducing behaviors. ClinicalTrials.gov, NCT01498276 . Registered 21 December 2011.

Information quality-control model

NASA Technical Reports Server (NTRS)

Vincent, D. A.

1971-01-01

Model serves as graphic tool for estimating complete product objectives from limited input information, and is applied to cost estimations, product-quality evaluations, and effectiveness measurements for manpower resources allocation. Six product quality levels are defined.

Effect of Weld Tool Geometry on Friction Stir Welded AA2219-T87 Properties

NASA Technical Reports Server (NTRS)

Querin, Joseph A.; Schneider, Judy A.

2008-01-01

In this study, flat panels of AA2219-T87 were friction stir welded (FSWed) using weld tools with tapered pins The three pin geometries of the weld tools included: 0 (straight cylinder), 30 , and 60 angles on the frustum. For each weld tool geometry, the FSW process parameters were optimized to eliminate defects. A constant heat input was maintained while varying the process parameters of spindle rpm and travel speed. This provided a constant heat input for each FSW weld panel while altering the hot working conditions imparted to the workpiece. The resulting mechanical properties were evaluated from tensile test results of the FSW joint.

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Data Visualization Saliency Model: A Tool for Evaluating Abstract Data Visualizations

DOE PAGES

Matzen, Laura E.; Haass, Michael J.; Divis, Kristin M.; ...

2017-08-29

Evaluating the effectiveness of data visualizations is a challenging undertaking and often relies on one-off studies that test a visualization in the context of one specific task. Researchers across the fields of data science, visualization, and human-computer interaction are calling for foundational tools and principles that could be applied to assessing the effectiveness of data visualizations in a more rapid and generalizable manner. One possibility for such a tool is a model of visual saliency for data visualizations. Visual saliency models are typically based on the properties of the human visual cortex and predict which areas of a scene havemore » visual features (e.g. color, luminance, edges) that are likely to draw a viewer's attention. While these models can accurately predict where viewers will look in a natural scene, they typically do not perform well for abstract data visualizations. In this paper, we discuss the reasons for the poor performance of existing saliency models when applied to data visualizations. We introduce the Data Visualization Saliency (DVS) model, a saliency model tailored to address some of these weaknesses, and we test the performance of the DVS model and existing saliency models by comparing the saliency maps produced by the models to eye tracking data obtained from human viewers. In conclusion, we describe how modified saliency models could be used as general tools for assessing the effectiveness of visualizations, including the strengths and weaknesses of this approach.« less

Data Visualization Saliency Model: A Tool for Evaluating Abstract Data Visualizations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Matzen, Laura E.; Haass, Michael J.; Divis, Kristin M.

Evaluating the effectiveness of data visualizations is a challenging undertaking and often relies on one-off studies that test a visualization in the context of one specific task. Researchers across the fields of data science, visualization, and human-computer interaction are calling for foundational tools and principles that could be applied to assessing the effectiveness of data visualizations in a more rapid and generalizable manner. One possibility for such a tool is a model of visual saliency for data visualizations. Visual saliency models are typically based on the properties of the human visual cortex and predict which areas of a scene havemore » visual features (e.g. color, luminance, edges) that are likely to draw a viewer's attention. While these models can accurately predict where viewers will look in a natural scene, they typically do not perform well for abstract data visualizations. In this paper, we discuss the reasons for the poor performance of existing saliency models when applied to data visualizations. We introduce the Data Visualization Saliency (DVS) model, a saliency model tailored to address some of these weaknesses, and we test the performance of the DVS model and existing saliency models by comparing the saliency maps produced by the models to eye tracking data obtained from human viewers. In conclusion, we describe how modified saliency models could be used as general tools for assessing the effectiveness of visualizations, including the strengths and weaknesses of this approach.« less

The evolution of clinical audit as a tool for quality improvement.

PubMed

Berk, Michael; Callaly, Thomas; Hyland, Mary

2003-05-01

Clinical auditing practices are recognized universally as a useful tool in evaluating and improving the quality of care provided by a health service. External auditing is a regular activity for mental health services in Australia but internal auditing activities are conducted at the discretion of each service. This paper evaluates the effectiveness of 6 years of internal auditing activities in a mental health service. A review of the scope, audit tools, purpose, sampling and design of the internal audits and identification of the recommendations from six consecutive annual audit reports was completed. Audit recommendations were examined, as well as levels of implementation and reasons for success or failure. Fifty-seven recommendations were identified, with 35% without action, 28% implemented and 33.3% still pending or in progress. The recommendations were more likely to be implemented if they relied on activity, planning and action across a selection of service areas rather than being restricted to individual departments within a service, if they did not involve non-mental health service departments and if they were not reliant on attitudinal change. Tools used, scope and reporting formats have become more sophisticated as part of the evolutionary nature of the auditing process. Internal auditing in the Barwon Health Mental Health Service has been effective in producing change in the quality of care across the organization. A number of evolutionary changes in the audit process have improved the efficiency and effectiveness of the audit.

Oral Treatment of Rodents with Insecticides for Control of Sand Flies (Diptera: Psychodidae) and the Fluorescent Tracer Technique (FTT) as a Tool to Evaluate Potential Sand Fly Control Methods

DTIC Science & Technology

2011-03-01

chitin synthesis inhibitors diflubenzuron and novaluron evaluated in these studies were...effective against sand fly larvae and palatable to hamsters. In contrast to the chitin synthesis inhibitors and juvenile hormone analogs...concentrations (mg/kg) Effects Chitin synthesis inhibitor Diflubenzuron 8.97, 89.7, 897 Mortality at larva-to-pupa molt Novaluron 9.88, 98.8,

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

An Innovative School-Based Intervention to Promote Healthy Lifestyles

ERIC Educational Resources Information Center

Piana, Natalia; Ranucci, Claudia; Buratta, Livia; Foglia, Elena; Fabi, Marta; Novelli, Francesca; Casucci, Simone; Reginato, Elisa; Pippi, Roberto; Aiello, Cristina; Leonardi, Alessia; Romani, Giannermete; De Feo, Pierpaolo; Mazzeschi, Claudia

2017-01-01

Objective: To describe an innovative school-based intervention to promote healthy lifestyles. To evaluate its effects on children's food habits and to highlight the key components which contribute most to the beneficial effects obtained from children's, teachers' and parents' perspectives. Design: An educational tool to improve personal awareness,…

Effectiveness of an Online Simulation for Teacher Education

ERIC Educational Resources Information Center

Badiee, Farnaz; Kaufman, David

2014-01-01

This study evaluated the effectiveness of the "simSchool" (v.1) simulation as a tool for preparing student teachers for actual classroom teaching. Twenty-two student teachers used the simulation for a practice session and two test sessions; data included objective performance statistics generated by the simulation program, self-rated…

Causal Mediation Analysis: Warning! Assumptions Ahead

ERIC Educational Resources Information Center

Keele, Luke

2015-01-01

In policy evaluations, interest may focus on why a particular treatment works. One tool for understanding why treatments work is causal mediation analysis. In this essay, I focus on the assumptions needed to estimate mediation effects. I show that there is no "gold standard" method for the identification of causal mediation effects. In…

Plant community dynamics in the shortgrass steppe 24 years after reversal of a grazing exclosure experiment

USDA-ARS?s Scientific Manuscript database

State and Transition Models are important decision-support tools for rangeland managers that suggest directional effects of both long-term grazing imposition and relaxation on plant community composition. However, most studies of the effects of grazing on semiarid rangelands evaluate only one direct...

Validity of Eye Movement Methods and Indices for Capturing Semantic (Associative) Priming Effects

ERIC Educational Resources Information Center

Odekar, Anshula; Hallowell, Brooke; Kruse, Hans; Moates, Danny; Lee, Chao-Yang

2009-01-01

Purpose: The purpose of this investigation was to evaluate the usefulness of eye movement methods and indices as a tool for studying priming effects by verifying whether eye movement indices capture semantic (associative) priming effects in a visual cross-format (written word to semantically related picture) priming paradigm. Method: In the…

A Few Observations and Remarks on Time Effectiveness of Interactive Electronic Testing

ERIC Educational Resources Information Center

Magdin, Martin; Turcáni, Milan

2015-01-01

In the paper, we point out several observations and remarks on time effectiveness of electronic testing, in particular of its new form (interactive tests). A test is often used as an effective didactic tool for evaluating the extent of gained cognitive capabilities. According to authors Rudman (1989) and Wang (2003) it is provable that the…

Can't Get No (Dis)satisfaction: The "Statecraft" Simulation's Effect on Student Decision Making

ERIC Educational Resources Information Center

Raymond, Chad

2014-01-01

Simulations are often employed as content-teaching tools in political science, but their effect on students' reasoning skills is rarely assessed. This article explores what effect the "Statecraft" simulation might have on undergraduate students' perceptions of their decision making. Decisions are often evaluated on the basis of…

Effectiveness of Student-Generated Video as a Teaching Tool for an Instrumental Technique in the Organic Chemistry Laboratory

ERIC Educational Resources Information Center

Jordan, Jeremy T.; Box, Melinda C.; Eguren, Kristen E.; Parker, Thomas A.; Saraldi-Gallardo, Victoria M.; Wolfe, Michael I.; Gallardo-Williams, Maria T.

2016-01-01

Multimedia instruction has been shown to serve as an effective learning aid for chemistry students. In this study, the viability of student-generated video instruction for organic chemistry laboratory techniques and procedure was examined and its effectiveness compared to instruction provided by a teaching assistant (TA) was evaluated. After…

A flexible tool for hydraulic and water quality performance analysis of green infrastructure

NASA Astrophysics Data System (ADS)

Massoudieh, A.; Alikhani, J.

2017-12-01

Models that allow for design considerations of green infrastructure (GI) practices to control stormwater runoff and associated contaminants have received considerable attention in recent years. To be used to evaluate the effect design configurations on the long-term performance of GIs, models should be able to consider processes within GIs with good fidelity. In this presentation, a sophisticated, yet flexible tool for hydraulic and water quality assessment of GIs will be introduced. The tool can be used by design engineers and researchers to capture and explore the effect of design factors and properties of the media employed in the performance of GI systems at a relatively small scale. We deemed it essential to have a flexible GI modeling tool that is capable of simulating GI system components and specific biogeochemical processes affecting contaminants such as evapotranspiration, plant uptake, reactions, and particle-associated transport accurately while maintaining a high degree of flexibility to account for the myriad of GI alternatives. The mathematical framework for a stand-alone GI performance assessment tool has been developed and will be demonstrated. The process-based model framework developed here can be used to model a diverse range of GI practices such as stormwater ponds, green roofs, retention ponds, bioretention systems, infiltration trench, permeable pavement and other custom-designed combinatory systems. An example of the application of the system to evaluate the performance of a rain-garden system will be demonstrated.

Building an Evaluation Framework of Environmental Interpretation for Chinese Geoparks--Case Study of Yuntaishan World Geopark

ERIC Educational Resources Information Center

Wei, Dongying

2009-01-01

Environmental interpretation is a key tool for integrated management of tourism, with potential for greater use in managing visitor numbers, behavior and impacts, and enhancing experience. Evaluation is necessary to determine whether interpretation is achieving its goals. It is vital for park managers to know if their management is effective in…

A Comparative Study of Competency-Based Courses Demonstrating a Potential Measure of Course Quality and Student Success

ERIC Educational Resources Information Center

Krause, Jackie; Dias, Laura Portolese; Schedler, Chris

2015-01-01

While competency-based education is growing, standardized tools for evaluating the unique characteristics of course design in this domain are still under development. This preliminary research study evaluated the effectiveness of a rubric developed for assessing course design of competency-based courses in an undergraduate Information Technology…

An Evaluation Protocol for Selection of Educational Technologies for Students with Developmental Disabilities: A Demonstration Study Using iPad Apps

ERIC Educational Resources Information Center

Arthanat, Sajay; Curtin, Christine; Kontak, David

2015-01-01

Mainstream technologies are widely being employed in inclusive and special education classrooms to accommodate the learning needs of students. As the evidence of their effectiveness evolves, educators and school-based therapists need tools and documentable strategies for their implementation. This research presents an evaluation protocol to guide…

Teachers' Perceptions of and Responses to Student Evaluation of Teaching: Purposes and Uses in Clinical Education

ERIC Educational Resources Information Center

Wong, Wai Yee; Moni, Karen

2014-01-01

Student evaluation of teaching (SET) only becomes an effective tool for improving teaching and learning when the relevant stakeholders seriously consider and plan appropriate actions according to student feedback. It is common practice in medical education to provide clinical teachers with student feedback. However, there is limited evidence about…

An Alternative Evaluation: Online Puzzle as a Course-End Activity

ERIC Educational Resources Information Center

Genç, Zülfü; Aydemir, Emrah

2015-01-01

Purpose: The purpose of this study is to determine whether the use of online puzzles in the instructional process has an effect on student achievement and learning retention. This study examined students ' perception and experiences on use of puzzle as an alternative evaluation tool. To achieve this aim, the following hypotheses were tested: using…

Evaluating the Interactive Learning Tool Simreal+ for Visualizing and Simulating Mathematical Concepts

ERIC Educational Resources Information Center

Hadjerrouit, Said

2015-01-01

This research study aims at evaluating the suitability of SimReal+ for effective use in teacher education. SimReal+ was originally developed to teach mathematics in universities, but it is has been recently improved to include school mathematics. The basic idea of SimReal+ is that the visualization of mathematical concepts is a powerful technique…

Student Views about a Flipped Physics Course: A Tool for Program Evaluation and Improvement

ERIC Educational Resources Information Center

Ramlo, Susan

2015-01-01

Flipped classrooms are a relatively new teaching strategy where the typical lecture and homework elements of a course are reversed. Although flipped classrooms are gaining popularity, evaluations of this type of pedagogical model are limited. The purpose of this study was to investigate student views related to the effectiveness of a flipped…

Evaluation of Computerised Reading-Assistance Systems for Reading Japanese Texts--From a Linguistic Point of View

ERIC Educational Resources Information Center

Toyoda, Etsuko

2016-01-01

For second-language learners to effectively and efficiently gather information from online texts in their target language, a well-designed computerised system to assist their reading is essential. While many articles and websites which introduce electronic second-language learning tools exist, evaluation of their functions in relation to the…

Re-Mediating Practitioners' Practice for Equity in Higher Education: Evaluating the Effectiveness of Action Research

ERIC Educational Resources Information Center

Vines, Erin

2012-01-01

This study examines the influence of action research on California community college practitioners' attitudes, beliefs, and behavior using the Center for Urban Education's (CUE) Equity Scorecard tools and process. This developmental evaluation study began March 2011 and concluded April 2012. The pseudonym of the field site studied is Las Flores…

Human Resources Development Policy. A Structured Approach to Its Definition, Analysis and Evaluation. Training Policies Discussion Paper No. 13.

ERIC Educational Resources Information Center

Bermant, M.; And Others

This study provides a tool for describing, analyzing, and evaluating the effectiveness of human resources development (HRD) systems and their components. It is intended for policy makers, planners, and senior officials from government, employers', and workers' organizations who have responsibilities in human resources development. The first part…

Engagement, Exploration, Explanation, Extension, and Evaluation (5E) Learning Cycle and Conceptual Change Text as Learning Tools

ERIC Educational Resources Information Center

Balci, Sibel; Cakiroglu, Jale; Tekkaya, Ceren

2006-01-01

The purpose of this study is to investigate the effects of the Engagement, Exploration, Explanation, Extension, and Evaluation (5E) learning cycle, conceptual change texts, and traditional instructions on 8th grade students' understanding of photosynthesis and respiration in plants. Students' understanding of photosynthesis and respiration in…

Granting Teachers the "Benefit of the Doubt" in Performance Evaluations

ERIC Educational Resources Information Center

Rogge, Nicky

2011-01-01

Purpose: This paper proposes a benefit of the doubt (BoD) approach to construct and analyse teacher effectiveness scores (i.e. SET scores). Design/methodology/approach: The BoD approach is related to data envelopment analysis (DEA), a linear programming tool for evaluating the relative efficiency performance of a set of similar units (e.g. firms,…

Use of Interactive Electronic Audience Response Tools (Clickers) to Evaluate Knowledge Gained in Extension Programming

ERIC Educational Resources Information Center

Gunn, Patrick; Loy, Dan

2015-01-01

Effectively measuring short-term impact, particularly a change in knowledge resulting from Extension programming, can prove to be challenging. Clicker-based technology, when used properly, is one alternative that may allow educators to better evaluate this aspect of the logic model. While the potential interface between clicker technology and…

A Framework for Quantitative Evaluation of Care Coordination Effectiveness

ERIC Educational Resources Information Center

Liu, Wei

2017-01-01

The U.S. healthcare system lacks incentives and quantitative evaluation tools to assess coordination in a patient's care transition process. This is needed because poor care coordination has been identified by many studies as one of the major root causes for the U.S. health system's inefficiency, for poor outcomes, and for high cost. Despite…

Wilderness educators' evaluation of the Impact Monster Program

Treesearch

William W. Hendricks; Alan E. Watson

1999-01-01

Since its development by Jim Bradley in the late 1970s, the Impact Monster, a wilderness education skit designed to teach minimum impact techniques, has been used as a wilderness education tool by federal land management agencies. This paper reports on an evaluation of the perceived effectiveness of the Impact Monster program and its content. Results indicate that the...

Estimate of the Potential Costs and Effectiveness of Scaling Up CRESST Assessment Software.

ERIC Educational Resources Information Center

Chung, Gregory K. W. K.; Herl, Howard E.; Klein, Davina C. D.; O'Neil, Harold F., Jr.; Schacter, John

This report examines issues in the scale-up of assessment software from the Center for Research on Evaluation, Standards, and Student Testing (CRESST). "Scale-up" is used in a metaphorical sense, meaning adding new assessment tools to CRESST's assessment software. During the past several years, CRESST has been developing and evaluating a…

Mathematical support for automated geometry analysis of lathe machining of oblique peakless round-nose tools

NASA Astrophysics Data System (ADS)

Filippov, A. V.; Tarasov, S. Yu; Podgornyh, O. A.; Shamarin, N. N.; Filippova, E. O.

2017-01-01

Automatization of engineering processes requires developing relevant mathematical support and a computer software. Analysis of metal cutting kinematics and tool geometry is a necessary key task at the preproduction stage. This paper is focused on developing a procedure for determining the geometry of oblique peakless round-nose tool lathe machining with the use of vector/matrix transformations. Such an approach allows integration into modern mathematical software packages in distinction to the traditional analytic description. Such an advantage is very promising for developing automated control of the preproduction process. A kinematic criterion for the applicable tool geometry has been developed from the results of this study. The effect of tool blade inclination and curvature on the geometry-dependent process parameters was evaluated.

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

PubMed

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design. Copyright © 2015 Elsevier Inc. All rights reserved.

HydroViz: A web-based hydrologic observatory for enhancing hydrology and earth-science education

NASA Astrophysics Data System (ADS)

Habib, E. H.; Ma, Y.; Williams, D.

2010-12-01

The main goal of this study is to develop a virtual hydrologic observatory (HydroViz) that integrates hydrologic field observations with numerical simulations by taking advantage of advances in hydrologic field & remote sensing data, computer modeling, scientific visualization, and web resources and internet accessibility. The HydroViz system is a web-based teaching tool that can run on any web browsers. It leverages the strength of Google Earth to provide authentic and hands-on activities to improve learning. Evaluation of the HydroViz was performed in three engineering courses (a senior level course and two Introductory courses at two different universities). Evaluation results indicate that HydroViz provides an improvement over existing engineering hydrology curriculum. HydroViz was effective in facilitating students’ learning and understanding of hydrologic concepts & increasing related skills. HydroViz was much more effective for students in engineering hydrology classes rather than at the freshmen introduction to civil engineering class. We found that HydroViz has great potential for freshmen audience. Even though HydroViz was challenging to some freshmen, most of them still learned the key concepts and the tool increased the enthusiasm for half of the freshmen. The evaluation provided suggestions to create a simplified version of HydroViz for freshmen-level courses students. It identified concepts and tasks that might be too challenging or irrelevant to the freshmen and areas where we could provide more guidance in the tool. After the first round of evaluation, the development team has made significant improvements to HydroViz, which would further improve its effectiveness for next round of class applications which is planned for the Fall of 2010 to take place in 5 classes at 4 different institutions.

Improving e-book access via a library-developed full-text search tool*

PubMed Central

Foust, Jill E.; Bergen, Phillip; Maxeiner, Gretchen L.; Pawlowski, Peter N.

2007-01-01

Purpose: This paper reports on the development of a tool for searching the contents of licensed full-text electronic book (e-book) collections. Setting: The Health Sciences Library System (HSLS) provides services to the University of Pittsburgh's medical programs and large academic health system. Brief Description: The HSLS has developed an innovative tool for federated searching of its e-book collections. Built using the XML-based Vivísimo development environment, the tool enables a user to perform a full-text search of over 2,500 titles from the library's seven most highly used e-book collections. From a single “Google-style” query, results are returned as an integrated set of links pointing directly to relevant sections of the full text. Results are also grouped into categories that enable more precise retrieval without reformulation of the search. Results/Evaluation: A heuristic evaluation demonstrated the usability of the tool and a web server log analysis indicated an acceptable level of usage. Based on its success, there are plans to increase the number of online book collections searched. Conclusion: This library's first foray into federated searching has produced an effective tool for searching across large collections of full-text e-books and has provided a good foundation for the development of other library-based federated searching products. PMID:17252065

Overview of Nuclear Physics Data: Databases, Web Applications and Teaching Tools

NASA Astrophysics Data System (ADS)

McCutchan, Elizabeth

2017-01-01

The mission of the United States Nuclear Data Program (USNDP) is to provide current, accurate, and authoritative data for use in pure and applied areas of nuclear science and engineering. This is accomplished by compiling, evaluating, and disseminating extensive datasets. Our main products include the Evaluated Nuclear Structure File (ENSDF) containing information on nuclear structure and decay properties and the Evaluated Nuclear Data File (ENDF) containing information on neutron-induced reactions. The National Nuclear Data Center (NNDC), through the website www.nndc.bnl.gov, provides web-based retrieval systems for these and many other databases. In addition, the NNDC hosts several on-line physics tools, useful for calculating various quantities relating to basic nuclear physics. In this talk, I will first introduce the quantities which are evaluated and recommended in our databases. I will then outline the searching capabilities which allow one to quickly and efficiently retrieve data. Finally, I will demonstrate how the database searches and web applications can provide effective teaching tools concerning the structure of nuclei and how they interact. Work supported by the Office of Nuclear Physics, Office of Science of the U.S. Department of Energy under Contract No. DE-AC02-98CH10886.

Mirage: a visible signature evaluation tool

NASA Astrophysics Data System (ADS)

Culpepper, Joanne B.; Meehan, Alaster J.; Shao, Q. T.; Richards, Noel

2017-10-01

This paper presents the Mirage visible signature evaluation tool, designed to provide a visible signature evaluation capability that will appropriately reflect the effect of scene content on the detectability of targets, providing a capability to assess visible signatures in the context of the environment. Mirage is based on a parametric evaluation of input images, assessing the value of a range of image metrics and combining them using the boosted decision tree machine learning method to produce target detectability estimates. It has been developed using experimental data from photosimulation experiments, where human observers search for vehicle targets in a variety of digital images. The images used for tool development are synthetic (computer generated) images, showing vehicles in many different scenes and exhibiting a wide variation in scene content. A preliminary validation has been performed using k-fold cross validation, where 90% of the image data set was used for training and 10% of the image data set was used for testing. The results of the k-fold validation from 200 independent tests show a prediction accuracy between Mirage predictions of detection probability and observed probability of detection of r(262) = 0:63, p < 0:0001 (Pearson correlation) and a MAE = 0:21 (mean absolute error).

Measuring infrastructure: A key step in program evaluation and planning

PubMed Central

Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-01-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

Measuring infrastructure: A key step in program evaluation and planning.

PubMed

Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-06-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Regression discontinuity design in criminal justice evaluation: an introduction and illustration.

PubMed

Rhodes, William; Jalbert, Sarah Kuck

2013-01-01

Corrections agencies frequently place offenders into risk categories, within which offenders receive different levels of supervision and programming. This supervision strategy is seldom evaluated but often can be through routine use of a regression discontinuity design (RDD). This article argues that RDD provides a rigorous and cost-effective method for correctional agencies to evaluate and improve supervision strategies and advocates for using RDD routinely in corrections administration. The objective is to better employ correctional resources. This article uses a Neyman-Pearson counterfactual framework to introduce readers to RDD, to provide intuition for why RDD should be used broadly, and to motivate a deeper reading into the methodology. The article also illustrates an application of RDD to evaluate an intensive supervision program for probationers. Application of the RDD, which requires basic knowledge of regressions and some special diagnostic tools, is within the competencies of many criminal justice evaluators. RDD is shown to be an effective strategy to identify the treatment effect in a community corrections agency using supervision that meets the necessary conditions for RDD. The article concludes with a critical review of how RDD compares to experimental methods to answer policy questions. The article recommends using RDD to evaluate whether differing levels of control and correction reduce criminal recidivism. It also advocates for routine use of RDD as an administrative tool to determine cut points used to assign offenders into different risk categories based on the offenders' risk scores.

Development and implementation of an independence rating scale and evaluation process for nursing orientation of new graduates.

PubMed

Durkin, Gregory J

2010-01-01

A wide variety of evaluation formats are available for new graduate nurses, but most of them are single-point evaluation tools that do not provide a clear picture of progress for orientee or educator. This article describes the development of a Web-based evaluation tool that combines learning taxonomies with the Synergy model into a rating scale based on independent performance. The evaluation tool and process provides open 24/7 access to evaluation documentation for members of the orientation team, demystifying the process and clarifying expectations. The implementation of the tool has proven to be transformative in the perceptions of evaluation and performance expectations of new graduates. This tool has been successful at monitoring progress, altering education, and opening dialogue about performance for over 125 new graduate nurses since inception.

Data Base Directions: Information Resource Management - Strategies and Tools. Proceedings of the Workshop of the National Bureau of Standards and the Association for Computing Machinery (Ft. Lauderdale, Florida, October 20-22, 1980).

ERIC Educational Resources Information Center

Goldfine, Alan H., Ed.

This workshop investigated how managers can evaluate, select, and effectively use information resource management (IRM) tools, especially data dictionary systems (DDS). An executive summary, which provides a definition of IRM as developed by workshop participants, precedes the keynote address, "Data: The Raw Material of a Paper Factory,"…

Jamming effect analysis of infrared reticle seeker for directed infrared countermeasures

NASA Astrophysics Data System (ADS)

Bae, Tae-Wuk; Kim, Byoung-Ik; Kim, Young-Choon; Ahn, Sang-Ho

2012-09-01

In directed infrared countermeasures (DIRCM), the purpose of jamming toward missiles is making missiles miss the target (aircraft of our forces) in the field of view. Since the DIRCM system directly emits the pulsing flashes of infrared (IR) energy to missiles, it is more effective than present flare method emitting IR source to omni-direction. In this paper, we implemented a reticle seeker simulation tool using MATLAB-SIMULINK, in order to analyze jamming effect of spin-scan and con-scan reticle missile seeker used widely in the world, though it was developed early. Because the jammer signal has influence on the missile guidance system using its variable frequency, it is very important technique among military defense systems protecting our forces from missiles of enemy. Simulation results show that jamming effect is greatly influenced according to frequency, phase and intensity of jammer signal. Especially, jammer frequency has the largest influence on jamming effect. Through our reticle seeker simulation tool, we can confirm that jamming effect toward missiles is significantly increased when jammer frequency is similar to reticle frequency. Finally, we evaluated jamming effect according to jammer frequencies, by using correlation coefficient as an evaluation criterion of jamming performance in two reticle missile seekers.

CDC MessageWorks: Designing and Validating a Social Marketing Tool to Craft and Defend Effective Messages.

PubMed

Cole, Galen E; Keller, Punam A; Reynolds, Jennifer; Schaur, Michelle; Krause, Diane

2016-03-01

The Centers for Disease Control and Prevention's Division of Cancer Prevention and Control, in partnership with Oak Ridge Associated Universities, designed an online social marketing strategy tool, MessageWorks, to help health communicators effectively formulate messages aimed at changing health behaviors and evaluate message tactics and audience characteristics. MessageWorks is based on the advisor for risk communication model that identifies 10 variables that can be used to predict target audience intentions to comply with health recommendations. This article discusses the value of the MessageWorks tool to health communicators and to the field of social marketing by (1) describing the scientific evidence supporting use of MessageWorks to improve health communication practice and (2) summarizing how to use MessageWorks and interpret the results it produces.

NNDC Tools and Publications

Science.gov Websites

Site Index NNDC Tools and Publications Nuclear Structure and Decay Tools Nuclear Reaction Tools Nuclear Structure and Decay Tools 2016 Atomic Mass Evaluation Atomic mass evaluation, by Wang, Audi values as a function of gamma energy and multipolarity. Calculations based on I.M. Band and S. Raman

The Effectiveness of a Route Crossing Tool in a Simulated New York Airspace

NASA Technical Reports Server (NTRS)

Parke, Bonny; Chevalley, Eric; Bienert, Nancy; Lee, Paul; Gonter, Kari; Omar, Faisal; Kraut, Joshua; Yoo, Hyo-Sang; Borade, Abhay; Gabriel, Conrad;

Measuring Workload Demand of Informatics Systems with the Clinical Case Demand Index

PubMed Central

Iyengar, M. Sriram; Rogith, Deevakar; Florez-Arango, Jose F

2017-01-01

Introduction: The increasing use of Health Information Technology (HIT) can add substantially to workload on clinical providers. Current methods for assessing workload do not take into account the nature of clinical cases and the use of HIT tools while solving them. Methods: The Clinical Case Demand Index (CCDI), consisting of a summary score and visual representation, was developed to meet this need. Consistency with current perceived workload measures was evaluated in a Randomized Control Trial of a mobile health system. Results: CCDI is significantly correlated with existing workload measures and inversely related to provider performance. Discussion: CCDI combines subjective and objective characteristics of clinical cases along with cognitive and clinical dimensions. Applications include evaluation of HIT tools, clinician scheduling, medical education. Conclusion: CCDI supports comparative effectiveness research of HIT tools. In addition, CCDI could have numerous applications including training, clinical trials, design of clinical workflows, and others. PMID:29854166

Geriatric Assessment and Tools for Predicting Treatment Toxicity in Older Adults With Cancer.

PubMed

Li, Daneng; Soto-Perez-de-Celis, Enrique; Hurria, Arti

Cancer is a disease of older adults, and the majority of new cancer cases and deaths occur in people 65 years or older. However, fewer data are available regarding the risks and benefits of cancer treatment in older adults, and commonly used assessments in oncology fail to adequately evaluate factors that affect treatment efficacy and outcomes in the older patients. The geriatric assessment is a multidisciplinary evaluation that provides detailed information about a patient's functional status, comorbidities, psychological state, social support, nutritional status, and cognitive function. Among older patients with cancer, geriatric assessment has been shown to identify patients at risk of poorer overall survival, and geriatric assessment-based tools are significantly more effective in predicting chemotherapy toxicity than other currently utilized measures. In this review, we summarize the components of the geriatric assessment and provide information about existing tools used to predict treatment toxicity in older patients with cancer.

Seminars in Pediatric Neurology Pediatric Pain Measurement, Assessment and Evaluation

PubMed Central

Manworren, Renee CB; Stinson, Jennifer

2016-01-01

Assessment provides the foundation for diagnosis, selection of treatments, and evaluation of treatment effectiveness for pediatric patients with acute, recurrent and chronic pain. Extensive research has resulted in the availability of a number of valid, reliable and recommended tools for assessing children’s pain. Yet, evidence suggests children’s pain is still not optimally assessed or treated. In this article, we provide an overview of pain assessment for premature neonates to adolescents. The difference between pain assessment and measurement will be highlighted; and the key steps in pain assessment identified. Information about self-report and behavioral pain assessment tools appropriate for children will be provided; and factors to be considered when choosing a pain assessment tool will be outlined. Finally, we will preview future approaches to personalized pain medicine in pediatrics that include harnessing the assessment potential of digital health technologies and genomics. PMID:27989326

Electromagnetic nondestructive evaluation of tempering process in AISI D2 tool steel

NASA Astrophysics Data System (ADS)

Kahrobaee, Saeed; Kashefi, Mehrdad

2015-05-01

The present paper investigates the potential of using eddy current technique as a reliable nondestructive tool to detect microstructural changes during the different stages of tempering treatment in AISI D2 tool steel. Five stages occur in tempering of the steel: precipitation of ɛ carbides, formation of cementite, retained austenite decomposition, secondary hardening effect and spheroidization of carbides. These stages were characterized by destructive methods, including dilatometry, differential scanning calorimetry, X-ray diffraction, scanning electron microscopic observations, and hardness measurements. The microstructural changes alter the electrical resistivity/magnetic saturation, which, in turn, influence the eddy current signals. Two EC parameters, induced voltage sensed by pickup coil and impedance point detected by excitation coil, were evaluated as a function of tempering temperature to characterize the microstructural features, nondestructively. The study revealed that a good correlation exists between the EC parameters and the microstructural changes.

Visual analytics for aviation safety: A collaborative approach to sensemaking

NASA Astrophysics Data System (ADS)

Wade, Andrew

Visual analytics, the "science of analytical reasoning facilitated by interactive visual interfaces", is more than just visualization. Understanding the human reasoning process is essential for designing effective visualization tools and providing correct analyses. This thesis describes the evolution, application and evaluation of a new method for studying analytical reasoning that we have labeled paired analysis. Paired analysis combines subject matter experts (SMEs) and tool experts (TE) in an analytic dyad, here used to investigate aircraft maintenance and safety data. The method was developed and evaluated using interviews, pilot studies and analytic sessions during an internship at the Boeing Company. By enabling a collaborative approach to sensemaking that can be captured by researchers, paired analysis yielded rich data on human analytical reasoning that can be used to support analytic tool development and analyst training. Keywords: visual analytics, paired analysis, sensemaking, boeing, collaborative analysis.

A Quasi-Universal Nonword Repetition Task as a Diagnostic Tool for Bilingual Children Learning Dutch as a Second Language.

PubMed

Boerma, Tessel; Chiat, Shula; Leseman, Paul; Timmermeister, Mona; Wijnen, Frank; Blom, Elma

2015-12-01

This study evaluated a newly developed quasi-universal nonword repetition task (Q-U NWRT) as a diagnostic tool for bilingual children with language impairment (LI) who have Dutch as a 2nd language. The Q-U NWRT was designed to be minimally influenced by knowledge of 1 specific language in contrast to a language-specific NWRT with which it was compared. One hundred twenty monolingual and bilingual children with and without LI participated (30 per group). A mixed-design analysis of variance was used to investigate the effects of LI and bilingualism on the NWRTs. Receiver operating characteristic analyses were conducted to evaluate the instruments' diagnostic value. Large negative effects of LI were found on both NWRTs, whereas negative effects of bilingualism only occurred on the language-specific NWRT. Both instruments had high clinical accuracy in the monolingual group, but only the Q-U NWRT had high clinical accuracy in the bilingual group. This study indicates that the Q-U NWRT is a promising diagnostic tool to help identify LI in bilingual children learning Dutch as a 2nd language. The instrument was clinically accurate in both a monolingual and bilingual group of children and seems better able to disentangle LI from language disadvantage than more language-specific measures.

Evaluation of tools used to measure critical thinking development in nursing and midwifery undergraduate students: a systematic review.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2015-07-01

Well developed critical thinking skills are essential for nursing and midwifery practices. The development of students' higher-order cognitive abilities, such as critical thinking, is also well recognised in nursing and midwifery education. Measurement of critical thinking development is important to demonstrate change over time and effectiveness of teaching strategies. To evaluate tools designed to measure critical thinking in nursing and midwifery undergraduate students. The following six databases were searched and resulted in the retrieval of 1191 papers: CINAHL, Ovid Medline, ERIC, Informit, PsycINFO and Scopus. After screening for inclusion, each paper was evaluated using the Critical Appraisal Skills Programme Tool. Thirty-four studies met the inclusion criteria and quality appraisal. Sixteen different tools that measure critical thinking were reviewed for reliability and validity and extent to which the domains of critical thinking were evident. Sixty percent of studies utilised one of four standardised commercially available measures of critical thinking. Reliability and validity were not consistently reported and there was a variation in reliability across studies that used the same measure. Of the remaining studies using different tools, there was also limited reporting of reliability making it difficult to assess internal consistency and potential applicability of measures across settings. Discipline specific instruments to measure critical thinking in nursing and midwifery are required, specifically tools that measure the application of critical thinking to practise. Given that critical thinking development occurs over an extended period, measurement needs to be repeated and multiple methods of measurement used over time. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

Development and evaluation of the feasibility and effects on staff, patients, and families of a new tool, the Psychosocial Assessment and Communication Evaluation (PACE), to improve communication and palliative care in intensive care and during clinical uncertainty.

PubMed

Higginson, Irene J; Koffman, Jonathan; Hopkins, Philip; Prentice, Wendy; Burman, Rachel; Leonard, Sara; Rumble, Caroline; Noble, Jo; Dampier, Odette; Bernal, William; Hall, Sue; Morgan, Myfanwy; Shipman, Cathy

2013-10-01

There are widespread concerns about communication and support for patients and families, especially when they face clinical uncertainty, a situation most marked in intensive care units (ICUs). Therefore, we aimed to develop and evaluate an interventional tool to improve communication and palliative care, using the ICU as an example of where this is difficult. Our design was a phase I-II study following the Medical Research Council Guidance for the Development and Evaluation of Complex Interventions and the (Methods of Researching End-of-life Care (MORECare) statement. In two ICUs, with over 1900 admissions annually, phase I modeled a new intervention comprising implementation training and an assessment tool. We conducted a literature review, qualitative interviews, and focus groups with 40 staff and 13 family members. This resulted in the new tool, the Psychosocial Assessment and Communication Evaluation (PACE). Phase II evaluated the feasibility and effects of PACE, using observation, record audit, and surveys of staff and family members. Qualitative data were analyzed using the framework approach. The statistical tests used on quantitative data were t-tests (for normally distributed characteristics), the χ2 or Fisher's exact test (for non-normally distributed characteristics) and the Mann-Whitney U-test (for experience assessments) to compare the characteristics and experience for cases with and without PACE recorded. PACE provides individualized assessments of all patients entering the ICU. It is completed within 24 to 48 hours of admission, and covers five aspects (key relationships, social details and needs, patient preferences, communication and information status, and other concerns), followed by recording of an ongoing communication evaluation. Implementation is supported by a training program with specialist palliative care. A post-implementation survey of 95 ICU staff found that 89% rated PACE assessment as very or generally useful. Of 213 family members, 165 (78%) responded to their survey, and two-thirds had PACE completed. Those for whom PACE was completed reported significantly higher satisfaction with symptom control, and the honesty and consistency of information from staff (Mann-Whitney U-test ranged from 616 to 1247, P-values ranged from 0.041 to 0.010) compared with those who did not. PACE is a feasible interventional tool that has the potential to improve communication, information consistency, and family perceptions of symptom control.

Evaluating the impact of a pre-rotation workshop on student preparation for clinical advanced pharmacy practice experiences.

PubMed

Medina, Melissa S; Stark, Jennifer E; Vesta, Kimi S; Lockhart, Staci M

2008-10-01

This pilot study was designed to evaluate the impact of a pre-rotation workshop (PRW) on pharmacy students' clinical skills and preparation for clinical Advanced Pharmacy Practice Experiences (APPE) involving direct patient care. Randomized controlled trial of an educational intervention with Institutional Review Board approval. PRW activities designed to simulate rotation activities around five competencies, patient charts, medication histories, SOAP notes, patient presentations, and professionalism. Endpoints were evaluated using clinical rotation preceptors' evaluation of performance and students' performance on objective structured clinical exams (OSCE). Eight fourth-year students and eight GPA matched controls (20% of the total class) were selected to voluntarily participate. The PRW demonstrated a positive impact on students' clinical skills and preparation for rotations by improving OSCE performance. However, no significant differences were found between groups when comparing preceptor evaluations of skills on rotations. These results are limited by the small sample size, potential OSCE "test-wiseness" effects, lack of OSCE evaluator blinding to study groups, potential case specificity effects due to the limited number of cases used on the OSCE and possible lack of sensitivity of the rotation evaluation tool to capture true differences among the experimental and control group participants. The PRW was successful at advancing students' clinical skills and preparation for rotations and may be considered as a tool to help bridge didactic to clinical experiences in the Pharm.D. curriculum.

Graphical Tests for Power Comparison of Competing Designs.

PubMed

Hofmann, H; Follett, L; Majumder, M; Cook, D

2012-12-01

Lineups have been established as tools for visual testing similar to standard statistical inference tests, allowing us to evaluate the validity of graphical findings in an objective manner. In simulation studies lineups have been shown as being efficient: the power of visual tests is comparable to classical tests while being much less stringent in terms of distributional assumptions made. This makes lineups versatile, yet powerful, tools in situations where conditions for regular statistical tests are not or cannot be met. In this paper we introduce lineups as a tool for evaluating the power of competing graphical designs. We highlight some of the theoretical properties and then show results from two studies evaluating competing designs: both studies are designed to go to the limits of our perceptual abilities to highlight differences between designs. We use both accuracy and speed of evaluation as measures of a successful design. The first study compares the choice of coordinate system: polar versus cartesian coordinates. The results show strong support in favor of cartesian coordinates in finding fast and accurate answers to spotting patterns. The second study is aimed at finding shift differences between distributions. Both studies are motivated by data problems that we have recently encountered, and explore using simulated data to evaluate the plot designs under controlled conditions. Amazon Mechanical Turk (MTurk) is used to conduct the studies. The lineups provide an effective mechanism for objectively evaluating plot designs.

The Seamless Transfer-of-Care Protocol: a randomized controlled trial assessing the efficacy of an electronic transfer-of-care communication tool.

PubMed

Okoniewska, Barbara M; Santana, Maria J; Holroyd-Leduc, Jayna; Flemons, Ward; O'Beirne, Maeve; White, Deborah; Clement, Fiona; Forster, Alan; Ghali, William A

2012-11-21

The transition between acute care and community care represents a vulnerable period in health care delivery. The vulnerability of this period has been attributed to changes to patients' medication regimens during hospitalization, failure to reconcile discrepancies between admission and discharge and the burdening of patients/families to take over care responsibilities at discharge and to relay important information to the primary care physician. Electronic communication platforms can provide an immediate link between acute care and community care physicians (and other community providers), designed to ensure consistent information transfer. This study examines whether a transfer-of-care (TOC) communication tool is efficacious and cost-effective for reducing hospital readmission, adverse events and adverse drug events as well as reducing death. A randomized controlled trial conducted on the Medical Teaching Unit of a Canadian tertiary care centre will evaluate the efficacy and cost-effectiveness of a TOC communication tool. Medical in-patients admitted to the unit will be considered for this study. Data will be collected upon admission, and a total of 1400 patients will be randomized. The control group's acute care stay will be summarized using a traditional dictated summary, while the intervention group will have a summary generated using the TOC communication tool. The primary outcome will be a composite, at 3 months, of death or readmission to any Alberta acute-care hospital. Secondary outcomes will be the occurrence of post-discharge adverse events and adverse drug events at 1 month post discharge. Patients with adverse outcomes will have their cases reviewed by two Royal College certified internists or College-certified family physicians, blinded to patients' group assignments, to determine the type, severity, preventability and ameliorability of all detected adverse outcomes. An accompanying economic evaluation will assess the cost per life saved, cost per readmission avoided and cost per QALY gained with the TOC communication tool compared to traditional dictation summaries. This paper outlines the study protocol for a randomized controlled trial evaluating an electronic transfer-of-care communication tool, with sufficient statistical power to assess the impact of the tool on the significant outcomes of post-discharge death or readmission. The study findings will inform health systems around the world on the potential benefits of such tools, and the value for money associated with their widespread implementation. ClinicalTrials.gov NCT01402609.

Evaluating hospital design from an operations management perspective.

PubMed

Vos, Leti; Groothuis, Siebren; van Merode, Godefridus G

2007-12-01

This paper describes an evaluation method for the assessment of hospital building design from the viewpoint of operations management to assure that the building design supports the efficient and effective operating of care processes now and in the future. The different steps of the method are illustrated by a case study. In the case study an experimental design is applied to assess the effect of used logistical concepts, patient mix and technologies. The study shows that the evaluation method provides a valuable tool for the assessment of both functionality and the ability to meet future developments in operational control of a building design.

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

The Systems SOAP Note: A Systems Learning Tool.

PubMed

Mitsuishi, Fumi; Young, John Q; Leary, Mark; Dilley, James; Mangurian, Christina

2016-02-01

Systems-based practice (SBP) is the only Accreditation Council for Graduate Medical Education (ACGME) competency concerned with public health and is relatively neglected in residency curricula. A tool was developed and pilot-tested to improve SBP learning on inpatient psychiatry rotations. A four-step approach was used: (1) literature review, (2) expert consultation, (3) tool development, and (4) pilot testing on four cases and evaluation for completion time and preliminary efficacy. Out of 51 SBP articles, six (12%) focused on psychiatric residency programs, and none had a practical SBP learning tool. The "systems SOAP (subjective, objective, assessment, plan) note" (S-SOAP) was structured after a clinical SOAP note and was easy to use (mean completion time = 60 min), and residents self-reported more insight into systems issues. The S-SOAP tool was effectively integrated into clinical experience and provided insight into systemic complexities. Future research should assess SBP knowledge acquisition after the use of such tools.

Design Tools for Reconfigurable Hardware in Orbit (RHinO)

NASA Technical Reports Server (NTRS)

French, Mathew; Graham, Paul; Wirthlin, Michael; Larchev, Gregory; Bellows, Peter; Schott, Brian

2004-01-01

The Reconfigurable Hardware in Orbit (RHinO) project is focused on creating a set of design tools that facilitate and automate design techniques for reconfigurable computing in space, using SRAM-based field-programmable-gate-array (FPGA) technology. These tools leverage an established FPGA design environment and focus primarily on space effects mitigation and power optimization. The project is creating software to automatically test and evaluate the single-event-upsets (SEUs) sensitivities of an FPGA design and insert mitigation techniques. Extensions into the tool suite will also allow evolvable algorithm techniques to reconfigure around single-event-latchup (SEL) events. In the power domain, tools are being created for dynamic power visualiization and optimization. Thus, this technology seeks to enable the use of Reconfigurable Hardware in Orbit, via an integrated design tool-suite aiming to reduce risk, cost, and design time of multimission reconfigurable space processors using SRAM-based FPGAs.

Evaluation of insight training of ambulance drivers in Sweden using DART, a new e-learning tool.

PubMed

Albertsson, Pontus; Sundström, Anna

2011-12-01

The aim of the study was to evaluate whether a new e-learning tool for insight training of ambulance drivers can have an effect on drivers' driving behaviors, perceived driving competence, competence to assess risks, self-reflection, and safety attitudes. A quasi-experimental study design, with participants nonrandomly assigned into a control and intervention group, was used. The intervention group participated in the insight-training course and the control group did not. Both groups completed a self- and peer assessment online questionnaire before and after the training. The main finding is that the ambulance drivers assessed themselves through the instruments after the training, with the e-learning tool Driver Access Recording Tool (DART), as safer drivers in the areas of speed adaptation, closing up, and overtaking. In the answers from the group-based evaluation, the ambulance drivers responded that they were more reflective/analytical, had increased their risk awareness, and had changed their driving behaviors. After insight training, the ambulance drivers in this study assessed themselves as safer drivers in several important areas, including speed adaptation, closing up, and overtaking. In future training of ambulance drivers there should be more focus on insight training instead of previous training focusing on maneuvering capabilities.

The experiences of undergraduate nursing students with bots in Second LifeRTM

NASA Astrophysics Data System (ADS)

Rose, Lesele H.

As technology continues to transform education from the status quo of traditional lecture-style instruction to an interactive engaging learning experience, students' experiences within the learning environment continues to change as well. This dissertation addressed the need for continuing research in advancing implementation of technology in higher education. The purpose of this phenomenological study was to discover more about the experiences of undergraduate nursing students using standardized geriatric evaluation tools when interacting with scripted geriatric patient bots tools in a simulated instructional intake setting. Data was collected through a Demographics questionnaire, an Experiential questionnaire, and a Reflection questionnaire. Triangulation of data collection occurred through an automatically created log of the interactions with the two bots, and by an automatically recorded log of the participants' movements while in the simulated geriatric intake interview. The data analysis consisted of an iterative review of the questionnaires and the participants' logs in an effort to identify common themes, recurring comments, and issues which would benefit from further exploration. Findings revealed that the interactions with the bots were perceived as a valuable experience for the participants from the perspective of interacting with the Geriatric Evaluation Tools in the role of an intake nurse. Further research is indicated to explore instructional interactions with bots in effectively mastering the use of established Geriatric Evaluation Tools.

Software component quality evaluation

NASA Technical Reports Server (NTRS)

Clough, A. J.

1991-01-01

The paper describes a software inspection process that can be used to evaluate the quality of software components. Quality criteria, process application, independent testing of the process and proposed associated tool support are covered. Early results indicate that this technique is well suited for assessing software component quality in a standardized fashion. With automated machine assistance to facilitate both the evaluation and selection of software components, such a technique should promote effective reuse of software components.

Sensitivity, reliability and the effects of diurnal variation on a test battery of field usable upper limb fatigue measures.

PubMed

Yung, Marcus; Wells, Richard P

2017-07-01

Fatigue has been linked to deficits in production quality and productivity and, if of long duration, work-related musculoskeletal disorders. It may thus be a useful risk indicator and design and evaluation tool. However, there is limited information on the test-retest reliability, the sensitivity and the effects of diurnal fluctuation on field usable fatigue measures. This study reports on an evaluation of 11 measurement tools and their 14 parameters. Eight measures were found to have test-retest ICC values greater than 0.8. Four measures were particularly responsive during an intermittent fatiguing condition. However, two responsive measures demonstrated rhythmic behaviour, with significant time effects from 08:00 to mid-afternoon and early evening. Action tremor, muscle mechanomyography and perceived fatigue were found to be most reliable and most responsive; but additional analytical considerations might be required when interpreting daylong responses of MMG and action tremor. Practitioner Summary: This paper presents findings from test-retest and daylong reliability and responsiveness evaluations of 11 fatigue measures. This paper suggests that action tremor, muscle mechanomyography and perceived fatigue were most reliable and most responsive. However, mechanomyography and action tremor may be susceptible to diurnal changes.

Creation and utilization of a World Wide Web based space radiation effects code: SIREST

NASA Technical Reports Server (NTRS)

Singleterry, R. C. Jr; Wilson, J. W.; Shinn, J. L.; Tripathi, R. K.; Thibeault, S. A.; Noor, A. K.; Cucinotta, F. A.; Badavi, F. F.; Chang, C. K.; Qualls, G. D.;

Measuring the quality of life and well-being of people with dementia: A review of observational measures.

PubMed

Algar, Katherine; Woods, Robert T; Windle, Gill

2016-07-01

The dynamic nature of psychosocial interventions implies that trying to measure their effects using standardised clinical trial measures may not capture their full effects. Rich and valuable data during the sessions may be missed by using standard quality of life questionnaires. This paper compares observational measures in the context of recording the well-being of a person with dementia during and outside of a visual arts intervention. A literature search was conducted using systematic principles of searching, screening and retrieval to identify peer-reviewed English language evaluations of research projects using observational measures with people with dementia. Psychometric properties, strengths and weaknesses of 11 observational tools are reviewed in order to identify the most appropriate one for evaluating a visual art intervention for people with dementia. This review supports the Greater Cincinnati Chapter Well-Being Observation Tool as an appropriate measure to evaluate a visual art programme for people with dementia. The results of this review will help researchers plan projects to show the full range of effects for people with dementia for taking part in art sessions. © The Author(s) 2014.

Department of Defense Interface Standard Electromagnetic Environmental Effects Requirements for Systems

DTIC Science & Technology

2002-12-19

effective tool in evaluating IMI. A5.2.2 Shipboard internal electromagnetic environment (EME). For ship applications, electric fields (peak V/m-rms...effects waveform parameters ........................................ 9 MIL-STD-464A v CONTENTS Page TABLES 2B Electromagnetic fields from near...blasting of hardware. 3.8 Lightning indirect effects. Electrical transients induced by lightning due to coupling of electromagnetic fields . 3.9

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Bioluminescent bioreporter pad biosensor for monitoring water toxicity.

PubMed

Axelrod, Tim; Eltzov, Evgeni; Marks, Robert S

2016-01-01

Toxicants in water sources are of concern. We developed a tool that is affordable and easy-to-use for monitoring toxicity in water. It is a biosensor composed of disposable bioreporter pads (calcium alginate matrix with immobilized bacteria) and a non-disposable CMOS photodetector. Various parameters to enhance the sensor's signal have been tested, including the effect of alginate and bacterium concentrations. The effect of various toxicants, as well as, environmental samples were tested by evaluating their effect on bacterial luminescence. This is the first step in the creation of a sensitive and simple operative tool that may be used in different environments. Copyright © 2015 Elsevier B.V. All rights reserved.

The nature and evaluation of commercial expert system building tools, revision 1

NASA Technical Reports Server (NTRS)

Gevarter, William B.

1987-01-01

This memorandum reviews the factors that constitute an Expert System Building Tool (ESBT) and evaluates current tools in terms of these factors. Evaluation of these tools is based on their structure and their alternative forms of knowledge representation, inference mechanisms and developer end-user interfaces. Next, functional capabilities, such as diagnosis and design, are related to alternative forms of mechanization. The characteristics and capabilities of existing commercial tools are then reviewed in terms of these criteria.

An Approach to Industrial Stormwater Benchmarks: Establishing and Using Site-Specific Threshold Criteria at Lawrence Livermore National Laboratory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Campbell, C G; Mathews, S

2006-09-07

Current regulatory schemes use generic or industrial sector specific benchmarks to evaluate the quality of industrial stormwater discharges. While benchmarks can be a useful tool for facility stormwater managers in evaluating the quality stormwater runoff, benchmarks typically do not take into account site-specific conditions, such as: soil chemistry, atmospheric deposition, seasonal changes in water source, and upstream land use. Failing to account for these factors may lead to unnecessary costs to trace a source of natural variation, or potentially missing a significant local water quality problem. Site-specific water quality thresholds, established upon the statistical evaluation of historic data take intomore » account these factors, are a better tool for the direct evaluation of runoff quality, and a more cost-effective trigger to investigate anomalous results. Lawrence Livermore National Laboratory (LLNL), a federal facility, established stormwater monitoring programs to comply with the requirements of the industrial stormwater permit and Department of Energy orders, which require the evaluation of the impact of effluent discharges on the environment. LLNL recognized the need to create a tool to evaluate and manage stormwater quality that would allow analysts to identify trends in stormwater quality and recognize anomalous results so that trace-back and corrective actions could be initiated. LLNL created the site-specific water quality threshold tool to better understand the nature of the stormwater influent and effluent, to establish a technical basis for determining when facility operations might be impacting the quality of stormwater discharges, and to provide ''action levels'' to initiate follow-up to analytical results. The threshold criteria were based on a statistical analysis of the historic stormwater monitoring data and a review of relevant water quality objectives.« less

Development and validation of methods for man-made machine interface evaluation. [for shuttles and shuttle payloads

NASA Technical Reports Server (NTRS)

Malone, T. B.; Micocci, A.

1975-01-01

The alternate methods of conducting a man-machine interface evaluation are classified as static and dynamic, and are evaluated. A dynamic evaluation tool is presented to provide for a determination of the effectiveness of the man-machine interface in terms of the sequence of operations (task and task sequences) and in terms of the physical characteristics of the interface. This dynamic checklist approach is recommended for shuttle and shuttle payload man-machine interface evaluations based on reduced preparation time, reduced data, and increased sensitivity of critical problems.

Validation of a Tool Evaluating Educational Apps for Smart Education

ERIC Educational Resources Information Center

Lee, Jeong-Sook; Kim, Sung-Wan

2015-01-01

The purpose of this study is to develop and validate an evaluation tool of educational apps for smart education. Based on literature reviews, a potential model for evaluating educational apps was suggested. An evaluation tool consisting of 57 survey items was delivered to 156 students in middle and high schools. An exploratory factor analysis was…

Solutions to Address Diabetes-Related Financial Burden and Cost-Related Nonadherence: Results From a Pilot Study.

PubMed

Patel, Minal R; Resnicow, Kenneth; Lang, Ian; Kraus, Kathleen; Heisler, Michele

2018-02-01

Cost-related nonadherence (CRN) to recommended self-management behaviors among adults with chronic conditions such as diabetes is prevalent. Few behavioral interventions to mitigate CRN have been tested and evaluated. We developed a financial burden resource tool and examined its acceptability and the preliminary effects on patient-centered outcomes among adults with diabetes or prediabetes seen in a clinical setting. We report a pre-post one-group design pilot study. From an endocrinology clinic, we recruited 104 adults with diabetes who reported financial burdens with their diabetes management or engaged in CRN behaviors. We offered participants the financial burden resource tool we developed, which provided tailored, low-cost resource options for diabetes management and other social needs. Acceptability and self-reported outcomes were assessed 2 months after use of the tool. Mean age of participants was 50.5 years ( SD = 15.3). Participants found the tool highly acceptable across 15 indicators (e.g., 93% "learned a lot," 98% "topics relevant" 95% "applicable to their lives," 98% "liked the information"). Significant improvements between baseline and 2-month follow-up were observed for discussion of cost concerns with nurses (19% to 29%, p < .05) and pharmacists (13% to 25.5%, p < .01), not skipping doses of medicines due to cost (11% to 4%, p < .03), and financial management (33.83 to 39.62, p < .007). There were no significant changes in perception of financial burden. A financial burden resource tool is highly acceptable to patients, is easy to administer, and can prompt behavior change. This pilot study supports the need for well-powered trials with longer follow-up to further evaluate the effectiveness of such tools in improving CRN and key outcomes.

Economic figures in herd health programmes as motivation factors for farmers.

PubMed

Anneberg, Inger; Østergaard, Søren; Ettema, Jehan Frans; Kudahl, Anne Braad

2016-11-01

Veterinarians often express frustrations when farmers do not implement their advice, and farmers sometimes shake their heads when they receive veterinary advice which is practically unfeasible. This is the background for the development of a focused 3 page economic report created in cooperation between veterinarians, farmers, advisers and researchers. Based on herd specific key-figures for management, the report presents the short- and long-term economic effects of changes in 15 management areas. Simulations are performed by the dairy herd simulation model "SimHerd". The aim is to assist the veterinarian in identifying the economically most favorable and feasible management improvements and thereby provide more relevant and prioritised advice to the farmer. In the developing process, a prototype of the advisory tool was tested by 15 veterinarians on 55 farms. After the test period, a selection of farmers were asked to take part in a qualitative evaluation questioning them whether they had implemented the action plans suggested on basis of the advisory tool and making them explain what made them agree or disagree on the results from this new advisory tool. The aim of this process was to evaluate the farmers' receptiveness to advice based on these economic analyses. We found that the analysed advisory tool (the report) can be seen as a valuable help and support for some farmers when deciding whether to implement the action plans. However, certain reservations were recognised. The trustworthiness of the tool depends on whether the veterinarians are able to suggest to the farmer which specific management changes are needed to obtain the estimated effects and what the related expenses might be (costs). Without transparency of expenses, time-limits, work hours and so on, farmers may not be convinced by the tool. Copyright © 2016 Elsevier B.V. All rights reserved.

Solutions to Address Diabetes-Related Financial Burden and Cost-Related Nonadherence: Results From a Pilot Study

PubMed Central

Patel, Minal R.; Resnicow, Kenneth; Lang, Ian; Kraus, Kathleen; Heisler, Michele

2018-01-01

Background Cost-related nonadherence (CRN) to recommended self-management behaviors among adults with chronic conditions such as diabetes is prevalent. Few behavioral interventions to mitigate CRN have been tested and evaluated. Aims We developed a financial burden resource tool and examined its acceptability and the preliminary effects on patient-centered outcomes among adults with diabetes or prediabetes seen in a clinical setting. Method We report a pre–post one-group design pilot study. From an endocrinology clinic, we recruited 104 adults with diabetes who reported financial burdens with their diabetes management or engaged in CRN behaviors. We offered participants the financial burden resource tool we developed, which provided tailored, low-cost resource options for diabetes management and other social needs. Acceptability and self-reported outcomes were assessed 2 months after use of the tool. Results Mean age of participants was 50.5 years (SD = 15.3). Participants found the tool highly acceptable across 15 indicators (e.g., 93% “learned a lot,” 98% “topics relevant” 95% “applicable to their lives,” 98% “liked the information”). Significant improvements between baseline and 2-month followup were observed for discussion of cost concerns with nurses (19% to 29%, p < .05) and pharmacists (13% to 25.5%, p < .01), not skipping doses of medicines due to cost (11% to 4%, p < .03), and financial management (33.83 to 39.62, p < .007). There were no significant changes in perception of financial burden. Conclusion A financial burden resource tool is highly acceptable to patients, is easy to administer, and can prompt behavior change. This pilot study supports the need for well-powered trials with longer follow-up to further evaluate the effectiveness of such tools in improving CRN and key outcomes. PMID:28443371

Tool making, hand morphology and fossil hominins.

PubMed

Marzke, Mary W

2013-11-19

Was stone tool making a factor in the evolution of human hand morphology? Is it possible to find evidence in fossil hominin hands for this capability? These questions are being addressed with increasingly sophisticated studies that are testing two hypotheses; (i) that humans have unique patterns of grip and hand movement capabilities compatible with effective stone tool making and use of the tools and, if this is the case, (ii) that there exist unique patterns of morphology in human hands that are consistent with these capabilities. Comparative analyses of human stone tool behaviours and chimpanzee feeding behaviours have revealed a distinctive set of forceful pinch grips by humans that are effective in the control of stones by one hand during manufacture and use of the tools. Comparative dissections, kinematic analyses and biomechanical studies indicate that humans do have a unique pattern of muscle architecture and joint surface form and functions consistent with the derived capabilities. A major remaining challenge is to identify skeletal features that reflect the full morphological pattern, and therefore may serve as clues to fossil hominin manipulative capabilities. Hominin fossils are evaluated for evidence of patterns of derived human grip and stress-accommodation features.

Tool making, hand morphology and fossil hominins

PubMed Central

Marzke, Mary W.

2013-01-01

Was stone tool making a factor in the evolution of human hand morphology? Is it possible to find evidence in fossil hominin hands for this capability? These questions are being addressed with increasingly sophisticated studies that are testing two hypotheses; (i) that humans have unique patterns of grip and hand movement capabilities compatible with effective stone tool making and use of the tools and, if this is the case, (ii) that there exist unique patterns of morphology in human hands that are consistent with these capabilities. Comparative analyses of human stone tool behaviours and chimpanzee feeding behaviours have revealed a distinctive set of forceful pinch grips by humans that are effective in the control of stones by one hand during manufacture and use of the tools. Comparative dissections, kinematic analyses and biomechanical studies indicate that humans do have a unique pattern of muscle architecture and joint surface form and functions consistent with the derived capabilities. A major remaining challenge is to identify skeletal features that reflect the full morphological pattern, and therefore may serve as clues to fossil hominin manipulative capabilities. Hominin fossils are evaluated for evidence of patterns of derived human grip and stress-accommodation features. PMID:24101624

CORAL REEF BIOCRITERIA

EPA Science Inventory

Coral reefs worldwide are experiencing the greatest decline of their known existence and few tools are available to offset the growing impacts of human coastal and watershed activities. Biocriteria are a potentially effective means to evaluate and restore impaired waters, but are...

Evaluating a bedside tool for neuroanatomical localization with extended-matching questions.

PubMed

Tan, Kevin; Chin, Han Xin; Yau, Christine W L; Lim, Erle C H; Samarasekera, Dujeepa; Ponnamperuma, Gominda; Tan, Nigel C K

2018-05-06

Neuroanatomical localization (NL) is a key skill in neurology, but learners often have difficulty with it. This study aims to evaluate a concise NL tool (NLT) developed to help teach and learn NL. To evaluate the NLT, an extended-matching questions (EMQ) test to assess NL was designed and validated. The EMQ was validated with fourth-year medical students and internal medicine and neurology residents. The NLT's usability was evaluated with third- and fourth-year students, and the effectiveness was evaluated with an experimental study of second-year students, using the EMQ as the outcome measure. Students were taught how to use both the NLT and textbook algorithms (control) to perform NL, then randomized into either group, and only allowed to use their assigned tool to complete the EMQ. Primary outcome was the difference in mean EMQ scores expressed as a percentage of total score. For EMQ validation, students (n = 56) scored lower than residents (n = 50) (76.7% ± 1.7 vs. 83.0% ± 1.6; mean ± standard error of mean, P < 0.009). The EMQ demonstrated good reliability (Cronbach's α 0.85) and generalizability (G-coefficient 0.85). Third- (n = 77) and fourth-year (n = 42) students found the NLT user-friendly and helpful in their learning of NL. In the experimental study, scores were significantly higher for NLT group (n = 94) than for controls (n = 101) (42.5 vs. 37.0%, P = 0.014); the effect size (Cohen's d) was 0.36. The EMQ is validated to reliably assess NL and is generalizable, feasible, practical, and of low cost. The concise and user-friendly NLT for NL was effective in aiding medical student performance of NL. Anat Sci Educ 11: 262-269. © 2017 American Association of Anatomists. © 2017 American Association of Anatomists.

Testing, Modeling and System Impact of Metabolic Heat Regenerated Temperature Swing Adsorption

NASA Technical Reports Server (NTRS)

Lacomini, Christine S.; Powers, Aaron; Lewis, Matthew; Linrud, Christopher; Waguespack, Glenn; Conger, Bruce; Paul, Heather L.

2008-01-01

Metabolic heat regenerated temperature swing adsorption (MTSA) technology is being developed for removal and rejection of carbon dioxide (CO2) and heat from a portable life support system (PLSS) to the Martian environment. Previously, hardware was built and tested to demonstrate using heat from simulated, dry ventilation loop gas to affect the temperature swing required to regenerate an adsorbent used for CO2 removal. New testing has been performed using a moist, simulated ventilation loop gas to demonstrate the effects of water condensing and freezing in the heat exchanger during adsorbent regeneration. In addition, thermal models of the adsorbent during regeneration were modified and calibrated with test data to capture the effect of the CO2 heat of desorption. Finally, MTSA impact on PLSS design was evaluated by performing thermal balances assuming a specific PLSS architecture. Results using NASA s Extravehicular Activity System Sizing Analysis Tool (EVAS_SAT), a PLSS system evaluation tool, are presented.

Scenario Tools For Efficient Eutrophication Management

NASA Astrophysics Data System (ADS)

Arheimer, B.; Vastra SP3 Team

Several possible measures are available to reduce diffuse (non-point source) nutri- ent load to surface water and thereby reduce eutrophication. Such measures include changed arable practices and constructions of wetlands and buffer zones in the land- scape, as well as managing lake ecosystems. In some cases, such as for wetlands, there is an intense debate regarding the efficiency of their nutrient reducing capability. In ad- dition, the combined effect of several measures in a catchment is not necessarily equal to their sum. It is therefore important to apply a holistic and integrated catchment approach when applying and evaluating different management strategies. To facili- tate such catchment analyses, the Swedish water management research programme (VASTRA) develop modelling tools addressing both phosphorus (P) and nitrogen (N) dynamics in catchments. During the last three years decision support tools for N man- agement in rivers and lakes have been developed (e.g., HBV-N, BIOLA) and applied in scenarios to demonstrate the effect of various reducing measures. At present, similar tools for P are under development. This presentation will demonstrate the VASTRA tool-box and its applications for efficient eutrophication management.

The effect of cinnarizine and cocculus indicus on simulator sickness.

PubMed

Lucertini, Marco; Mirante, Nadia; Casagrande, Maria; Trivelloni, Pierandrea; Lugli, Vittoria

2007-05-16

Pensacola Simulator Sickness Questionnaire (SSQ) is a valuable method to analyse symptoms evoked by exposure to a flight simulator environment that can also be adopted to evaluate the effectiveness of preventive tools, aiming at reducing simulator sickness (SS). In this study we analysed SSQ data in subjects undergoing a standard ground based spatial disorientation training inside a flight simulator, in order to evaluate the SS prevention obtained with two different pharmacological tools. Twelve males volunteers participated to an experimental design based on a double-blind, balanced administration of either 30 mg cinnarizine (CIN), or Cocculus Indicus 6CH (COC), or placebo (PLC) before one trial of about one hour spent inside a spatial disorientation trainer. All subjects underwent the three different conditions (CIN, COC, PLC) during 3 non-consecutive days separated by at least 2 weeks. During each experimental day, all subjects filled in SSQ. In addition, both postural instability (with the use of a static stabilometric platform), and sleepiness symptoms were evaluated. All the tests were performed before and after the simulated flight, at different times, in one-and-half-hour intervals. Results indicated a strong increase of sickness after flight simulation that linearly decreased, showing pre-simulator scores after 1.30 hours. In contrast to both PLC and COC, CIN showed significant side effects immediately following flight simulation, with no benefit at the simultaneous SSQ scores. Globally, no highly significant differences between COC and PLC were observed, although a minor degree of postural instability could be detected after COC administration. As far as the present exposure to a simulator environment is concerned, none of the pharmacological tools administered in this study resulted effective in reducing SS symptoms as detected by the SSQ. Moreover, CIN significantly increased sleepiness and postural instability in most subjects.

Objective Assessment of Laparoscopic Force and Psychomotor Skills in a Novel Virtual Reality-Based Haptic Simulator.

PubMed

Prasad, M S Raghu; Manivannan, Muniyandi; Manoharan, Govindan; Chandramohan, S M

2016-01-01

Most of the commercially available virtual reality-based laparoscopic simulators do not effectively evaluate combined psychomotor and force-based laparoscopic skills. Consequently, the lack of training on these critical skills leads to intraoperative errors. To assess the effectiveness of the novel virtual reality-based simulator, this study analyzed the combined psychomotor (i.e., motion or movement) and force skills of residents and expert surgeons. The study also examined the effectiveness of real-time visual force feedback and tool motion during training. Bimanual fundamental (i.e., probing, pulling, sweeping, grasping, and twisting) and complex tasks (i.e., tissue dissection) were evaluated. In both tasks, visual feedback on applied force and tool motion were provided. The skills of the participants while performing the early tasks were assessed with and without visual feedback. Participants performed 5 repetitions of fundamental and complex tasks. Reaction force and instrument acceleration were used as metrics. Surgical Gastroenterology, Government Stanley Medical College and Hospital; Institute of Surgical Gastroenterology, Madras Medical College and Rajiv Gandhi Government General Hospital. Residents (N = 25; postgraduates and surgeons with <2 years of laparoscopic surgery) and expert surgeons (N = 25; surgeons with >4 and ≤10 years of laparoscopic surgery). Residents applied large forces compared with expert surgeons and performed abrupt tool movements (p < 0.001). However, visual + haptic feedback improved the performance of residents (p < 0.001). In complex tasks, visual + haptic feedback did not influence the applied force of expert surgeons, but influenced their tool motion (p < 0.001). Furthermore, in complex tissue sweeping task, expert surgeons applied more force, but were within the tissue damage limits. In both groups, exertion of large forces and abrupt tool motion were observed during grasping, probing or pulling, and tissue sweeping maneuvers (p < 0.001). Modern day curriculum-based training should evaluate the skills of residents with robust force and psychomotor-based exercises for proficient laparoscopy. Visual feedback on force and motion during training has the potential to enhance the learning curve of residents. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Evaluating selection and efficacy of pressure-relieving equipment.

PubMed

Chaloner, Donna; Stevens, Jenny

2003-06-01

The drive towards evidence-based practice has highlighted the lack of randomized controlled trials that compare interventions such as pressure-relieving medical devices. This may influence practitioners, particularly purchasing practitioners, to consider other types of evidence when appraising literature to determine clinical practice and support recommendations and local guidelines. This article will illustrate the development of an audit tool used to evaluate nurses' knowledge and skills in patient assessment, selection and installation of appropriate pressure-relieving equipment. The tool also assists in assessing clinical effectiveness and user satisfaction of equipment. This article focuses on a small audit of the Karomed Ltd Transair 1500 (also known as the 3-Comm) mattress replacement system.

Friction Stir Spot Welding of Advanced High Strength Steels

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hovanski, Yuri; Grant, Glenn J.; Santella, M. L.

Friction stir spot welding techniques were developed to successfully join several advanced high strength steels. Two distinct tool materials were evaluated to determine the effect of tool materials on the process parameters and joint properties. Welds were characterized primarily via lap shear, microhardness, and optical microscopy. Friction stir spot welds were compared to the resistance spot welds in similar strength alloys by using the AWS standard for resistance spot welding high strength steels. As further comparison, a primitive cost comparison between the two joining processes was developed, which included an evaluation of the future cost prospects of friction stir spotmore » welding in advanced high strength steels.« less

Print material as a public health education tool.

PubMed

Paul, C L; Redman, S; Sanson-Fisher, R W

1998-02-01

Despite the widespread use of print materials in public health education, little is known about the costs and processes involved in developing these materials and their effectiveness in practice. We examined a sample of printed health education materials, using interviews and checklists. The most cost-effective processes for developing materials were not being used and the effectiveness of materials was rarely evaluated.

The Anticipated Effects of Alcohol Scale: Development and Psychometric Evaluation of a Novel Assessment Tool for Measuring Alcohol Expectancies

ERIC Educational Resources Information Center

Morean, Meghan E.; Corbin, William R.; Treat, Teresa A.

2012-01-01

Alcohol expectancy (AEs) research has enhanced our understanding of how anticipated alcohol effects confer risk for heavy drinking and alcohol-related problems. However, extant AE measures have limitations within 1 or more of the following areas: assessing a comprehensive range of effects, specifying the hypothetical number of drinks consumed,…

A Cross-Sectional Descriptive Study of Graduate Students' Perceptions of Learning Effectiveness in Face-to-Face and Online Courses

ERIC Educational Resources Information Center

Evans, Nicole Stayton

2013-01-01

The measurement of student perceptions of learning effectiveness is often used as a tool at universities to enhance the quality of course offerings. The recent growth in online course offerings creates new challenges in evaluating learning effectiveness. This study used three principles of adult learning theory, foundation, self-concept, and…

Evaluation of a Life Skills Program to Prevent Adolescent Alcohol Use in Two European Countries: One-Year Follow-Up

ERIC Educational Resources Information Center

Giannotta, Fabrizia; Weichold, Karina

2016-01-01

Background: Life skills programs are effective tools to combat youth substance use. However there is a lack of studies concerning their effectiveness in Europe. Objective: This study investigated the 1 year follow up effects and the program implementation of a life skills school-based intervention (IPSY: Information + Psychosocial…

An Exploratory Factor Analysis of the Sheltered Instruction Observation Protocol as an Evaluation Tool to Measure Teaching Effectiveness

ERIC Educational Resources Information Center

Polat, Nihat; Cepik, Saban

2016-01-01

To narrow the achievement gap between English language learners (ELLs) and their native-speaking peers in K-12 settings in the United States, effective instructional models must be identified. However, identifying valid observation protocols that can measure the effectiveness of specially designed instructional practices is not an easy task. This…

Learning-by-Doing Teamwork KSA: The Role of Strategic Management Simulation

ERIC Educational Resources Information Center

Martín-Pérez, Víctor; Martín-Cruz, Natalia; Pérez-Santana, Pilar

2012-01-01

The objective of this paper is to evaluate the effectiveness of strategic management simulations as a learning-by-doing tool so that university students can learn to work in a team, that is, they can enhance their knowledge, skills, and abilities (KSA) for effective teamwork. The authors have carried out an analysis of the effect of strategic…

Enhancing a rainfall-runoff model to assess the impacts of BMPs and LID practices on storm runoff.

PubMed

Liu, Yaoze; Ahiablame, Laurent M; Bralts, Vincent F; Engel, Bernard A

2015-01-01

Best management practices (BMPs) and low impact development (LID) practices are increasingly being used as stormwater management techniques to reduce the impacts of urban development on hydrology and water quality. To assist planners and decision-makers at various stages of development projects (planning, implementation, and evaluation), user-friendly tools are needed to assess the effectiveness of BMPs and LID practices. This study describes a simple tool, the Long-Term Hydrologic Impact Assessment-LID (L-THIA-LID), which is enhanced with additional BMPs and LID practices, improved approaches to estimate hydrology and water quality, and representation of practices in series (meaning combined implementation). The tool was used to evaluate the performance of BMPs and LID practices individually and in series with 30 years of daily rainfall data in four types of idealized land use units and watersheds (low density residential, high density residential, industrial, and commercial). Simulation results were compared with the results of other published studies. The simulated results showed that reductions in runoff volume and pollutant loads after implementing BMPs and LID practices, both individually and in series, were comparable with the observed impacts of these practices. The L-THIA-LID 2.0 model is capable of assisting decision makers in evaluating environmental impacts of BMPs and LID practices, thereby improving the effectiveness of stormwater management decisions. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of an Innovative Tool for Child Sexual Abuse Education

ERIC Educational Resources Information Center

Davis, Deborah Winders; Pressley-McGruder, Gloria; Jones, V. Faye; Potter, Deborah; Rowland, Michael; Currie, Melissa; Gale, Bruce

2013-01-01

Child sexual abuse poses a serious threat to public health and is often unreported, unrecognized, and untreated. Prevention, early recognition, and treatment are critically important to reduce long-term effects. Little data are available on effective methods of preventing child sexual abuse. The current research demonstrates a unique approach to…

An Implementation of Active Learning: Assessing the Effectiveness of the Team Infomercial Assignment

ERIC Educational Resources Information Center

Matveev, Alexei V.; Milter, Richard G.

2010-01-01

This article examines the effectiveness of the team infomercial assignment as an active learning tool in undergraduate courses. The structure and three phases of the team infomercial assignment, as well as student evaluations and feedback, are presented. We investigated student experiences working on the team infomercial assignment, the common…

Bayesian belief networks: applications in ecology and natural resource management.

Treesearch

R.K. McCann; B.G. Marcot; R. Ellis

2006-01-01

We review the use of Bayesian belief networks (BBNs) in natural resource management and ecology. We suggest that BBNs are useful tools for representing expert knowledge of a system, evaluating potential effects of alternative management decisions, and communicating to nonexperts about resource decision issues. BBNs can be used effectively to represent uncertainty in...

Evaluating Effectiveness of Pair Programming as a Teaching Tool in Programming Courses

ERIC Educational Resources Information Center

Faja, Silvana

2014-01-01

This study investigates the effectiveness of pair programming on student learning and satisfaction in introductory programming courses. Pair programming, used in the industry as a practice of an agile development method, can be adopted in classroom settings to encourage peer learning, increase students' social skills, and enhance student…