Development and Early Piloting of a CanMEDS Competency-Based Feedback Tool for Surgical Grand Rounds.

PubMed

Fahim, Christine; Bhandari, Mohit; Yang, Ilun; Sonnadara, Ranil

2016-01-01

Grand rounds offer an excellent opportunity for the evaluation of medical expertise, and other competencies, such as communication and professionalism. The purpose of this study was to develop a tool that would facilitate the provision of formative feedback for grand rounds to improve learning. The resulting CanMEDS-based evaluation tool was piloted in an academic surgical department. This study employed the use of a 3-phase, qualitatively-focused, embedded mixed methods approach. In Phase 1, an intrinsic case study was conducted to identify preliminary themes. These findings were crystallized using a quantitative survey. Following interpretation of these data, a grand rounds evaluation tool was developed in Phase 2. The tool was piloted in the Phase 3 focus group. This study was piloted at an academic surgical center among members of the Department of Surgery, McMaster University, Ontario, Canada. Purposive sampling was used for this study. A total of n = 7 individuals participated in the Phase 1 interviews, and n = 24 participants completed the Phase 1 survey. Participants included a representative sample of medical students, residents, fellows, and staff. The tool was piloted among n = 19 participants. The proposed evaluation tool contains 13 Likert-scale questions and 2 open-ended questions. The tool outlines specific questions to assess grand rounds presenters within the structure of the 7 CanMEDS competency domains. "Evaluation fatigue" was identified as a major barrier in the willingness to provide effective feedback. Further, a number of factors regarding the preferred content, structure, and format of surgical grand rounds were identified. This pilot study presents a CanMEDS-specific evaluation tool that can be applied to surgical grand rounds. With the increasing adoption of competency-based medical education, comprehensive evaluation of surgical activities is required. This form provides a template for the development of competency-based evaluation tools for medical and surgical learning activities. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Planning Tool for Strategic Evaluation of Facility Plans - 13570

DOE Office of Scientific and Technical Information (OSTI.GOV)

Magoulas, Virginia; Cercy, Michael; Hall, Irin

2013-07-01

Savannah River National Laboratory (SRNL) has developed a strategic planning tool for the evaluation of the utilization of its unique resources for processing and research and development of nuclear materials. The Planning Tool is a strategic level tool for assessing multiple missions that could be conducted utilizing the SRNL facilities and showcasing the plan. Traditional approaches using standard scheduling tools and laying out a strategy on paper tended to be labor intensive and offered either a limited or cluttered view for visualizing and communicating results. A tool that can assess the process throughput, duration, and utilization of the facility wasmore » needed. SRNL teamed with Newport News Shipbuilding (NNS), a division of Huntington Ingalls Industries, to create the next generation Planning Tool. The goal of this collaboration was to create a simulation based tool that allows for quick evaluation of strategies with respect to new or changing missions, and clearly communicates results to the decision makers. This tool has been built upon a mature modeling and simulation software previously developed by NNS. The Planning Tool provides a forum for capturing dependencies, constraints, activity flows, and variable factors. It is also a platform for quickly evaluating multiple mission scenarios, dynamically adding/updating scenarios, generating multiple views for evaluating/communicating results, and understanding where there are areas of risks and opportunities with respect to capacity. The Planning Tool that has been developed is useful in that it presents a clear visual plan for the missions at the Savannah River Site (SRS). It not only assists in communicating the plans to SRS corporate management, but also allows the area stakeholders a visual look at the future plans for SRS. The design of this tool makes it easily deployable to other facility and mission planning endeavors. (authors)« less

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

Analysis Tools for CFD Multigrid Solvers

NASA Technical Reports Server (NTRS)

Mineck, Raymond E.; Thomas, James L.; Diskin, Boris

2004-01-01

Analysis tools are needed to guide the development and evaluate the performance of multigrid solvers for the fluid flow equations. Classical analysis tools, such as local mode analysis, often fail to accurately predict performance. Two-grid analysis tools, herein referred to as Idealized Coarse Grid and Idealized Relaxation iterations, have been developed and evaluated within a pilot multigrid solver. These new tools are applicable to general systems of equations and/or discretizations and point to problem areas within an existing multigrid solver. Idealized Relaxation and Idealized Coarse Grid are applied in developing textbook-efficient multigrid solvers for incompressible stagnation flow problems.

Professional Development through Organizational Assessment: Using APPA's Facilities Management Evaluation Program

ERIC Educational Resources Information Center

Medlin, E. Lander; Judd, R. Holly

2013-01-01

APPA's Facilities Management Evaluation Program (FMEP) provides an integrated system to optimize organizational performance. The criteria for evaluation not only provide a tool for organizational continuous improvement, they serve as a compelling leadership development tool essential for today's facilities management professional. The senior…

Development of a Self-Report Tool to Evaluate Hearing Aid Outcomes among Chinese Speakers

ERIC Educational Resources Information Center

Wong, Lena L. N.; Hang, Na

2014-01-01

Purpose: This article reports on the development of a self-report tool--the Chinese Hearing Aid Outcomes Questionnaire (CHAOQ)--to evaluate hearing aid outcomes among Chinese speakers. Method: There were 4 phases to construct the CHAOQ and evaluate its psychometric properties. First, items were selected to evaluate a range of culturally relevant…

Development and field testing of a decision support tool to facilitate shared decision making in contraceptive counseling.

PubMed

Dehlendorf, Christine; Fitzpatrick, Judith; Steinauer, Jody; Swiader, Lawrence; Grumbach, Kevin; Hall, Cara; Kuppermann, Miriam

2017-07-01

We developed and formatively evaluated a tablet-based decision support tool for use by women prior to a contraceptive counseling visit to help them engage in shared decision making regarding method selection. Drawing upon formative work around women's preferences for contraceptive counseling and conceptual understanding of health care decision making, we iteratively developed a storyboard and then digital prototypes, based on best practices for decision support tool development. Pilot testing using both quantitative and qualitative data and cognitive testing was conducted. We obtained feedback from patient and provider advisory groups throughout the development process. Ninety-six percent of women who used the tool in pilot testing reported that it helped them choose a method, and qualitative interviews indicated acceptability of the tool's content and presentation. Compared to the control group, women who used the tool demonstrated trends toward increased likelihood of complete satisfaction with their method. Participant responses to cognitive testing were used in tool refinement. Our decision support tool appears acceptable to women in the family planning setting. Formative evaluation of the tool supports its utility among patients making contraceptive decisions, which can be further evaluated in a randomized controlled trial. Copyright © 2017 Elsevier B.V. All rights reserved.

Digital Discernment: An E-Commerce Web Site Evaluation Tool

ERIC Educational Resources Information Center

Sigman, Betsy Page; Boston, Brian J.

2013-01-01

Students entering the business workforce today may well share some responsibility for developing, revising, or evaluating their company's Web site. They may lack the experience, however, to critique their employer's Web presence effectively. The purpose of developing Digital Discernment, an e-commerce Web site evaluation tool, was to prepare…

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

iSELF: The Development of an Internet-Tool for Self-Evaluation and Learner Feedback

ERIC Educational Resources Information Center

Theunissen, Nicolet; Stubbé, Hester

2014-01-01

This paper describes the theoretical basis and development of the iSELF: an Internet-tool for Self-Evaluation and Learner Feedback to stimulate self-directed learning in ubiquitous learning environments. In ubiquitous learning, learners follow their own trails of interest, scaffolded by coaches, peers and tools for thinking and learning.…

Evaluating online diagnostic decision support tools for the clinical setting.

PubMed

Pryor, Marie; White, David; Potter, Bronwyn; Traill, Roger

2012-01-01

Clinical decision support tools available at the point of care are an effective adjunct to support clinicians to make clinical decisions and improve patient outcomes. We developed a methodology and applied it to evaluate commercially available online clinical diagnostic decision support (DDS) tools for use at the point of care. We identified 11 commercially available DDS tools and assessed these against an evaluation instrument that included 6 categories; general information, content, quality control, search, clinical results and other features. We developed diagnostically challenging clinical case scenarios based on real patient experience that were commonly missed by junior medical staff. The evaluation was divided into 2 phases; an initial evaluation of all identified and accessible DDS tools conducted by the Clinical Information Access Portal (CIAP) team and a second phase that further assessed the top 3 tools identified in the initial evaluation phase. An evaluation panel consisting of senior and junior medical clinicians from NSW Health conducted the second phase. Of the eleven tools that were assessed against the evaluation instrument only 4 tools completely met the DDS definition that was adopted for this evaluation and were able to produce a differential diagnosis. From the initial phase of the evaluation 4 DDS tools scored 70% or more (maximum score 96%) for the content category, 8 tools scored 65% or more (maximum 100%) for the quality control category, 5 tools scored 65% or more (maximum 94%) for the search category, and 4 tools score 70% or more (maximum 81%) for the clinical results category. The second phase of the evaluation was focused on assessing diagnostic accuracy for the top 3 tools identified in the initial phase. Best Practice ranked highest overall against the 6 clinical case scenarios used. Overall the differentiating factor between the top 3 DDS tools was determined by diagnostic accuracy ranking, ease of use and the confidence and credibility of the clinical information. The evaluation methodology used here to assess the quality and comprehensiveness of clinical DDS tools was effective in identifying the most appropriate tool for the clinical setting. The use of clinical case scenarios is fundamental in determining the diagnostic accuracy and usability of the tools.

Development and Validation of the Controller Acceptance Rating Scale (CARS): Results of Empirical Research

NASA Technical Reports Server (NTRS)

Lee, Katharine K.; Kerns, Karol; Bone, Randall

2001-01-01

The measurement of operational acceptability is important for the development, implementation, and evolution of air traffic management decision support tools. The Controller Acceptance Rating Scale was developed at NASA Ames Research Center for the development and evaluation of the Passive Final Approach Spacing Tool. CARS was modeled after a well-known pilot evaluation rating instrument, the Cooper-Harper Scale, and has since been used in the evaluation of the User Request Evaluation Tool, developed by MITRE's Center for Advanced Aviation System Development. In this paper, we provide a discussion of the development of CARS and an analysis of the empirical data collected with CARS to examine construct validity. Results of intraclass correlations indicated statistically significant reliability for the CARS. From the subjective workload data that were collected in conjunction with the CARS, it appears that the expected set of workload attributes was correlated with the CARS. As expected, the analysis also showed that CARS was a sensitive indicator of the impact of decision support tools on controller operations. Suggestions for future CARS development and its improvement are also provided.

Development of a Design Tool for Planning Aqueous Amendment Injection Systems

DTIC Science & Technology

2012-08-01

Chemical Oxidation with Permanganate (MnO4- ) ...................................... 2 1.4 IMPLEMENTATION ISSUES...17 6.4 SS DESIGN TOOL DEVELOPMENT AND EVALUATION ........................... 19 7.0 CHEMICAL OXIDATION WITH PERMANGANATE ...21 7.1 NUMERICAL MODELING OF PERMANGANATE DISTRIBUTION ........... 21 7.2 CDISCO DEVELOPMENT AND EVALUATION

Assessment of a human computer interface prototyping environment

NASA Technical Reports Server (NTRS)

Moore, Loretta A.

1993-01-01

A Human Computer Interface (HCI) prototyping environment with embedded evaluation capability has been successfully assessed which will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. The HCI prototyping environment is designed to include four components: (1) a HCI format development tool, (2) a test and evaluation simulator development tool, (3) a dynamic, interactive interface between the HCI prototype and simulator, and (4) an embedded evaluation capability to evaluate the adequacy of an HCI based on a user's performance.

Programming Tools: Status, Evaluation, and Comparison

NASA Technical Reports Server (NTRS)

Cheng, Doreen Y.; Cooper, D. M. (Technical Monitor)

1994-01-01

In this tutorial I will first describe the characteristics of scientific applications and their developers, and describe the computing environment in a typical high-performance computing center. I will define the user requirements for tools that support application portability and present the difficulties to satisfy them. These form the basis of the evaluation and comparison of the tools. I will then describe the tools available in the market and the tools available in the public domain. Specifically, I will describe the tools for converting sequential programs, tools for developing portable new programs, tools for debugging and performance tuning, tools for partitioning and mapping, and tools for managing network of resources. I will introduce the main goals and approaches of the tools, and show main features of a few tools in each category. Meanwhile, I will compare tool usability for real-world application development and compare their different technological approaches. Finally, I will indicate the future directions of the tools in each category.

Computer-Based Tools for Evaluating Graphical User Interfaces

NASA Technical Reports Server (NTRS)

Moore, Loretta A.

1997-01-01

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Validation of a Tool Evaluating Educational Apps for Smart Education

ERIC Educational Resources Information Center

Lee, Jeong-Sook; Kim, Sung-Wan

2015-01-01

The purpose of this study is to develop and validate an evaluation tool of educational apps for smart education. Based on literature reviews, a potential model for evaluating educational apps was suggested. An evaluation tool consisting of 57 survey items was delivered to 156 students in middle and high schools. An exploratory factor analysis was…

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

Development, Evaluation, and Validation of Environmental Assessment Tools to Evaluate the College Nutrition Environment

ERIC Educational Resources Information Center

Freedman, Marjorie R.

2010-01-01

Objective: To develop, evaluate, and validate 2 nutrition environment assessment tools (surveys), for specific use in combating overweight on college/university campuses. Participants and Methods: Invitations to complete surveys were e-mailed to food service and health center directors at 47 universities, Winter 2008. Overall response rate was…

Developing a consumer evaluation tool of weight control strategy advertisements on the Internet.

PubMed

Luevorasirikul, Kanokrat; Gray, Nicola J; Anderson, Claire W

2008-06-01

To develop two evaluation tools for weight loss and weight gain advertisements on the Internet in order to help consumers to evaluate the quality of information within these advertisements. One hundred websites identified by Internet search engines for weight loss and weight gain strategies (50 websites each) were evaluated using two specific scoring instruments, developed by adapting questions from the 'DISCERN' tool and reviewing all related weight control guidelines and advertising regulations. The validity and reliability of the adapted tools were tested. Our evaluation tools rated the information from most websites as poor quality (70%). In the case of weight loss strategies, statements about rapid (18%) and permanent (28%) weight loss caused concern as well as lack of sensible advice about dieting and a lack of product warnings (84%). Safety concerns relating to weight gain products were the lack of warnings about side effects in products containing steroids and creatine (92%). The adapted tools exhibited acceptable validity and reliability. Quality of information within weight control advertisements on the Internet was generally poor. Problems of false claims, little advice on healthy ways to modify weight and few warnings on side effects have been highlighted in this study.

The development and evaluation of the Screening Tool for the Assessment of Malnutrition in Paediatrics (STAMP©) for use by healthcare staff.

PubMed

McCarthy, H; Dixon, M; Crabtree, I; Eaton-Evans, M J; McNulty, H

2012-08-01

The early identification of malnutrition and nutrition risk through nutrition screening is common practice in adult clinical care but, in children, this has been hampered by the lack of an appropriate nutrition screening tool. The present study aimed to develop and evaluate a simple, child-specific nutrition screening tool for administration by non-nutrition healthcare professionals. In a two-phase observational study, significant predictors of nutrition risk were identified using a structured questionnaire. These were then combined to produce a nutrition screening tool. For evaluation purposes, the reliability, sensitivity and specificity of the newly-developed Screening Tool for the Assessment of Malnutrition in Paediatrics (STAMP(©)) were estimated by comparing the classification of nutrition risk using the tool with that determined by a full nutritional assessment by a registered dietitian. A total of 122 children were recruited for development phase and a separate cohort of 238 children was recruited for the evaluation phase. Low percentile weight for age, reported weight loss, discrepancy between weight and height percentile and recently changed appetite were all identified as predictors of nutrition risk. These predictors, together with the expected nutrition risk of clinical diagnoses, were combined to produce STAMP(©). Evaluation of STAMP(©) demonstrated fair to moderate reliability in identifying nutrition risk compared to the nutrition risk classification determined by a registered dietitian (κ = 0.541; 95% confidence interval = 0.461-0.621). Sensitivity and specificity were estimated at 70% (51-84%) and 91% (86-94%), respectively. The present study describes the development and evaluation of a new nutrition screening tool specifically for use in a UK general paediatric inpatient population. © 2012 The Authors. Journal of Human Nutrition and Dietetics © 2012 The British Dietetic Association Ltd.

Multi-modal virtual environment research at Armstrong Laboratory

NASA Technical Reports Server (NTRS)

Eggleston, Robert G.

1995-01-01

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

Assessment Tools for Evaluation of Oral Feeding in Infants Younger Than 6 Months.

PubMed

Pados, Britt F; Park, Jinhee; Estrem, Hayley; Awotwi, Araba

2016-04-01

Feeding difficulty is common in infants younger than 6 months. Identification of infants in need of specialized treatment is critical to ensure appropriate nutrition and feeding skill development. Valid and reliable assessment tools help clinicians objectively evaluate feeding. To identify and evaluate assessment tools available for clinical assessment of bottle- and breastfeeding in infants younger than 6 months. CINAHL, HaPI, PubMed, and Web of Science were searched for "infant feeding" and "assessment tool." The literature (n = 237) was reviewed for relevant assessment tools. A secondary search was conducted in CINAHL and PubMed for additional literature on identified tools. Eighteen assessment tools met inclusion criteria. Of these, 7 were excluded because of limited available literature or because they were intended for use with a specific diagnosis or in research only. There are 11 assessment tools available for clinical practice. Only 2 of these were intended for bottle-feeding. All 11 indicated that they were appropriate for use with breastfeeding. None of the available tools have adequate psychometric development and testing. All of the tools should be used with caution. The Early Feeding Skills Assessment and Bristol Breastfeeding Assessment Tool had the most supportive psychometric development and testing. Feeding assessment tools need to be developed and tested to guide optimal clinical care of infants from birth through 6 months. A tool that assesses both bottle- and breastfeeding would allow for consistent assessment across feeding methods.

A Program Evaluation Tool for Dual Enrollment Transition Programs

ERIC Educational Resources Information Center

Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

2012-01-01

This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

Prioritizing guideline topics: development and evaluation of a practical tool.

PubMed

Ketola, Eeva; Toropainen, Erja; Kaila, Minna; Luoto, Riitta; Mäkelä, Marjukka

2007-08-01

A clear process for selecting and adopting clinical practice guidelines in the new topic areas is needed. The aim of this study is to design and develop a practical tool to assess guideline topics that have been suggested to the organization responsible for producing guidelines. We carried out an iterative development, feasibility and validation study of a guideline topic prioritization tool. The setting included the guideline producer organization and the tax-funded health care system. In the first stage of the tool development, participants were researchers, members of the Current Care Board and experts from health care organizations. In the second stage, the evaluation was done internally within the project by three independent reviewers. The main outcome measures were responses to an evaluation questionnaire, qualitative process feedback and analysis of the performance of the instrument on a random set of guidelines. Evaluations by three independent reviewers revealed good agreement and face validity with respect to its feasibility as a planning tool at the guideline board level. Feedback from board members suggested that the instrument is useful in prioritizing guideline topics. This instrument was accepted for use by the Board. Further developments are needed to ensure feedback and acceptability of the instrument by those proposing topics.

Writing Development in Secondary/Post Secondary Language Learning: Integrating Multiple Motivating Factors, Explanatory Feedback, and Explanatory Writing Tools to Increase Competence and Confidence in Writing

ERIC Educational Resources Information Center

Jefferson, Trevina

2013-01-01

Background: This study discusses data-driven results of newly-developed writing tools that are objective, easy, and less time-consuming than standard classroom writing strategies; additionally, multiple motivation triggers and peer evaluation are evaluated together with these new, modernized writing tools. The results are explained separately and…

The nature and evaluation of commercial expert system building tools, revision 1

NASA Technical Reports Server (NTRS)

Gevarter, William B.

1987-01-01

This memorandum reviews the factors that constitute an Expert System Building Tool (ESBT) and evaluates current tools in terms of these factors. Evaluation of these tools is based on their structure and their alternative forms of knowledge representation, inference mechanisms and developer end-user interfaces. Next, functional capabilities, such as diagnosis and design, are related to alternative forms of mechanization. The characteristics and capabilities of existing commercial tools are then reviewed in terms of these criteria.

Number and type of guideline implementation tools varies by guideline, clinical condition, country of origin, and type of developer organization: content analysis of guidelines.

PubMed

Liang, Laurel; Abi Safi, Jhoni; Gagliardi, Anna R

2017-11-15

Guideline implementation tools (GI tools) can improve clinician behavior and patient outcomes. Analyses of guidelines published before 2010 found that many did not offer GI tools. Since 2010 standards, frameworks and instructions for GI tools have emerged. This study analyzed the number and types of GI tools offered by guidelines published in 2010 or later. Content analysis and a published GI tool framework were used to categorize GI tools by condition, country, and type of organization. English-language guidelines on arthritis, asthma, colorectal cancer, depression, diabetes, heart failure, and stroke management were identified in the National Guideline Clearinghouse. Screening and data extraction were in triplicate. Findings were reported with summary statistics. Eighty-five (67.5%) of 126 eligible guidelines published between 2010 and 2017 offered one or more of a total of 464 GI tools. The mean number of GI tools per guideline was 5.5 (median 4.0, range 1 to 28) and increased over time. The majority of GI tools were for clinicians (239, 51.5%), few were for patients (113, 24.4%), and fewer still were to support implementation (66, 14.3%) or evaluation (46, 9.9%). Most clinician GI tools were guideline summaries (116, 48.5%), and most patient GI tools were condition-specific information (92, 81.4%). Government agencies (patient 23.5%, clinician 28.9%, implementation 24.1%, evaluation 23.5%) and developers in the UK (patient 18.5%, clinician 25.2%, implementation 27.2%, evaluation 29.1%) were more likely to generate guidelines that offered all four types of GI tools. Professional societies were more likely to generate guidelines that included clinician GI tools. Many guidelines do not include any GI tools, or a variety of GI tools for different stakeholders that may be more likely to prompt guideline uptake (point-of-care forms or checklists for clinicians, decision-making or self-management tools for patients, implementation and evaluation tools for managers and policy-makers). While this may vary by country and type of organization, and suggests that developers could improve the range of GI tools they develop, further research is needed to identify determinants and potential solutions. Research is also needed to examine the cost-effectiveness of various types of GI tools so that developers know where to direct their efforts and scarce resources.

The Development and Implementation of the Kennedy Space Center Umbilical Clearance Tool

NASA Technical Reports Server (NTRS)

Chesnutt, David

2016-01-01

In preparation for NASAs upcoming Space Launch System program, the Kennedy Space Center is currently developing subsystems to provide fuel, purges and communications to the flight vehicle, known as umbilicals. It is vital to the crew and mission that these umbilicals release at T-0 without re-contacting the vehicle as it is accelerating from the launch pad. To help ensure this requirement is met by the program, a methodology of evaluating the moving bodies was developed and implemented into a tool using MATLAB. The tool, known as the KSC Umbilical Clearance Tool, takes a given elevation of interest and an umbilical retract profile within the plane to evaluate the clearance between the umbilical arm and thousands of independent flight vehicle drift profiles from a Monte Carlo analysis. The presentation will delve into the challenges associated with developing and implementing the tool framed in the context of evaluating the clearance for one of the SLS umbilicals.

Evaluating radiographers' diagnostic accuracy in screen-reading mammograms: what constitutes a quality study?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Debono, Josephine C, E-mail: josephine.debono@bci.org.au; Poulos, Ann E; Westmead Breast Cancer Institute, Westmead, New South Wales

The aim of this study was to first evaluate the quality of studies investigating the diagnostic accuracy of radiographers as mammogram screen-readers and then to develop an adapted tool for determining the quality of screen-reading studies. A literature search was used to identify relevant studies and a quality evaluation tool constructed by combining the criteria for quality of Whiting, Rutjes, Dinnes et al. and Brealey and Westwood. This constructed tool was then applied to the studies and subsequently adapted specifically for use in evaluating quality in studies investigating diagnostic accuracy of screen-readers. Eleven studies were identified and the constructed toolmore » applied to evaluate quality. This evaluation resulted in the identification of quality issues with the studies such as potential for bias, applicability of results, study conduct, reporting of the study and observer characteristics. An assessment of the applicability and relevance of the tool for this area of research resulted in adaptations to the criteria and the development of a tool specifically for evaluating diagnostic accuracy in screen-reading. This tool, with further refinement and rigorous validation can make a significant contribution to promoting well-designed studies in this important area of research and practice.« less

Development of a tailored strategy to improve postpartum hemorrhage guideline adherence.

PubMed

de Visser, Suzan M; Woiski, Mallory D; Grol, Richard P; Vandenbussche, Frank P H A; Hulscher, Marlies E J L; Scheepers, Hubertina C J; Hermens, Rosella P M G

2018-02-08

Despite the introduction of evidence based guidelines and practical courses, the incidence of postpartum hemorrhage shows an increasing trend in developed countries. Substandard care is often found, which implies an inadequate implementation in high resource countries. We aimed to reduce the gap between evidence-based guidelines and clinical application, by developing a strategy, tailored to current barriers for implementation. The development of the implementation strategy consisted of three phases, supervised by a multidisciplinary expert panel. In the first phase a framework of the strategy was created, based on barriers to optimal adherence identified among professionals and patients together with evidence on effectiveness of strategies found in literature. In the second phase, the tools within the framework were developed, leading to a first draft. In the third phase the strategy was evaluated among professionals and patients. The professionals were asked to give written feedback on tool contents, clinical usability and inconsistencies with current evidence care. Patients evaluated the tools on content and usability. Based on the feedback of both professionals and patients the tools were adjusted. We developed a tailored strategy to improve guideline adherence, covering the trajectory of the third trimester of pregnancy till the end of the delivery. The strategy, directed at professionals, comprehending three stop moments includes a risk assessment checklist, care bundle and time-out procedure. As patient empowerment tools, a patient passport and a website with patient information was developed. The evaluation among the expert panel showed all professionals to be satisfied with the content and usability and no discrepancies or inconsistencies with current evidence was found. Patients' evaluation revealed that the information they received through the tools was incomplete. The tools were adjusted accordingly to the missing information. A usable, tailored strategy to implement PPH guidelines and practical courses was developed. The next step is the evaluation of the strategy in a feasibility trial. Clinical trial registration: The Fluxim study, registration number: NCT00928863 .

STRESSED SEBATES: A TRAIT-BASED EVALUATION OF CLIMATE RISKS TO ROCKFISHES OF THE NORTHEASTERN PACIFIC USING THE COASTAL BIOGEOGRAPHIC RISK ANALYSIS TOOL (CBRAT)

EPA Science Inventory

The EPA and USGS have developed a framework to evaluate the relative vulnerability of near-coastal species to impacts of climate change. This framework is implemented in a web-based tool, the Coastal Biogeographic Risk Analysis Tool (CBRAT). We evaluated the vulnerability of the ...

Stressed Sebastes: A Trait-Based Evaluation of Climate Risks to Rockfishes of the Northeastern Pacific Using the Coastal Biogeographic Risk Analysis Tool (CBRAT)

EPA Science Inventory

The EPA and USGS have developed a framework to evaluate the relative vulnerability of near-coastal species to impacts of climate change. This framework was implemented in a web-based tool, the Coastal Biogeographic Risk Analysis Tool (CBRAT). We evaluated the vulnerability of the...

Stage Separation CFD Tool Development and Evaluation

NASA Technical Reports Server (NTRS)

Droege, Alan; Gomez, Reynaldo; Wang, Ten-See

2002-01-01

This viewgraph presentation evaluates CFD (Computational Fluid Dynamics) tools for solving stage separation problems. The demonstration and validation of the tools is for a second generation RLV (Reusable Launch Vehicle) stage separation. The flow solvers are: Cart3D; Overflow/Overflow-D; Unic.

Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites

PubMed Central

Steinwachs, Donald; Rubin, Haya R

2003-01-01

Background Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness. Objective This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality. Methods An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness. Results Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80. Conclusions Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information. PMID:14713658

Assessment Tools for Evaluation of Oral Feeding in Infants Less than Six Months Old

PubMed Central

Pados, Britt F.; Park, Jinhee; Estrem, Hayley; Awotwi, Araba

2015-01-01

Background Feeding difficulty is common in infants less than six months old. Identification of infants in need of specialized treatment is critical to ensure appropriate nutrition and feeding skill development. Valid and reliable assessment tools help clinicians objectively evaluate feeding. Purpose To identify and evaluate assessment tools available for clinical assessment of bottle- and breast-feeding in infants less than six months old. Methods/Search Strategy CINAHL, HaPI, PubMed, and Web of Science were searched for “infant feeding” and “assessment tool.” The literature (n=237) was reviewed for relevant assessment tools. A secondary search was conducted in CINAHL and PubMed for additional literature on identified tools. Findings/Results Eighteen assessment tools met inclusion criteria. Of these, seven were excluded because of limited available literature or because they were intended for use with a specific diagnosis or in research only. There are 11 assessment tools available for clinical practice. Only two of these were intended for bottle-feeding. All 11 indicated they were appropriate for use with breast-feeding. None of the available tools have adequate psychometric development and testing. Implications for Practice All of the tools should be used with caution. The Early Feeding Skills Assessment and Bristol Breastfeeding Assessment Tool had the most supportive psychometric development and testing. Implications for Research Feeding assessment tools need to be developed and tested to guide optimal clinical care of infants from birth through six months. A tool that assesses both bottle- and breast-feeding would allow for consistent assessment across feeding methods. PMID:26945280

The guideline implementability research and application network (GIRAnet): an international collaborative to support knowledge exchange: study protocol.

PubMed

Gagliardi, Anna R; Brouwers, Melissa C; Bhattacharyya, Onil K

2012-04-02

Modifying the format and content of guidelines may facilitate their use and lead to improved quality of care. We reviewed the medical literature to identify features desired by different users and associated with guideline use to develop a framework of implementability and found that most guidelines do not contain these elements. Further research is needed to develop and evaluate implementability tools. We are launching the Guideline Implementability Research and Application Network (GIRAnet) to enable the development and testing of implementability tools in three domains: Resource Implications, Implementation, and Evaluation. Partners include the Guidelines International Network (G-I-N) and its member guideline developers, implementers, and researchers. In phase one, international guidelines will be examined to identify and describe exemplar tools. Indication-specific and generic tools will populate a searchable repository. In phase two, qualitative analysis of cognitive interviews will be used to understand how developers can best integrate implementability tools in guidelines and how health professionals use them for interpreting and applying guidelines. In phase three, a small-scale pilot test will assess the impact of implementability tools based on quantitative analysis of chart-based behavioural outcomes and qualitative analysis of interviews with participants. The findings will be used to plan a more comprehensive future evaluation of implementability tools. Infrastructure funding to establish GIRAnet will be leveraged with the in-kind contributions of collaborating national and international guideline developers to advance our knowledge of implementation practice and science. Needs assessment and evaluation of GIRAnet will provide a greater understanding of how to develop and sustain such knowledge-exchange networks. Ultimately, by facilitating use of guidelines, this research may lead to improved delivery and outcomes of patient care.

Development and Validation of the Texas Best Management Practice Evaluation Tool (TBET)

USDA-ARS?s Scientific Manuscript database

Conservation planners need simple yet accurate tools to predict sediment and nutrient losses from agricultural fields to guide conservation practice implementation and increase cost-effectiveness. The Texas Best management practice Evaluation Tool (TBET), which serves as an input/output interpreter...

A tool kit for evaluating electronic flight bags

DOT National Transportation Integrated Search

2006-09-01

Over the past few years, the Volpe Center has developed a set of five tools that can be used to evaluate Electronic Flight Bags (EFBs) from a human factors perspective. The goal of these tools is to help streamline and standardize EFB human factors a...

The development of a multidisciplinary fall risk evaluation tool for demented nursing home patients in the Netherlands.

PubMed

Neyens, Jacques C L; Dijcks, Béatrice P J; van Haastregt, Jolanda C M; de Witte, Luc P; van den Heuvel, Wim J A; Crebolder, Harry F J M; Schols, Jos M G A

2006-03-21

Demented nursing home patients are at high risk for falls. Falls and associated injuries can have a considerable influence on the autonomy and quality of life of patients. The prevention of falls among demented patients is therefore an important issue. In order to intervene in an efficient way in this group of patients, it is important to systematically evaluate the fall risk profile of each individual patient so that for each patient tailor-made preventive measures can be taken. Therefore, the objective of the present study is to develop a feasible and evidence based multidisciplinary fall risk evaluation tool to be used for tailoring preventive interventions to the needs of individual demented patients. To develop this multidisciplinary fall risk evaluation tool we have chosen to combine scientific evidence on the one hand and experts' opinions on the other hand. Firstly, relevant risk factors for falling in elderly persons were gathered from the literature. Secondly, a group of Dutch experts in the field of falls and fall prevention in the elderly were consulted to judge the suitability of these risk factors for use in a multidisciplinary fall risk evaluation tool for demented nursing home patients. Thirdly, in order to generate a compact list of the most relevant risk factors for falling in demented elderly, all risk factors had to fulfill a set of criteria indicating their relevance for this specific target population. Lastly the final list of risk factors resulting from the above mentioned procedure was presented to the expert group. The members were also asked to give their opinion about the practical use of the tool. The multidisciplinary fall risk evaluation tool we developed includes the following items: previous falls, use of medication, locomotor functions, and (correct) choice and use of assistive and protective devices. The tool is developed for the multidisciplinary teams of the nursing homes. This evidence and practice based multidisciplinary fall risk evaluation tool targets the preventive interventions aimed to prevent falls and their negative consequences in demented nursing home patients.

Current State and Model for Development of Technology-Based Care for Attention Deficit Hyperactivity Disorder.

PubMed

Benyakorn, Songpoom; Riley, Steven J; Calub, Catrina A; Schweitzer, Julie B

2016-09-01

Care (i.e., evaluation and intervention) delivered through technology is used in many areas of mental health services, including for persons with attention deficit hyperactivity disorder (ADHD). Technology can facilitate care for individuals with ADHD, their parents, and their care providers. The adoption of technological tools for ADHD care requires evidence-based studies to support the transition from development to integration into use in the home, school, or work for persons with the disorder. The initial phase, which is development of technological tools, has begun in earnest; however, the evidence base for many of these tools is lacking. In some instances, the uptake of a piece of technology into home use or clinical practice may be further along than the research to support its use. In this study, we review the current evidence regarding technology for ADHD and also propose a model to evaluate the support for other tools that have yet to be tested. We propose using the Research Domain Criteria as a framework for evaluating the tools' relationships to dimensions related to ADHD. This article concludes with recommendations for testing new tools that may have promise in improving the evaluation or treatment of persons with ADHD.

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

Tools and Metrics for Environmental Sustainability

EPA Science Inventory

Within the U.S. Environmental Protection Agency’s Office of Research and Development the National Risk Management Research Laboratory has been developing tools to help design and evaluate chemical processes with a life cycle perspective. These tools include the Waste Reduction (...

Development of EUV mask handling technology at MIRAI-Selete

NASA Astrophysics Data System (ADS)

Ota, Kazuya; Amemiya, Mitsuaki; Taguchi, Takao; Kamono, Takashi; Kubo, Hiroyoshi; Takikawa, Tadahiko; Usui, Yoichi; Suga, Osamu

2007-03-01

We, MIRAI-Selete, started a new EUV mask program in April, 2006. Development of EUV mask handling technology is one of the key areas of the program. We plan to develop mask handling technology and to evaluate EUV mask carriers using Lasertec M3350, a particle inspection tool with the defect sensitivity less than 50nm PSL, and Mask Protection Engineering Tool (named "MPE Tool"). M3350 is a newly developed tool based on a conventional M1350 for EUV blanks inspection. Since our M3350 has a blank flipping mechanism in it, we can inspect the front and the back surface of the blank automatically. We plan to use the M3350 for evaluating particle adders during mask shipping, storage and handling. MPE Tool is a special tool exclusively developed for demonstration of pellicleless mask handling. It can handle a mask within a protective enclosure, which Canon and Nikon have been jointly proposing1, and also, can be modified to handle other type of carrier as the need arises.

A Hybrid Evaluation System Framework (Shell & Web) with Standardized Access to Climate Model Data and Verification Tools for a Clear Climate Science Infrastructure on Big Data High Performance Computers

NASA Astrophysics Data System (ADS)

Kadow, C.; Illing, S.; Kunst, O.; Cubasch, U.

2014-12-01

The project 'Integrated Data and Evaluation System for Decadal Scale Prediction' (INTEGRATION) as part of the German decadal prediction project MiKlip develops a central evaluation system. The fully operational hybrid features a HPC shell access and an user friendly web-interface. It employs one common system with a variety of verification tools and validation data from different projects in- and outside of MiKlip. The evaluation system is located at the German Climate Computing Centre (DKRZ) and has direct access to the bulk of its ESGF node including millions of climate model data sets, e.g. from CMIP5 and CORDEX. The database is organized by the international CMOR standard using the meta information of the self-describing model, reanalysis and observational data sets. Apache Solr is used for indexing the different data projects into one common search environment. This implemented meta data system with its advanced but easy to handle search tool supports users, developers and their tools to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitating the provision and usage of tools and climate data increases automatically the number of scientists working with the data sets and identify discrepancies. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a MySQL database. Configurations and results of the tools can be shared among scientists via shell or web-system. Therefore, plugged-in tools gain automatically from transparency and reproducibility. Furthermore, when configurations match while starting a evaluation tool, the system suggests to use results already produced by other users-saving CPU time, I/O and disk space. This study presents the different techniques and advantages of such a hybrid evaluation system making use of a Big Data HPC in climate science. website: www-miklip.dkrz.de visitor-login: guest password: miklip

A Hybrid Evaluation System Framework (Shell & Web) with Standardized Access to Climate Model Data and Verification Tools for a Clear Climate Science Infrastructure on Big Data High Performance Computers

NASA Astrophysics Data System (ADS)

Kadow, Christopher; Illing, Sebastian; Kunst, Oliver; Ulbrich, Uwe; Cubasch, Ulrich

2015-04-01

The project 'Integrated Data and Evaluation System for Decadal Scale Prediction' (INTEGRATION) as part of the German decadal prediction project MiKlip develops a central evaluation system. The fully operational hybrid features a HPC shell access and an user friendly web-interface. It employs one common system with a variety of verification tools and validation data from different projects in- and outside of MiKlip. The evaluation system is located at the German Climate Computing Centre (DKRZ) and has direct access to the bulk of its ESGF node including millions of climate model data sets, e.g. from CMIP5 and CORDEX. The database is organized by the international CMOR standard using the meta information of the self-describing model, reanalysis and observational data sets. Apache Solr is used for indexing the different data projects into one common search environment. This implemented meta data system with its advanced but easy to handle search tool supports users, developers and their tools to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitating the provision and usage of tools and climate data increases automatically the number of scientists working with the data sets and identify discrepancies. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a MySQL database. Configurations and results of the tools can be shared among scientists via shell or web-system. Therefore, plugged-in tools gain automatically from transparency and reproducibility. Furthermore, when configurations match while starting a evaluation tool, the system suggests to use results already produced by other users-saving CPU time, I/O and disk space. This study presents the different techniques and advantages of such a hybrid evaluation system making use of a Big Data HPC in climate science. website: www-miklip.dkrz.de visitor-login: click on "Guest"

Quality Evaluation Tool for Computer-and Web-Delivered Instruction

DTIC Science & Technology

2005-06-01

Bryman , A ., Mars, R., & Tapangco, L. (1996). When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons...is unlimited. " A " 13. ABSTRACT (Maximum 200 words) The objective of this effort was to develop an Instructional Quality Evaluation Tool to help...developed for each rating point on all scales. This report includes these anchored Likert scales, which can serve as a "stand-alone" Tool. The

Clarus multi-state regional demonstrations, evaluation of use case #4 : multi-state control strategy tool.

DOT National Transportation Integrated Search

2011-06-10

This report provides the results of an independent evaluation of the Clarus Use Case #4 Multi-State Control Strategy Tool (MSCST). This tool, developed for the Road Weather Management Program of the Federal Highway Administration by a private contrac...

Developing a practical evaluation tool for preceptor use.

PubMed

Walsh, Catherine M; Seldomridge, Lisa A; Badros, Karen K

2008-01-01

After years of dissatisfaction with existing instruments, a tool for preceptors to evaluate an undergraduate student's clinical performance was developed, with preceptors' input in its construction. A 2-year pilot evaluation revealed notable problems including excessively high preceptor ratings and significant disparities between faculty and preceptor ratings. Further revisions were made, reducing indicators to those which the preceptors can actually evaluate on an everyday basis and developing a rubric. Additional recommendations to bolster the quality of ratings are improving orientation and guidance of preceptors and modifying procedures for giving feedback.

One approach for evaluating the Distributed Computing Design System (DCDS)

NASA Technical Reports Server (NTRS)

Ellis, J. T.

1985-01-01

The Distributed Computer Design System (DCDS) provides an integrated environment to support the life cycle of developing real-time distributed computing systems. The primary focus of DCDS is to significantly increase system reliability and software development productivity, and to minimize schedule and cost risk. DCDS consists of integrated methodologies, languages, and tools to support the life cycle of developing distributed software and systems. Smooth and well-defined transistions from phase to phase, language to language, and tool to tool provide a unique and unified environment. An approach to evaluating DCDS highlights its benefits.

Application of Multimedia Design Principles to Visuals Used in Course-Books: An Evaluation Tool

ERIC Educational Resources Information Center

Kuzu, Abdullah; Akbulut, Yavuz; Sahin, Mehmet Can

2007-01-01

This paper introduces an evaluation tool prepared to examine the quality of visuals in course-books. The tool is based on Mayer's Cognitive Theory of Multimedia Learning (i.e. Generative Theory) and its principles regarding the correct use of illustrations within text. The reason to generate the tool, the development process along with the…

Improving Students' Understanding of Quantum Measurement. II. Development of Research-Based Learning Tools

ERIC Educational Resources Information Center

Zhu, Guangtian; Singh, Chandralekha

2012-01-01

We describe the development and implementation of research-based learning tools such as the Quantum Interactive Learning Tutorials and peer-instruction tools to reduce students' common difficulties with issues related to measurement in quantum mechanics. A preliminary evaluation shows that these learning tools are effective in improving students'…

The characteristics, implementation and effects of Aboriginal and Torres Strait Islander health promotion tools: a systematic literature search

PubMed Central

2014-01-01

Background Health promotion by and with Aboriginal and Torres Strait Islander (hereafter Indigenous) Australians is critically important given a wide gap in health parity compared to other Australians. The development and implementation of step-by-step guides, instruments, packages, frameworks or resources has provided a feasible and low-resource strategy for strengthening evidence-informed health promotion practice. Yet there has been little assessment of where and how these tools are implemented or their effectiveness. This paper reviews the characteristics, implementation and effects of Indigenous health promotion tools. Methods Indigenous health promotion tools were identified through a systematic literature search including a prior scoping study, eight databases, references of other reviews and the authors’ knowledge (n = 1494). Documents in the peer reviewed and grey literature were included if they described or evaluated tools designed, recommended or used for strengthening Indigenous Australian health promotion. Eligible publications were entered into an Excel spreadsheet and documented tools classified according to their characteristics, implementation and effects. Quality was appraised using the Dictionary for Effective Public Health Practice Project (EPHPP) and Critical Appraisal Skills Program (CASP) tools for quantitative and qualitative studies respectively. Results The review found that Indigenous health promotion tools were widely available. Of 74 publications that met inclusion criteria, sixty (81%) documented tools developed specifically for the Indigenous Australian population. All tools had been developed in reference to evidence; but only 22/74 (30%) publications specified intended or actual implementation, and only 11/74 (15%) publications evaluated impacts of the implemented tools. Impacts included health, environmental, community, organisational and health care improvements. The quality of impact evaluations was strong for only five (7%) studies. Conclusions The small number and generally moderate quality of implementation and evaluation studies means that little is known about how tools work to strengthen Indigenous health promotion practice. The findings suggest that rather than continuing to invest in tool development, practitioners, policy makers and researchers could evaluate the implementation and effects of existing tools and publish the results. There is a need for long-term investment in research to review the current use of health promotion tools and the factors that are likely to enhance their implementation. PMID:25012401

Psychometric Analysis of the Servicemember Evaluation Tool

DTIC Science & Technology

to assess psychological resilience. The Naval Center for Combat and Operational Stress Control developed the Servicemember Evaluation Tool (SET) to...vessels on deployment. The goals of this thesis are to evaluate the psychometric properties of the SET on this sample population. Furthermore, this

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of High Resolution Imagery and Elevation Data

DTIC Science & Technology

2009-06-01

the value of cutting-edge geospatial tools while keeping the data constant, the present experiment evaluated the effect of higher resolution imagery...and elevation data while keeping the tools constant. The high resolution data under evaluation was generated from TEC’s Buckeye system, an...results. As researchers and developers provide increasingly advanced tools to process data more quickly and accurately, it is necessary to assess each

Positioning Mentoring as a Coach Development Tool: Recommendations for Future Practice and Research

ERIC Educational Resources Information Center

McQuade, Sarah; Davis, Louise; Nash, Christine

2015-01-01

Current thinking in coach education advocates mentoring as a development tool to connect theory and practice. However, little empirical evidence exists to evaluate the effectiveness of mentoring as a coach development tool. Business, education, and nursing precede the coaching industry in their mentoring practice, and research findings offered in…

Multi-criteria development and incorporation into decision tools for health technology adoption.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Waddell, Cameron D; Dixon, Elijah; Poulin, Michelle; Lafrenière, René

2013-01-01

When introducing new health technologies, decision makers must integrate research evidence with local operational management information to guide decisions about whether and under what conditions the technology will be used. Multi-criteria decision analysis can support the adoption or prioritization of health interventions by using criteria to explicitly articulate the health organization's needs, limitations, and values in addition to evaluating evidence for safety and effectiveness. This paper seeks to describe the development of a framework to create agreed-upon criteria and decision tools to enhance a pre-existing local health technology assessment (HTA) decision support program. The authors compiled a list of published criteria from the literature, consulted with experts to refine the criteria list, and used a modified Delphi process with a group of key stakeholders to review, modify, and validate each criterion. In a workshop setting, the criteria were used to create decision tools. A set of user-validated criteria for new health technology evaluation and adoption was developed and integrated into the local HTA decision support program. Technology evaluation and decision guideline tools were created using these criteria to ensure that the decision process is systematic, consistent, and transparent. This framework can be used by others to develop decision-making criteria and tools to enhance similar technology adoption programs. The development of clear, user-validated criteria for evaluating new technologies adds a critical element to improve decision-making on technology adoption, and the decision tools ensure consistency, transparency, and real-world relevance.

Development of a Video-Based Evaluation Tool in Rett Syndrome

ERIC Educational Resources Information Center

Fyfe, S.; Downs, J.; McIlroy, O.; Burford, B.; Lister, J.; Reilly, S.; Laurvick, C. L.; Philippe, C.; Msall, M.; Kaufmann, W. E.; Ellaway, C.; Leonard, H.

2007-01-01

This paper describes the development of a video-based evaluation tool for use in Rett syndrome (RTT). Components include a parent-report checklist, and video filming and coding protocols that contain items on eating, drinking, communication, hand function and movements, personal care and mobility. Ninety-seven of the 169 families who initially…

Development and psychometric evaluation of the "Neurosurgical Evaluation of Attitudes towards simulation Training" (NEAT) tool for use in neurosurgical education and training.

PubMed

Kirkman, Matthew A; Muirhead, William; Nandi, Dipankar; Sevdalis, Nick

2014-01-01

Neurosurgical simulation training is becoming increasingly popular. Attitudes toward simulation among residents can contribute to the effectiveness of simulation training, but such attitudes remain poorly explored in neurosurgery with no psychometrically proven measure in the literature. The aim of the present study was to evaluate prospectively a newly developed tool for this purpose: the Neurosurgical Evaluation of Attitudes towards simulation Training (NEAT). The NEAT tool was prospectively developed in 2 stages and psychometrically evaluated (validity and reliability) in 2 administrations with the same participants. The tool comprises a questionnaire with 9 Likert scale items and 2 free-text sections assessing attitudes toward simulation in neurosurgery. The evaluation was completed with 31 neurosurgery residents in London, United Kingdom, who were generally favorable toward neurosurgical simulation. The internal consistency of the questionnaire was high, as demonstrated by the overall Cronbach α values (α=0.899 and α=0.955). All but 2 questionnaire items had "substantial" or "almost perfect" test-retest reliability following repeated survey administrations (median Pearson r correlation=0.688; range, 0.248-0.841). NEAT items were well correlated with each other on both occasions, showing good validity of content within the NEAT tool. There was no significant relationship between either gender or length of neurosurgical experience and item ratings. NEAT is the first psychometrically evaluated tool for evaluating attitudes toward simulation in neurosurgery. Further implementation of NEAT is required in wider neurosurgical populations to establish whether specific population groups differ. Use of NEAT in studies of neurosurgical simulation could offer an additional outcome measure to performance metrics, permitting evaluation of the impact of neurosurgical simulation on attitudes toward simulation both between participants and within the same participants over time. Copyright © 2014 Elsevier Inc. All rights reserved.

Nutrition Environment Food Pantry Assessment Tool (NEFPAT): Development and Evaluation.

PubMed

Nikolaus, Cassandra J; Laurent, Emily; Loehmer, Emily; An, Ruopeng; Khan, Naiman; McCaffrey, Jennifer

2018-04-24

To develop and evaluate a nutrition environment assessment tool to assess the consumer nutrition environment and use of recommended practices in food pantries. The Nutrition Environment Food Pantry Assessment Tool (NEFPAT) was developed based on a literature review and guidance from professionals working with food pantries. The tool was pilot-tested at 9 food pantries, an expert panel assessed content validity, and interrater reliability was evaluated by pairs in 3 pantries. After revisions, the NEFPAT was used in 27 pantries. Pilot tests indicated positive appraisal for the NEFPAT and recommendations were addressed. The NEFPAT's 6 objectives and the overall tool were rated as content valid by experts, with an average section rating of 3.85 ± 0.10. Intraclass correlation coefficients for interrater reliability were >0.90. The NEFPAT is content valid with high interrater reliability. It provides baseline data that could be valuable for interventions within the nutrition environment of food pantries. Published by Elsevier Inc.

Strategic and tactical fuel treatment evaluation tools

Treesearch

Ken Skog

2007-01-01

Strategic identification and local placement of fuel treatments are significant regional and local forest management problems addressed by two tools developed by Forest Service Research and Development.

A GIS Tool for evaluating and improving NEXRAD and its application in distributed hydrologic modeling

NASA Astrophysics Data System (ADS)

Zhang, X.; Srinivasan, R.

2008-12-01

In this study, a user friendly GIS tool was developed for evaluating and improving NEXRAD using raingauge data. This GIS tool can automatically read in raingauge and NEXRAD data, evaluate the accuracy of NEXRAD for each time unit, implement several geostatistical methods to improve the accuracy of NEXRAD through raingauge data, and output spatial precipitation map for distributed hydrologic model. The geostatistical methods incorporated in this tool include Simple Kriging with varying local means, Kriging with External Drift, Regression Kriging, Co-Kriging, and a new geostatistical method that was newly developed by Li et al. (2008). This tool was applied in two test watersheds at hourly and daily temporal scale. The preliminary cross-validation results show that incorporating raingauge data to calibrate NEXRAD can pronouncedly change the spatial pattern of NEXRAD and improve its accuracy. Using different geostatistical methods, the GIS tool was applied to produce long term precipitation input for a distributed hydrologic model - Soil and Water Assessment Tool (SWAT). Animated video was generated to vividly illustrate the effect of using different precipitation input data on distributed hydrologic modeling. Currently, this GIS tool is developed as an extension of SWAT, which is used as water quantity and quality modeling tool by USDA and EPA. The flexible module based design of this tool also makes it easy to be adapted for other hydrologic models for hydrological modeling and water resources management.

Development, Validation, and Verification of a Self-Assessment Tool to Estimate Agnibala (Digestive Strength).

PubMed

Singh, Aparna; Singh, Girish; Patwardhan, Kishor; Gehlot, Sangeeta

2017-01-01

According to Ayurveda, the traditional system of healthcare of Indian origin, Agni is the factor responsible for digestion and metabolism. Four functional states (Agnibala) of Agni have been recognized: regular, irregular, intense, and weak. The objective of the present study was to develop and validate a self-assessment tool to estimate Agnibala The developed tool was evaluated for its reliability and validity by administering it to 300 healthy volunteers of either gender belonging to 18 to 40-year age group. Besides confirming the statistical validity and reliability, the practical utility of the newly developed tool was also evaluated by recording serum lipid parameters of all the volunteers. The results show that the lipid parameters vary significantly according to the status of Agni The tool, therefore, may be used to screen normal population to look for possible susceptibility to certain health conditions. © The Author(s) 2016.

Developing a realistic-prototyping road user cost evaluation tool for FDOT.

DOT National Transportation Integrated Search

2008-12-31

The objective of this project is to develop a realistic-prototyping RUC (Road User Cost) calculation tool that is userfriendly : and utilizing limited number of data inputs that are easy to use. The tool can help engineers to estimate RUC on : specif...

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

ERIC Educational Resources Information Center

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Review of Currently Available Instruments

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

An extensive list of published and unpublished instruments used to investigate or evaluate sleep issues in children was collected and assessed based on the fundamental operational principles of instrument development (11 steps). Of all the available tools identified, only a few were validated and standardized using appropriate psychometric criteria. In fact, only 2 fulfill all desirable criteria and approximately 11 instruments seem to adhere to most of the psychometric tool development requirements, and were therefore assessed in greater detail. Notwithstanding, in the rapidly developing scientific world of pediatric sleep, there are too many tools being used that have not undergone careful and methodical psychometric evaluation, and as such may be fraught with biased or invalid findings. It is hoped that this initial effort in categorizing and assessing available tools for pediatric sleep will serve as recognition of the relatively early developmental stage of our field, and provide the necessary impetus for future tool development using multicentered approaches and adequate methodologies. PMID:20934896

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

PubMed

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

New Automotive Air Conditioning System Simulation Tool Developed in MATLAB/Simulink

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kiss, T.; Chaney, L.; Meyer, J.

Further improvements in vehicle fuel efficiency require accurate evaluation of the vehicle's transient total power requirement. When operated, the air conditioning (A/C) system is the largest auxiliary load on a vehicle; therefore, accurate evaluation of the load it places on the vehicle's engine and/or energy storage system is especially important. Vehicle simulation software, such as 'Autonomie,' has been used by OEMs to evaluate vehicles' energy performance. A transient A/C simulation tool incorporated into vehicle simulation models would also provide a tool for developing more efficient A/C systems through a thorough consideration of the transient A/C system performance. The dynamic systemmore » simulation software Matlab/Simulink was used to develop new and more efficient vehicle energy system controls. The various modeling methods used for the new simulation tool are described in detail. Comparison with measured data is provided to demonstrate the validity of the model.« less

Current State and Model for Development of Technology-Based Care for Attention Deficit Hyperactivity Disorder

PubMed Central

Riley, Steven J.; Calub, Catrina A.; Schweitzer, Julie B.

2016-01-01

Abstract Introduction: Care (i.e., evaluation and intervention) delivered through technology is used in many areas of mental health services, including for persons with attention deficit hyperactivity disorder (ADHD). Technology can facilitate care for individuals with ADHD, their parents, and their care providers. The adoption of technological tools for ADHD care requires evidence-based studies to support the transition from development to integration into use in the home, school, or work for persons with the disorder. The initial phase, which is development of technological tools, has begun in earnest; however, the evidence base for many of these tools is lacking. In some instances, the uptake of a piece of technology into home use or clinical practice may be further along than the research to support its use. Methods: In this study, we review the current evidence regarding technology for ADHD and also propose a model to evaluate the support for other tools that have yet to be tested. Results: We propose using the Research Domain Criteria as a framework for evaluating the tools' relationships to dimensions related to ADHD. Conclusion: This article concludes with recommendations for testing new tools that may have promise in improving the evaluation or treatment of persons with ADHD. PMID:26985703

Developing a Physiotherapy-Specific Preliminary Clinical Decision-Making Tool for Oxygen Titration: A Modified Delphi Study

PubMed Central

Duong, Michelle; Bertin, Kendra; Henry, Renee; Singh, Deepti; Timmins, Nolla; Brooks, Dina; Mathur, Sunita

2014-01-01

ABSTRACT Purpose: To develop and evaluate a preliminary clinical decision-making tool (CDMT) to assist physiotherapists in titrating oxygen for acutely ill adults in Ontario. Methods: A panel of 14 experienced cardiorespiratory physiotherapists was recruited. Factors relating to oxygen titration were identified using a modified Delphi technique. Four rounds of questionnaires were conducted, during which the goals were to (1) generate factors, (2) reduce factors and debate contentious factors, (3) finalize factors and develop the preliminary CDMT, and (4) evaluate the usability of the tool in a clinical context. Results: The panel reached consensus on a total of 89 factors, which were compiled to create the preliminary CDMT. The global tool reached consensus for sensibility, receiving a mean score of 6/7 on a 7-point Likert-type scale (1=unacceptable; 7=excellent). Five of the nine individual components of evaluation of the tool achieved scores ≥6.0; the remaining four had mean scores between 5.4 and 5.9. Conclusion: This study produced a preliminary CDMT for oxygen titration, which the panel agreed was highly comprehensible and globally sensible. Further research is necessary to evaluate the sensibility and applicability of the tool in a clinical setting. PMID:25125782

Human Factors Evaluation of Advanced Electric Power Grid Visualization Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.; Dauenhauer, Peter M.; Wierks, Tamara G.

This report describes initial human factors evaluation of four visualization tools (Graphical Contingency Analysis, Force Directed Graphs, Phasor State Estimator and Mode Meter/ Mode Shapes) developed by PNNL, and proposed test plans that may be implemented to evaluate their utility in scenario-based experiments.

The current state of cancer family history collection tools in primary care: a systematic review.

PubMed

Qureshi, Nadeem; Carroll, June C; Wilson, Brenda; Santaguida, Pasqualina; Allanson, Judith; Brouwers, Melissa; Raina, Parminder

2009-07-01

Systematic collection of family history is a prerequisite for identifying genetic risk. This study reviewed tools applicable to the primary care assessment of family history of breast, colorectal, ovarian, and prostate cancer. MEDLINE, EMBASE, CINAHL, and Cochrane Central were searched for publications. All primary study designs were included. Characteristics of the studies, the family history collection tools, and the setting were evaluated. Of 40 eligible studies, 18 relevant family history tools were identified, with 11 developed for use in primary care. Most collected information on more than one cancer and on affected relatives used self-administered questionnaires and paper-based formats. Eleven tools had been evaluated relative to current practice, demonstrating 46-78% improvement in data recording over family history recording in patient charts and 75-100% agreement with structured genetic interviews. Few tools have been developed specifically for primary care settings. The few that have been evaluated performed well. The very limited evidence, which depends in part on extrapolation from studies in settings other than primary care, suggests that systematic tools may add significant family health information compared with current primary care practice. The effect of their use on health outcomes has not been evaluated.

Teacher Evaluation as a Tool for Professional Development: A Case of Saudi Arabia

ERIC Educational Resources Information Center

Hakim, Badia Muntazir

2015-01-01

This study reports on the use of teacher evaluation and appraisal process as a tool for professional development. A group of 30 teachers from seven different nationalities with diverse qualifications and teaching experiences participated in this case study at the English Language Institute (ELI) at King Abdulaziz University (KAU), Saudi Arabia.…

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluation of Seeds of Science/Roots of Reading: Effective Tools for Developing Literacy through Science in the Early Grades-Light Energy Unit. CRESST Report 781

ERIC Educational Resources Information Center

Goldschmidt, Pete; Jung, Hyekyung

2011-01-01

This evaluation focuses on the Seeds of Science/Roots of Reading: Effective Tools for Developing Literacy through Science in the Early Grades ("Seeds/Roots") model of science-literacy integration. The evaluation is based on a cluster randomized design of 100 teachers, half of which were in the treatment group. Multi-level models are employed to…

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Ergonomics: CTD management evaluation tool.

PubMed

Ostendorf, J S; Rogers, B; Bertsche, P K

2000-01-01

Cumulative trauma disorder (CTD) occurrences peaked in number in 1994 and although decreasing in 1995, still accounted for 62% of all illness cases reported. A CTD Management Evaluation Tool was developed to assist Occupational Safety and Health Compliance Officers (CSHOs) in program evaluation and documentation of the occupational health management component and the need for an ergonomics program. Occupational and environmental health nurses may use the tool not only to reduce and prevent CTD occurrences, but also as a benchmark for program evaluation.

Development, implementation and evaluation of a patient handoff tool to improve safety in orthopaedic surgery.

PubMed

Gagnier, Joel J; Derosier, Joseph M; Maratt, Joseph D; Hake, Mark E; Bagian, James P

2016-06-01

To develop, implement and test the effect of a handoff tool for orthopaedic trauma residents that reduces adverse events associated with the omission of critical information and the transfer of erroneous information. Components of this project included a literature review, resident surveys and observations, checklist development and refinement, implementation and evaluation of impact on adverse events through a chart review of a prospective cohort compared with a historical control group. Large teaching hospital. Findings of a literature review were presented to orthopaedic residents, epidemiologists, orthopaedic surgeons and patient safety experts in face-to-face meetings, during which we developed and refined the contents of a resident handoff tool. The tool was tested in an orthopaedic trauma service and its impact on adverse events was evaluated through a chart review. The handoff tool was developed and refined during the face-to-face meetings and a pilot implementation. Adverse event data were collected on 127 patients (n = 67 baseline period; n = 60 test period). A handoff tool for use by orthopaedic residents. Adverse events in patients handed off by orthopaedic trauma residents. After controlling for age, gender and comorbidities, testing resulted in fewer events per person (25-27% reduction; P < 0.10). Preliminary evidence suggests that our resident handoff tool may contribute to a decrease in adverse events in orthopaedic patients. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Bayesian cross-validation for model evaluation and selection, with application to the North American Breeding Bird Survey

USGS Publications Warehouse

Link, William; Sauer, John R.

2016-01-01

The analysis of ecological data has changed in two important ways over the last 15 years. The development and easy availability of Bayesian computational methods has allowed and encouraged the fitting of complex hierarchical models. At the same time, there has been increasing emphasis on acknowledging and accounting for model uncertainty. Unfortunately, the ability to fit complex models has outstripped the development of tools for model selection and model evaluation: familiar model selection tools such as Akaike's information criterion and the deviance information criterion are widely known to be inadequate for hierarchical models. In addition, little attention has been paid to the evaluation of model adequacy in context of hierarchical modeling, i.e., to the evaluation of fit for a single model. In this paper, we describe Bayesian cross-validation, which provides tools for model selection and evaluation. We describe the Bayesian predictive information criterion and a Bayesian approximation to the BPIC known as the Watanabe-Akaike information criterion. We illustrate the use of these tools for model selection, and the use of Bayesian cross-validation as a tool for model evaluation, using three large data sets from the North American Breeding Bird Survey.

The availability and effectiveness of tools supporting shared decision making in metastatic breast cancer care: a review.

PubMed

Spronk, Inge; Burgers, Jako S; Schellevis, François G; van Vliet, Liesbeth M; Korevaar, Joke C

2018-05-11

Shared decision-making (SDM) in the management of metastatic breast cancer care is associated with positive patient outcomes. In daily clinical practice, however, SDM is not fully integrated yet. Initiatives to improve the implementation of SDM would be helpful. The aim of this review was to assess the availability and effectiveness of tools supporting SDM in metastatic breast cancer care. Literature databases were systematically searched for articles published since 2006 focusing on the development or evaluation of tools to improve information-provision and to support decision-making in metastatic breast cancer care. Internet searches and experts identified additional tools. Data from included tools were extracted and the evaluation of tools was appraised using the GRADE grading system. The literature search yielded five instruments. In addition, two tools were identified via internet searches and consultation of experts. Four tools were specifically developed for supporting SDM in metastatic breast cancer, the other three tools focused on metastatic cancer in general. Tools were mainly applicable across the care process, and usable for decisions on supportive care with or without chemotherapy. All tools were designed for patients to be used before a consultation with the physician. Effects on patient outcomes were generally weakly positive although most tools were not studied in well-designed studies. Despite its recognized importance, only two tools were positively evaluated on effectiveness and are available to support patients with metastatic breast cancer in SDM. These tools show promising results in pilot studies and focus on different aspects of care. However, their effectiveness should be confirmed in well-designed studies before implementation in clinical practice. Innovation and development of SDM tools targeting clinicians as well as patients during a clinical encounter is recommended.

What's new in well logging and formation evaluation

USGS Publications Warehouse

Prensky, S.

2011-01-01

A number of significant new developments is emerging in well logging and formation evaluation. Some of the new developments include an ultrasonic wireline imager, an electromagnetic free-point indicator, wired and fiber-optic coiled tubing systems, and extreme-temperature logging-while-drilling (LWD) tools. The continued consolidation of logging and petrophysical service providers in 2010 means that these innovations are increasingly being provided by a few large companies. Weatherford International has launched a slimhole cross-dipole tool as part of the company's line of compact logging tools. The 26-ft-long Compact Cross-Dipole Sonic (CXD) tool can be run as part of a quad-combo compact logging string. Halliburton has introduced a version of its circumferential acoustic scanning tool (CAST) that runs on monoconductor cable (CAST-M) to provide high-resolution images in open hole and in cased hole for casing and cement evaluation.

EDCATS: An Evaluation Tool

NASA Technical Reports Server (NTRS)

Heard, Pamala D.

1998-01-01

The purpose of this research is to explore the development of Marshall Space Flight Center Unique Programs. These academic tools provide the Education Program Office with important information from the Education Computer Aided Tracking System (EDCATS). This system is equipped to provide on-line data entry, evaluation, analysis, and report generation, with full archiving for all phases of the evaluation process. Another purpose is to develop reports and data that is tailored to Marshall Space Flight Center Unique Programs. It also attempts to acquire knowledge on how, why, and where information is derived. As a result, a user will be better prepared to decide which available tool is the most feasible for their reports.

PROTOTYPE TOOL FOR EVALUATING THE COST AND EFFECTIVENESS OF GREENHOUSE GAS MITIGATION TECHNOLOGIES

EPA Science Inventory

The paper introduces the structure of a tool, being developed by the U.S. EPA's Office of Research and Development, that will be able to analyze the benefits of new technologies and strategies for controlling greenhouse gas (GHG) emissions. When completed, the tool will be able ...

Measuring ability to assess claims about treatment effects: the development of the 'Claim Evaluation Tools'.

PubMed

Austvoll-Dahlgren, Astrid; Semakula, Daniel; Nsangi, Allen; Oxman, Andrew David; Chalmers, Iain; Rosenbaum, Sarah; Guttersrud, Øystein

2017-05-17

To describe the development of the Claim Evaluation Tools, a set of flexible items to measure people's ability to assess claims about treatment effects. Methodologists and members of the community (including children) in Uganda, Rwanda, Kenya, Norway, the UK and Australia. In the iterative development of the items, we used purposeful sampling of people with training in research methodology, such as teachers of evidence-based medicine, as well as patients and members of the public from low-income and high-income countries. Development consisted of 4 processes: (1) determining the scope of the Claim Evaluation Tools and development of items; (2) expert item review and feedback (n=63); (3) cognitive interviews with children and adult end-users (n=109); and (4) piloting and administrative tests (n=956). The Claim Evaluation Tools database currently includes a battery of multiple-choice items. Each item begins with a scenario which is intended to be relevant across contexts, and which can be used for children (from age 10  and above), adult members of the public and health professionals. People with expertise in research methods judged the items to have face validity, and end-users judged them relevant and acceptable in their settings. In response to feedback from methodologists and end-users, we simplified some text, explained terms where needed, and redesigned formats and instructions. The Claim Evaluation Tools database is a flexible resource from which researchers, teachers and others can design measurement instruments to meet their own requirements. These evaluation tools are being managed and made freely available for non-commercial use (on request) through Testing Treatments interactive (testingtreatments.org). PACTR201606001679337 and PACTR201606001676150; Pre-results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Evaluation in undergraduate medical education: Conceptualizing and validating a novel questionnaire for assessing the quality of bedside teaching.

PubMed

Dreiling, Katharina; Montano, Diego; Poinstingl, Herbert; Müller, Tjark; Schiekirka-Schwake, Sarah; Anders, Sven; von Steinbüchel, Nicole; Raupach, Tobias

2017-08-01

Evaluation is an integral part of curriculum development in medical education. Given the peculiarities of bedside teaching, specific evaluation tools for this instructional format are needed. Development of these tools should be informed by appropriate frameworks. The purpose of this study was to develop a specific evaluation tool for bedside teaching based on the Stanford Faculty Development Program's clinical teaching framework. Based on a literature review yielding 47 evaluation items, an 18-item questionnaire was compiled and subsequently completed by undergraduate medical students at two German universities. Reliability and validity were assessed in an exploratory full information item factor analysis (study one) and a confirmatory factor analysis as well as a measurement invariance analysis (study two). The exploratory analysis involving 824 students revealed a three-factor structure. Reliability estimates of the subscales were satisfactory (α = 0.71-0.84). The model yielded satisfactory fit indices in the confirmatory factor analysis involving 1043 students. The new questionnaire is short and yet based on a widely-used framework for clinical teaching. The analyses presented here indicate good reliability and validity of the instrument. Future research needs to investigate whether feedback generated from this tool helps to improve teaching quality and student learning outcome.

Development and Piloting of a Food Safety Audit Tool for the Domestic Environment.

PubMed

Borrusso, Patricia; Quinlan, Jennifer J

2013-12-04

Research suggests that consumers often mishandle food in the home based on survey and observation studies. There is a need for a standardized tool for researchers to objectively evaluate the prevalence and identify the nature of food safety risks in the domestic environment. An audit tool was developed to measure compliance with recommended sanitation, refrigeration and food storage conditions in the domestic kitchen. The tool was piloted by four researchers who independently completed the inspection in 22 homes. Audit tool questions were evaluated for reliability using the κ statistic. Questions that were not sufficiently reliable (κ < 0.5) or did not provide direct evidence of risk were revised or eliminated from the final tool. Piloting the audit tool found good reliability among 18 questions, 6 questions were revised and 28 eliminated, resulting in a final 24 question tool. The audit tool was able to identify potential food safety risks, including evidence of pest infestation (27%), incorrect refrigeration temperature (73%), and lack of hot water (>43 °C, 32%). The audit tool developed here provides an objective measure for researchers to observe and record the most prevalent food safety risks in consumer's kitchens and potentially compare risks among consumers of different demographics.

Evaluating the Development of Science Research Skills in Work-Integrated Learning through the Use of Workplace Science Tools

ERIC Educational Resources Information Center

McCurdy, Susan M.; Zegwaard, Karsten E.; Dalgety, Jacinta

2013-01-01

Concept understanding, the development of analytical skills and a research mind set are explored through the use of academic tools common in a tertiary science education and relevant work-integrated learning (WIL) experiences. The use and development of the tools; laboratory book, technical report, and literature review are examined by way of…

ARBOOK: Development and Assessment of a Tool Based on Augmented Reality for Anatomy

ERIC Educational Resources Information Center

Ferrer-Torregrosa, J.; Torralba, J.; Jimenez, M. A.; García, S.; Barcia, J. M.

2015-01-01

The evolution of technologies and the development of new tools with educational purposes are growing up. This work presents the experience of a new tool based on augmented reality (AR) focusing on the anatomy of the lower limb. ARBOOK was constructed and developed based on TC and MRN images, dissections and drawings. For ARBOOK evaluation, a…

Improved Aerodynamic Analysis for Hybrid Wing Body Conceptual Design Optimization

NASA Technical Reports Server (NTRS)

Gern, Frank H.

2012-01-01

This paper provides an overview of ongoing efforts to develop, evaluate, and validate different tools for improved aerodynamic modeling and systems analysis of Hybrid Wing Body (HWB) aircraft configurations. Results are being presented for the evaluation of different aerodynamic tools including panel methods, enhanced panel methods with viscous drag prediction, and computational fluid dynamics. Emphasis is placed on proper prediction of aerodynamic loads for structural sizing as well as viscous drag prediction to develop drag polars for HWB conceptual design optimization. Data from transonic wind tunnel tests at the Arnold Engineering Development Center s 16-Foot Transonic Tunnel was used as a reference data set in order to evaluate the accuracy of the aerodynamic tools. Triangularized surface data and Vehicle Sketch Pad (VSP) models of an X-48B 2% scale wind tunnel model were used to generate input and model files for the different analysis tools. In support of ongoing HWB scaling studies within the NASA Environmentally Responsible Aviation (ERA) program, an improved finite element based structural analysis and weight estimation tool for HWB center bodies is currently under development. Aerodynamic results from these analyses are used to provide additional aerodynamic validation data.

Low-Cost, Full-Field Surface Profiling Tool for Mechanical Damage Evaluation

DOT National Transportation Integrated Search

2010-03-03

In this project, Intelligent Optical Systems (IOS) developed an inexpensive, full-field, surfaceprofiling tool for mechanical damage evaluation based on the processing of a single digital image. Little operator training is required for acquiring the ...

A mobile phone based tool to identify symptoms of common childhood diseases in Ghana: development and evaluation of the integrated clinical algorithm in a cross-sectional study.

PubMed

Franke, Konstantin H; Krumkamp, Ralf; Mohammed, Aliyu; Sarpong, Nimako; Owusu-Dabo, Ellis; Brinkel, Johanna; Fobil, Julius N; Marinovic, Axel Bonacic; Asihene, Philip; Boots, Mark; May, Jürgen; Kreuels, Benno

2018-03-27

The aim of this study was the development and evaluation of an algorithm-based diagnosis-tool, applicable on mobile phones, to support guardians in providing appropriate care to sick children. The algorithm was developed on the basis of the Integrated Management of Childhood Illness (IMCI) guidelines and evaluated at a hospital in Ghana. Two hundred and thirty-seven guardians applied the tool to assess their child's symptoms. Data recorded by the tool and health records completed by a physician were compared in terms of symptom detection, disease assessment and treatment recommendation. To compare both assessments, Kappa statistics and predictive values were calculated. The tool detected the symptoms of cough, fever, diarrhoea and vomiting with good agreement to the physicians' findings (kappa = 0.64; 0.59; 0.57 and 0.42 respectively). The disease assessment barely coincided with the physicians' findings. The tool's treatment recommendation correlated with the physicians' assessments in 93 out of 237 cases (39.2% agreement, kappa = 0.11), but underestimated a child's condition in only seven cases (3.0%). The algorithm-based tool achieved reliable symptom detection and treatment recommendations were administered conformably to the physicians' assessment. Testing in domestic environment is envisaged.

Anthropomorphic Telemanipulation System in Terminus Control Mode

NASA Technical Reports Server (NTRS)

Jau, Bruno M.; Lewis, M. Anthony; Bejczy, Antal K.

1994-01-01

This paper describes a prototype anthropomorphic kinesthetic telepresence system that is being developed at JPL. It utilizes dexterous terminus devices in the form of an exoskeleton force-sensing master glove worn by the operator and a replica four finger anthropomorphic slave hand. The newly developed master glove is integrated with our previously developed non-anthropomorphic six degree of freedom (DOF) universal force-reflecting hand controller (FRHC). The mechanical hand and forearm are mounted to an industrial robot (PUMA 560), replacing its standard forearm. The notion of 'terminus control mode' refers to the fact that only the terminus devices (glove and robot hand) are of anthropomorphic nature, and the master and slave arms are non-anthropomorphic. The system is currently being evaluated, focusing on tool handling and astronaut equivalent task executions. The evaluation revealed the system's potential for tool handling but it also became evident that hand tool manipulations and space operations require a dual arm robot. This paper describes the system's principal components, its control and computing architecture, discusses findings of the tool handling evaluation, and explains why common tool handling and EVA space tasks require dual arm robots.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

The development and initial validation of a clinical tool for patients' preferences on patient participation--The 4Ps.

PubMed

Eldh, Ann Catrine; Luhr, Kristina; Ehnfors, Margareta

2015-12-01

To report on the development and initial testing of a clinical tool, The Patient Preferences for Patient Participation tool (The 4Ps), which will allow patients to depict, prioritize, and evaluate their participation in health care. While patient participation is vital for high quality health care, a common definition incorporating all stakeholders' experience is pending. In order to support participation in health care, a tool for determining patients' preferences on participation is proposed, including opportunities to evaluate participation while considering patient preferences. Exploratory mixed methods studies informed the development of the tool, and descriptive design guided its initial testing. The 4Ps tool was tested with 21 Swedish researcher experts (REs) and patient experts (PEs) with experience of patient participation. Individual Think Aloud interviews were employed to capture experiences of content, response process, and acceptability. 'The 4Ps' included three sections for the patient to depict, prioritize, and evaluate participation using 12 items corresponding to 'Having Dialogue', 'Sharing Knowledge', 'Planning', and 'Managing Self-care'. The REs and PEs considered 'The 4Ps' comprehensible, and that all items corresponded to the concept of patient participation. The tool was perceived to facilitate patient participation whilst requiring amendments to content and layout. A tool like The 4Ps provides opportunities for patients to depict participation, and thus supports communication and collaboration. Further patient evaluation is needed to understand the conditions for patient participation. While The 4Ps is promising, revision and testing in clinical practice is required. © 2014 John Wiley & Sons Ltd.

[The Italian instrument evaluating the nursing students clinical learning quality].

PubMed

Palese, Alvisa; Grassetti, Luca; Mansutti, Irene; Destrebecq, Anne; Terzoni, Stefano; Altini, Pietro; Bevilacqua, Anita; Brugnolli, Anna; Benaglio, Carla; Dal Ponte, Adriana; De Biasio, Laura; Dimonte, Valerio; Gambacorti, Benedetta; Fasci, Adriana; Grosso, Silvia; Mantovan, Franco; Marognolli, Oliva; Montalti, Sandra; Nicotera, Raffaela; Randon, Giulia; Stampfl, Brigitte; Tollini, Morena; Canzan, Federica; Saiani, Luisa; Zannini, Lucia

2017-01-01

. The Clinical Learning Quality Evaluation Index for nursing students. The Italian nursing programs, the need to introduce tools evaluating the quality of the clinical learning as perceived by nursing students. Several tools already exist, however, several limitations suggesting the need to develop a new tool. A national project aimed at developing and validating a new instrument capable of measuring the clinical learning quality as experience by nursing students. A validation study design was undertaken from 2015 to 2016. All nursing national programs (n=43) were invited to participate by including all nursing students attending regularly their clinical learning. The tool developed based upon a) literature, b) validated tools already established among other healthcare professionals, and c) consensus expressed by experts and nursing students, was administered to the eligible students. 9606 nursing in 27 universities (62.8%) participated. The psychometric properties of the new instrument ranged from good to excellent. According to the findings, the tool consists in 22 items and five factors: a) quality of the tutorial strategies, b) learning opportunities; c) safety and nursing care quality; d) self-direct learning; e) quality of the learning environment. The tool is already used. Its systematic adoption may support comparison among settings and across different programs; moreover, the tool may also support in accrediting new settings as well as in measuring the effects of strategies aimed at improving the quality of the clinical learning.

Trauma system evaluation in developing countries: applicability of American College of Surgeons/Committee on Trauma (ACS/COT) basic criteria.

PubMed

Latifi, Rifat; Ziemba, Michelle; Leppäniemi, Ari; Dasho, Erion; Dogjani, Agron; Shatri, Zhaneta; Kociraj, Agim; Oldashi, Fatos; Shosha, Lida

2014-08-01

Trauma continues to be a major health problem worldwide, particularly in the developing world, with high mortality and morbidity. Yet most developing countries lack an organized trauma system. Furthermore, developing countries do not have in place any accreditation process for trauma centers; thus, no accepted standard assessment tools exist to evaluate their trauma services. The aims of this study were to evaluate the trauma system in Albania, using the basic trauma criteria of the American College of Surgeons/Committee on Trauma (ACS/COT) as assessment tools, and to provide the Government with a situational analysis relative to these criteria. We used the ACS/COT basic criteria as assessment tools to evaluate the trauma system in Albania. We conducted a series of semi-structured interviews, unstructured interviews, and focus groups with all stakeholders at the Ministry of Health, at the University Trauma Hospital (UTH) based in Tirana (the capital city), and at ten regional hospitals across the country. Albania has a dedicated national trauma center that serves as the only tertiary center, plus ten regional hospitals that provide some trauma care. However, overall, its trauma system is in need of major reforms involving all essential elements in order to meet the basic requirements of a structured trauma system. The ACS/COT basic criteria can be used as assessment tools to evaluate trauma care in developing countries. Further studies are needed in other developing countries to validate the applicability of these criteria.

Optimizing the ASC WAN: evaluating network performance tools for comparing transport protocols.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lydick, Christopher L.

2007-07-01

The Advanced Simulation & Computing Wide Area Network (ASC WAN), which is a high delay-bandwidth network connection between US Department of Energy National Laboratories, is constantly being examined and evaluated for efficiency. One of the current transport-layer protocols which is used, TCP, was developed for traffic demands which are different from that on the ASC WAN. The Stream Control Transport Protocol (SCTP), on the other hand, has shown characteristics which make it more appealing to networks such as these. Most important, before considering a replacement for TCP on any network, a testing tool that performs well against certain criteria needsmore » to be found. In order to try to find such a tool, two popular networking tools (Netperf v.2.4.3 & v.2.4.6 (OpenSS7 STREAMS), and Iperf v.2.0.6) were tested. These tools implement both TCP and SCTP and were evaluated using four metrics: (1) How effectively can the tool reach a throughput near the bandwidth? (2) How much of the CPU does the tool utilize during operation? (3) Is the tool freely and widely available? And, (4) Is the tool actively developed? Following the analysis of those tools, this paper goes further into explaining some recommendations and ideas for future work.« less

Evaluating Inclusive Educational Practices for Students with Severe Disabilities Using the Program Quality Measurement Tool

ERIC Educational Resources Information Center

Cushing, Lisa S.; Carter, Erik W.; Clark, Nitasha; Wallis, Terry; Kennedy, Craig H.

2009-01-01

Recent legislative and school reform efforts require schools to evaluate and improve educational practices for students with severe disabilities. The authors developed the "Program Quality Measurement Tool" (PQMT) to enable administrators and educators to evaluate the educational programming provided to students with severe disabilities against…

Development and evaluation of RAMP I - a practitioner's tool for screening of musculoskeletal disorder risk factors in manual handling.

PubMed

Lind, Carl Mikael; Forsman, Mikael; Rose, Linda Maria

2017-10-16

RAMP I is a screening tool developed to support practitioners in screening for work-related musculoskeletal disorder risk factors related to manual handling. RAMP I, which is part of the RAMP tool, is based on research-based studies combined with expert group judgments. More than 80 practitioners participated in the development of RAMP I. The tool consists of dichotomous assessment items grouped into seven categories. Acceptable reliability was found for a majority of the assessment items for 15 practitioners who were given 1 h of training. The usability evaluation points to RAMP I being usable for screening for musculoskeletal disorder risk factors, i.e., usable for assessing risks, being usable as a decision base, having clear results and that the time needed for an assessment is acceptable. It is concluded that RAMP I is a usable tool for practitioners.

Community-led Air Sensor Evaluation: New Tools for Citizen Scientists Fact Sheet

EPA Pesticide Factsheets

EPA has developed a guide and analysis tool for citizen scientists to evaluate the performance of low-cost sensors and interpret the data they collect to help citizen scientists interested in learning about local air quality.

Evaluating Electronic Flight Bags in the Real World

DOT National Transportation Integrated Search

2006-09-20

Over the past few years, the Volpe National Transportation Systems Center (Volpe Center) has developed several tools that can be used to evaluate Electronic Flight Bags (EFBs) from a human factors perspective. The tools are needed because EFBs are so...

Development of an Interactive Social Media Tool for Parents with Concerns about Vaccines

ERIC Educational Resources Information Center

Shoup, Jo Ann; Wagner, Nicole M.; Kraus, Courtney R.; Narwaney, Komal J.; Goddard, Kristin S.; Glanz, Jason M.

2015-01-01

Objective: Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method: We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results:…

Teachers' Perspectives on Digital Tools for Pedagogic Planning and Design

ERIC Educational Resources Information Center

Masterman, Elizabeth; Manton, Marion

2011-01-01

The authors introduce the concept of design support tools and situate them in the pedagogic context of professional development for technology-enhanced learning (TEL) and the research field of learning design. Through focusing on the development and evaluation of one such tool, Phoebe, they discuss their value to lecturers in post-compulsory…

The development of a plant risk evaluation (PRE) tool for assessing the invasive potential of ornamental plants.

PubMed

Conser, Christiana; Seebacher, Lizbeth; Fujino, David W; Reichard, Sarah; DiTomaso, Joseph M

2015-01-01

Weed Risk Assessment (WRA) methods for evaluating invasiveness in plants have evolved rapidly in the last two decades. Many WRA tools exist, but none were specifically designed to screen ornamental plants prior to being released into the environment. To be accepted as a tool to evaluate ornamental plants for the nursery industry, it is critical that a WRA tool accurately predicts non-invasiveness without falsely categorizing them as invasive. We developed a new Plant Risk Evaluation (PRE) tool for ornamental plants. The 19 questions in the final PRE tool were narrowed down from 56 original questions from existing WRA tools. We evaluated the 56 WRA questions by screening 21 known invasive and 14 known non-invasive ornamental plants. After statistically comparing the predictability of each question and the frequency the question could be answered for both invasive and non-invasive species, we eliminated questions that provided no predictive power, were irrelevant in our current model, or could not be answered reliably at a high enough percentage. We also combined many similar questions. The final 19 remaining PRE questions were further tested for accuracy using 56 additional known invasive plants and 36 known non-invasive ornamental species. The resulting evaluation demonstrated that when "needs further evaluation" classifications were not included, the accuracy of the model was 100% for both predicting invasiveness and non-invasiveness. When "needs further evaluation" classifications were included as either false positive or false negative, the model was still 93% accurate in predicting invasiveness and 97% accurate in predicting non-invasiveness, with an overall accuracy of 95%. We conclude that the PRE tool should not only provide growers with a method to accurately screen their current stock and potential new introductions, but also increase the probability of the tool being accepted for use by the industry as the basis for a nursery certification program.

The use of high-fidelity human patient simulation as an evaluative tool in the development of clinical research protocols and procedures.

PubMed

Wright, Melanie C; Taekman, Jeffrey M; Barber, Linda; Hobbs, Gene; Newman, Mark F; Stafford-Smith, Mark

2005-12-01

Errors in clinical research can be costly, in terms of patient safety, data integrity, and data collection. Data inaccuracy in early subjects of a clinical study may be associated with problems in the design of the protocol, procedures, and data collection tools. High-fidelity patient simulation centers provide an ideal environment to apply human-centered design to clinical trial development. A draft of a complex clinical protocol was designed, evaluated and modified using a high-fidelity human patient simulator in the Duke University Human Simulation and Patient Safety Center. The process included walk-throughs, detailed modifications of the protocol and development of procedural aids. Training of monitors and coordinators provided an opportunity for observation of performance that was used to identify further improvements to the protocol. Evaluative steps were used to design the research protocol and procedures. Iterative modifications were made to the protocol and data collection tools. The success in use of human simulation in the preparation of a complex clinical drug trial suggests the benefits of human patient simulation extend beyond training and medical equipment evaluation. Human patient simulation can provide a context for informal expert evaluation of clinical protocol design and for formal "rehearsal" to evaluate the efficacy of procedures and support tools.

Understanding online health information: Evaluation, tools, and strategies.

PubMed

Beaunoyer, Elisabeth; Arsenault, Marianne; Lomanowska, Anna M; Guitton, Matthieu J

2017-02-01

Considering the status of the Internet as a prominent source of health information, assessing online health material has become a central issue in patient education. We describe the strategies available to evaluate the characteristics of online health information, including readability, emotional content, understandability, usability. Popular tools used in assessment of readability, emotional content and comprehensibility of online health information were reviewed. Tools designed to evaluate both printed and online material were considered. Readability tools are widely used in online health material evaluation and are highly covariant. Assessment of emotional content of online health-related communications via sentiment analysis tools is becoming more popular. Understandability and usability tools have been developed specifically for health-related material, but each tool has important limitations and has been tested on a limited number of health issues. Despite the availability of numerous assessment tools, their overall reliability differs between readability (high) and understandability (low). Approaches combining multiple assessment tools and involving both quantitative and qualitative observations would optimize assessment strategies. Effective assessment of online health information should rely on mixed strategies combining quantitative and qualitative evaluations. Assessment tools should be selected according to their functional properties and compatibility with target material. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Global Health Security Agenda: Joint External Evaluation and Legislation-A 1-Year Review.

PubMed

Forzley, Michele

In 2014, the IHR Review Committee recommended moving from exclusive self-evaluation to a combination of domestic and independent experts and began the process in conjunction with stakeholders to develop the Joint External Evaluation tool. The tool was launched in February 2016, and at the 2016 WHA, the IHR Review Committee recommended that all states parties should undertake assessments of their core capacities using the JEE tool and results of other evaluation processes such as the OIE PVS. A goal was set to conduct 50 country JEE assessments prior to WHA 2017. It is notable that legislation was added as a separate element of the JEE tool coupled with 2 indicators. Given the importance of law to the development discourse today, more needs to be done with the JEE with regards to legislation for the benefits of the law to be realized in global health security and overall in health outcomes. As we are at the 1-year anniversary of the tool, and WHO has begun a review of the JEE tool and requests for feedback are circulating, this article focuses on the JEE element of legislation and proposes some simple and substantive fixes. Considering the importance of law in the context of the GHSA, the results of the JEE tool are reviewed, and, drawing on the author's experience with the tool and other IHR and GHSA legal assessments, a case is made for a significant revision of the tool section on legislation and the manner in which the subject of legislation is integrated during the evaluation process.

Assessment Tool Development for Extracurricular Smet Programs for Girls

NASA Astrophysics Data System (ADS)

House, Jody; Johnson, Molly; Borthwick, Geoffrey

Many different programs have been designed to increase girls' interest in and exposure to science, mathematics, engineering, and technology (SMET). Two of these programs are discussed and contrasted in the dimensions of length, level of science content, pedagogical approach, degree of self- vs. parent-selected participants, and amount of communitybuilding content. Two different evaluation tools were used. For one program, a modified version of the University of Pittsburgh's undergraduate engineering attitude assessment survey was used. Program participants' responses were compared to those from a fifth grade, mixed-sex science class. The only gender difference found was in the area of parental encouragement. The girls in the special class were more encouraged to participate in SMET areas. For the second program, a new age-appropriate tool developed specifically for these types of programs was used, and the tool itself was evaluated. The results indicate that the new tool has construct validity. On the basis of these preliminary results, a long-term plan for the continued development of the assessment tool is outlined.

Evaluation and Verification of Decadal Predictions using the MiKlip Central Evaluation System - a Case Study using the MiKlip Prototype Model Data

NASA Astrophysics Data System (ADS)

Illing, Sebastian; Schuster, Mareike; Kadow, Christopher; Kröner, Igor; Richling, Andy; Grieger, Jens; Kruschke, Tim; Lang, Benjamin; Redl, Robert; Schartner, Thomas; Cubasch, Ulrich

2016-04-01

MiKlip is project for medium-term climate prediction funded by the Federal Ministry of Education and Research in Germany (BMBF) and aims to create a model system that is able provide reliable decadal climate forecasts. During the first project phase of MiKlip the sub-project INTEGRATION located at Freie Universität Berlin developed a framework for scientific infrastructures (FREVA). More information about FREVA can be found in EGU2016-13060. An instance of this framework is used as Central Evaluation System (CES) during the MiKlip project. Throughout the first project phase various sub-projects developed over 25 analysis tools - so called plugins - for the CES. The main focus of these plugins is on the evaluation and verification of decadal climate prediction data, but most plugins are not limited to this scope. They target a wide range of scientific questions. Starting from preprocessing tools like the "LeadtimeSelector", which creates lead-time dependent time-series from decadal hindcast sets, over tracking tools like the "Zykpak" plugin, which can objectively locate and track mid-latitude cyclones, to plugins like "MurCSS" or "SPECS", which calculate deterministic and probabilistic skill metrics. We also integrated some analyses from Model Evaluation Tools (MET), which was developed at NCAR. We will show the theoretical background, technical implementation strategies, and some interesting results of the evaluation of the MiKlip Prototype decadal prediction system for a selected set of these tools.

A Tool for the Automated Design and Evaluation of Habitat Interior Layouts

NASA Technical Reports Server (NTRS)

Simon, Matthew A.; Wilhite, Alan W.

2013-01-01

The objective of space habitat design is to minimize mass and system size while providing adequate space for all necessary equipment and a functional layout that supports crew health and productivity. Unfortunately, development and evaluation of interior layouts is often ignored during conceptual design because of the subjectivity and long times required using current evaluation methods (e.g., human-in-the-loop mockup tests and in-depth CAD evaluations). Early, more objective assessment could prevent expensive design changes that may increase vehicle mass and compromise functionality. This paper describes a new interior design evaluation method to enable early, structured consideration of habitat interior layouts. This interior layout evaluation method features a comprehensive list of quantifiable habitat layout evaluation criteria, automatic methods to measure these criteria from a geometry model, and application of systems engineering tools and numerical methods to construct a multi-objective value function measuring the overall habitat layout performance. In addition to a detailed description of this method, a C++/OpenGL software tool which has been developed to implement this method is also discussed. This tool leverages geometry modeling coupled with collision detection techniques to identify favorable layouts subject to multiple constraints and objectives (e.g., minimize mass, maximize contiguous habitable volume, maximize task performance, and minimize crew safety risks). Finally, a few habitat layout evaluation examples are described to demonstrate the effectiveness of this method and tool to influence habitat design.

NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare.

PubMed

Akl, Elie A; Treweek, Shaun; Foy, Robbie; Francis, Jill; Oxman, Andrew D

2007-06-26

The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions.

NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare

PubMed Central

Akl, Elie A; Treweek, Shaun; Foy, Robbie; Francis, Jill; Oxman, Andrew D

2007-01-01

Background The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. Methods We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. Results NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial Conclusion NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions. PMID:17594495

Open source tools for ATR development and performance evaluation

NASA Astrophysics Data System (ADS)

Baumann, James M.; Dilsavor, Ronald L.; Stubbles, James; Mossing, John C.

2002-07-01

Early in almost every engineering project, a decision must be made about tools; should I buy off-the-shelf tools or should I develop my own. Either choice can involve significant cost and risk. Off-the-shelf tools may be readily available, but they can be expensive to purchase and to maintain licenses, and may not be flexible enough to satisfy all project requirements. On the other hand, developing new tools permits great flexibility, but it can be time- (and budget-) consuming, and the end product still may not work as intended. Open source software has the advantages of both approaches without many of the pitfalls. This paper examines the concept of open source software, including its history, unique culture, and informal yet closely followed conventions. These characteristics influence the quality and quantity of software available, and ultimately its suitability for serious ATR development work. We give an example where Python, an open source scripting language, and OpenEV, a viewing and analysis tool for geospatial data, have been incorporated into ATR performance evaluation projects. While this case highlights the successful use of open source tools, we also offer important insight into risks associated with this approach.

Evaluation and process development of salt cedar and juniper biocomposites as tools to utilize exotic and invasive species and restore native ecosystems

Treesearch

Jerrold E. Winandy; Craig M. Clemons; Nicole M. Stark; James H. Muehl; R. Sam Williams

2005-01-01

This research program is developing and evaluating potential value-added uses for a variety of exotic invasive woody species, such as salt cedar (Tamarisk spp.), one-seed juniper (Juniperus monosperma), and eastern red- cedar (Juniperus virginiana). Because each of these species is encroaching into America's natural indigenous ecosystems, land managers need tools...

Development of an accessibility formulation to measure customers' evaluations of demand-responsive transit (DRT) systems : final report.

DOT National Transportation Integrated Search

2017-03-01

This report discusses the application of the paratransit microsimulation patron accessibility analysis tool : developed by the University of Texas researchers. The research team worked on updating the DRT Accessibility : Tool developed by the Texas D...

Electronic tools to support medication reconciliation: a systematic review.

PubMed

Marien, Sophie; Krug, Bruno; Spinewine, Anne

2017-01-01

Medication reconciliation (MedRec) is essential for reducing patient harm caused by medication discrepancies across care transitions. Electronic support has been described as a promising approach to moving MedRec forward. We systematically reviewed the evidence about electronic tools that support MedRec, by (a) identifying tools; (b) summarizing their characteristics with regard to context, tool, implementation, and evaluation; and (c) summarizing key messages for successful development and implementation. We searched PubMed, the Cumulative Index to Nursing and Allied Health Literature, Embase, PsycINFO, and the Cochrane Library, and identified additional reports from reference lists, reviews, and patent databases. Reports were included if the electronic tool supported medication history taking and the identification and resolution of medication discrepancies. Two researchers independently selected studies, evaluated the quality of reporting, and extracted data. Eighteen reports relative to 11 tools were included. There were eight quality improvement projects, five observational effectiveness studies, three randomized controlled trials (RCTs) or RCT protocols (ie, descriptions of RCTs in progress), and two patents. All tools were developed in academic environments in North America. Most used electronic data from multiple sources and partially implemented functionalities considered to be important. Relevant information on functionalities and implementation features was frequently missing. Evaluations mainly focused on usability, adherence, and user satisfaction. One RCT evaluated the effect on potential adverse drug events. Successful implementation of electronic tools to support MedRec requires favorable context, properly designed tools, and attention to implementation features. Future research is needed to evaluate the effect of these tools on the quality and safety of healthcare. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Participatory methods for Inuit public health promotion and programme evaluation in Nunatsiavut, Canada.

PubMed

Saini, Manpreet

2017-01-01

Engaging stakeholders is crucial for health promotion and programme evaluations; understanding how to best engage stakeholders is less clear, especially within Indigenous communities. The objectives of this thesis research were to use participatory methods to: (1) co-develop and evaluate a whiteboard video for use as a public health promotion tool in Rigolet, Nunatsiavut, and (2) develop and validate a framework for participatory evaluation of Inuit public health initiatives in Nunatsiavut, Labrador. Data collection tools included interactive workshops, community events, interviews, focus-group discussions and surveys. Results indicated the whiteboard video was an engaging and suitable medium for sharing public health messaging due to its contextually relevant elements. Participants identified 4 foundational evaluation framework components necessary to conduct appropriate evaluations, including: (1) community engagement, (2) collaborative evaluation development, (3) tailored evaluation data collection and (4) evaluation scope. This research illustrates stakeholder participation is critical to develop and evaluate contextually relevant public health initiatives in Nunatsiavut, Labrador and should be considered in other Indigenous communities.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

Assessment Tools for the Evaluation of Risk

EPA Science Inventory

ASTER (Assessment Tools for the Evaluation of Risk) was developed by the U.S. EPA Mid-Continent Ecology Division, Duluth, MN to assist regulators in performing ecological risk assessments. ASTER is an integration of the ECOTOXicology Database (ECOTOX; Evaluating the Effectiveness of Web-based Climate Resilience Decision Support Tools: Insights from Coastal New Jersey

NASA Astrophysics Data System (ADS)

Brady, M.; Lathrop, R.; Auermuller, L. M.; Leichenko, R.

2016-12-01

Despite the recent surge of Web-based decision support tools designed to promote resiliency in U.S. coastal communities, to-date there has been no systematic study of their effectiveness. This study demonstrates a method to evaluate important aspects of effectiveness of four Web map tools designed to promote consideration of climate risk information in local decision-making and planning used in coastal New Jersey. In summer 2015, the research team conducted in-depth phone interviews with users of one regulatory and three non-regulatory Web map tools using a semi-structured questionnaire. The interview and analysis design drew from a combination of effectiveness evaluation approaches developed in software and information usability, program evaluation, and management information system (MIS) research. Effectiveness assessment results were further analyzed and discussed in terms of conceptual hierarchy of system objectives defined by respective tool developer and user organizations represented in the study. Insights from the interviews suggest that users rely on Web tools as a supplement to desktop and analog map sources because they provide relevant and up-to-date information in a highly accessible and mobile format. The users also reported relying on multiple information sources and comparison between digital and analog sources for decision support. However, with respect to this decision support benefit, users were constrained by accessibility factors such as lack of awareness and training with some tools, lack of salient information such as planning time horizons associated with future flood scenarios, and environmental factors such as mandates restricting some users to regulatory tools. Perceptions of Web tool credibility seem favorable overall, but factors including system design imperfections and inconsistencies in data and information across platforms limited trust, highlighting a need for better coordination between tools. Contributions of the study include user feedback on web-tool system designs consistent with collaborative methods for enhancing usability and a systematic look at effectiveness that includes both user perspectives and consideration of developer and organizational objectives.

Performance profiling for brachytherapy applications

NASA Astrophysics Data System (ADS)

Choi, Wonqook; Cho, Kihyeon; Yeo, Insung

2018-05-01

In many physics applications, a significant amount of software (e.g. R, ROOT and Geant4) is developed on novel computing architectures, and much effort is expended to ensure the software is efficient in terms of central processing unit (CPU) time and memory usage. Profiling tools are used during the evaluation process to evaluate the efficiency; however, few such tools are able to accommodate low-energy physics regions. To address this limitation, we developed a low-energy physics profiling system in Geant4 to profile the CPU time and memory of software applications in brachytherapy applications. This paper describes and evaluates specific models that are applied to brachytherapy applications in Geant4, such as QGSP_BIC_LIV, QGSP_BIC_EMZ, and QGSP_BIC_EMY. The physics range in this tool allows it to be used to generate low energy profiles in brachytherapy applications. This was a limitation in previous studies, which caused us to develop a new profiling tool that supports profiling in the MeV range, in contrast to the TeV range that is supported by existing high-energy profiling tools. In order to easily compare the profiling results between low-energy and high-energy modes, we employed the same software architecture as that in the SimpliCarlo tool developed at the Fermilab National Accelerator Laboratory (FNAL) for the Large Hadron Collider (LHC). The results show that the newly developed profiling system for low-energy physics (less than MeV) complements the current profiling system used for high-energy physics (greater than TeV) applications.

Evolution of a Simulation Testbed into an Operational Tool

NASA Technical Reports Server (NTRS)

Sheth, Kapil; Bilimoria, Karl D.; Sridhar, Banavar; Sterenchuk, Mike; Niznik, Tim; O'Neill, Tom; Clymer, Alexis; Gutierrez Nolasco, Sebastian; Edholm, Kaj; Shih, Fu-Tai

2017-01-01

This paper describes the evolution over a 20-year period of the Future ATM (Air Traffic Management) Concepts Evaluation Tool (FACET) from a National Airspace System (NAS) based simulation testbed into an operational tool. FACET was developed as a testbed for assessing futuristic ATM concepts, e.g., automated conflict detection and resolution. NAS Constraint Evaluation and Notification Tool (NASCENT) is an application, within FACET, for alerting airspace users of inefficiencies in flight operations and advising time- and fuel-saving reroutes.It is currently in use at American Airlines Integrated Operations Center in Fort Worth, TX. The concepts assessed,research conducted, and the operational capability developed, along with the NASA support and achievements are presented in this paper.

Development and psychometric testing of a Clinical Reasoning Evaluation Simulation Tool (CREST) for assessing nursing students' abilities to recognize and respond to clinical deterioration.

PubMed

Liaw, Sok Ying; Rashasegaran, Ahtherai; Wong, Lai Fun; Deneen, Christopher Charles; Cooper, Simon; Levett-Jones, Tracy; Goh, Hongli Sam; Ignacio, Jeanette

2018-03-01

The development of clinical reasoning skills in recognising and responding to clinical deterioration is essential in pre-registration nursing education. Simulation has been increasingly used by educators to develop this skill. To develop and evaluate the psychometric properties of a Clinical Reasoning Evaluation Simulation Tool (CREST) for measuring clinical reasoning skills in recognising and responding to clinical deterioration in a simulated environment. A scale development with psychometric testing and mixed methods study. Nursing students and academic staff were recruited at a university. A three-phase prospective study was conducted. Phase 1 involved the development and content validation of the CREST; Phase 2 included the psychometric testing of the tool with 15 second-year and 15 third-year nursing students who undertook the simulation-based assessment; Phase 3 involved the usability testing of the tool with nine academic staff through a survey questionnaire and focus group discussion. A 10-item CREST was developed based on a model of clinical reasoning. A content validity of 0.93 was obtained from the validation of 15 international experts. The construct validity was supported as the third-year students demonstrated significantly higher (p<0.001) clinical reasoning scores than the second-year students. The concurrent validity was also supported with significant positive correlations between global rating scores and almost all subscale scores, and the total scores. The predictive validity was supported with an existing tool. The internal consistency was high with a Cronbach's alpha of 0.92. A high inter-rater reliability was demonstrated with an intraclass correlation coefficient of 0.88. The usability of the tool was rated positively by the nurse educators but the need to ease the scoring process was highlighted. A valid and reliable tool was developed to measure the effectiveness of simulation in developing clinical reasoning skills for recognising and responding to clinical deterioration. Copyright © 2017. Published by Elsevier Ltd.

The Stuttering Treatment Research Evaluation and Assessment Tool (STREAT): Evaluating Treatment Research as Part of Evidence-Based Practice

ERIC Educational Resources Information Center

Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.

2006-01-01

Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…

Social Work Admission Assessment Tool for Identifying Patients in Need of Comprehensive Social Work Evaluation

ERIC Educational Resources Information Center

Boutin-Foster, Carla; Euster, Sona; Rolon, Yvette; Motal, Athena; BeLue, Rhonda; Kline, Robin; Charlson, Mary E.

2005-01-01

Early identification of patients who need a social work evaluation is integral to effective discharge planning. This article describes the development and application of the Social Work Admission Assessment Tool (SWAAT), a six-item scale that identifies patients with complicated discharge needs who require a social work evaluation. It addresses…

Relating MBSE to Spacecraft Development: A NASA Pathfinder

NASA Technical Reports Server (NTRS)

Othon, Bill

2016-01-01

The NASA Engineering and Safety Center (NESC) has sponsored a Pathfinder Study to investigate how Model Based Systems Engineering (MBSE) and Model Based Engineering (MBE) techniques can be applied by NASA spacecraft development projects. The objectives of this Pathfinder Study included analyzing both the products of the modeling activity, as well as the process and tool chain through which the spacecraft design activities are executed. Several aspects of MBSE methodology and process were explored. Adoption and consistent use of the MBSE methodology within an existing development environment can be difficult. The Pathfinder Team evaluated the possibility that an "MBSE Template" could be developed as both a teaching tool as well as a baseline from which future NASA projects could leverage. Elements of this template include spacecraft system component libraries, data dictionaries and ontology specifications, as well as software services that do work on the models themselves. The Pathfinder Study also evaluated the tool chain aspects of development. Two chains were considered: 1. The Development tool chain, through which SysML model development was performed and controlled, and 2. The Analysis tool chain, through which both static and dynamic system analysis is performed. Of particular interest was the ability to exchange data between SysML and other engineering tools such as CAD and Dynamic Simulation tools. For this study, the team selected a Mars Lander vehicle as the element to be designed. The paper will discuss what system models were developed, how data was captured and exchanged, and what analyses were conducted.

Evaluating Digital Authoring Tools

ERIC Educational Resources Information Center

Wilde, Russ

2004-01-01

As the quality of authoring software increases, online course developers become less reliant on proprietary learning management systems, and develop skills in the design of original, in-house materials and the delivery platforms for them. This report examines the capabilities of digital authoring software tools for the development of learning…

Automated Geospatial Watershed Assessment Tool (AGWA): Applications for Assessing the Impact of Urban Growth and the use of Low Impact Development Practices.

EPA Science Inventory

New tools and functionality have been incorporated into the Automated Geospatial Watershed Assessment Tool (AGWA) to assess the impact of urban growth and evaluate the effects of low impact development (LID) practices. AGWA (see: www.tucson.ars.ag.gov/agwa or http://www.epa.gov...

Development and Piloting of a Food Safety Audit Tool for the Domestic Environment

PubMed Central

Borrusso, Patricia; Quinlan, Jennifer J.

2013-01-01

Research suggests that consumers often mishandle food in the home based on survey and observation studies. There is a need for a standardized tool for researchers to objectively evaluate the prevalence and identify the nature of food safety risks in the domestic environment. An audit tool was developed to measure compliance with recommended sanitation, refrigeration and food storage conditions in the domestic kitchen. The tool was piloted by four researchers who independently completed the inspection in 22 homes. Audit tool questions were evaluated for reliability using the κ statistic. Questions that were not sufficiently reliable (κ < 0.5) or did not provide direct evidence of risk were revised or eliminated from the final tool. Piloting the audit tool found good reliability among 18 questions, 6 questions were revised and 28 eliminated, resulting in a final 24 question tool. The audit tool was able to identify potential food safety risks, including evidence of pest infestation (27%), incorrect refrigeration temperature (73%), and lack of hot water (>43 °C, 32%). The audit tool developed here provides an objective measure for researchers to observe and record the most prevalent food safety risks in consumer’s kitchens and potentially compare risks among consumers of different demographics. PMID:28239139

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

DSC: software tool for simulation-based design of control strategies applied to wastewater treatment plants.

PubMed

Ruano, M V; Ribes, J; Seco, A; Ferrer, J

2011-01-01

This paper presents a computer tool called DSC (Simulation based Controllers Design) that enables an easy design of control systems and strategies applied to wastewater treatment plants. Although the control systems are developed and evaluated by simulation, this tool aims to facilitate the direct implementation of the designed control system to the PC of the full-scale WWTP (wastewater treatment plants). The designed control system can be programmed in a dedicated control application and can be connected to either the simulation software or the SCADA of the plant. To this end, the developed DSC incorporates an OPC server (OLE for process control) which facilitates an open-standard communication protocol for different industrial process applications. The potential capabilities of the DSC tool are illustrated through the example of a full-scale application. An aeration control system applied to a nutrient removing WWTP was designed, tuned and evaluated with the DSC tool before its implementation in the full scale plant. The control parameters obtained by simulation were suitable for the full scale plant with only few modifications to improve the control performance. With the DSC tool, the control systems performance can be easily evaluated by simulation. Once developed and tuned by simulation, the control systems can be directly applied to the full-scale WWTP.

An evaluation of copy number variation detection tools for cancer using whole exome sequencing data.

PubMed

Zare, Fatima; Dow, Michelle; Monteleone, Nicholas; Hosny, Abdelrahman; Nabavi, Sheida

2017-05-31

Recently copy number variation (CNV) has gained considerable interest as a type of genomic/genetic variation that plays an important role in disease susceptibility. Advances in sequencing technology have created an opportunity for detecting CNVs more accurately. Recently whole exome sequencing (WES) has become primary strategy for sequencing patient samples and study their genomics aberrations. However, compared to whole genome sequencing, WES introduces more biases and noise that make CNV detection very challenging. Additionally, tumors' complexity makes the detection of cancer specific CNVs even more difficult. Although many CNV detection tools have been developed since introducing NGS data, there are few tools for somatic CNV detection for WES data in cancer. In this study, we evaluated the performance of the most recent and commonly used CNV detection tools for WES data in cancer to address their limitations and provide guidelines for developing new ones. We focused on the tools that have been designed or have the ability to detect cancer somatic aberrations. We compared the performance of the tools in terms of sensitivity and false discovery rate (FDR) using real data and simulated data. Comparative analysis of the results of the tools showed that there is a low consensus among the tools in calling CNVs. Using real data, tools show moderate sensitivity (~50% - ~80%), fair specificity (~70% - ~94%) and poor FDRs (~27% - ~60%). Also, using simulated data we observed that increasing the coverage more than 10× in exonic regions does not improve the detection power of the tools significantly. The limited performance of the current CNV detection tools for WES data in cancer indicates the need for developing more efficient and precise CNV detection methods. Due to the complexity of tumors and high level of noise and biases in WES data, employing advanced novel segmentation, normalization and de-noising techniques that are designed specifically for cancer data is necessary. Also, CNV detection development suffers from the lack of a gold standard for performance evaluation. Finally, developing tools with user-friendly user interfaces and visualization features can enhance CNV studies for a broader range of users.

Developing a Tool to Evaluate Differences in Beliefs about Science Teaching and Learning among Freshman Science Student Teachers from Different Science Teaching Domains: A Case Study

ERIC Educational Resources Information Center

Markic, Silvija; Eilks, Ingo; Valanides, Nicos

2008-01-01

This paper presents a pilot case study on developing a qualitative tool to evaluate science student teachers' beliefs concerning science teaching and learning. The study is based on student teachers' drawings of themselves in a typical classroom situation and four open questions. Data was collected from 104 freshman science student teachers, and…

GET SMARTE: DECISION TOOLS TO REVITALIZE BROWNFIELDS

EPA Science Inventory

SMARTe (Sustainable Management Approaches and Revitalization Tools-electronic) is an open-source, web-based, decision-support system for developing and evaluating future use scenarios for potentially contaminated sites (i.e., brownfields). It contains resources and analysis tools...

Developing a tool to support diagnostic delivery of dementia.

PubMed

Bennett, Claire E; De Boos, Danielle; Moghaddam, Nima G

2018-01-01

It is increasingly recognised that there are challenges affecting the current delivery of dementia diagnoses. Steps are required to address this. Current good practice guidelines provide insufficient direction and interventions from other healthcare settings do not appear to fully translate to dementia care settings. This project has taken a sequential two-phase design to developing a tool specific to dementia diagnostic delivery. Interviews with 14 participants explored good diagnostic delivery. Thematic analysis produced key themes (overcoming barriers, navigation of multiple journeys and completing overt and covert tasks) that were used to inform the design of a tool for use by clinicians, patients and companions. The tool was evaluated for acceptability in focused group discussions with 13 participants, which indicated a desire to use the tool and that it could encourage good practice. Adaptations were highlighted and incorporated to improve acceptability. Future research is now required to further evaluate the tool.

Concept mapping in a critical care orientation program: a pilot study to develop critical thinking and decision-making skills in novice nurses.

PubMed

Wahl, Stacy E; Thompson, Anita M

2013-10-01

Newly graduated registered nurses who were hired into a critical care intensive care unit showed a lack of critical thinking skills to inform their clinical decision-making abilities. This study evaluated the effectiveness of concept mapping as a teaching tool to improve critical thinking and clinical decision-making skills in novice nurses. A self-evaluation tool was administered before and after the learning intervention. The 25-item tool measured five key indicators of the development of critical thinking skills: problem recognition, clinical decision-making, prioritization, clinical implementation, and reflection. Statistically significant improvements were seen in 10 items encompassing all five indicators. Concept maps are an effective tool for educators to use in assisting novice nurses to develop their critical thinking and clinical decision-making skills. Copyright 2013, SLACK Incorporated.

The development and evaluation of a new coding system for medical records.

PubMed

Papazissis, Elias

2014-01-01

The present study aims to develop a simple, reliable and easy tool enabling clinicians to codify the major part of individualized medical details (patient history and findings of physical examination) quickly and easily in routine medical practice, by entering data to a purpose-built software application, using structure data elements and detailed medical illustrations. We studied medical records of 9,320 patients and we extracted individualized medical details. We recorded the majority of symptoms and the majority of findings of physical examination into the system, which was named IMPACT® (Intelligent Medical Patient Record and Coding Tool). Subsequently the system was evaluated by clinicians, based on the examination of 1206 patients. The evaluation results showed that IMPACT® is an efficient tool, easy to use even under time-pressing conditions. IMPACT® seems to be a promising tool for illustration-guided, structured data entry of medical narrative, in electronic patient records.

Software Tools to Support the Assessment of System Health

NASA Technical Reports Server (NTRS)

Melcher, Kevin J.

2013-01-01

This presentation provides an overview of three software tools that were developed by the NASA Glenn Research Center to support the assessment of system health: the Propulsion Diagnostic Method Evaluation Strategy (ProDIMES), the Systematic Sensor Selection Strategy (S4), and the Extended Testability Analysis (ETA) tool. Originally developed to support specific NASA projects in aeronautics and space, these software tools are currently available to U.S. citizens through the NASA Glenn Software Catalog. The ProDiMES software tool was developed to support a uniform comparison of propulsion gas path diagnostic methods. Methods published in the open literature are typically applied to dissimilar platforms with different levels of complexity. They often address different diagnostic problems and use inconsistent metrics for evaluating performance. As a result, it is difficult to perform a one ]to ]one comparison of the various diagnostic methods. ProDIMES solves this problem by serving as a theme problem to aid in propulsion gas path diagnostic technology development and evaluation. The overall goal is to provide a tool that will serve as an industry standard, and will truly facilitate the development and evaluation of significant Engine Health Management (EHM) capabilities. ProDiMES has been developed under a collaborative project of The Technical Cooperation Program (TTCP) based on feedback provided by individuals within the aircraft engine health management community. The S4 software tool provides a framework that supports the optimal selection of sensors for health management assessments. S4 is structured to accommodate user ]defined applications, diagnostic systems, search techniques, and system requirements/constraints. One or more sensor suites that maximize this performance while meeting other user ]defined system requirements that are presumed to exist. S4 provides a systematic approach for evaluating combinations of sensors to determine the set or sets of sensors that optimally meet the performance goals and the constraints. It identifies optimal sensor suite solutions by utilizing a merit (i.e., cost) function with one of several available optimization approaches. As part of its analysis, S4 can expose fault conditions that are difficult to diagnose due to an incomplete diagnostic philosophy and/or a lack of sensors. S4 was originally developed and applied to liquid rocket engines. It was subsequently used to study the optimized selection of sensors for a simulation ]based aircraft engine diagnostic system. The ETA Tool is a software ]based analysis tool that augments the testability analysis and reporting capabilities of a commercial ]off ]the ]shelf (COTS) package. An initial diagnostic assessment is performed by the COTS software using a user ]developed, qualitative, directed ]graph model of the system being analyzed. The ETA Tool accesses system design information captured within the model and the associated testability analysis output to create a series of six reports for various system engineering needs. These reports are highlighted in the presentation. The ETA Tool was developed by NASA to support the verification of fault management requirements early in the Launch Vehicle process. Due to their early development during the design process, the TEAMS ]based diagnostic model and the ETA Tool were able to positively influence the system design by highlighting gaps in failure detection, fault isolation, and failure recovery.

Clarus multi-state regional demonstrations, evaluation of use case #5 : enhanced road weather content for traveler advisories.

DOT National Transportation Integrated Search

2011-05-11

This evaluation report presents an assessment of the benefits of a new road condition forecast tool that offers road weather information to travelers. The tool has been developed by Meridian Environmental Technology, Inc. and has been demonstrated in...

Evaluating auditory perception and communication demands required to carry out work tasks and complimentary hearing resources and skills for older workers with hearing loss.

PubMed

Jennings, M B; Shaw, L; Hodgins, H; Kuchar, D A; Bataghva, L Poost-Foroosh

2010-01-01

For older workers with acquired hearing loss, this loss as well as the changing nature of work and the workforce, may lead to difficulties and disadvantages in obtaining and maintaining employment. Currently there are very few instruments that can assist workplaces, employers and workers to prepare for older workers with hearing loss or with the evaluation of auditory perception demands of work, especially those relevant to communication, and safety sensitive workplaces that require high levels of communication. This paper introduces key theoretical considerations that informed the development of a new framework, The Audiologic Ergonomic (AE) Framework to guide audiologists, work rehabilitation professionals and workers in developing tools to support the identification and evaluation of auditory perception demands in the workplace, the challenges to communication and the subsequent productivity and safety in the performance of work duties by older workers with hearing loss. The theoretical concepts underpinning this framework are discussed along with next steps in developing tools such as the Canadian Hearing Demands Tool (C-HearD Tool) in advancing approaches to evaluate auditory perception and communication demands in the workplace.

SMARTE: HELPING COMMUNITIES EVALUATE REUSE OPTIONS AND OVERCOME REVITALIZATION OBSTACLES

EPA Science Inventory

SMARTe (Sustainable Management Approaches and Revitalization Tools electronic) is a web-based decision support tool being developed by the Office of Research and Development (ORD) in partnership with the Office of Brownfields and Land Revitalization (OBLR), the Interstate Techn...

Necessity to Develop a Tool to Evaluate Activity of Daily Living for Electric Powered Indoor/Outdoor Chair Users

PubMed Central

Lee, Jiwon; Lim, Jae Kuk; Lee, Min Jun; Jo, Yoon-Sik; Park, Jae Sung; Kim, Jong Moon

2015-01-01

Objective To evaluate changes in activity of daily living before and after provision of electric-powered indoor/outdoor chair (EPIOC), discuss problems of current activities of daily living (ADL) evaluating tools for EPIOC users, and provide preliminary data to develop ADL evaluation tool for EPIOC user. Methods A total of 70 users who were prescribed EPIOC and had been using for more than 1 year were recruited in this study. Before and after provision of EPIOC, MBI and FIM scores were measured and a questionnaire consisting of six categories (general socioeconomic states, currently using state, whether EPIOC was helpful for social participation and occupational chances, psychiatric influences, self-reported degrees of independency, and barriers of using EPIOC) was used. Results No difference in MBI scores before and after provision of EPIOC was observed. However, the wheelchair ambulation category showed a significant difference. While motor FIM was not significantly different from MBI, FIM score were significantly (p<0.05) higher than MBI. For questions regarding social participation frequency, helpfulness of EPIOC on confidence, refreshing patients' emotions and self-reported degrees of independence, all of them showed positive responses. Especially, EPIOC users' self-reported degree of independency showed favorable results. There was discrepancy in MBI or FIM measured by physicians. Conclusion Our study showed that there was a gap between the existing ADL evaluation tool and the ADL level that EPIOC users were actually feeling. Thus, it is necessary to develop an evaluation tool specifically for EPIOC. PMID:25932425

A Comparative Analysis of Life-Cycle Assessment Tools for ...

EPA Pesticide Factsheets

We identified and evaluated five life-cycle assessment tools that community decision makers can use to assess the environmental and economic impacts of end-of-life (EOL) materials management options. The tools evaluated in this report are waste reduction mode (WARM), municipal solid waste-decision support tool (MSW-DST), solid waste optimization life-cycle framework (SWOLF), environmental assessment system for environmental technologies (EASETECH), and waste and resources assessment for the environment (WRATE). WARM, MSW-DST, and SWOLF were developed for US-specific materials management strategies, while WRATE and EASETECH were developed for European-specific conditions. All of the tools (with the exception of WARM) allow specification of a wide variety of parameters (e.g., materials composition and energy mix) to a varying degree, thus allowing users to model specific EOL materials management methods even outside the geographical domain they are originally intended for. The flexibility to accept user-specified input for a large number of parameters increases the level of complexity and the skill set needed for using these tools. The tools were evaluated and compared based on a series of criteria, including general tool features, the scope of the analysis (e.g., materials and processes included), and the impact categories analyzed (e.g., climate change, acidification). A series of scenarios representing materials management problems currently relevant to c

Evaluating a Bedside Tool for Neuroanatomical Localization with Extended-Matching Questions

ERIC Educational Resources Information Center

Tan, Kevin; Chin, Han Xin; Yau, Christine W. L.; Lim, Erle C. H.; Samarasekera, Dujeepa; Ponnamperuma, Gominda; Tan, Nigel C. K.

2018-01-01

Neuroanatomical localization (NL) is a key skill in neurology, but learners often have difficulty with it. This study aims to evaluate a concise NL tool (NLT) developed to help teach and learn NL. To evaluate the NLT, an extended-matching questions (EMQ) test to assess NL was designed and validated. The EMQ was validated with fourth-year medical…

Evaluation of the acceptability of a CD-Rom as a health promotion tool for Inuit in Ottawa.

PubMed

McShane, Kelly E; Smylie, Janet K; Hastings, Paul D; Prince, Conrad; Siedule, Connie

2013-01-01

There are few health promotion tools for urban Inuit, and there is a specific dearth of evaluations on such tools. The current study used a community-specific approach in the evaluation of a health promotion tool, based on an urban Inuit community's preferences of health knowledge sources and distribution strategies. In partnership with the Tungasuvvingat Inuit Family Health Team in Ottawa, a CD-Rom was developed featuring an Inuk Elder presenting prenatal health messages in both Inuktitut and English. Also, relevant evaluation materials were developed. Using a mixed methods approach, 40 participants completed interviews prior to viewing the CD-Rom and participated in a focus group at follow-up. Questionnaires were also completed pre- and post-viewing to assess changes between expectations and reactions in order to document acceptability. Significant increases were found on satisfaction, acceptability of medium and relevance of content ratings. Qualitative findings also included (a) interest, uncertainty and conditional interest prior to viewing; and (b) positive evaluations of the CD-Rom. This suggests that CD-Rom technology has the potential for health promotion for urban Inuit, and the community-specific evaluation approach yielded useful information.

Evaluation of the acceptability of a CD-Rom as a health promotion tool for Inuit in Ottawa

PubMed Central

McShane, Kelly E.; Smylie, Janet K.; Hastings, Paul D.; Prince, Conrad; Siedule, Connie

2013-01-01

Background There are few health promotion tools for urban Inuit, and there is a specific dearth of evaluations on such tools. Objective The current study used a community-specific approach in the evaluation of a health promotion tool, based on an urban Inuit community's preferences of health knowledge sources and distribution strategies. In partnership with the Tungasuvvingat Inuit Family Health Team in Ottawa, a CD-Rom was developed featuring an Inuk Elder presenting prenatal health messages in both Inuktitut and English. Also, relevant evaluation materials were developed. Design Using a mixed methods approach, 40 participants completed interviews prior to viewing the CD-Rom and participated in a focus group at follow-up. Questionnaires were also completed pre- and post-viewing to assess changes between expectations and reactions in order to document acceptability. Results Significant increases were found on satisfaction, acceptability of medium and relevance of content ratings. Qualitative findings also included (a) interest, uncertainty and conditional interest prior to viewing; and (b) positive evaluations of the CD-Rom. Conclusions This suggests that CD-Rom technology has the potential for health promotion for urban Inuit, and the community-specific evaluation approach yielded useful information. PMID:23717816

Development of a Learning-Oriented Computer Assisted Instruction Designed to Improve Skills in the Clinical Assessment of the Nutritional Status: A Pilot Evaluation

PubMed Central

García de Diego, Laura; Cuervo, Marta; Martínez, J. Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient’s nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient’s needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum. PMID:25978456

Development of a learning-oriented computer assisted instruction designed to improve skills in the clinical assessment of the nutritional status: a pilot evaluation.

PubMed

García de Diego, Laura; Cuervo, Marta; Martínez, J Alfredo

2015-01-01

Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient's nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient's needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum.

GET SMARTE: DECISION TOOLS TO REVITALIZE COMMUNITIES (MAY 2006)

EPA Science Inventory

SMARTe (Sustainable Management Approaches and Revitalization Tools-electronic) is an open-source, web-based, decision-support system for developing and evaluating future use scenarios for potentially contaminated sites (i.e., brownfields). It contains resources and analysis tools...

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Development and Evaluation of a Case-Based Digital Learning Tool about Children's Mathematical Thinking for Elementary School Teachers (L-TEST)

ERIC Educational Resources Information Center

Olkun, Sinan; Altun, Arif; Deryakulu, Deniz

2009-01-01

It is important for teachers of mathematics to know how pupils react to certain mathematical situations and what these reactions imply, in order to design more effective instructional environments based on their learning needs. This study reports the development processes of a digital learning tool (Learning Tool for Elementary School Teachers…

Development of an Adaptable Display and Diagnostic System for the Evaluation of Tropical Cyclone Forecasts

NASA Astrophysics Data System (ADS)

Kucera, P. A.; Burek, T.; Halley-Gotway, J.

2015-12-01

NCAR's Joint Numerical Testbed Program (JNTP) focuses on the evaluation of experimental forecasts of tropical cyclones (TCs) with the goal of developing new research tools and diagnostic evaluation methods that can be transitioned to operations. Recent activities include the development of new TC forecast verification methods and the development of an adaptable TC display and diagnostic system. The next generation display and diagnostic system is being developed to support evaluation needs of the U.S. National Hurricane Center (NHC) and broader TC research community. The new hurricane display and diagnostic capabilities allow forecasters and research scientists to more deeply examine the performance of operational and experimental models. The system is built upon modern and flexible technology that includes OpenLayers Mapping tools that are platform independent. The forecast track and intensity along with associated observed track information are stored in an efficient MySQL database. The system provides easy-to-use interactive display system, and provides diagnostic tools to examine forecast track stratified by intensity. Consensus forecasts can be computed and displayed interactively. The system is designed to display information for both real-time and for historical TC cyclones. The display configurations are easily adaptable to meet the needs of the end-user preferences. Ongoing enhancements include improving capabilities for stratification and evaluation of historical best tracks, development and implementation of additional methods to stratify and compute consensus hurricane track and intensity forecasts, and improved graphical display tools. The display is also being enhanced to incorporate gridded forecast, satellite, and sea surface temperature fields. The presentation will provide an overview of the display and diagnostic system development and demonstration of the current capabilities.

Assessment of Energy Storage Alternatives in the Puget Sound Energy System Volume 2: Energy Storage Evaluation Tool

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wu, Di; Jin, Chunlian; Balducci, Patrick J.

2013-12-01

This volume presents the battery storage evaluation tool developed at Pacific Northwest National Laboratory (PNNL), which is used to evaluate benefits of battery storage for multiple grid applications, including energy arbitrage, balancing service, capacity value, distribution system equipment deferral, and outage mitigation. This tool is based on the optimal control strategies to capture multiple services from a single energy storage device. In this control strategy, at each hour, a look-ahead optimization is first formulated and solved to determine battery base operating point. The minute by minute simulation is then performed to simulate the actual battery operation. This volume provide backgroundmore » and manual for this evaluation tool.« less

Using the arthroscopic surgery skill evaluation tool as a pass-fail examination.

PubMed

Koehler, Ryan J; Nicandri, Gregg T

2013-12-04

Examination of arthroscopic skill requires evaluation tools that are valid and reliable with clear criteria for passing. The Arthroscopic Surgery Skill Evaluation Tool was developed as a video-based assessment of technical skill with criteria for passing established by a panel of experts. The purpose of this study was to test the validity and reliability of the Arthroscopic Surgery Skill Evaluation Tool as a pass-fail examination of arthroscopic skill. Twenty-eight residents and two sports medicine faculty members were recorded performing diagnostic knee arthroscopy on a left and right cadaveric specimen in our arthroscopic skills laboratory. Procedure videos were evaluated with use of the Arthroscopic Surgery Skill Evaluation Tool by two raters blind to subject identity. Subjects were considered to pass the Arthroscopic Surgery Skill Evaluation Tool when they attained scores of ≥ 3 on all eight assessment domains. The raters agreed on a pass-fail rating for fifty-five of sixty videos rated with an interclass correlation coefficient value of 0.83. Ten of thirty participants were assigned passing scores by both raters for both diagnostic arthroscopies performed in the laboratory. Receiver operating characteristic analysis demonstrated that logging more than eighty arthroscopic cases or performing more than thirty-five arthroscopic knee cases was predictive of attaining a passing Arthroscopic Surgery Skill Evaluation Tool score on both procedures performed in the laboratory. The Arthroscopic Surgery Skill Evaluation Tool is valid and reliable as a pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. This study demonstrates that the Arthroscopic Surgery Skill Evaluation Tool may be a useful tool for pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. Further study is necessary to determine whether the Arthroscopic Surgery Skill Evaluation Tool can be used for the assessment of multiple arthroscopic procedures and whether it can be used to evaluate arthroscopic procedures performed in the operating room.

Can Interactive Visualization Tools Engage and Support Pre-University Students in Exploring Non-Trivial Mathematical Concepts?

ERIC Educational Resources Information Center

Liang, Hai-Ning; Sedig, Kamran

2010-01-01

Many students find it difficult to engage with mathematical concepts. As a relatively new class of learning tools, visualization tools may be able to promote higher levels of engagement with mathematical concepts. Often, development of new tools may outpace empirical evaluations of the effectiveness of these tools, especially in educational…

Computer assisted blast design and assessment tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cameron, A.R.; Kleine, T.H.; Forsyth, W.W.

1995-12-31

In general the software required by a blast designer includes tools that graphically present blast designs (surface and underground), can analyze a design or predict its result, and can assess blasting results. As computers develop and computer literacy continues to rise the development of and use of such tools will spread. An example of the tools that are becoming available includes: Automatic blast pattern generation and underground ring design; blast design evaluation in terms of explosive distribution and detonation simulation; fragmentation prediction; blast vibration prediction and minimization; blast monitoring for assessment of dynamic performance; vibration measurement, display and signal processing;more » evaluation of blast results in terms of fragmentation; and risk and reliability based blast assessment. The authors have identified a set of criteria that are essential in choosing appropriate software blasting tools.« less

Integrate Evaluation into the Planning Process.

ERIC Educational Resources Information Center

Camp, William

1985-01-01

In an attempt to correct for limitations in the Program Evaluation and Review Technique-Critical Path Method (PERT-CPM), the Graphical Evaluation and Review Technique (GERT) has been developed. This management tool allows for evaluation during the facilities' development process. Two figures and two references are provided. (DCS)

Multidisciplinary eHealth Survey Evaluation Methods

ERIC Educational Resources Information Center

Karras, Bryant T.; Tufano, James T.

2006-01-01

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

Evaluating the Zebrafish Embryo Toxicity Test for Pesticide Hazard Screening

EPA Science Inventory

Given the numerous chemicals used in society, it is critical to develop tools for accurate and efficient evaluation of potential risks to human and ecological receptors. Fish embryo acute toxicity tests are 1 tool that has been shown to be highly predictive of standard, more reso...

Evaluation of the soil health nutrient tool for corn nitrogen recommendations across the Midwest

USDA-ARS?s Scientific Manuscript database

Use and development of soil biological tests for estimating soil N availability and subsequently corn (Zea mays L.) fertilizer N recommendations is garnering considerable interest. The objective of this research was to evaluate relationships between the Soil Health Nutrient Tool (SHNT), also known a...

The Visible Signature Modelling and Evaluation ToolBox

DTIC Science & Technology

2008-12-01

Technology Organisation DSTO–TR–2212 ABSTRACT A new software suite, the Visible Signature ToolBox ( VST ), has been developed to model and evaluate the...visible signatures of maritime platforms. The VST is a collection of commercial, off-the-shelf software and DSTO developed pro- grams and procedures. The...suite. The VST can be utilised to model and assess visible signatures of maritime platforms. A number of examples are presented to demonstrate the

Improving e-book access via a library-developed full-text search tool*

PubMed Central

Foust, Jill E.; Bergen, Phillip; Maxeiner, Gretchen L.; Pawlowski, Peter N.

2007-01-01

Purpose: This paper reports on the development of a tool for searching the contents of licensed full-text electronic book (e-book) collections. Setting: The Health Sciences Library System (HSLS) provides services to the University of Pittsburgh's medical programs and large academic health system. Brief Description: The HSLS has developed an innovative tool for federated searching of its e-book collections. Built using the XML-based Vivísimo development environment, the tool enables a user to perform a full-text search of over 2,500 titles from the library's seven most highly used e-book collections. From a single “Google-style” query, results are returned as an integrated set of links pointing directly to relevant sections of the full text. Results are also grouped into categories that enable more precise retrieval without reformulation of the search. Results/Evaluation: A heuristic evaluation demonstrated the usability of the tool and a web server log analysis indicated an acceptable level of usage. Based on its success, there are plans to increase the number of online book collections searched. Conclusion: This library's first foray into federated searching has produced an effective tool for searching across large collections of full-text e-books and has provided a good foundation for the development of other library-based federated searching products. PMID:17252065

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

Evaluation of tools used to measure critical thinking development in nursing and midwifery undergraduate students: a systematic review.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2015-07-01

Well developed critical thinking skills are essential for nursing and midwifery practices. The development of students' higher-order cognitive abilities, such as critical thinking, is also well recognised in nursing and midwifery education. Measurement of critical thinking development is important to demonstrate change over time and effectiveness of teaching strategies. To evaluate tools designed to measure critical thinking in nursing and midwifery undergraduate students. The following six databases were searched and resulted in the retrieval of 1191 papers: CINAHL, Ovid Medline, ERIC, Informit, PsycINFO and Scopus. After screening for inclusion, each paper was evaluated using the Critical Appraisal Skills Programme Tool. Thirty-four studies met the inclusion criteria and quality appraisal. Sixteen different tools that measure critical thinking were reviewed for reliability and validity and extent to which the domains of critical thinking were evident. Sixty percent of studies utilised one of four standardised commercially available measures of critical thinking. Reliability and validity were not consistently reported and there was a variation in reliability across studies that used the same measure. Of the remaining studies using different tools, there was also limited reporting of reliability making it difficult to assess internal consistency and potential applicability of measures across settings. Discipline specific instruments to measure critical thinking in nursing and midwifery are required, specifically tools that measure the application of critical thinking to practise. Given that critical thinking development occurs over an extended period, measurement needs to be repeated and multiple methods of measurement used over time. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

An Evaluation Tool for CONUS-Scale Estimates of Components of the Water Balance

NASA Astrophysics Data System (ADS)

Saxe, S.; Hay, L.; Farmer, W. H.; Markstrom, S. L.; Kiang, J. E.

2016-12-01

Numerous research groups are independently developing data products to represent various components of the water balance (e.g. runoff, evapotranspiration, recharge, snow water equivalent, soil moisture, and climate) at the scale of the conterminous United States. These data products are derived from a range of sources, including direct measurement, remotely-sensed measurement, and statistical and deterministic model simulations. An evaluation tool is needed to compare these data products and the components of the water balance they contain in order to identify the gaps in the understanding and representation of continental-scale hydrologic processes. An ideal tool will be an objective, universally agreed upon, framework to address questions related to closing the water balance. This type of generic, model agnostic evaluation tool would facilitate collaboration amongst different hydrologic research groups and improve modeling capabilities with respect to continental-scale water resources. By adopting a comprehensive framework to consider hydrologic modeling in the context of a complete water balance, it is possible to identify weaknesses in process modeling, data product representation and regional hydrologic variation. As part of its National Water Census initiative, the U.S. Geological survey is facilitating this dialogue to developing prototype evaluation tools.

Developing Oral Case Presentation Skills: Peer and Self-Evaluations as Instructional Tools.

PubMed

Williams, Dustyn E; Surakanti, Shravani

2016-01-01

Oral case presentation is an essential skill in clinical practice that is decidedly varied and understudied in teaching curricula. We developed a curriculum to improve oral case presentation skills in medical students. As part of an internal medicine clerkship, students receive instruction in the elements of a good oral case presentation and then present a real-world case in front of a video camera. Each student self-evaluates his/her presentation and receives evaluations from his/her peers. We expect peer and self-evaluation to be meaningful tools for developing skills in oral presentation. We hope to not only improve the quality of oral case presentations by students but also to reduce the time burden on faculty.

The Development of a Plant Risk Evaluation (PRE) Tool for Assessing the Invasive Potential of Ornamental Plants

PubMed Central

Conser, Christiana; Seebacher, Lizbeth; Fujino, David W.; Reichard, Sarah; DiTomaso, Joseph M.

2015-01-01

Weed Risk Assessment (WRA) methods for evaluating invasiveness in plants have evolved rapidly in the last two decades. Many WRA tools exist, but none were specifically designed to screen ornamental plants prior to being released into the environment. To be accepted as a tool to evaluate ornamental plants for the nursery industry, it is critical that a WRA tool accurately predicts non-invasiveness without falsely categorizing them as invasive. We developed a new Plant Risk Evaluation (PRE) tool for ornamental plants. The 19 questions in the final PRE tool were narrowed down from 56 original questions from existing WRA tools. We evaluated the 56 WRA questions by screening 21 known invasive and 14 known non-invasive ornamental plants. After statistically comparing the predictability of each question and the frequency the question could be answered for both invasive and non-invasive species, we eliminated questions that provided no predictive power, were irrelevant in our current model, or could not be answered reliably at a high enough percentage. We also combined many similar questions. The final 19 remaining PRE questions were further tested for accuracy using 56 additional known invasive plants and 36 known non-invasive ornamental species. The resulting evaluation demonstrated that when “needs further evaluation” classifications were not included, the accuracy of the model was 100% for both predicting invasiveness and non-invasiveness. When “needs further evaluation” classifications were included as either false positive or false negative, the model was still 93% accurate in predicting invasiveness and 97% accurate in predicting non-invasiveness, with an overall accuracy of 95%. We conclude that the PRE tool should not only provide growers with a method to accurately screen their current stock and potential new introductions, but also increase the probability of the tool being accepted for use by the industry as the basis for a nursery certification program. PMID:25803830

Deployment of a tool for measuring freeway safety performance.

DOT National Transportation Integrated Search

2011-12-01

This project updated and deployed a freeway safety performance measurement tool, building upon a previous project that developed the core methodology. The tool evaluates the cumulative risk over time of an accident or a particular kind of accident. T...

Toolpack mathematical software development environment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Osterweil, L.

1982-07-21

The purpose of this research project was to produce a well integrated set of tools for the support of numerical computation. The project entailed the specification, design and implementation of both a diversity of tools and an innovative tool integration mechanism. This large configuration of tightly integrated tools comprises an environment for numerical software development, and has been named Toolpack/IST (Integrated System of Tools). Following the creation of this environment in prototype form, the environment software was readied for widespread distribution by transitioning it to a development organization for systematization, documentation and distribution. It is expected that public release ofmore » Toolpack/IST will begin imminently and will provide a basis for evaluation of the innovative software approaches taken as well as a uniform set of development tools for the numerical software community.« less

Tools for Supporting Distributed Agile Project Planning

NASA Astrophysics Data System (ADS)

Wang, Xin; Maurer, Frank; Morgan, Robert; Oliveira, Josyleuda

Agile project planning plays an important part in agile software development. In distributed settings, project planning is severely impacted by the lack of face-to-face communication and the inability to share paper index cards amongst all meeting participants. To address these issues, several distributed agile planning tools were developed. The tools vary in features, functions and running platforms. In this chapter, we first summarize the requirements for distributed agile planning. Then we give an overview on existing agile planning tools. We also evaluate existing tools based on tool requirements. Finally, we present some practical advices for both designers and users of distributed agile planning tools.

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

Developing an Evaluation Tool for Assessing Clinical Ethics Consultation Skills in Simulation Based Education: The ACES Project.

PubMed

Wasson, Katherine; Parsi, Kayhan; McCarthy, Michael; Siddall, Viva Jo; Kuczewski, Mark

2016-06-01

The American Society for Bioethics and Humanities has created a quality attestation (QA) process for clinical ethics consultants; the pilot phase of reviewing portfolios has begun. One aspect of the QA process which is particularly challenging is assessing the interpersonal skills of individual clinical ethics consultants. We propose that using case simulation to evaluate clinical ethics consultants is an approach that can meet this need provided clear standards for assessment are identified. To this end, we developed the Assessing Clinical Ethics Skills (ACES) tool, which identifies and specifies specific behaviors that a clinical ethics consultant should demonstrate in an ethics case simulation. The aim is for the clinical ethics consultant or student to use a videotaped case simulation, along with the ACES tool scored by a trained rater, to demonstrate their competence as part of their QA portfolio. The development and piloting of the tool is described.

Testing and refining the Science in Risk Assessment and Policy (SciRAP) web-based platform for evaluating the reliability and relevance of in vivo toxicity studies.

PubMed

Beronius, Anna; Molander, Linda; Zilliacus, Johanna; Rudén, Christina; Hanberg, Annika

2018-05-28

The Science in Risk Assessment and Policy (SciRAP) web-based platform was developed to promote and facilitate structure and transparency in the evaluation of ecotoxicity and toxicity studies for hazard and risk assessment of chemicals. The platform includes sets of criteria and a colour-coding tool for evaluating the reliability and relevance of individual studies. The SciRAP method for evaluating in vivo toxicity studies was first published in 2014 and the aim of the work presented here was to evaluate and develop that method further. Toxicologists and risk assessors from different sectors and geographical areas were invited to test the SciRAP criteria and tool on a specific set of in vivo toxicity studies and to provide feedback concerning the scientific soundness and user-friendliness of the SciRAP approach. The results of this expert assessment were used to refine and improve both the evaluation criteria and the colour-coding tool. It is expected that the SciRAP web-based platform will continue to be developed and enhanced to keep up to date with the needs of end-users. Copyright © 2018 John Wiley & Sons, Ltd.

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design.

PubMed

Kastner, Monika; Sawka, Anna; Thorpe, Kevin; Chignel, Mark; Marquez, Christine; Newton, David; Straus, Sharon E

2011-07-22

Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines on assessing and managing osteoporosis are available, many patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions, a series of mixed-methods studies, and advice from experts in osteoporosis and human-factors engineering were used collectively to develop a multicomponent tool (targeted to family physicians and patients at risk for osteoporosis) that may support clinical decision making in osteoporosis disease management at the point of care. A three-phased approach will be used to evaluate the osteoporosis tool. In phase 1, the tool will be implemented in three family practices. It will involve ensuring optimal functioning of the tool while minimizing disruption to usual practice. In phase 2, the tool will be pilot tested in a quasi-experimental interrupted time series (ITS) design to determine if it can improve osteoporosis disease management at the point of care. Phase 3 will involve conducting a qualitative postintervention follow-up study to better understand participants' experiences and perceived utility of the tool and readiness to adopt the tool at the point of care. The osteoporosis tool has the potential to make several contributions to the development and evaluation of complex, chronic disease interventions, such as the inclusion of an implementation strategy prior to conducting an evaluation study. Anticipated benefits of the tool may be to increase awareness for patients about osteoporosis and its associated risks and provide an opportunity to discuss a management plan with their physician, which may all facilitate patient self-management.

Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design

PubMed Central

2011-01-01

Background Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines on assessing and managing osteoporosis are available, many patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions, a series of mixed-methods studies, and advice from experts in osteoporosis and human-factors engineering were used collectively to develop a multicomponent tool (targeted to family physicians and patients at risk for osteoporosis) that may support clinical decision making in osteoporosis disease management at the point of care. Methods A three-phased approach will be used to evaluate the osteoporosis tool. In phase 1, the tool will be implemented in three family practices. It will involve ensuring optimal functioning of the tool while minimizing disruption to usual practice. In phase 2, the tool will be pilot tested in a quasi-experimental interrupted time series (ITS) design to determine if it can improve osteoporosis disease management at the point of care. Phase 3 will involve conducting a qualitative postintervention follow-up study to better understand participants' experiences and perceived utility of the tool and readiness to adopt the tool at the point of care. Discussion The osteoporosis tool has the potential to make several contributions to the development and evaluation of complex, chronic disease interventions, such as the inclusion of an implementation strategy prior to conducting an evaluation study. Anticipated benefits of the tool may be to increase awareness for patients about osteoporosis and its associated risks and provide an opportunity to discuss a management plan with their physician, which may all facilitate patient self-management. PMID:21781318

Aligning "TextEvaluator"® Scores with the Accelerated Text Complexity Guidelines Specified in the Common Core State Standards. Research Report. ETS RR-15-21

ERIC Educational Resources Information Center

Sheehan, Kathleen M.

2015-01-01

The "TextEvaluator"® text analysis tool is a fully automated text complexity evaluation tool designed to help teachers, curriculum specialists, textbook publishers, and test developers select texts that are consistent with the text complexity guidelines specified in the Common Core State Standards.This paper documents the procedure used…

Ulcerative colitis outpatient management: development and evaluation of tools to support primary care practitioners.

PubMed

Bennett, A L; Buckton, S; Lawrance, I; Leong, R W; Moore, G; Andrews, J M

2015-12-01

Current models of care for ulcerative colitis (UC) across healthcare systems are inconsistent with a paucity of existing guidelines or supportive tools for outpatient management. This study aimed to produce and evaluate evidence-based outpatient management tools for UC to guide primary care practitioners and patients in clinical decision-making. Three tools were developed after identifying current gaps in the provision of healthcare services for patients with UC at a Clinical Insights Meeting in 2013. Draft designs were further refined through consultation and consolidation of feedback by the steering committee. Final drafts were developed following feasibility testing in three key stakeholder groups (gastroenterologists, general practitioners and patients) by questionnaire. The tools were officially launched into mainstream use in Australia in 2014. Three quarters of all respondents liked the layout and content of each tool. Minimal safety concerns were aired and those, along with pieces of information that were felt to be omitted, that were reviewed by the steering committee and incorporated into the final documents. The majority (over 80%) of respondents felt that the tools would be useful and would improve outpatient management of UC. Evidence-based outpatient clinical management tools for UC can be developed. The concept and end-product have been well received by all stakeholder groups. These tools should support non-specialist clinicians to optimise UC management and empower patients by facilitating them to safely self-manage and identify when medical support is needed. © 2015 Royal Australasian College of Physicians.

Objective Evaluation Tool for Texture-Modified Food (OET-TMF): Development of the Tool and Validation.

PubMed

Calleja-Fernández, Alicia; Pintor-de-la-Maza, Begoña; Vidal-Casariego, Alfonso; Cano-Rodríguez, Isidoro; Ballesteros-Pomar, María D

2016-06-01

Texture-modified diets (TMDs) should fulfil nutritional goals, guarantee homogenous texture, and meet food safety regulations. The food industry has created texture-modified food (TMF) that meets the TMD requirements of quality and safety for inpatients. To design and develop a tool that allows the objective selection of foodstuffs for TMDs that ensures nutritional requirements and swallowing safety of inpatients in order to improve their quality of life, especially regarding their food satisfaction. An evaluation tool was designed to objectively determine the adequacy of food included in the TMD menus of a hospital. The "Objective Evaluation Tool for Texture-Modified Food" (OET-TMF) consists of seven items that evaluate the food's nutritional quality (energy and protein input), presence of allergens, texture and viscosity, cooking, storage type, useful life, and patient acceptance. The total score ranged from 0 to 64 and was divided into four categories: high quality, good quality, medium quality, and low quality. Studying four different commercial TMFs contributed to the validation of the tool. All the evaluated products scored between high and good regarding quality. There was a tendency (p = 0.077) towards higher consumption and a higher overall quality of the product obtained with the OET-TMF. The product that scored highest with the tool was the best accepted; the product with the lowest score had the highest rate of refusal. The OET-TMF allows for the objective discrimination of the quality of TMF. In addition, it shows a certain relationship between the observed and assessed quality intake.

Tools for surveying and improving the quality of life: people with special needs in focus.

PubMed

Hoyningen-Süess, Ursula; Oberholzer, David; Stalder, René; Brügger, Urs

2012-01-01

This article seeks to describe online tools for surveying and improving quality of life for people with disabilities living in assisted living centers and special education service organizations. Ensuring a decent quality of life for disabled people is an important welfare state goal. Using well-accepted quality of life conceptions, online diagnostic and planning tools were developed during an Institute for Education, University of Zurich, research project. The diagnostic tools measure, evaluate and analyze disabled people's quality of life. The planning tools identify factors that can affect their quality of life and suggest improvements. Instrument validity and reliability are not tested according to the standard statistical procedures. This will be done at a more advanced stage of the project. Instead, the tool is developed, refined and adjusted in cooperation with practitioners who are constantly judging it according to best practice standards. The tools support staff in assisted living centers and special education service organizations. These tools offer comprehensive resources for surveying, quantifying, evaluating, describing and simulating quality of life elements.

[EEQ in clinical embryology: a starting program].

PubMed

Boyer, Pierre; Brugnon, Florence; Levy, Rachel; Pfeffer, Jérôme; Siest, Jean-Pascal

2014-01-01

Every laboratory including those working in assisted reproductive technologies have to be accredited EN ISO 15189 before 2020. This standardisation includes an external quality evaluation (EQE). In order to work out an EQE tool, we used images extracted from our own database developed during daily practice. We achieved an easily online tool called: "EEQ en embryologie clinique", developed on Biologie prospective web site with ART French biologists Association (Blefco) expertise in evaluation of early human embryonic stages. In 2013, 38 ART laboratories participate to the first program with more than 90% of appropriates results. The present article aims at describing this tool and discussing its limits.

Development and Validation of a Standardized Tool for Prioritization of Information Sources.

PubMed

Akwar, Holy; Kloeze, Harold; Mukhi, Shamir

2016-01-01

To validate the utility and effectiveness of a standardized tool for prioritization of information sources for early detection of diseases. The tool was developed with input from diverse public health experts garnered through survey. Ten raters used the tool to evaluate ten information sources and reliability among raters was computed. The Proc mixed procedure with random effect statement and SAS Macros were used to compute multiple raters' Fleiss Kappa agreement and Kendall's Coefficient of Concordance. Ten disparate information sources evaluated obtained the following composite scores: ProMed 91%; WAHID 90%; Eurosurv 87%; MediSys 85%; SciDaily 84%; EurekAl 83%; CSHB 78%; GermTrax 75%; Google 74%; and CBC 70%. A Fleiss Kappa agreement of 50.7% was obtained for ten information sources and 72.5% for a sub-set of five sources rated, which is substantial agreement validating the utility and effectiveness of the tool. This study validated the utility and effectiveness of a standardized criteria tool developed to prioritize information sources. The new tool was used to identify five information sources suited for use by the KIWI system in the CEZD-IIR project to improve surveillance of infectious diseases. The tool can be generalized to situations when prioritization of numerous information sources is necessary.

Evaluating the State of Water Management in the Rio Grande/Bravo Basin

NASA Astrophysics Data System (ADS)

Ortiz Partida, Jose Pablo; Sandoval-Solis, Samuel; Diaz Gomez, Romina

2017-04-01

Water resource modeling tools have been developed for many different regions and sub-basins of the Rio Grande/Bravo (RGB). Each of these tools has specific objectives, whether it is to explore drought mitigation alternatives, conflict resolution, climate change evaluation, tradeoff and economic synergies, water allocation, reservoir operations, or collaborative planning. However, there has not been an effort to integrate different available tools, or to link models developed for specific reaches into a more holistic watershed decision-support tool. This project outlines promising next steps to meet long-term goals of improved decision support tools and modeling. We identify, describe, and synthesize water resources management practices in the RGB basin and available water resources models and decision support tools that represent the RGB and the distribution of water for human and environmental uses. The extent body of water resources modeling is examined from a perspective of environmental water needs and water resources management and thereby allows subsequent prioritization of future research and monitoring needs for the development of river system modeling tools. This work communicates the state of the RGB science to diverse stakeholders, researchers, and decision-makers. The products of this project represent a planning tool to support an integrated water resources management framework to maximize economic and social welfare without compromising vital ecosystems.

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

Web-based routing assistance tool to reduce pavement damage by overweight and oversize vehicles.

DOT National Transportation Integrated Search

2016-10-30

This report documents the results of a completed project titled Web-Based Routing Assistance Tool to Reduce Pavement Damage by Overweight and Oversize Vehicles. The tasks involved developing a Web-based GIS routing assistance tool and evaluate ...

Evaluating the Effectiveness of a Large-Scale Professional Development Programme

ERIC Educational Resources Information Center

Main, Katherine; Pendergast, Donna

2017-01-01

An evaluation of the effectiveness of a large-scale professional development (PD) programme delivered to 258 schools in Queensland, Australia is presented. Formal evaluations were conducted at two stages during the programme using a tool developed from Desimone's five core features of effective PD. Descriptive statistics of 38 questions and…

Advanced engineering environment collaboration project.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lamph, Jane Ann; Pomplun, Alan R.; Kiba, Grant W.

2008-12-01

The Advanced Engineering Environment (AEE) is a model for an engineering design and communications system that will enhance project collaboration throughout the nuclear weapons complex (NWC). Sandia National Laboratories and Parametric Technology Corporation (PTC) worked together on a prototype project to evaluate the suitability of a portion of PTC's Windchill 9.0 suite of data management, design and collaboration tools as the basis for an AEE. The AEE project team implemented Windchill 9.0 development servers in both classified and unclassified domains and used them to test and evaluate the Windchill tool suite relative to the needs of the NWC using weaponsmore » project use cases. A primary deliverable was the development of a new real time collaborative desktop design and engineering process using PDMLink (data management tool), Pro/Engineer (mechanical computer aided design tool) and ProductView Lite (visualization tool). Additional project activities included evaluations of PTC's electrical computer aided design, visualization, and engineering calculations applications. This report documents the AEE project work to share information and lessons learned with other NWC sites. It also provides PTC with recommendations for improving their products for NWC applications.« less

A new tool for the evaluation of the analytical procedure: Green Analytical Procedure Index.

PubMed

Płotka-Wasylka, J

2018-05-01

A new means for assessing analytical protocols relating to green analytical chemistry attributes has been developed. The new tool, called GAPI (Green Analytical Procedure Index), evaluates the green character of an entire analytical methodology, from sample collection to final determination, and was created using such tools as the National Environmental Methods Index (NEMI) or Analytical Eco-Scale to provide not only general but also qualitative information. In GAPI, a specific symbol with five pentagrams can be used to evaluate and quantify the environmental impact involved in each step of an analytical methodology, mainly from green through yellow to red depicting low, medium to high impact, respectively. The proposed tool was used to evaluate analytical procedures applied in the determination of biogenic amines in wine samples, and polycyclic aromatic hydrocarbon determination by EPA methods. GAPI tool not only provides an immediately perceptible perspective to the user/reader but also offers exhaustive information on evaluated procedures. Copyright © 2018 Elsevier B.V. All rights reserved.

Situation Awareness and Workload Measures for SAFOR

NASA Technical Reports Server (NTRS)

DeMaio, Joe; Hart, Sandra G.; Allen, Ed (Technical Monitor)

1999-01-01

The present research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale (DRAWS), and a situation awareness measurement tool in which the crews self-evaluation of performance is compared against actual performance. These two measurement tools were evaluated in the context of a test of an innovative approach to alerting the crew by way of a helmet mounted display. The DRAWS was found to be usable, but it offered no advantages over extant scales, and it had only limited resolution. The performance self-evaluation metric of situation awareness was found to be highly effective.

Evaluating Academic Workplaces: The Hyper-Expansive Environment Experienced by University Lecturers in Professional Fields

ERIC Educational Resources Information Center

Boyd, Pete; Smith, Caroline; Ilhan Beyaztas, Dilek

2015-01-01

Academic developers need to understand the situated workplaces of the academic tribes they are supporting. This study proposes the use of the expansive--restrictive workplace learning environment continuum as a tool for evaluation of academic workplaces. The tool is critically appraised through its application to the analysis of workplace…

Evaluation of Visual Computer Simulator for Computer Architecture Education

ERIC Educational Resources Information Center

Imai, Yoshiro; Imai, Masatoshi; Moritoh, Yoshio

2013-01-01

This paper presents trial evaluation of a visual computer simulator in 2009-2011, which has been developed to play some roles of both instruction facility and learning tool simultaneously. And it illustrates an example of Computer Architecture education for University students and usage of e-Learning tool for Assembly Programming in order to…

Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

ERIC Educational Resources Information Center

Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

2013-01-01

Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

Evaluating the Effectiveness of Tools for Online Database Instruction

ERIC Educational Resources Information Center

Mery, Yvonne; DeFrain, Erica; Kline, Elizabeth; Sult, Leslie

2014-01-01

The intent of this study was to evaluate the Guide on the Side (Gots), an online learning tool developed by the University of Arizona Libraries, and a screencast tutorial for teaching information literacy and database searching skills. Ninety undergraduate students were randomly assigned into three groups: group 1 completed a GotS tutorial; group…

OPTIMAL WELL LOCATOR (OWL): A SCREENING TOOL FOR EVALUATING LOCATIONS OF MONITORING WELLS

EPA Science Inventory

The Optimal Well Locator ( OWL) program was designed and developed by USEPA to be a screening tool to evaluate and optimize the placement of wells in long term monitoring networks at small sites. The first objective of the OWL program is to allow the user to visualize the change ...

Evaluation of the Haney Soil Health Nutrient Tool for corn nitrogen recommendations across eight Midwest states

USDA-ARS?s Scientific Manuscript database

Use and development of soil biological tests for estimating soil N availability and subsequently corn (Zea mays L.) fertilizer N recommendations is garnering considerable interest. The objective of this research was to evaluate relationships between the Soil Health Nutrient Tool (SHNT), also known a...

Recommendations and Improvements for the Evaluation of Integrated Community-Wide Interventions Approaches.

PubMed

van Koperen, Tessa M; Renders, Carry M; Spierings, Eline J M; Hendriks, Anna-Marie; Westerman, Marjan J; Seidell, Jacob C; Schuit, Albertine J

2016-01-01

Background . Integrated community-wide intervention approaches (ICIAs) are implemented to prevent childhood obesity. Programme evaluation improves these ICIAs, but professionals involved often struggle with performance. Evaluation tools have been developed to support Dutch professionals involved in ICIAs. It is unclear how useful these tools are to intended users. We therefore researched the facilitators of and barriers to ICIA programme evaluation as perceived by professionals and their experiences of the evaluation tools. Methods . Focus groups and interviews with 33 public health professionals. Data were analysed using a thematic content approach. Findings . Evaluation is hampered by insufficient time, budget, and experience with ICIAs, lack of leadership, and limited advocacy for evaluation. Epidemiologists are regarded as responsible for evaluation but feel incompetent to perform evaluation or advocate its need in a political environment. Managers did not prioritise process evaluations, involvement of stakeholders, and capacity building. The evaluation tools are perceived as valuable but too comprehensive considering limited resources. Conclusion . Evaluating ICIAs is important but most professionals are unfamiliar with it and management does not prioritise process evaluation nor incentivize professionals to evaluate. To optimise programme evaluation, more resources and coaching are required to improve professionals' evaluation capabilities and specifically the use of evaluation.

Recommendations and Improvements for the Evaluation of Integrated Community-Wide Interventions Approaches

PubMed Central

Spierings, Eline J. M.; Westerman, Marjan J.; Seidell, Jacob C.; Schuit, Albertine J.

2016-01-01

Background. Integrated community-wide intervention approaches (ICIAs) are implemented to prevent childhood obesity. Programme evaluation improves these ICIAs, but professionals involved often struggle with performance. Evaluation tools have been developed to support Dutch professionals involved in ICIAs. It is unclear how useful these tools are to intended users. We therefore researched the facilitators of and barriers to ICIA programme evaluation as perceived by professionals and their experiences of the evaluation tools. Methods. Focus groups and interviews with 33 public health professionals. Data were analysed using a thematic content approach. Findings. Evaluation is hampered by insufficient time, budget, and experience with ICIAs, lack of leadership, and limited advocacy for evaluation. Epidemiologists are regarded as responsible for evaluation but feel incompetent to perform evaluation or advocate its need in a political environment. Managers did not prioritise process evaluations, involvement of stakeholders, and capacity building. The evaluation tools are perceived as valuable but too comprehensive considering limited resources. Conclusion. Evaluating ICIAs is important but most professionals are unfamiliar with it and management does not prioritise process evaluation nor incentivize professionals to evaluate. To optimise programme evaluation, more resources and coaching are required to improve professionals' evaluation capabilities and specifically the use of evaluation. PMID:28116149

Evaluation of the efficiency and reliability of software generated by code generators

NASA Technical Reports Server (NTRS)

Schreur, Barbara

1994-01-01

There are numerous studies which show that CASE Tools greatly facilitate software development. As a result of these advantages, an increasing amount of software development is done with CASE Tools. As more software engineers become proficient with these tools, their experience and feedback lead to further development with the tools themselves. What has not been widely studied, however, is the reliability and efficiency of the actual code produced by the CASE Tools. This investigation considered these matters. Three segments of code generated by MATRIXx, one of many commercially available CASE Tools, were chosen for analysis: ETOFLIGHT, a portion of the Earth to Orbit Flight software, and ECLSS and PFMC, modules for Environmental Control and Life Support System and Pump Fan Motor Control, respectively.

Tools developed and disseminated by guideline producers to promote the uptake of their guidelines.

PubMed

Flodgren, Gerd; Hall, Amanda M; Goulding, Lucy; Eccles, Martin P; Grimshaw, Jeremy M; Leng, Gillian C; Shepperd, Sasha

2016-08-22

The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs. To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective. We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites. We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area. Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines. We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service. Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.

Critical thinking evaluation in reflective writing: Development and testing of Carter Assessment of Critical Thinking in Midwifery (Reflection).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-11-01

develop and test a tool designed for use by academics to evaluate pre-registration midwifery students' critical thinking skills in reflective writing. a descriptive cohort design was used. a random sample (n = 100) of archived student reflective writings based on a clinical event or experience during 2014 and 2015. a staged model for tool development was used to develop a fifteen item scale involving item generation; mapping of draft items to critical thinking concepts and expert review to test content validity; inter-rater reliability testing; pilot testing of the tool on 100 reflective writings; and psychometric testing. Item scores were analysed for mean, range and standard deviation. Internal reliability, content and construct validity were assessed. expert review of the tool revealed a high content validity index score of 0.98. Using two independent raters to establish inter-rater reliability, good absolute agreement of 72% was achieved with a Kappa coefficient K = 0.43 (p<0.0001). Construct validity via exploratory factor analysis revealed three factors: analyses context, reasoned inquiry, and self-evaluation. The mean total score for the tool was 50.48 (SD = 12.86). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of .93. this study establishedthe reliability and validity of the CACTiM (reflection) for use by academics to evaluate midwifery students' critical thinking in reflective writing. Validation with large diverse samples is warranted. reflective practice is a key learning and teaching strategy in undergraduate Bachelor of Midwifery programmes and essential for safe, competent practice. There is the potential to enhance critical thinking development by assessingreflective writing with the CACTiM (reflection) tool to provide formative and summative feedback to students and inform teaching strategies. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

DEVELOPMENT OF PROTOCOLS AND DECISION SUPPORT TOOLS FOR ASSESSING WATERSHED SYSTEM ASSIMILATIVE

EPA Science Inventory

Investigations are underway on Lake Texoma, a Corps of Engineers lake on the Oklahoma/Texas border, to develop decision support tools and information to evaluate the transport and attenuation of contaminants and stressors in a lake ecosystem, and link them to observable ecologica...

Ottawa Model of Implementation Leadership and Implementation Leadership Scale: mapping concepts for developing and evaluating theory-based leadership interventions.

PubMed

Gifford, Wendy; Graham, Ian D; Ehrhart, Mark G; Davies, Barbara L; Aarons, Gregory A

2017-01-01

Leadership in health care is instrumental to creating a supportive organizational environment and positive staff attitudes for implementing evidence-based practices to improve patient care and outcomes. The purpose of this study is to demonstrate the alignment of the Ottawa Model of Implementation Leadership (O-MILe), a theoretical model for developing implementation leadership, with the Implementation Leadership Scale (ILS), an empirically validated tool for measuring implementation leadership. A secondary objective is to describe the methodological process for aligning concepts of a theoretical model with an independently established measurement tool for evaluating theory-based interventions. Modified template analysis was conducted to deductively map items of the ILS onto concepts of the O-MILe. An iterative process was used in which the model and scale developers (n=5) appraised the relevance, conceptual clarity, and fit of each ILS items with the O-MILe concepts through individual feedback and group discussions until consensus was reached. All 12 items of the ILS correspond to at least one O-MILe concept, demonstrating compatibility of the ILS as a measurement tool for the O-MILe theoretical constructs. The O-MILe provides a theoretical basis for developing implementation leadership, and the ILS is a compatible tool for measuring leadership based on the O-MILe. Used together, the O-MILe and ILS provide an evidence- and theory-based approach for developing and measuring leadership for implementing evidence-based practices in health care. Template analysis offers a convenient approach for determining the compatibility of independently developed evaluation tools to test theoretical models.

Ottawa Model of Implementation Leadership and Implementation Leadership Scale: mapping concepts for developing and evaluating theory-based leadership interventions

PubMed Central

Gifford, Wendy; Graham, Ian D; Ehrhart, Mark G; Davies, Barbara L; Aarons, Gregory A

2017-01-01

Purpose Leadership in health care is instrumental to creating a supportive organizational environment and positive staff attitudes for implementing evidence-based practices to improve patient care and outcomes. The purpose of this study is to demonstrate the alignment of the Ottawa Model of Implementation Leadership (O-MILe), a theoretical model for developing implementation leadership, with the Implementation Leadership Scale (ILS), an empirically validated tool for measuring implementation leadership. A secondary objective is to describe the methodological process for aligning concepts of a theoretical model with an independently established measurement tool for evaluating theory-based interventions. Methods Modified template analysis was conducted to deductively map items of the ILS onto concepts of the O-MILe. An iterative process was used in which the model and scale developers (n=5) appraised the relevance, conceptual clarity, and fit of each ILS items with the O-MILe concepts through individual feedback and group discussions until consensus was reached. Results All 12 items of the ILS correspond to at least one O-MILe concept, demonstrating compatibility of the ILS as a measurement tool for the O-MILe theoretical constructs. Conclusion The O-MILe provides a theoretical basis for developing implementation leadership, and the ILS is a compatible tool for measuring leadership based on the O-MILe. Used together, the O-MILe and ILS provide an evidence- and theory-based approach for developing and measuring leadership for implementing evidence-based practices in health care. Template analysis offers a convenient approach for determining the compatibility of independently developed evaluation tools to test theoretical models. PMID:29355212

Designing Real-time Decision Support for Trauma Resuscitations

PubMed Central

Yadav, Kabir; Chamberlain, James M.; Lewis, Vicki R.; Abts, Natalie; Chawla, Shawn; Hernandez, Angie; Johnson, Justin; Tuveson, Genevieve; Burd, Randall S.

2016-01-01

Background Use of electronic clinical decision support (eCDS) has been recommended to improve implementation of clinical decision rules. Many eCDS tools, however, are designed and implemented without taking into account the context in which clinical work is performed. Implementation of the pediatric traumatic brain injury (TBI) clinical decision rule at one Level I pediatric emergency department includes an electronic questionnaire triggered when ordering a head computed tomography using computerized physician order entry (CPOE). Providers use this CPOE tool in less than 20% of trauma resuscitation cases. A human factors engineering approach could identify the implementation barriers that are limiting the use of this tool. Objectives The objective was to design a pediatric TBI eCDS tool for trauma resuscitation using a human factors approach. The hypothesis was that clinical experts will rate a usability-enhanced eCDS tool better than the existing CPOE tool for user interface design and suitability for clinical use. Methods This mixed-methods study followed usability evaluation principles. Pediatric emergency physicians were surveyed to identify barriers to using the existing eCDS tool. Using standard trauma resuscitation protocols, a hierarchical task analysis of pediatric TBI evaluation was developed. Five clinical experts, all board-certified pediatric emergency medicine faculty members, then iteratively modified the hierarchical task analysis until reaching consensus. The software team developed a prototype eCDS display using the hierarchical task analysis. Three human factors engineers provided feedback on the prototype through a heuristic evaluation, and the software team refined the eCDS tool using a rapid prototyping process. The eCDS tool then underwent iterative usability evaluations by the five clinical experts using video review of 50 trauma resuscitation cases. A final eCDS tool was created based on their feedback, with content analysis of the evaluations performed to ensure all concerns were identified and addressed. Results Among 26 EPs (76% response rate), the main barriers to using the existing tool were that the information displayed is redundant and does not fit clinical workflow. After the prototype eCDS tool was developed based on the trauma resuscitation hierarchical task analysis, the human factors engineers rated it to be better than the CPOE tool for nine of 10 standard user interface design heuristics on a three-point scale. The eCDS tool was also rated better for clinical use on the same scale, in 84% of 50 expert–video pairs, and was rated equivalent in the remainder. Clinical experts also rated barriers to use of the eCDS tool as being low. Conclusions An eCDS tool for diagnostic imaging designed using human factors engineering methods has improved perceived usability among pediatric emergency physicians. PMID:26300010

Evaluation tools to support ITS planning process : development of a sketch planning tool in FSUTMS/cube environment.

DOT National Transportation Integrated Search

2008-12-15

Intelligent Transportation Systems (ITS) planning requires the use of tools to assess the performance of ITS deployment alternatives relative to each other and to other types of transportation system improvement alternatives. This research project in...

Evaluation of the Effectiveness of Stormwater Decision Support Tools for Infrastructure Selection and the Barriers to Implementation

NASA Astrophysics Data System (ADS)

Spahr, K.; Hogue, T. S.

2016-12-01

Selecting the most appropriate green, gray, and / or hybrid system for stormwater treatment and conveyance can prove challenging to decision markers across all scales, from site managers to large municipalities. To help streamline the selection process, a multi-disciplinary team of academics and professionals is developing an industry standard for selecting and evaluating the most appropriate stormwater management technology for different regions. To make the tool more robust and comprehensive, life-cycle cost assessment and optimization modules will be included to evaluate non-monetized and ecosystem benefits of selected technologies. Initial work includes surveying advisory board members based in cities that use existing decision support tools in their infrastructure planning process. These surveys will qualify the decisions currently being made and identify challenges within the current planning process across a range of hydroclimatic regions and city size. Analysis of social and other non-technical barriers to adoption of the existing tools is also being performed, with identification of regional differences and institutional challenges. Surveys will also gage the regional appropriateness of certain stormwater technologies based off experiences in implementing stormwater treatment and conveyance plans. In additional to compiling qualitative data on existing decision support tools, a technical review of components of the decision support tool used will be performed. Gaps in each tool's analysis, like the lack of certain critical functionalities, will be identified and ease of use will be evaluated. Conclusions drawn from both the qualitative and quantitative analyses will be used to inform the development of the new decision support tool and its eventual dissemination.

An Overview of Public Domain Tools for Measuring the Sustainability of Environmental Remediation - 12060

DOE Office of Scientific and Technical Information (OSTI.GOV)

Claypool, John E.; Rogers, Scott

The application of sustainability principles to the investigation and remediation of contaminated sites is an area of rapid development within the environmental profession, with new business practices, tools, and performance standards for identifying, evaluating, and managing the 'collateral' impacts of cleanup projects to the environment, economy and society coming from many organizations. Guidelines, frameworks, and standards of practice for 'green and sustainable remediation' (GSR) have been released and are under development by the Sustainable Remediation Forum (SURF), the American Society for Testing Materials (ASTM), the Interstate Technology Roundtable Commission (ITRC) and other organizations in the U.S. and internationally. In responsemore » to Executive Orders from the President, Federal government agencies have developed policies, procedures and guidelines for evaluating and reporting the sustainability of their environmental restoration projects. Private sector companies in the petroleum, utility, manufacturing, defense, and other sectors are developing their own corporate GSR programs to improve day-to-day management of contaminated sites and to support external reporting as part of their corporate social responsibility (CSR) efforts. The explosion of mandates, policy, procedures and guidance raises the question of how to determine whether a remediation technology or cleanup approach is green and/or sustainable. The environmental profession has responded to this question by designing, developing and deploying a wide array of tools, calculators, and databases that enable regulatory agencies, site managers and environmental professionals to calculate the collateral impacts of their remediation projects in the environmental, social, and economic domains. Many of these tools are proprietary ones developed by environmental engineering/consulting firms for use in their consulting engagements and/or tailored specifically to meet the needs of their clients. When it comes to the public domain, Federal government agencies are spearheading the development of software tools to measure and report emissions of air pollutants (e.g., carbon dioxide, other greenhouse gases, criteria air pollutants); consumption of energy, water and natural resources; accident and safety risks; project costs and other economic metrics. Most of the tools developed for the Government are available to environmental practitioners without charge, so they are growing in usage and popularity. The key features and metrics calculated by the available public-domain tools for measuring the sustainability of environmental remediation projects share some commonalities but there are differences amongst the tools. The SiteWise{sup TM} sustainability tool developed for the Navy and US Army will be compared with the Sustainable Remediation Tool (SRT{sup TM}) developed for the US Air Force (USAF). In addition, the USAF's Clean Solar and Wind Energy in Environmental Programs (CleanSWEEP), a soon-to-be-released tool for evaluating the economic feasibility of utilizing renewal energy for powering remediation systems will be described in the paper. (authors)« less

Modeling and Simulation Roadmap to Enhance Electrical Energy Security of U.S. Naval Bases

DTIC Science & Technology

2012-03-01

evaluating power system architectures and technologies and, therefore, can become a valuable tool for the implementation of the described plan for Navy...a well validated and consistent process for evaluating power system architectures and technologies and, therefore, can be a valuable tool for the...process for evaluating power system architectures and component technologies is needed to support the development and implementation of these new

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Freva - Freie Univ Evaluation System Framework for Scientific Infrastructures in Earth System Modeling

NASA Astrophysics Data System (ADS)

Kadow, Christopher; Illing, Sebastian; Kunst, Oliver; Schartner, Thomas; Kirchner, Ingo; Rust, Henning W.; Cubasch, Ulrich; Ulbrich, Uwe

2016-04-01

The Freie Univ Evaluation System Framework (Freva - freva.met.fu-berlin.de) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, including all features present in the shell and web environment. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). Freva indexes different data projects into one common search environment by storing the meta data information of the self-describing model, reanalysis and observational data sets in a database. This implemented meta data system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. The integrated web-shell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gate to the research projects HPC. Plugins are able to integrate their e.g. post-processed results into the database of the user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a database. Configurations and results of the tools can be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, if configurations match while starting an evaluation plugin, the system suggests to use results already produced by other users - saving CPU/h, I/O, disk space and time. The efficient interaction between different technologies improves the Earth system modeling science framed by Freva.

Educational Effects of the Tools of the Mind Curriculum: A Randomized Trial

ERIC Educational Resources Information Center

Barnett, W.Steven; Jung, Kwanghee; Yarosz, Donald J.; Thomas, Jessica; Hornbeck, Amy; Stechuk, Robert; Burns, Susan

2008-01-01

The effectiveness of the "Tools of the Mind (Tools)" curriculum in improving the education of 3- and 4-year-old children was evaluated by means of a randomized trial. The "Tools" curriculum, based on the work of Vygotsky, focuses on the development of self-regulation at the same time as teaching literacy and mathematics skills…

Battery Storage Evaluation Tool, version 1.x

DOE Office of Scientific and Technical Information (OSTI.GOV)

2015-10-02

The battery storage evaluation tool developed at Pacific Northwest National Laboratory is used to run a one-year simulation to evaluate the benefits of battery storage for multiple grid applications, including energy arbitrage, balancing service, capacity value, distribution system equipment deferral, and outage mitigation. This tool is based on the optimal control strategies to capture multiple services from a single energy storage device. In this control strategy, at each hour, a lookahead optimization is first formulated and solved to determine the battery base operating point. The minute-by-minute simulation is then performed to simulate the actual battery operation.

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

SUSTAINABLE MANAGEMENT APPROACHES AND REVITALIZATION TOOLS-ELECTRONIC (SMARTE): OVERVIEW AND DEMONSTRATION FOR FINAL PHASE 3 CONFERENCE

EPA Science Inventory

The U.S. contingent of the U.S.-German Bilateral Working Group is developing Sustainable Management Approaches and Revitalization Tools-electronic (SMARTe). SMARTe is a web-based, decision support system designed to assist stakeholders in developing and evaluating alternative reu...

Marine and Hydrokinetic Research | Water Power | NREL

Science.gov Websites

. Resource Characterization and Maps NREL develops measurement systems, simulation tools, and web-based models and tools to evaluate the economic potential of power-generating devices for all technology Acceleration NREL analysts study the potential impacts that developing a robust MHK market could have on

Evaluating the Use of a Strengths-Based Development Tool with Head Teachers

ERIC Educational Resources Information Center

Cooper, Liz; Woods, Kevin

2017-01-01

This exploratory study investigated an educational psychologist's use of a strengths-based development tool with head teachers, in the context of influencing and supporting leaders in school organisations. Nine head teachers completed the "Realise2 Introductory Profile" online strengths assessment and then received a structured debrief…

DEVELOPING A CAPE-OPEN COMPLIANT METAL FINISHING FACILITY POLLUTION PREVENTION TOOL (CO-MFFP2T)

EPA Science Inventory

The USEPA is developing a Computer Aided Process Engineering (CAPE) software tool for the metal finishing industry that helps users design efficient metal finishing processes that are less polluting to the environment. Metal finishing process lines can be simulated and evaluated...

Supporting Literacy in Preschool: Using a Teacher-Observation Tool to Guide Professional Development

ERIC Educational Resources Information Center

McNerney, Shelly; Nielsen, Diane Corcoran; Clay, Phyllis

2006-01-01

Teachers involved with professional-development opportunities inevitably differ in their content knowledge, access to resources, and instructional practices. The purpose of this study was to investigate how a standardized assessment observation tool, selected to gather summative information for grant-evaluation purposes about preschool teachers'…

The Handbook of Leadership Development Evaluation

ERIC Educational Resources Information Center

Hannum, Kelly M., Ed.; Martineau, Jennifer W., Ed.; Reinelt, Claire, Ed.

2007-01-01

With the increase in the number of organizational leadership development programs, there is a pressing need for evaluation to answer important questions, improve practice, and inform decisions. The Handbook is a comprehensive resource filled with examples, tools, and the most innovative models and approaches designed to evaluate leadership…

A concept taxonomy and an instrument hierarchy: tools for establishing and evaluating the conceptual framework of a patient-reported outcome (PRO) instrument as applied to product labeling claims.

PubMed

Erickson, Pennifer; Willke, Richard; Burke, Laurie

2009-01-01

To facilitate development and evaluation of a PRO instrument conceptual framework, we propose two tools--a PRO concept taxonomy and a PRO instrument hierarchy. FDA's draft guidance on patient reported outcome (PRO) measures states that a clear description of the conceptual framework of an instrument is useful for evaluating its adequacy to support a treatment benefit claim for use in product labeling the draft guidance, however does not propose tools for establishing or evaluating a PRO instrument's conceptual framework. We draw from our review of PRO concepts and instruments that appear in prescription drug labeling approved in the United States from 1997 to 2007. We propose taxonomy terms that define relationships between PRO concepts, including "family,"compound concept," and "singular concept." Based on the range of complexity represented by the concepts, as defined by the taxonomy, we propose nine instrument orders for PRO measurement. The nine orders range from individual event counts to multi-item, multiscale instruments. This analysis of PRO concepts and instruments illustrates that the taxonomy and hierarchy are applicable to PRO concepts across a wide range of therapeutic areas and provide a basis for defining the instrument conceptual framework complexity. Although the utility of these tools in the drug development, review, and approval processes has not yet been demonstrated, these tools could be useful to improve communication and enhance efficiency in the instrument development and review process.

A risk assessment tool applied to the study of shale gas resources.

PubMed

Veiguela, Miguel; Hurtado, Antonio; Eguilior, Sonsoles; Recreo, Fernando; Roqueñi, Nieves; Loredo, Jorge

2016-11-15

The implementation of a risk assessment tool with the capacity to evaluate the risks for health, safety and the environment (HSE) from extraction of non-conventional fossil fuel resources by the hydraulic fracturing (fracking) technique can be a useful tool to boost development and progress of the technology and winning public trust and acceptance of this. At the early project stages, the lack of data related the selection of non-conventional gas deposits makes it difficult the use of existing approaches to risk assessment of fluids injected into geologic formations. The qualitative risk assessment tool developed in this work is based on the approach that shale gas exploitation risk is dependent on both the geologic site and the technological aspects. It follows from the Oldenburg's 'Screening and Ranking Framework (SRF)' developed to evaluate potential geologic carbon dioxide (CO2) storage sites. These two global characteristics: (1) characteristics centered on the natural aspects of the site and (2) characteristics centered on the technological aspects of the Project, have been evaluated through user input of Property values, which define Attributes, which define the Characteristics. In order to carry out an individual evaluation of each of the characteristics and the elements of the model, the tool has been implemented in a spreadsheet. The proposed model has been applied to a site with potential for the exploitation of shale gas in Asturias (northwestern Spain) with tree different technological options to test the approach. Copyright © 2016 Elsevier B.V. All rights reserved.

Development and Implementation of a Design Metric for Systems Containing Long-Term Fluid Loops

NASA Technical Reports Server (NTRS)

Steele, John W.

2016-01-01

John Steele, a chemist and technical fellow from United Technologies Corporation, provided a water quality module to assist engineers and scientists with a metric tool to evaluate risks associated with the design of space systems with fluid loops. This design metric is a methodical, quantitative, lessons-learned based means to evaluate the robustness of a long-term fluid loop system design. The tool was developed by a cross-section of engineering disciplines who had decades of experience and problem resolution.

Review of quality assessment tools for the evaluation of pharmacoepidemiological safety studies

PubMed Central

Neyarapally, George A; Hammad, Tarek A; Pinheiro, Simone P; Iyasu, Solomon

2012-01-01

Objectives Pharmacoepidemiological studies are an important hypothesis-testing tool in the evaluation of postmarketing drug safety. Despite the potential to produce robust value-added data, interpretation of findings can be hindered due to well-recognised methodological limitations of these studies. Therefore, assessment of their quality is essential to evaluating their credibility. The objective of this review was to evaluate the suitability and relevance of available tools for the assessment of pharmacoepidemiological safety studies. Design We created an a priori assessment framework consisting of reporting elements (REs) and quality assessment attributes (QAAs). A comprehensive literature search identified distinct assessment tools and the prespecified elements and attributes were evaluated. Primary and secondary outcome measures The primary outcome measure was the percentage representation of each domain, RE and QAA for the quality assessment tools. Results A total of 61 tools were reviewed. Most tools were not designed to evaluate pharmacoepidemiological safety studies. More than 50% of the reviewed tools considered REs under the research aims, analytical approach, outcome definition and ascertainment, study population and exposure definition and ascertainment domains. REs under the discussion and interpretation, results and study team domains were considered in less than 40% of the tools. Except for the data source domain, quality attributes were considered in less than 50% of the tools. Conclusions Many tools failed to include critical assessment elements relevant to observational pharmacoepidemiological safety studies and did not distinguish between REs and QAAs. Further, there is a lack of considerations on the relative weights of different domains and elements. The development of a quality assessment tool would facilitate consistent, objective and evidence-based assessments of pharmacoepidemiological safety studies. PMID:23015600

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review

PubMed Central

Dall, PM; Coulter, EH; Fitzsimons, CF; Skelton, DA; Chastin, SFM

2017-01-01

Objective Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. Design A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Data sources Systematic searches were conducted via EBSCO, reference lists and expert opinion. Eligibility criteria for selecting studies The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. Results The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Conclusions Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. Trial registration number International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. PMID:28391233

Effective Tools and Resources from the MAVEN Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Mason, T.

2015-12-01

Since 2010, NASA's Mars Atmosphere and Volatile Evolution (MAVEN) Education and Public Outreach (E/PO) team has developed and implemented a robust and varied suite of projects, serving audiences of all ages and diverse backgrounds from across the country. With a program designed to reach formal K-12 educators and students, afterschool and summertime communities, museum docents, journalists, and online audiences, we have incorporated an equally varied approach to developing tools, resources, and evaluation methods to specifically reach each target population and to determine the effectiveness of our efforts. This poster will highlight some of the tools and resources we have developed to share the complex science and engineering of the MAVEN mission, as well as initial evaluation results and lessons-learned from each of our E/PO projects.

A decision-making tool for incorporating sustainability measures into pavement design : research project capsule.

DOT National Transportation Integrated Search

2016-10-01

The objective of the proposed study is to conceive and develop a decision-making tool : for evaluating sustainability of pavement designs based on a cradle-to-grave analysis. : This tool will utilize EPDs to enhance the reliability of the assessment ...

Child development in primary care: a surveillance proposal.

PubMed

Coelho, Renato; Ferreira, José Paulo; Sukiennik, Ricardo; Halpern, Ricardo

2016-01-01

To evaluate a child development surveillance tool proposal to be used in primary care, with simultaneous use of the Denver II scale. This was a cross-sectional study of 282 infants aged up to 36 months, enrolled in a public daycare in a countryside community in Rio Grande do Sul/Brazil. Child development was assessed using the surveillance tool and the Denver II scale. The prevalence of probable developmental delay was 53%; most of these cases were in the alert group and 24% had normal development, but with risk factors. At the Denver scale, the prevalence of suspected developmental delay was 32%. When risk factors and sociodemographic variables were assessed, no significant difference was observed. The evaluation of this surveillance tool resulted in objective and comparable data, which were adequate for a screening test. It is easily applicable as a screening tool, even though it was originally designed as a surveillance tool. The inclusion of risk factors to the scoring system is an innovation that allows for the identification of children with suspected delay in addition to developmental milestones, although the definition of parameters and choice of indicators should be thoroughly studied. Copyright © 2016 Sociedade Brasileira de Pediatria. Published by Elsevier Editora Ltda. All rights reserved.

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

NASA Technical Reports Server (NTRS)

Simon, Donald L.

2010-01-01

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

A software technology evaluation program

NASA Technical Reports Server (NTRS)

Novaes-Card, David N.

1985-01-01

A set of quantitative approaches is presented for evaluating software development methods and tools. The basic idea is to generate a set of goals which are refined into quantifiable questions which specify metrics to be collected on the software development and maintenance process and product. These metrics can be used to characterize, evaluate, predict, and motivate. They can be used in an active as well as passive way by learning form analyzing the data and improving the methods and tools based upon what is learned from that analysis. Several examples were given representing each of the different approaches to evaluation. The cost of the approaches varied inversely with the level of confidence in the interpretation of the results.

An Evaluation of Operational Airspace Sectorization Integrated System (OASIS) Advisory Tool

NASA Technical Reports Server (NTRS)

Lee, Paul U.; Mogford, Richard H.; Bridges, Wayne; Buckley, Nathan; Evans, Mark; Gujral, Vimmy; Lee, Hwasoo; Peknik, Daniel; Preston, William

2013-01-01

In January 2013, a human-in-the-loop evaluation of the Operational Airspace Sectorization Integrated System (OASIS) was conducted in the Airspace Operations Laboratory of the Human Systems Integration Division (Code TH) in conjunction with the Aviation Systems Division (Code AF). The development of OASIS is a major activity of the Dynamic Airspace Configuration (DAC) research focus area within the Aeronautics Research Mission Directorate (ARMD) Airspace Systems Program. OASIS is an advisory tool to assist Federal Aviation Administration (FAA) En Route Area Supervisors in their planning of sector combinedecombine operations as well as opening closing of Data-side (D-side) control positions. These advisory solutions are tailored to the predicted traffic demand over the next few hours. During the experiment, eight retired FAA personnel served as participants for a part-task evaluation of OASIS functionality, covering the user interface as well as the underlying algorithm. Participants gave positive feedback on both the user interface and the algorithm solutions for airspace configuration, including an excellent average rating of 94 on the tool usability scales. They also suggested various enhancements to the OASIS tool, which will be incorporated into the next tool development cycle for the full-scale human-in-the-loop evaluation to be conducted later this year.

Development of a personalized decision aid for breast cancer risk reduction and management.

PubMed

Ozanne, Elissa M; Howe, Rebecca; Omer, Zehra; Esserman, Laura J

2014-01-14

Breast cancer risk reduction has the potential to decrease the incidence of the disease, yet remains underused. We report on the development a web-based tool that provides automated risk assessment and personalized decision support designed for collaborative use between patients and clinicians. Under Institutional Review Board approval, we evaluated the decision tool through a patient focus group, usability testing, and provider interviews (including breast specialists, primary care physicians, genetic counselors). This included demonstrations and data collection at two scientific conferences (2009 International Shared Decision Making Conference, 2009 San Antonio Breast Cancer Symposium). Overall, the evaluations were favorable. The patient focus group evaluations and usability testing (N = 34) provided qualitative feedback about format and design; 88% of these participants found the tool useful and 94% found it easy to use. 91% of the providers (N = 23) indicated that they would use the tool in their clinical setting. BreastHealthDecisions.org represents a new approach to breast cancer prevention care and a framework for high quality preventive healthcare. The ability to integrate risk assessment and decision support in real time will allow for informed, value-driven, and patient-centered breast cancer prevention decisions. The tool is being further evaluated in the clinical setting.

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

Blood Sugar, Your Pancreas, and Unicorns: The Development of Health Education Materials for Youth With Prediabetes.

PubMed

Yazel-Smith, Lisa G; Pike, Julie; Lynch, Dustin; Moore, Courtney; Haberlin, Kathryn; Taylor, Jennifer; Hannon, Tamara S

2018-05-01

The obesity epidemic has led to an increase in prediabetes in youth, causing a serious public health concern. Education on diabetes risk and initiation of lifestyle change are the primary treatment modalities. There are few existing age-appropriate health education tools to address diabetes prevention for high-risk youth. To develop an age-appropriate health education tool(s) to help youth better understand type 2 diabetes risk factors and the reversibility of risk. Health education tool development took place in five phases: exploration, design, analysis, refinement, and process evaluation. The project resulted in (1) booklet designed to increase knowledge of risk, (2) meme generator that mirrors the booklet graphics and allows youth to create their own meme based on their pancreas' current mood, (3) environmental posters for clinic, and (4) brief self-assessment that acts as a conversation starter for the health educators. Patients reported high likability and satisfaction with the health education tools, with the majority of patients giving the materials an "A" rating. The process evaluation indicated a high level of fidelity and related measures regarding how the health education tools were intended to be used and how they were actually used in the clinic setting.

Evaluating the compatibility of multi-functional and intensive urban land uses

NASA Astrophysics Data System (ADS)

Taleai, M.; Sharifi, A.; Sliuzas, R.; Mesgari, M.

2007-12-01

This research is aimed at developing a model for assessing land use compatibility in densely built-up urban areas. In this process, a new model was developed through the combination of a suite of existing methods and tools: geographical information system, Delphi methods and spatial decision support tools: namely multi-criteria evaluation analysis, analytical hierarchy process and ordered weighted average method. The developed model has the potential to calculate land use compatibility in both horizontal and vertical directions. Furthermore, the compatibility between the use of each floor in a building and its neighboring land uses can be evaluated. The method was tested in a built-up urban area located in Tehran, the capital city of Iran. The results show that the model is robust in clarifying different levels of physical compatibility between neighboring land uses. This paper describes the various steps and processes of developing the proposed land use compatibility evaluation model (CEM).

The SAFE-T assessment tool: derivation and validation of a web-based application for point-of-care evaluation of gastroenterology fellow performance in colonoscopy.

PubMed

Kumar, Navin L; Kugener, Guillaume; Perencevich, Molly L; Saltzman, John R

2018-01-01

Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise assessment tool to evaluate real-time fellow performance in colonoscopy administered via a web-based application. The Skill Assessment in Fellow Endoscopy Training (SAFE-T) tool was derived as a novel 5-question evaluation tool that captures both summative and formative feedback adapted into a web-based application. A prospective study of 15 gastroenterology fellows (5 fellows each from years 1 to 3 of training) was performed using the SAFE-T tool. An independent reviewer evaluated a subset of these procedures and completed the SAFE-T tool and Mayo Colonoscopy Skills Assessment Tool (MCSAT) for reliability testing. Twenty-six faculty completed 350 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score (year 1, 2.00; year 2, 3.84; year 3, 4.28) differentiated each sequential fellow year of training (P < .0001). The mean SAFE-T overall score decreased with increasing case complexity score, with straightforward cases compared with average cases (4.07 vs 3.50, P < .0001), and average cases compared with challenging cases (3.50 vs 3.08, P = .0134). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a kappa agreement statistic of 0.898 (P < .0001). Correlation of the SAFE-T overall score with the MCSAT overall hands-on and individual motor scores was excellent (each r > 0.90, P < .0001). We developed and validated the SAFE-T assessment tool, a concise and web-based means of assessing real-time gastroenterology fellow performance in colonoscopy. Copyright © 2018 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.

The development of the residential Fire H.E.L.P. tool kit: a resource to protect homebound older adults.

PubMed

Diekman, Shane; Huitric, Michele; Netterville, Linda

2010-01-01

This article describes the development of the Fire H.E.L.P. tool kit for training selected Meals On Wheels (MOW) staff in Texas to implement a fire safety program for homebound older adults. We used a formative evaluation approach during the tool kit's development, testing, and initial implementation stages. The tool kit includes instructional curricula on how to implement Fire H.E.L.P., a home assessment tool to determine a residence's smoke alarm needs, and fire safety educational materials. During the tool kit's pilot test, MOW participants showed enhanced fire safety knowledge and high levels of confidence about applying their newfound training skills. After the pilot test, MOW staff used the tool kit to conduct local training sessions, provide fire safety education, and install smoke alarms in the homes of older adults. We believe the approach used to develop this tool kit can be applied to education efforts for other, related healthy home topics.

SAFAS: Unifying Form and Structure through Interactive 3D Simulation

ERIC Educational Resources Information Center

Polys, Nicholas F.; Bacim, Felipe; Setareh, Mehdi; Jones, Brett D.

2015-01-01

There has been a significant gap between the tools used for the design of a building's architectural form and those that evaluate the structural physics of that form. Seeking to bring the perspectives of visual design and structural engineering closer together, we developed and evaluated a design tool for students and practitioners to explore the…

Development of an Evaluation Tool for Online Food Safety Training Programs

ERIC Educational Resources Information Center

Neal, Jack A., Jr.; Murphy, Cheryl A.; Crandall, Philip G.; O'Bryan, Corliss A.; Keifer, Elizabeth; Ricke, Steven C.

2011-01-01

The objective of this study was to provide the person in charge and food safety instructors an assessment tool to help characterize, identify strengths and weaknesses, determine the completeness of the knowledge gained by the employee, and evaluate the level of content presentation and usability of current retail food safety training platforms. An…

Usability Evaluation of an Augmented Reality System for Teaching Euclidean Vectors

ERIC Educational Resources Information Center

Martin-Gonzalez, Anabel; Chi-Poot, Angel; Uc-Cetina, Victor

2016-01-01

Augmented reality (AR) is one of the emerging technologies that has demonstrated to be an efficient technological tool to enhance learning techniques. In this paper, we describe the development and evaluation of an AR system for teaching Euclidean vectors in physics and mathematics. The goal of this pedagogical tool is to facilitate user's…

Experimental and analytical tools for evaluation of Stirling engine rod seal behavior

NASA Technical Reports Server (NTRS)

Krauter, A. I.; Cheng, H. S.

1979-01-01

The first year of a two year experimental and analytical program is reported. The program is directed at the elastohydrodynamic behavior of sliding elastomeric rod seals for the Stirling engine. During the year, experimental and analytical tools were developed for evaluating seal leakage, seal friction, and the fluid film thickness at the seal/cylinder interface.

OPTIMAL WELL LOCATOR (OWL): A SCREENING TOOL FOR EVALUATING LOCATIONS OF MONITORING WELLS: USER'S GUIDE VERSION 1.2

EPA Science Inventory

The Optimal Well Locator ( OWL) program was designed and developed by USEPA to be a screening tool to evaluate and optimize the placement of wells in long term monitoring networks at small sites. The first objective of the OWL program is to allow the user to visualize the change ...

A Data-Driven Framework for Incorporating New Tools for ...

EPA Pesticide Factsheets

This talk was given during the “Exposure-Based Toxicity Testing” session at the annual meeting of the International Society for Exposure Science. It provided an update on the state of the science and tools that may be employed in risk-based prioritization efforts. It outlined knowledge gained from the data provided using these high-throughput tools to assess chemical bioactivity and to predict chemical exposures and also identified future needs. It provided an opportunity to showcase ongoing research efforts within the National Exposure Research Laboratory and the National Center for Computational Toxicology within the Office of Research and Development to an international audience. The National Exposure Research Laboratory (NERL) Computational Exposure Division (CED) develops and evaluates data, decision-support tools, and models to be applied to media-specific or receptor-specific problem areas. CED uses modeling-based approaches to characterize exposures, evaluate fate and transport, and support environmental diagnostics/forensics with input from multiple data sources. It also develops media- and receptor-specific models, process models, and decision support tools for use both within and outside of EPA.

An introduction to using children's drawings as an assessment tool.

PubMed

Wilson, D; Ratekin, C

1990-03-01

This article is intended to familiarize the ambulatory care provider with possible uses of children's drawings as assessment tools. Drawings can be a useful adjunct in detecting perceptual-motor difficulties and developmental delay, and can provide clues to self-image and family dynamics. Piaget's theory of cognitive development provides a framework to evaluate the child's intellectual development as reflected in drawings. The developmental scales of Koppitz are presented as a practical screening tool. The Koppitz scales include both developmental norms and items that might indicate emotional problems. Observing the child's drawing of the family provides clues to family dynamics. Becoming highly skilled in the evaluation of children's drawings requires a familiarity with neurophysiology, education, psychology, and psychoanalytic and developmental theory, along with intuition and practice. This article presents an introduction to evaluating children's drawings.

Mobile mental health: a challenging research agenda.

PubMed

Olff, Miranda

2015-01-01

The field of mobile health ("m-Health") is evolving rapidly and there is an explosive growth of psychological tools on the market. Exciting high-tech developments may identify symptoms, help individuals manage their own mental health, encourage help seeking, and provide both preventive and therapeutic interventions. This development has the potential to be an efficient cost-effective approach reducing waiting lists and serving a considerable portion of people globally ("g-Health"). However, few of the mobile applications (apps) have been rigorously evaluated. There is little information on how valid screening and assessment tools are, which of the mobile intervention apps are effective, or how well mobile apps compare to face-to-face treatments. But how feasible is rigorous scientific evaluation with the rising demands from policy makers, business partners, and users for their quick release? In this paper, developments in m-Health tools-targeting screening, assessment, prevention, and treatment-are reviewed with examples from the field of trauma and posttraumatic stress disorder. The academic challenges in developing and evaluating m-Health tools are being addressed. Evidence-based guidance is needed on appropriate research designs that may overcome some of the public and ethical challenges (e.g., equity, availability) and the market-driven wish to have mobile apps in the "App Store" yesterday rather than tomorrow.

SMARTe 2008

EPA Science Inventory

Sustainable Management Approaches and Revitalization Tools - electronic (SMARTe), is an open-source, web-based, decision support system for developing and evaluating future reuse scenarios for potentially contaminated land. SMARTe contains resources and analysis tools for all asp...

SMARTe 2011

EPA Science Inventory

Sustainable Management Approaches and Revitalization Tools - electronic (SMARTe), is an open-source, web-based, decisions support system for developing and evaluating future reuse scenarios for potentially contaminated land. SMARTe contains resources and analysis tools for all a...

SMARTE 2007

EPA Science Inventory

Sustainable Management Approaches and Revitalization Tools-electronic (SMARTe), is an open-source, web-based, decision support system for developing and evaluating future reuse scenarios for potentially contaminated land. SMARTe contains guidance and analysis tools for all aspect...

Mathematical support for automated geometry analysis of lathe machining of oblique peakless round-nose tools

NASA Astrophysics Data System (ADS)

Filippov, A. V.; Tarasov, S. Yu; Podgornyh, O. A.; Shamarin, N. N.; Filippova, E. O.

2017-01-01

Automatization of engineering processes requires developing relevant mathematical support and a computer software. Analysis of metal cutting kinematics and tool geometry is a necessary key task at the preproduction stage. This paper is focused on developing a procedure for determining the geometry of oblique peakless round-nose tool lathe machining with the use of vector/matrix transformations. Such an approach allows integration into modern mathematical software packages in distinction to the traditional analytic description. Such an advantage is very promising for developing automated control of the preproduction process. A kinematic criterion for the applicable tool geometry has been developed from the results of this study. The effect of tool blade inclination and curvature on the geometry-dependent process parameters was evaluated.

Development of the public information and communication technology assessment tool.

PubMed

Ripat, Jacquie; Watzke, James; Birch, Gary

2008-09-01

Public information and communication technologies, such as information kiosks, automated banking machines and ticket dispensers, allow people to access services in a convenient and timely manner. However, the development of these technologies has occurred largely without consideration of access by people with disabilities. Inaccessible technical features make operation of a public technology difficult and barriers in the environment create navigational challenges, limiting the opportunity of people with disabilities to use these devices and access the services they provide. This paper describes the development of a tool that individuals, disability advocacy groups, business owners, healthcare providers, and urban planners can use to evaluate the accessibility of public technologies and the surrounding environment. Evaluation results can then be used to develop recommendations and advocate for technical and environmental changes to improve access. Tool development consisted of a review of the literature and key Canadian Standards Association documents, task analysis, and consultation with accessibility experts. Studies of content validity, tool usability, inter-rater and test-retest reliability were conducted in sites across Canada. Accessibility experts verified the content validity of the tool. The current version of the tool has incorporated the findings of a usability study. Initial testing indicated excellent agreement for inter-rater and test-retest reliability scores. Social exclusion can arise when public technologies are not accessible. This newly developed instrument provides detailed information that can be used to advocate for more accessible and inclusive public information and communication technologies.

Appraisal Tools for Clinical Practice Guidelines: A Systematic Review

PubMed Central

Siering, Ulrich; Eikermann, Michaela; Hausner, Elke; Hoffmann-Eßer, Wiebke; Neugebauer, Edmund A.

2013-01-01

Introduction Clinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools. Methods Among others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items. Results We identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions “evaluation of evidence” (mentioned in 35 tools; 88%), “presentation of guideline content” (34 tools; 85%), “transferability” (33 tools; 83%), “independence” (32 tools; 80%), “scope” (30 tools; 75%), and “information retrieval” (29 tools; 73%). The quality dimensions “consideration of different perspectives” and “dissemination, implementation and evaluation of the guideline” were covered by only twenty (50%) and eighteen tools (45%) respectively. Conclusions Most guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools. PMID:24349397

DOE Office of Scientific and Technical Information (OSTI.GOV)

Carpenter, Alberta; Mann, Margaret; Gelman, Rachel

In evaluating next-generation materials and processes, the supply chain can have a large impact on the life cycle energy impacts. The Materials Flow through Industry (MFI) tool was developed for the Department of Energy's Advanced Manufacturing Office to be able to evaluate the energy impacts of the U.S. supply chain. The tool allows users to perform process comparisons, material substitutions, and grid modifications, and to see the effects of implementing sector efficiency potentials (Masanet, et al. 2009). This paper reviews the methodology of the tool and provides results around specific scenarios.

An agent based simulation tool for scheduling emergency department physicians.

PubMed

Jones, Spencer S; Evans, R Scott

2008-11-06

Emergency department overcrowding is a problem that threatens the public health of communities and compromises the quality of care given to individual patients. The Institute of Medicine recommends that hospitals employ information technology and operations research methods to reduce overcrowding. This paper describes the development of an agent based simulation tool that has been designed to evaluate the impact of various physician staffing configurations on patient waiting times in the emergency department. We evaluate the feasibility of this tool at a single hospital emergency department.

The MEDA Project: Developing Evaluation Competence in the Training Software Domain.

ERIC Educational Resources Information Center

Machell, Joan; Saunders, Murray

1992-01-01

The MEDA (Methodologie d'Evaluation des Didacticiels pour les Adultes) tool is a generic instrument to evaluate training courseware. It was developed for software designers to improve products, for instructors to select appropriate courseware, and for distributors and consultants to match software to client needs. Describes software evaluation…

Classification and assessment tools for structural motif discovery algorithms.

PubMed

Badr, Ghada; Al-Turaiki, Isra; Mathkour, Hassan

2013-01-01

Motif discovery is the problem of finding recurring patterns in biological data. Patterns can be sequential, mainly when discovered in DNA sequences. They can also be structural (e.g. when discovering RNA motifs). Finding common structural patterns helps to gain a better understanding of the mechanism of action (e.g. post-transcriptional regulation). Unlike DNA motifs, which are sequentially conserved, RNA motifs exhibit conservation in structure, which may be common even if the sequences are different. Over the past few years, hundreds of algorithms have been developed to solve the sequential motif discovery problem, while less work has been done for the structural case. In this paper, we survey, classify, and compare different algorithms that solve the structural motif discovery problem, where the underlying sequences may be different. We highlight their strengths and weaknesses. We start by proposing a benchmark dataset and a measurement tool that can be used to evaluate different motif discovery approaches. Then, we proceed by proposing our experimental setup. Finally, results are obtained using the proposed benchmark to compare available tools. To the best of our knowledge, this is the first attempt to compare tools solely designed for structural motif discovery. Results show that the accuracy of discovered motifs is relatively low. The results also suggest a complementary behavior among tools where some tools perform well on simple structures, while other tools are better for complex structures. We have classified and evaluated the performance of available structural motif discovery tools. In addition, we have proposed a benchmark dataset with tools that can be used to evaluate newly developed tools.

Combining web-based tools for transparent evaluation of data for risk assessment: developmental effects of bisphenol A on the mammary gland as a case study.

PubMed

Molander, Linda; Hanberg, Annika; Rudén, Christina; Ågerstrand, Marlene; Beronius, Anna

2017-03-01

Different tools have been developed that facilitate systematic and transparent evaluation and handling of toxicity data in the risk assessment process. The present paper sets out to explore the combined use of two web-based tools for study evaluation and identification of reliable data relevant to health risk assessment. For this purpose, a case study was performed using in vivo toxicity studies investigating low-dose effects of bisphenol A on mammary gland development. The reliability of the mammary gland studies was evaluated using the Science in Risk Assessment and Policy (SciRAP) criteria for toxicity studies. The Health Assessment Workspace Collaborative (HAWC) was used for characterizing and visualizing the mammary gland data in terms of type of effects investigated and reported, and the distribution of these effects within the dose interval. It was then investigated whether there was any relationship between study reliability and the type of effects reported and/or their distribution in the dose interval. The combination of the SciRAP and HAWC tools allowed for transparent evaluation and visualization of the studies investigating developmental effects of BPA on the mammary gland. The use of these tools showed that there were no apparent differences in the type of effects and their distribution in the dose interval between the five studies assessed as most reliable and the whole data set. Combining the SciRAP and HAWC tools was found to be a useful approach for evaluating in vivo toxicity studies and identifying reliable and sensitive information relevant to regulatory risk assessment of chemicals. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP)

PubMed Central

Moodie, Sheila T.; Malandrino, April C.; Richert, Frances M.; Clench, Debbie A.; Scollie, Susan D.

2011-01-01

This study proposed and evaluated a guideline for outcome evaluation for infants and children with hearing loss who wear hearing aids. The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP) was developed following a critical review of pediatric outcome evaluation tools and was systematically examined by the Network of Pediatric Audiologists of Canada. It consists of tools to gather clinical process outcomes as well as functional caregiver reports. The UWO PedAMP was administered to a clinical population of infants and children with hearing aids. Sixty-eight children were administered the functional outcome evaluation tools (i.e., caregiver reports) a total of 133 times. Clinical process outcomes of hearing aid verification (e.g., real-ear-to-coupler difference) revealed typical aided audibility (e.g., Speech Intelligibility Index). Results for the LittlEARS® questionnaire revealed that typically developing children with hearing loss who wear hearing aids are meeting auditory development milestones. Children with mild to moderate comorbidities displayed typical auditory development during the 1st year of life after which development began to decline. Children with complex factors related to hearing aid use had lower scores on the LittlEARS, but auditory development was in parallel to norms. Parents’ Evaluation of Aural/Oral Performance (PEACH) results indicated no age effect on scoring for children above 2 years of age; however, the effect of degree of hearing loss was significant. This work provides clinicians with a systematic, evidence-based outcome evaluation protocol to implement as part of a complete pediatric hearing aid fitting. PMID:22194316

Overview of EPA tools for supporting local-, state- and regional-level decision makers addressing energy and environmental issues: NYC MARKAL Energy Systems Model and Municipal Solid Waste Decision Support Tool

EPA Science Inventory

A workshop will be conducted to demonstrate and focus on two decision support tools developed at EPA/ORD: 1. Community-scale MARKAL model: an energy-water technology evaluation tool and 2. Municipal Solid Waste Decision Support Tool (MSW DST). The Workshop will be part of Southea...

Market Transformation | Hydrogen and Fuel Cells | NREL

Science.gov Websites

deployment sites Develop techno-economic assessment tools, deployment tools, and business cases for various fuel cell applications Collect and evaluate data from deployment projects to verify the business cases

Development of a simplified urban water balance model (WABILA).

PubMed

Henrichs, M; Langner, J; Uhl, M

2016-01-01

During the last decade, water sensitive urban design (WSUD) has become more and more accepted. However, there is not any simple tool or option available to evaluate the influence of these measures on the local water balance. To counteract the impact of new settlements, planners focus on mitigating increases in runoff through installation of infiltration systems. This leads to an increasing non-natural groundwater recharge and decreased evapotranspiration. Simple software tools which evaluate or simulate the effect of WSUD on the local water balance are still needed. The authors developed a tool named WABILA (Wasserbilanz) that could support planners for optimal WSUD. WABILA is an easy-to-use planning tool that is based on simplified regression functions for established measures and land covers. Results show that WSUD has to be site-specific, based on climate conditions and the natural water balance.

Tool to assess causality of direct and indirect adverse events associated with therapeutic interventions.

PubMed

Zorzela, Liliane; Mior, Silvano; Boon, Heather; Gross, Anita; Yager, Jeromy; Carter, Rose; Vohra, Sunita

2018-03-01

To develop and test a tool to assess the causality of direct and indirect adverse events associated with therapeutic interventions. The intervention was one or more drugs and/or natural health products, a device, or practice (professional delivering the intervention). Through the assessment of causality of adverse events, we can learn about factors contributing to the harm and consider what modification may prevent its reoccurrence. Existing scales (WHO-UMC, Naranjo and Horn) were adapted to develop a tool (algorithm and table) to evaluate cases of serious harmful events reported through a national surveillance study. We also incorporated a novel approach that assesses indirect harm (caused by the delay in diagnosis/treatment) and the health provider delivering the intervention (practice). The tool was tested, revised and then implemented to assess all reported cases of serious events resulting from use of complementary therapies. The use of complementary therapies was the trigger to report the event. Each case was evaluated by two assessors, out of a panel of five, representing different health care professionals. The tool was used in assessment of eight serious adverse events. Each event was independently evaluated by two assessors. The algorithm facilitated assessment of a serious direct or indirect harm. Assessors agreed in the final score on seven of eight cases (weighted kappa coefficient of 0.75). A tool to support the assessment of causality of adverse events was developed and tested. We propose a novel method to assess direct and indirect harms related to product(s), device(s), practice or a combination of the previous. Further research will probably help evaluate this approach across different settings and interventions.

The Effects of Tools of the Mind on Math and Reading Scores in Kindergarten

ERIC Educational Resources Information Center

Mackay, Patricia E.

2013-01-01

Although a limited body of research has supported the positive impact of the Tools of the Mind curriculum on the development of self-regulation, research supporting a direct relationship between Tools and academic achievement is extremely limited. The purpose of this study is to evaluate the effectiveness of the Tools of the Mind curriculum…

Development of a problem solving evaluation instrument; untangling of specific problem solving assets

NASA Astrophysics Data System (ADS)

Adams, Wendy Kristine

The purpose of my research was to produce a problem solving evaluation tool for physics. To do this it was necessary to gain a thorough understanding of how students solve problems. Although physics educators highly value problem solving and have put extensive effort into understanding successful problem solving, there is currently no efficient way to evaluate problem solving skill. Attempts have been made in the past; however, knowledge of the principles required to solve the subject problem are so absolutely critical that they completely overshadow any other skills students may use when solving a problem. The work presented here is unique because the evaluation tool removes the requirement that the student already have a grasp of physics concepts. It is also unique because I picked a wide range of people and picked a wide range of tasks for evaluation. This is an important design feature that helps make things emerge more clearly. This dissertation includes an extensive literature review of problem solving in physics, math, education and cognitive science as well as descriptions of studies involving student use of interactive computer simulations, the design and validation of a beliefs about physics survey and finally the design of the problem solving evaluation tool. I have successfully developed and validated a problem solving evaluation tool that identifies 44 separate assets (skills) necessary for solving problems. Rigorous validation studies, including work with an independent interviewer, show these assets identified by this content-free evaluation tool are the same assets that students use to solve problems in mechanics and quantum mechanics. Understanding this set of component assets will help teachers and researchers address problem solving within the classroom.

Pilot evaluation of a continuing professional development tool for developing leadership skills.

PubMed

Patterson, Brandon J; Chang, Elizabeth H; Witry, Matthew J; Garza, Oscar W; Trewet, CoraLynn B

2013-01-01

Strategies are needed to assure essential nonclinical competencies, such as leadership, can be gained using a continuing professional development (CPD) framework. The objective of this study was to explore student pharmacists' utilization and perceived effectiveness of a CPD tool for leadership development in an elective course. Students completed 2 CPD cycles during a semester-long leadership elective using a CPD tool. A questionnaire was used to measure students' perceptions of utility, self-efficacy, and satisfaction in completing CPD cycles when using a tool to aid in this process. The CPD tool was completed twice by 7 students. On average, students spent nearly 5 hours per CPD cycle. More than half (57.1%) scored themselves as successful or very successful in achieving their learning plans, and most (71.4%) found the tool somewhat useful in developing their leadership skills. Some perceived that the tool provided a systematic way to engage in leadership development, whereas others found it difficult to use. In this pilot study, most student pharmacists successfully achieved a leadership development plan and found the CPD tool useful. Providing students with more guidance may help facilitate use and effectiveness of CPD tools. There is a need to continue to develop and refine tools that assist in the CPD of pharmacy practitioners at all levels. Copyright © 2013 Elsevier Inc. All rights reserved.

A multi-center study benchmarks software tools for label-free proteome quantification

PubMed Central

Gillet, Ludovic C; Bernhardt, Oliver M.; MacLean, Brendan; Röst, Hannes L.; Tate, Stephen A.; Tsou, Chih-Chiang; Reiter, Lukas; Distler, Ute; Rosenberger, George; Perez-Riverol, Yasset; Nesvizhskii, Alexey I.; Aebersold, Ruedi; Tenzer, Stefan

2016-01-01

The consistent and accurate quantification of proteins by mass spectrometry (MS)-based proteomics depends on the performance of instruments, acquisition methods and data analysis software. In collaboration with the software developers, we evaluated OpenSWATH, SWATH2.0, Skyline, Spectronaut and DIA-Umpire, five of the most widely used software methods for processing data from SWATH-MS (sequential window acquisition of all theoretical fragment ion spectra), a method that uses data-independent acquisition (DIA) for label-free protein quantification. We analyzed high-complexity test datasets from hybrid proteome samples of defined quantitative composition acquired on two different MS instruments using different SWATH isolation windows setups. For consistent evaluation we developed LFQbench, an R-package to calculate metrics of precision and accuracy in label-free quantitative MS, and report the identification performance, robustness and specificity of each software tool. Our reference datasets enabled developers to improve their software tools. After optimization, all tools provided highly convergent identification and reliable quantification performance, underscoring their robustness for label-free quantitative proteomics. PMID:27701404

A multicenter study benchmarks software tools for label-free proteome quantification.

PubMed

Navarro, Pedro; Kuharev, Jörg; Gillet, Ludovic C; Bernhardt, Oliver M; MacLean, Brendan; Röst, Hannes L; Tate, Stephen A; Tsou, Chih-Chiang; Reiter, Lukas; Distler, Ute; Rosenberger, George; Perez-Riverol, Yasset; Nesvizhskii, Alexey I; Aebersold, Ruedi; Tenzer, Stefan

2016-11-01

Consistent and accurate quantification of proteins by mass spectrometry (MS)-based proteomics depends on the performance of instruments, acquisition methods and data analysis software. In collaboration with the software developers, we evaluated OpenSWATH, SWATH 2.0, Skyline, Spectronaut and DIA-Umpire, five of the most widely used software methods for processing data from sequential window acquisition of all theoretical fragment-ion spectra (SWATH)-MS, which uses data-independent acquisition (DIA) for label-free protein quantification. We analyzed high-complexity test data sets from hybrid proteome samples of defined quantitative composition acquired on two different MS instruments using different SWATH isolation-window setups. For consistent evaluation, we developed LFQbench, an R package, to calculate metrics of precision and accuracy in label-free quantitative MS and report the identification performance, robustness and specificity of each software tool. Our reference data sets enabled developers to improve their software tools. After optimization, all tools provided highly convergent identification and reliable quantification performance, underscoring their robustness for label-free quantitative proteomics.

Environmental Evaluation of Soil Salinity with Various Watering Technologies Assessment.

PubMed

Seitkaziev, Adeubay; Shilibek, Kenzhegali; Fakhrudenova, Idiya; Salybayev, Satybaldy; Zhaparova, Sayagul; Duisenbayeva, Saule; Bayazitova, Zulfia; Aliya, Maimakova; Seitkazieva, Karlygash; Aubakirov, Hamit

2018-01-01

  The purpose of this study is to develop mathematical tools for evaluating the level of environmental safety of various watering technologies. A set of indicators, was developed with regard to the natural factors, the nature of the man-induced load, degradation type, and characteristics of the disruption of humification conditions. Thermal and physical characteristics of the soil, the state of its surface, and meteorological factors, including air temperature, relative humidity, precipitation, wind speed, solar radiation, etc. were studied with a view to determining the heat and air exchange in the soil. An environmental evaluation of the methods for saline land development was conducted with regard to the heat and moisture supply. This tool can be used to determine the level of environmental safety of soil salinization during the environmental evaluation of the investigation of soil salinity with various watering technologies.

Designing and evaluating a STEM teacher learning opportunity in the research university.

PubMed

Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D

2014-04-01

This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development and Evaluation of LEGUME ID: A ToolBook Multimedia Module.

ERIC Educational Resources Information Center

Hannaway, David B.; And Others

1992-01-01

Describes the development and advantages of LEGUME ID, a multimedia module for agricultural education. LEGUME ID is an example of how teachers, given the opportunity through accessible computer software programs, can create powerful teaching tools. Summarized is a student response to the use of this teacher-produced software program. (MCO)

Development of Assessment Tools To Measure Organizational Support for Employee Health.

ERIC Educational Resources Information Center

Golaszewski, Thomas; Barr, Donald; Pronk, Nico

2003-01-01

Describes one working group's attempts to develop and utilize assessment tools for measuring and changing organizational support for employee health. Originally designed as part of a heart health related intervention, the system has evolved into a managed care evaluation and major chronic disease inventory. Findings indicate the potential of…

Teacher Quality, Professionalism and Professional Development: Findings from a European Project

ERIC Educational Resources Information Center

Hilton, Gillian; Flores, Maria Assunção; Niklasson, Laila

2013-01-01

This paper presents and discusses findings from a European project concerning strengthening the teacher's voice in defining professional quality. In the project tools were developed and evaluated to help teachers reflect on their professional quality. Twelve countries participated and twelve tools were tested with help of student teachers,…

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Fast analysis of radionuclide decay chain migration

NASA Astrophysics Data System (ADS)

Chen, J. S.; Liang, C. P.; Liu, C. W.; Li, L.

2014-12-01

A novel tool for rapidly predicting the long-term plume behavior of an arbitrary length radionuclide decay chain is presented in this study. This fast tool is achieved based on generalized analytical solutions in compact format derived for a set of two-dimensional advection-dispersion equations coupled with sequential first-order decay reactions in groundwater system. The performance of the developed tool is evaluated by a numerical model using a Laplace transform finite difference scheme. The results of performance evaluation indicate that the developed model is robust and accurate. The developed model is then used to fast understand the transport behavior of a four-member radionuclide decay chain. Results show that the plume extents and concentration levels of any target radionuclide are very sensitive to longitudinal, transverse dispersion, decay rate constant and retardation factor. The developed model are useful tools for rapidly assessing the ecological and environmental impact of the accidental radionuclide releases such as the Fukushima nuclear disaster where multiple radionuclides leaked through the reactor, subsequently contaminating the local groundwater and ocean seawater in the vicinity of the nuclear plant.

Developing a uniformed assessment tool to evaluate care service needs for disabled persons in Japan.

PubMed

Takei, Teiji; Takahashi, Hiroshi; Nakatani, Hiroki

2008-05-01

Until recently, the care services for disabled persons have been under rigid control by public sectors in terms of provision and funding in Japan. A reform was introduced in 2003 that brought a rapid increase of utilization of services and serious shortage of financial resources. Under these circumstances, the "Services and Supports for Persons with Disabilities Act" was enacted in 2005, requiring that the care service provision process should be transparent, fair and standardized. The purpose of this study is to develop an objective tool for assessing the need for disability care. In the present study we evaluate 1423 cases of patients receiving care services in 60 municipalities, including all three categories of disabilities (physical, intellectual and mental). Using the data of the total 106 items, we conducted factor analysis and regression analysis to develop an assessment tool for people with disabilities. The data revealed that instrumental activities of daily living (IADL) played an essential role in assessing disability levels. We have developed the uniformed assessment tool that has been utilized to guide the types and quantity of care services throughout Japan.

Development of an Online Toolkit for Measuring Performance in Health Emergency Response Exercises.

PubMed

Agboola, Foluso; Bernard, Dorothy; Savoia, Elena; Biddinger, Paul D

2015-10-01

Exercises that simulate emergency scenarios are accepted widely as an essential component of a robust Emergency Preparedness program. Unfortunately, the variability in the quality of the exercises conducted, and the lack of standardized processes to measure performance, has limited the value of exercises in measuring preparedness. In order to help health organizations improve the quality and standardization of the performance data they collect during simulated emergencies, a model online exercise evaluation toolkit was developed using performance measures tested in over 60 Emergency Preparedness exercises. The exercise evaluation toolkit contains three major components: (1) a database of measures that can be used to assess performance during an emergency response exercise; (2) a standardized data collection tool (form); and (3) a program that populates the data collection tool with the measures that have been selected by the user from the database. The evaluation toolkit was pilot tested from January through September 2014 in collaboration with 14 partnering organizations representing 10 public health agencies and four health care agencies from eight states across the US. Exercise planners from the partnering organizations were asked to use the toolkit for their exercise evaluation process and were interviewed to provide feedback on the use of the toolkit, the generated evaluation tool, and the usefulness of the data being gathered for the development of the exercise after-action report. Ninety-three percent (93%) of exercise planners reported that they found the online database of performance measures appropriate for the creation of exercise evaluation forms, and they stated that they would use it again for future exercises. Seventy-two percent (72%) liked the exercise evaluation form that was generated from the toolkit, and 93% reported that the data collected by the use of the evaluation form were useful in gauging their organization's performance during the exercise. Seventy-nine percent (79%) of exercise planners preferred the evaluation form generated by the toolkit to other forms of evaluations. Results of this project show that users found the newly developed toolkit to be user friendly and more relevant to measurement of specific public health and health care capabilities than other tools currently available. The developed toolkit may contribute to the further advancement of developing a valid approach to exercise performance measurement.

Development of a participatory tool for the evaluation of Village Animal Health Workers in Cambodia.

PubMed

Calba, Clementine; Ponsich, Aurelia; Nam, Sophorn; Collineau, Lucie; Min, Sophoan; Thonnat, Jerome; Goutard, Flavie Luce

2014-06-01

In countries with a lack of primary care systems, health workers are of crucial importance to improving the delivery of health and animal health services at community level. But somehow they are rarely evaluated and usually with a top-down approach. This is the case in Cambodia, where thousands of Village Animal Health Workers (VAHWs) have been trained by the government, and where no standardized evaluation tool is available to accurately assess the situation. Based on methodology developed by the French NGO Agronomes et Vétérinaires Sans Frontières (AVSF) in Madagascar for farmers' association evaluation, we developed our own participatory methods to collect information about the VAHW context and build a criteria grid for their evaluation. In this framework, several participatory approaches were used such as problem trees, semi-structured interviews, pair-wise ranking and focus groups. The grid was built with the help of relevant stakeholders involved in the animal health system in Cambodia in order to (i) identify VAHW functions; (ii) set up criteria and associated questionnaires, and (iii) score the grid with all the stakeholders. The tool was divided into five categories of evaluation criteria: sustainability, treatment, production, vaccination and disease reporting. Our approach looked at local indicators of success developed and used by VAHWs themselves, which should lead to better acceptability of evaluation. This method gave priority to dialog aiming to engage decision makers and other stakeholders in a mutual learning process and could be applied in other countries to develop trust between health workers and official service representatives as well as to foster corrective action after evaluation. Copyright © 2014 The Authors. Published by Elsevier B.V. All rights reserved.

Communicative Access Measures for Stroke: Development and Evaluation of a Quality Improvement Tool.

PubMed

Kagan, Aura; Simmons-Mackie, Nina; Victor, J Charles; Chan, Melodie T

2017-11-01

To (1) develop a systems-level quality improvement tool targeting communicative access to information and decision-making for stroke patients with language disorders; and (2) evaluate the resulting tool-the Communicative Access Measures for Stroke (CAMS). Survey development and evaluation was in line with accepted guidelines and included item generation and reduction, survey formatting and composition, pretesting, pilot testing, and reliability assessment. Development and evaluation were carried out in hospital and community agency settings. The project used a convenience sample of 31 participants for the survey development, and 63 participants for the CAMS reliability study (broken down into 6 administrators/managers, 32 frontline staff, 25 participants with aphasia). Eligible participants invited to the reliability study included individuals from 45 community-based organizations in Ontario as well as 4400 individuals from communities of practice. Not applicable. Data were analyzed using kappa statistics and intraclass correlations for each item score on all surveys. A tool, the CAMS, comprising 3 surveys, was developed for health facilities from the perspectives of (1) administrators/policymakers, (2) staff/frontline health care providers, and (3) patients with aphasia (using a communicatively accessible version). Reliability for items on the CAMS-Administrator and CAMS-Staff surveys was moderate to high (kappa/intraclass correlation coefficients [ICCs], .54-1.00). As expected, reliability was lower for the CAMS-Patient survey, with most items having ICCs between 0.4 and 0.6. These findings suggest that CAMS may provide useful quality improvement information for health care facilities with an interest in improving care for patients with stroke and aphasia. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

FIA BioSum: a tool to evaluate financial costs, opportunities and effectiveness of fuel treatments.

Treesearch

Jeremy Fried; Glenn Christensen

2004-01-01

FIA BioSum, a tool developed by the USDA Forest Services Forest Inventory and Analysis (FIA) Program, generates reliable cost estimates, identifies opportunities and evaluates the effectiveness of fuel treatments in forested landscapes. BioSum is an analytic framework that integrates a suite of widely used computer models with a foundation of attribute-rich,...

Evaluation of the validity of osteoporosis and fracture risk assessment tools (IOF One Minute Test, SCORE, and FRAX) in postmenopausal Palestinian women.

PubMed

Kharroubi, Akram; Saba, Elias; Ghannam, Ibrahim; Darwish, Hisham

2017-12-01

The need for simple self-assessment tools is necessary to predict women at high risk for developing osteoporosis. In this study, tools like the IOF One Minute Test, Fracture Risk Assessment Tool (FRAX), and Simple Calculated Osteoporosis Risk Estimation (SCORE) were found to be valid for Palestinian women. The threshold for predicting women at risk for each tool was estimated. The purpose of this study is to evaluate the validity of the updated IOF (International Osteoporosis Foundation) One Minute Osteoporosis Risk Assessment Test, FRAX, SCORE as well as age alone to detect the risk of developing osteoporosis in postmenopausal Palestinian women. Three hundred eighty-two women 45 years and older were recruited including 131 women with osteoporosis and 251 controls following bone mineral density (BMD) measurement, 287 completed questionnaires of the different risk assessment tools. Receiver operating characteristic (ROC) curves were evaluated for each tool using bone BMD as the gold standard for osteoporosis. The area under the ROC curve (AUC) was the highest for FRAX calculated with BMD for predicting hip fractures (0.897) followed by FRAX for major fractures (0.826) with cut-off values ˃1.5 and ˃7.8%, respectively. The IOF One Minute Test AUC (0.629) was the lowest compared to other tested tools but with sufficient accuracy for predicting the risk of developing osteoporosis with a cut-off value ˃4 total yes questions out of 18. SCORE test and age alone were also as good predictors of risk for developing osteoporosis. According to the ROC curve for age, women ≥64 years had a higher risk of developing osteoporosis. Higher percentage of women with low BMD (T-score ≤-1.5) or osteoporosis (T-score ≤-2.5) was found among women who were not exposed to the sun, who had menopause before the age of 45 years, or had lower body mass index (BMI) compared to controls. Women who often fall had lower BMI and approximately 27% of the recruited postmenopausal Palestinian women had accidents that caused fractures. Simple self-assessment tools like FRAX without BMD, SCORE, and the IOF One Minute Tests were valid for predicting Palestinian postmenopausal women at high risk of developing osteoporosis.

The Definition and Measurement of Evaluation Quality as a Management Tool.

ERIC Educational Resources Information Center

Chelimsky, Eleanor

1983-01-01

Evaluation management requires a system for measuring, improving, and accounting for quality. The Institute for Program Evaluation in the United States General Accounting Office is developing such a system. (Author)

New Tool for Benefit-Cost Analysis in Evaluating Transportation Alternatives

DOT National Transportation Integrated Search

1997-01-01

The Intermodal Surface Transportation Efficiency Act (ISTEA) emphasizes assessment of multi-modal alternatives and demand management strategies. In 1995, the Federal Highway Administration (FHWA) developed a corridor sketch planning tool called the S...

ECO-DRIVING MODELING ENVIRONMENT

DOT National Transportation Integrated Search

2015-11-01

This research project aims to examine the eco-driving modeling capabilities of different traffic modeling tools available and to develop a driver-simulator-based eco-driving modeling tool to evaluate driver behavior and to reliably estimate or measur...

A web tool for STORET/WQX water quality data retrieval and Best Management Practice scenario suggestion.

PubMed

Park, Youn Shik; Engel, Bernie A; Kim, Jonggun; Theller, Larry; Chaubey, Indrajeet; Merwade, Venkatesh; Lim, Kyoung Jae

2015-03-01

Total Maximum Daily Load is a water quality standard to regulate water quality of streams, rivers and lakes. A wide range of approaches are used currently to develop TMDLs for impaired streams and rivers. Flow and load duration curves (FDC and LDC) have been used in many states to evaluate the relationship between flow and pollutant loading along with other models and approaches. A web-based LDC Tool was developed to facilitate development of FDC and LDC as well as to support other hydrologic analyses. In this study, the FDC and LDC tool was enhanced to allow collection of water quality data via the web and to assist in establishing cost-effective Best Management Practice (BMP) implementations. The enhanced web-based tool provides use of water quality data not only from the US Geological Survey but also from the Water Quality Portal for the U.S. via web access. Moreover, the web-based tool identifies required pollutant reductions to meet standard loads and suggests a BMP scenario based on ability of BMPs to reduce pollutant loads, BMP establishment and maintenance costs. In the study, flow and water quality data were collected via web access to develop LDC and to identify the required reduction. The suggested BMP scenario from the web-based tool was evaluated using the EPA Spreadsheet Tool for the Estimation of Pollutant Load model to attain the required pollutant reduction at least cost. Copyright © 2014 Elsevier Ltd. All rights reserved.

Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users

NASA Technical Reports Server (NTRS)

Kanefsky, Bob; Zheng, Jimin; Deliz, Ivonne; Marquez, Jessica J.; Hillenius, Steven

2017-01-01

Typically, user tests for software tools are conducted in person. At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission. The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group's existing planning-and-execution software application. Once the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis. Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools.P-DAT has demonstrated the capability of discreetly capturing usability data in amanner that is transparent to Playbook’s end-users. In our experience, P-DAT data hasalready shown its utility, revealing potential usability patterns, helping diagnose softwarebugs, and identifying metrics and events that are pertinent to Playbook usage aswell as spaceflight operations. As we continue to develop this analysis tool, P-DATmay yet provide a method for long-duration, unobtrusive human performance collectionand evaluation for mission controllers back on Earth and researchers investigatingthe effects and mitigations related to future human spaceflight performance.

Health impact assessment – A survey on quantifying tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fehr, Rainer, E-mail: rainer.fehr@uni-bielefeld.de; Mekel, Odile C.L., E-mail: odile.mekel@lzg.nrw.de; Fintan Hurley, J., E-mail: fintan.hurley@iom-world.org

Integrating human health into prospective impact assessments is known to be challenging. This is true for both approaches: dedicated health impact assessments (HIA) as well as inclusion of health into more general impact assessments. Acknowledging the full range of participatory, qualitative, and quantitative approaches, this study focuses on the latter, especially on computational tools for quantitative health modelling. We conducted a survey among tool developers concerning the status quo of development and availability of such tools; experiences made with model usage in real-life situations; and priorities for further development. Responding toolmaker groups described 17 such tools, most of them beingmore » maintained and reported as ready for use and covering a wide range of topics, including risk & protective factors, exposures, policies, and health outcomes. In recent years, existing models have been improved and were applied in new ways, and completely new models emerged. There was high agreement among respondents on the need to further develop methods for assessment of inequalities and uncertainty. The contribution of quantitative modeling to health foresight would benefit from building joint strategies of further tool development, improving the visibility of quantitative tools and methods, and engaging continuously with actual and potential users. - Highlights: • A survey investigated computational tools for health impact quantification. • Formal evaluation of such tools has been rare. • Handling inequalities and uncertainties are priority areas for further development. • Health foresight would benefit from tool developers and users forming a community. • Joint development strategies across computational tools are needed.« less

The Air Quality Model Evaluation International Initiative ...

EPA Pesticide Factsheets

This presentation provides an overview of the Air Quality Model Evaluation International Initiative (AQMEII). It contains a synopsis of the three phases of AQMEII, including objectives, logistics, and timelines. It also provides a number of examples of analyses conducted through AQMEII with a particular focus on past and future analyses of deposition. The National Exposure Research Laboratory (NERL) Computational Exposure Division (CED) develops and evaluates data, decision-support tools, and models to be applied to media-specific or receptor-specific problem areas. CED uses modeling-based approaches to characterize exposures, evaluate fate and transport, and support environmental diagnostics/forensics with input from multiple data sources. It also develops media- and receptor-specific models, process models, and decision support tools for use both within and outside of EPA.

The Chinese version of monitoring and evaluation system strengthening tool for human immunodeficiency virus (HIV) capacity building: Development and evaluation.

PubMed

Zhao, Ran; Chen, Ren; Zhang, Bing; Ma, Ying; Qin, Xia; Hu, Zhi

2015-08-01

Monitoring and evaluation (M&E) for human immunodeficiency virus (HIV) capacity building has become a significant step for HIV prevention and control. The M&E system strengthening tool published by the United Nations Joint Programme on HIV/AIDS (UNAIDS) was intended to be the most authoritative assessment tool internationally. Facing the fact that the M&E system in China did not function at an optimum level, we considered taking the international standards for reference. By linguistic validating and different stages' discussions and revisions, we came up with the Chinese version of the capacity diagnosis tool with at least 12 components and tested its validity and reliability. The tool turned out to have a sufficiently linguistic validation and proved to be a scientific and feasible instrument which was suitable for China's national conditions.

Enhancing emergency care in low-income countries using mobile technology-based training tools

PubMed Central

Edgcombe, Hilary; Paton, Chris; English, Mike

2016-01-01

In this paper, we discuss the role of mobile technology in developing training tools for health workers, with particular reference to low-income countries (LICs). The global and technological context is outlined, followed by a summary of approaches to using and evaluating mobile technology for learning in healthcare. Finally, recommendations are made for those developing and using such tools, based on current literature and the authors' involvement in the field. PMID:27658948

A practical assessment of physician biopsychosocial performance.

PubMed

Margalit, Alon Pa; Glick, Shimon M; Benbassat, Jochanan; Cohen, Ayala; Margolis, Carmi Z

2007-10-01

A biopsychosocial approach to care seems to improve patient satisfaction and health outcomes. Nevertheless, this approach is not widely practiced, possibly because its precepts have not been translated into observable skills. To identify the skill components of a biopsychosocial consultation and develop an tool for their evaluation. We approached three e-mail discussion groups of family physicians and pooled their responses to the question "what types of observed physician behavior would characterize a biopsychosocial consultation?" We received 35 responses describing 37 types of behavior, all of which seemed to cluster around one of three aspects: patient-centered interview; system-centered and family-centered approach to care; or problem-solving orientation. Using these categories, we developed a nine-item evaluation tool. We used the evaluation tool to score videotaped encounters of patients with two types of doctors: family physicians who were identified by peer ratings to have a highly biopsychosocial orientation (n = 9) or a highly biomedical approach (n = 4); and 44 general practitioners, before and after they had participated in a program that taught a biopsychosocial approach to care. The evaluation tool was found to demonstrate high reliability (alpha = 0.90) and acceptable interobserver variability. The average scores of the physicians with a highly biopsychosocial orientation were significantly higher than those of physicians with a highly biomedical approach. There were significant differences between the scores of the teaching-program participants before and after the program. A biopsychosocial approach to patient care can be characterized using a valid and easy-to-apply evaluation tool.

Evaluation of the Families SHARE workbook: an educational tool outlining disease risk and healthy guidelines to reduce risk of heart disease, diabetes, breast cancer and colorectal cancer.

PubMed

Koehly, Laura M; Morris, Bronwyn A; Skapinsky, Kaley; Goergen, Andrea; Ludden, Amanda

2015-11-13

Common diseases such as heart disease, diabetes, and cancer are etiologically complex with multiple risk factors (e.g., environment, genetic, lifestyle). These risk factors tend to cluster in families, making families an important social context for intervention and lifestyle-focused disease prevention. The Families Sharing Health Assessment and Risk Evaluation (SHARE) workbook was designed as an educational tool outlining family health history based risk of heart disease, type 2 diabetes, breast cancer, and colorectal cancer. The current paper describes the steps taken to develop and evaluate the workbook employing a user-centered design approach. The workbook was developed in four steps, culminating in an evaluation focusing on understanding and usability of the tool. The evaluation was based on two Phases of data collected from a sample of mothers of young children in the Washington, D.C., area. A baseline assessment and follow-up approximately two weeks after receipt of the workbook were conducted, as well as focus groups with participants. The design of the workbook was refined in response to participant feedback from the first evaluation Phase and subsequently re-evaluated with a new sample. After incorporating user-based feedback and revising the workbook, Phase 2 evaluation results indicated that understanding of the workbook components improved for all sections (from 6.26 to 6.81 on a 7-point scale). In addition, 100% of users were able to use the algorithm to assess their disease risk and over 60% used the algorithm to assess family members' disease risk. At follow-up, confidence to increase fruit, vegetable and fiber intake improved significantly, as well. The Families SHARE workbook was developed and evaluated resulting in a family health history tool that is both understandable and usable by key stakeholders. This educational tool will be used in intervention studies assessing the effectiveness of family genomics health educators who use the Families SHARE workbook to disseminate family risk information and encourage risk reducing behaviors. ClinicalTrials.gov, NCT01498276 . Registered 21 December 2011.

Using Simulation to Teach About Poverty in Nursing Education: A Review of Available Tools.

PubMed

Reid, Carol A; Evanson, Tracy A

2016-01-01

Poverty is one of the most significant social determinants of health, and as such, it is imperative that nurses have an understanding of the impact that living in poverty has upon one's life and health. A lack of such understanding will impede nurses from providing care that is patient centered, treats all patients fairly, and advocates for social justice. It is essential that nursing educators assure that poverty-related content and effective teaching strategies are used in nursing curricula in order to help students develop this understanding. Several poverty-simulation tools are available and may be able to assist with development of accurate knowledge, skills, and attitudes. Unfortunately, little evidence exists to evaluate most poverty simulation tools. This article will provide an introduction to several poverty-related simulation tools, discuss any related research that evaluates their effectiveness, and make recommendations for integration of such simulation tools into nursing curricula. Copyright © 2016 Elsevier Inc. All rights reserved.

Report on Automated Semantic Analysis of Scientific and Engineering Codes

NASA Technical Reports Server (NTRS)

Stewart. Maark E. M.; Follen, Greg (Technical Monitor)

2001-01-01

The loss of the Mars Climate Orbiter due to a software error reveals what insiders know: software development is difficult and risky because, in part, current practices do not readily handle the complex details of software. Yet, for scientific software development the MCO mishap represents the tip of the iceberg; few errors are so public, and many errors are avoided with a combination of expertise, care, and testing during development and modification. Further, this effort consumes valuable time and resources even when hardware costs and execution time continually decrease. Software development could use better tools! This lack of tools has motivated the semantic analysis work explained in this report. However, this work has a distinguishing emphasis; the tool focuses on automated recognition of the fundamental mathematical and physical meaning of scientific code. Further, its comprehension is measured by quantitatively evaluating overall recognition with practical codes. This emphasis is necessary if software errors-like the MCO error-are to be quickly and inexpensively avoided in the future. This report evaluates the progress made with this problem. It presents recommendations, describes the approach, the tool's status, the challenges, related research, and a development strategy.

Tool to Prioritize Energy Efficiency Investments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Farese, P.; Gelman, R.; Hendron, R.

2012-08-01

To provide analytic support of the U.S. Department of Energy's Office of the Building Technology Program (BTP), NREL developed a Microsoft Excel-based tool to provide an open and objective comparison of the hundreds of investment opportunities available to BTP. This tool uses established methodologies to evaluate the energy savings and cost of those savings.

Survey Tools for Faculty to Quickly Assess Multidisciplinary Team Dynamics in Capstone Courses

ERIC Educational Resources Information Center

Solnosky, Ryan; Fairchild, Joshua

2017-01-01

Many engineering faculty have limited skills and/or assessment tools to evaluate team dynamics in multidisciplinary team-based capstone courses. Rapidly deployable tools are needed here to provide proactive feedback to teams to facilitate deeper learning. Two surveys were developed based on industrial and organizational psychology theories around…

Interagency Transition Team Development and Facilitation. Essential Tools.

ERIC Educational Resources Information Center

Stodden, Robert A.; Brown, Steven E.; Galloway, L. M.; Mrazek, Susan; Noy, Liora

2005-01-01

The purpose of this Essential Tool is to assist state-level transition coordinators and others responsible for forming, conducting, and evaluating the performance of interagency transition teams that are focused upon the school and post-school needs of youth with disabilities. This Essential Tool is designed to guide the coordination efforts of…

Examining the Quality of IEPs for Young Children with Autism

ERIC Educational Resources Information Center

Ruble, Lisa A.; McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2010-01-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool's reliability; test the tool on a pilot sample of IEPs of young children; and examine…

A Standards-Based Grading and Reporting Tool for Faculty: Design and Implications

ERIC Educational Resources Information Center

Sadik, Alaa M.

2011-01-01

The use of standard-based assessment, grading and reporting tools is essential to ensure that assessment meets acceptable levels of quality and standardization. This study reports the design, development and evaluation of a standards-based assessment tool for the instructors at Sultan Qaboos University, Sultanate of Oman. The Rapid Applications…

Piloting a programme tool to evaluate malaria case investigation and reactive case detection activities: results from 3 settings in the Asia Pacific.

PubMed

Cotter, Chris; Sudathip, Prayuth; Herdiana, Herdiana; Cao, Yuanyuan; Liu, Yaobao; Luo, Alex; Ranasinghe, Neil; Bennett, Adam; Cao, Jun; Gosling, Roly D

2017-08-22

Case investigation and reactive case detection (RACD) activities are widely-used in low transmission settings to determine the suspected origin of infection and identify and treat malaria infections nearby to the index patient household. Case investigation and RACD activities are time and resource intensive, include methodologies that vary across eliminating settings, and have no standardized metrics or tools available to monitor and evaluate them. In response to this gap, a simple programme tool was developed for monitoring and evaluating (M&E) RACD activities and piloted by national malaria programmes. During the development phase, four modules of the RACD M&E tool were created to assess and evaluate key case investigation and RACD activities and costs. A pilot phase was then carried out by programme implementers between 2013 and 2015, during which malaria surveillance teams in three different settings (China, Indonesia, Thailand) piloted the tool over a period of 3 months each. This study describes summary results of the pilots and feasibility and impact of the tool on programmes. All three study areas implemented the RACD M&E tool modules, and pilot users reported the tool and evaluation process were helpful to identify gaps in RACD programme activities. In the 45 health facilities evaluated, 71.8% (97/135; min 35.3-max 100.0%) of the proper notification and reporting forms and 20.0% (27/135; min 0.0-max 100.0%) of standard operating procedures (SOPs) were available to support malaria elimination activities. The tool highlighted gaps in reporting key data indicators on the completeness for malaria case reporting (98.8%; min 93.3-max 100.0%), case investigations (65.6%; min 61.8-max 78.4%) and RACD activities (70.0%; min 64.7-max 100.0%). Evaluation of the SOPs showed that knowledge and practices of malaria personnel varied within and between study areas. Average monthly costs for conducting case investigation and RACD activities showed variation between study areas (min USD $844.80-max USD $2038.00) for the malaria personnel, commodities, services and other costs required to carry out the activities. The RACD M&E tool was implemented in the three pilot areas, identifying key gaps that led to impacts on programme decision making. Study findings support the need for routine M&E of malaria case reporting, case investigation and RACD activities. Scale-up of the RACD M&E tool in malaria-eliminating settings will contribute to improved programme performance to the high level that is required to reach elimination.

Altered States of Consciousness Profile: An Afro-Centric Intrapsychic Evaluation Tool

PubMed Central

Bell, Carl C.; Thompson, Belinda; Shorter-Gooden, Kumea; Mays, Raymond; Shakoor, Bambade

1985-01-01

In an effort to develop an Afro-centric intrapsychic evaluation tool, the Community Mental Health Council, Inc., Altered States of Consciousness Research Team, developed a structured interview used to quantify and qualify the 17 states of consciousness1 that occurred in black control, precare, and aftercare subjects. Differences were noted in the three groups as to the incidence, prevalence, and quality of the various states of consciousness. It was also noted that the profile obtained from the interviews yielded a sharp clinical picture of the subjects' total intrapsychic propensities. PMID:4057274

Refining prognosis in lung cancer: A report on the quality and relevance of clinical prognostic tools

PubMed Central

Mahar, Alyson L.; Compton, Carolyn; McShane, Lisa M.; Halabi, Susan; Asamura, Hisao; Rami-Porta, Ramon; Groome, Patti A.

2015-01-01

Introduction Accurate, individualized prognostication for lung cancer patients requires the integration of standard patient and pathologic factors, biologic, genetic, and other molecular characteristics of the tumor. Clinical prognostic tools aim to aggregate information on an individual patient to predict disease outcomes such as overall survival, but little is known about their clinical utility and accuracy in lung cancer. Methods A systematic search of the scientific literature for clinical prognostic tools in lung cancer published Jan 1, 1996-Jan 27, 2015 was performed. In addition, web-based resources were searched. A priori criteria determined by the Molecular Modellers Working Group of the American Joint Committee on Cancer were used to investigate the quality and usefulness of tools. Criteria included clinical presentation, model development approaches, validation strategies, and performance metrics. Results Thirty-two prognostic tools were identified. Patients with metastases were the most frequently considered population in non-small cell lung cancer. All tools for small cell lung cancer covered that entire patient population. Included prognostic factors varied considerably across tools. Internal validity was not formally evaluated for most tools and only eleven were evaluated for external validity. Two key considerations were highlighted for tool development: identification of an explicit purpose related to a relevant clinical population and clear decision-points, and prioritized inclusion of established prognostic factors over emerging factors. Conclusions Prognostic tools will contribute more meaningfully to the practice of personalized medicine if better study design and analysis approaches are used in their development and validation. PMID:26313682

Decision tools in health care: focus on the problem, not the solution.

PubMed

Liu, Joseph; Wyatt, Jeremy C; Altman, Douglas G

2006-01-20

Systematic reviews or randomised-controlled trials usually help to establish the effectiveness of drugs and other health technologies, but are rarely sufficient by themselves to ensure actual clinical use of the technology. The process from innovation to routine clinical use is complex. Numerous computerised decision support systems (DSS) have been developed, but many fail to be taken up into actual use. Some developers construct technologically advanced systems with little relevance to the real world. Others did not determine whether a clinical need exists. With NHS investing 5 billion pounds sterling in computer systems, also occurring in other countries, there is an urgent need to shift from a technology-driven approach to one that identifies and employs the most cost-effective method to manage knowledge, regardless of the technology. The generic term, 'decision tool' (DT), is therefore suggested to demonstrate that these aids, which seem different technically, are conceptually the same from a clinical viewpoint. Many computerised DSSs failed for various reasons, for example, they were not based on best available knowledge; there was insufficient emphasis on their need for high quality clinical data; their development was technology-led; or evaluation methods were misapplied. We argue that DSSs and other computer-based, paper-based and even mechanical decision aids are members of a wider family of decision tools. A DT is an active knowledge resource that uses patient data to generate case specific advice, which supports decision making about individual patients by health professionals, the patients themselves or others concerned about them. The identification of DTs as a consistent and important category of health technology should encourage the sharing of lessons between DT developers and users and reduce the frequency of decision tool projects focusing only on technology. The focus of evaluation should become more clinical, with the impact of computer-based DTs being evaluated against other computer, paper- or mechanical tools, to identify the most cost effective tool for each clinical problem. We suggested the generic term 'decision tool' to demonstrate that decision-making aids, such as computerised DSSs, paper algorithms, and reminders are conceptually the same, so the methods to evaluate them should be the same.

An evaluation of software tools for the design and development of cockpit displays

NASA Technical Reports Server (NTRS)

Ellis, Thomas D., Jr.

1993-01-01

The use of all-glass cockpits at the NASA Langley Research Center (LaRC) simulation facility has changed the means of design, development, and maintenance of instrument displays. The human-machine interface has evolved from a physical hardware device to a software-generated electronic display system. This has subsequently caused an increased workload at the facility. As computer processing power increases and the glass cockpit becomes predominant in facilities, software tools used in the design and development of cockpit displays are becoming both feasible and necessary for a more productive simulation environment. This paper defines LaRC requirements of a display software development tool and compares two available applications against these requirements. As a part of the software engineering process, these tools reduce development time, provide a common platform for display development, and produce exceptional real-time results.

Instruction Guide and Macro Analysis Tool for Community-led Air Monitoring

EPA Pesticide Factsheets

EPA has developed two tools for evaluating the performance of low-cost sensors and interpreting the data they collect to help citizen scientists, communities, and professionals interested in learning about local air quality.

Assessment of the Aviation Environmental Design Tool

DOT National Transportation Integrated Search

2009-06-29

A comprehensive Tools Suite to allow for : thorough evaluation of the environmental effects and impacts : of aviation is currently being developed by the U.S. This suite : consists of the Environmental Design Space (EDS), the : Aviation Environmental...

Surface roughness model based on force sensors for the prediction of the tool wear.

PubMed

de Agustina, Beatriz; Rubio, Eva María; Sebastián, Miguel Ángel

2014-04-04

In this study, a methodology has been developed with the objective of evaluating the surface roughness obtained during turning processes by measuring the signals detected by a force sensor under the same cutting conditions. In this way, the surface quality achieved along the process is correlated to several parameters of the cutting forces (thrust forces, feed forces and cutting forces), so the effect that the tool wear causes on the surface roughness is evaluated. In a first step, the best cutting conditions (cutting parameters and radius of tool) for a certain quality surface requirement were found for pieces of UNS A97075. Next, with this selection a model of surface roughness based on the cutting forces was developed for different states of wear that simulate the behaviour of the tool throughout its life. The validation of this model reveals that it was effective for approximately 70% of the surface roughness values obtained.

The development and validation of the clinicians' awareness towards cognitive errors (CATChES) in clinical decision making questionnaire tool.

PubMed

Chew, Keng Sheng; Kueh, Yee Cheng; Abdul Aziz, Adlihafizi

2017-03-21

Despite their importance on diagnostic accuracy, there is a paucity of literature on questionnaire tools to assess clinicians' awareness toward cognitive errors. A validation study was conducted to develop a questionnaire tool to evaluate the Clinician's Awareness Towards Cognitive Errors (CATChES) in clinical decision making. This questionnaire is divided into two parts. Part A is to evaluate the clinicians' awareness towards cognitive errors in clinical decision making while Part B is to evaluate their perception towards specific cognitive errors. Content validation for both parts was first determined followed by construct validation for Part A. Construct validation for Part B was not determined as the responses were set in a dichotomous format. For content validation, all items in both Part A and Part B were rated as "excellent" in terms of their relevance in clinical settings. For construct validation using exploratory factor analysis (EFA) for Part A, a two-factor model with total variance extraction of 60% was determined. Two items were deleted. Then, the EFA was repeated showing that all factor loadings are above the cut-off value of >0.5. The Cronbach's alpha for both factors are above 0.6. The CATChES questionnaire tool is a valid questionnaire tool aimed to evaluate the awareness among clinicians toward cognitive errors in clinical decision making.

Development of a StandAlone Surgical Haptic Arm.

PubMed

Jones, Daniel; Lewis, Andrew; Fischer, Gregory S

2011-01-01

When performing telesurgery with current commercially available Minimally Invasive Robotic Surgery (MIRS) systems, a surgeon cannot feel the tool interactions that are inherent in traditional laparoscopy. It is proposed that haptic feedback in the control of MIRS systems could improve the speed, safety and learning curve of robotic surgery. To test this hypothesis, a standalone surgical haptic arm (SASHA) capable of manipulating da Vinci tools has been designed and fabricated with the additional ability of providing information for haptic feedback. This arm was developed as a research platform for developing and evaluating approaches to telesurgery, including various haptic mappings between master and slave and evaluating the effects of latency.

On the evaluation of segmentation editing tools

PubMed Central

Heckel, Frank; Moltz, Jan H.; Meine, Hans; Geisler, Benjamin; Kießling, Andreas; D’Anastasi, Melvin; dos Santos, Daniel Pinto; Theruvath, Ashok Joseph; Hahn, Horst K.

2014-01-01

Abstract. Efficient segmentation editing tools are important components in the segmentation process, as no automatic methods exist that always generate sufficient results. Evaluating segmentation editing algorithms is challenging, because their quality depends on the user’s subjective impression. So far, no established methods for an objective, comprehensive evaluation of such tools exist and, particularly, intermediate segmentation results are not taken into account. We discuss the evaluation of editing algorithms in the context of tumor segmentation in computed tomography. We propose a rating scheme to qualitatively measure the accuracy and efficiency of editing tools in user studies. In order to objectively summarize the overall quality, we propose two scores based on the subjective rating and the quantified segmentation quality over time. Finally, a simulation-based evaluation approach is discussed, which allows a more reproducible evaluation without the need for human input. This automated evaluation complements user studies, allowing a more convincing evaluation, particularly during development, where frequent user studies are not possible. The proposed methods have been used to evaluate two dedicated editing algorithms on 131 representative tumor segmentations. We show how the comparison of editing algorithms benefits from the proposed methods. Our results also show the correlation of the suggested quality score with the qualitative ratings. PMID:26158063

Frailty in trauma: A systematic review of the surgical literature for clinical assessment tools.

PubMed

McDonald, Victoria S; Thompson, Kimberly A; Lewis, Paul R; Sise, C Beth; Sise, Michael J; Shackford, Steven R

2016-05-01

Elderly trauma patients have outcomes worse than those of similarly injured younger patients. Although patient age and comorbidities explain some of the difference, the contribution of frailty to outcomes is largely unknown because of the lack of assessment tools developed specifically to assess frailty in the trauma population. This systematic review of the surgical literature identifies currently available frailty clinical assessment tools and evaluates the potential of each instrument to assess frailty in elderly patients with trauma. This review was registered with PROSPERO (the international prospective register of systematic reviews, registration number CRD42014015350). Publications in English from January 1995 to October 2014 were identified by a comprehensive search strategy in MEDLINE, EMBASE, and CINAHL, supplemented by manual screening of article bibliographies and subjected to three tiers of review. Forty-two studies reporting on frailty assessment tools were selected for analysis. Criteria for objectivity, feasibility in the trauma setting, and utility to predict trauma outcomes were formulated and used to evaluate the tools, including their subscales and individual items. Thirty-two unique frailty assessment tools were identified. Of those, 4 tools as a whole, 2 subscales, and 29 individual items qualified as objective, feasible, and useful in the clinical assessment of trauma patients. The single existing tool developed specifically to assess frailty in trauma did not meet evaluation criteria. Few frailty assessment tools in the surgical literature qualify as objective, feasible, and useful measures of frailty in the trauma population. However, a number of individual tool items and subscales could be combined to assess frailty in the trauma setting. Research to determine the accuracy of these measures and the magnitude of the contribution of frailty to trauma outcomes is needed. Systematic review, level III.

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

Self-Reacting Friction Stir Welding for Aluminum Alloy Circumferential Weld Applications

NASA Technical Reports Server (NTRS)

Bjorkman, Gerry; Cantrell, Mark; Carter, Robert

2003-01-01

Friction stir welding is an innovative weld process that continues to grow in use, in the commercial, defense, and space sectors. It produces high quality and high strength welds in aluminum alloys. The process consists of a rotating weld pin tool that plasticizes material through friction. The plasticized material is welded by applying a high weld forge force through the weld pin tool against the material during pin tool rotation. The high weld forge force is reacted against an anvil and a stout tool structure. A variation of friction stir welding currently being evaluated is self-reacting friction stir welding. Self-reacting friction stir welding incorporates two opposing shoulders on the crown and root sides of the weld joint. In self-reacting friction stir welding, the weld forge force is reacted against the crown shoulder portion of the weld pin tool by the root shoulder. This eliminates the need for a stout tooling structure to react the high weld forge force required in the typical friction stir weld process. Therefore, the self-reacting feature reduces tooling requirements and, therefore, process implementation costs. This makes the process attractive for aluminum alloy circumferential weld applications. To evaluate the application of self-reacting friction stir welding for aluminum alloy circumferential welding, a feasibility study was performed. The study consisted of performing a fourteen-foot diameter aluminum alloy circumferential demonstration weld using typical fusion weld tooling. To accomplish the demonstration weld, weld and tack weld development were performed and fourteen-foot diameter rings were fabricated. Weld development consisted of weld pin tool selection and the generation of a process map and envelope. Tack weld development evaluated gas tungsten arc welding and friction stir welding for tack welding rings together for circumferential welding. As a result of the study, a successful circumferential demonstration weld was produced leading the way for future circumferential weld implementation.

Constructing Benchmark Databases and Protocols for Medical Image Analysis: Diabetic Retinopathy

PubMed Central

Kauppi, Tomi; Kämäräinen, Joni-Kristian; Kalesnykiene, Valentina; Sorri, Iiris; Uusitalo, Hannu; Kälviäinen, Heikki

2013-01-01

We address the performance evaluation practices for developing medical image analysis methods, in particular, how to establish and share databases of medical images with verified ground truth and solid evaluation protocols. Such databases support the development of better algorithms, execution of profound method comparisons, and, consequently, technology transfer from research laboratories to clinical practice. For this purpose, we propose a framework consisting of reusable methods and tools for the laborious task of constructing a benchmark database. We provide a software tool for medical image annotation helping to collect class label, spatial span, and expert's confidence on lesions and a method to appropriately combine the manual segmentations from multiple experts. The tool and all necessary functionality for method evaluation are provided as public software packages. As a case study, we utilized the framework and tools to establish the DiaRetDB1 V2.1 database for benchmarking diabetic retinopathy detection algorithms. The database contains a set of retinal images, ground truth based on information from multiple experts, and a baseline algorithm for the detection of retinopathy lesions. PMID:23956787

Twitter: A Professional Development and Community of Practice Tool for Teachers

ERIC Educational Resources Information Center

Rosell-Aguilar, Fernando

2018-01-01

This article shows how a group of language teachers use Twitter as a tool for continuous professional development through the #MFLtwitterati hashtag. Based on data collected through a survey (n = 116) and interviews (n = 11), it describes how this collective of teachers use the hashtag and evaluates the impact of their Twitter network on their…

Development of a Tool to Evaluate Lecturers' Verbal Repertoire in Action

ERIC Educational Resources Information Center

van der Rijst, R. M.; Visser-Wijnveen, G. J.; Verloop, N.; van Driel, J. H.

2014-01-01

A broad communicative repertoire can help university lecturers to motivate and engage diverse student populations. The aim of this study is to develop and explore the usefulness and validity of a tool to identify patterns in lecturers' verbal repertoire. Speech act theory is presented as a framework to study lecturers' verbal…

U.S.-GERMAN BILATERAL WORKING GROUP: International Research Cooperation to Develop and Evaluate Tools and Techniques for Revitalization of Potentially Contaminated Sites

EPA Science Inventory

The U.S. German Bilateral Working Group originated in 1990 in order to share and transfer information, ideas, tools and techniques regarding environmental research. The U.S. Environmental Protection Agency (EPA)/Office of Research and Development (ORD) and the German Federal Mini...

Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

ERIC Educational Resources Information Center

Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

2017-01-01

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

Microcutting characteristics on the single crystal diamond tool with edge radius using molecular dynamics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kim, Jeong-Du; Moon, Chan-Hong

1995-12-31

Ultraprecision metal cutting (UPMC) technology which makes possible submicrometer form accuracy and manometer roughness is developed to reach the 1nm nominal (undeformed) thickness of cut. At this thickness level, a few of atom`s layers should be considered. In this paper using the Molecuar Dynamics simulation, the phenomena of microcutting with a subnanometer chip thickness, the cutting mechanism for tool edge configuration to consider the sharp edge and round edge tool, the cut material and cutting speed are evaluated. Cutting mechanism of subnanometer depth of cut is evaluated.

Modeling Electrostatic Fields Generated by Internal Charging of Materials in Space Radiation Environments

NASA Technical Reports Server (NTRS)

Minow, Joseph I.

2011-01-01

Internal charging is a risk to spacecraft in energetic electron environments. DICTAT, NU MIT computational codes are the most widely used engineering tools for evaluating internal charging of insulator materials exposed to these environments. Engineering tools are designed for rapid evaluation of ESD threats, but there is a need for more physics based models for investigating the science of materials interactions with energetic electron environments. Current tools are limited by the physics included in the models and ease of user implementation .... additional development work is needed to improve models.

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

PubMed

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

ThinTool: a spreadsheet model to evaluate fuel reduction thinning cost, net energy output, and nutrient impacts

Treesearch

Sang-Kyun Han; Han-Sup Han; William J. Elliot; Edward M. Bilek

2017-01-01

We developed a spreadsheet-based model, named ThinTool, to evaluate the cost of mechanical fuel reduction thinning including biomass removal, to predict net energy output, and to assess nutrient impacts from thinning treatments in northern California and southern Oregon. A combination of literature reviews, field-based studies, and contractor surveys was used to...

Evaluation of an existing screening tool for psoriatic arthritis in people with psoriasis and the development of a new instrument: the Psoriasis Epidemiology Screening Tool (PEST) questionnaire.

PubMed

Ibrahim, G H; Buch, M H; Lawson, C; Waxman, R; Helliwell, P S

2009-01-01

To evaluate an existing tool (the Swedish modification of the Psoriasis Assessment Questionnaire) and to develop a new instrument to screen for psoriatic arthritis in people with psoriasis. The starting point was a community-based survey of people with psoriasis using questionnaires developed from the literature. Selected respondents were examined and additional known cases of psoriatic arthritis were included in the analysis. The new instrument was developed using univariate statistics and a logistic regression model, comparing people with and without psoriatic arthritis. The instruments were compared using receiver operating curve (ROC) curve analysis. 168 questionnaires were returned (response rate 27%) and 93 people attended for examination (55% of questionnaire respondents). Of these 93, twelve were newly diagnosed with psoriatic arthritis during this study. These 12 were supplemented by 21 people with known psoriatic arthritis. Just 5 questions were found to be significant predictors of psoriatic arthritis in this population. Figures for sensitivity and specificity were 0.92 and 0.78 respectively, an improvement on the Alenius tool (sensitivity and specificity, 0.63 and 0.72 respectively). A new screening tool for identifying people with psoriatic arthritis has been developed. Five simple questions demonstrated good sensitivity and specificity in this population but further validation is required.

Development of Usability Criteria for E-Learning Content Development Software

ERIC Educational Resources Information Center

Celik, Serkan

2012-01-01

Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step…

Introduction of Sustainable Development in Engineers' Curricula: Problematic and Evaluation Methods

ERIC Educational Resources Information Center

Lourdel, N.; Gondran, N.; Laforest, V.; Brodhag, C.

2005-01-01

Purpose: Owing to its complexity, sustainable development cannot be simply integrated as a supplementary course within the engineers' curricula. The first point of this paper aims to focalise on how to reflect pedagogically. After dealing with these questions, a tool that can evaluate the student's understanding of sustainable development concepts…

A quality assessment tool for markup-based clinical guidelines.

PubMed

Shalom, Erez; Shahar, Yuval; Taieb-Maimon, Meirav; Lunenfeld, Eitan

2008-11-06

We introduce a tool for quality assessment of procedural and declarative knowledge. We developed this tool for evaluating the specification of mark-up-based clinical GLs. Using this graphical tool, the expert physician and knowledge engineer collaborate to perform scoring, using pre-defined scoring scale, each of the knowledge roles of the mark-ups, comparing it to a gold standard. The tool enables scoring the mark-ups simultaneously at different sites by different users at different locations.

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review.

PubMed

Dall, P M; Coulter, E H; Fitzsimons, C F; Skelton, D A; Chastin, Sfm

2017-04-08

Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Systematic searches were conducted via EBSCO, reference lists and expert opinion. The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

An Integrated Knowledge Translation Experience

PubMed Central

Bagatto, Marlene P.; Miller, Linda T.; Kothari, Anita; Seewald, Richard; Scollie, Susan D.

2011-01-01

Pediatric audiologists lack evidence-based, age-appropriate outcome evaluation tools with well-developed normative data that could be used to evaluate the auditory development and performance of children aged birth to 6 years with permanent childhood hearing impairment. Bagatto and colleagues recommend a battery of outcome tools that may be used with this population. This article provides results of an evaluation of the individual components of the University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP) version 1.0 by the audiologists associated with the Network of Pediatric Audiologists of Canada. It also provides information regarding barriers and facilitators to implementing outcome measures in clinical practice. Results indicate that when compared to the Parents’ Evaluation of Aural/Oral Performance of Children (PEACH) Diary, audiologists found the PEACH Rating Scale to be a more clinically feasible evaluation tool to implement in practice from a time, task, and consistency of use perspective. Results also indicate that the LittlEARS® Auditory Questionnaire could be used to evaluate the auditory development and performance of children aged birth to 6 years with permanent childhood hearing impairment (PCHI). The most cited barrier to implementation is time. The result of this social collaboration was the creation of a knowledge product, the UWO PedAMP v1.0, which has the potential to be useful to audiologists and the children and families they serve. PMID:22194315

Development of RAD-Score: A Tool to Assess the Procedural Competence of Diagnostic Radiology Residents.

PubMed

Isupov, Inga; McInnes, Matthew D F; Hamstra, Stan J; Doherty, Geoffrey; Gupta, Ashish; Peddle, Susan; Jibri, Zaid; Rakhra, Kawan; Hibbert, Rebecca M

2017-04-01

The purpose of this study is to develop a tool to assess the procedural competence of radiology trainees, with sources of evidence gathered from five categories to support the construct validity of tool: content, response process, internal structure, relations to other variables, and consequences. A pilot form for assessing procedural competence among radiology residents, known as the RAD-Score tool, was developed by evaluating published literature and using a modified Delphi procedure involving a group of local content experts. The pilot version of the tool was tested by seven radiology department faculty members who evaluated procedures performed by 25 residents at one institution between October 2014 and June 2015. Residents were evaluated while performing multiple procedures in both clinical and simulation settings. The main outcome measure was the percentage of residents who were considered ready to perform procedures independently, with testing conducted to determine differences between levels of training. A total of 105 forms (for 52 procedures performed in a clinical setting and 53 procedures performed in a simulation setting) were collected for a variety of procedures (eight vascular or interventional, 42 body, 12 musculoskeletal, 23 chest, and 20 breast procedures). A statistically significant difference was noted in the percentage of trainees who were rated as being ready to perform a procedure independently (in postgraduate year [PGY] 2, 12% of residents; in PGY3, 61%; in PGY4, 85%; and in PGY5, 88%; p < 0.05); this difference persisted in the clinical and simulation settings. User feedback and psychometric analysis were used to create a final version of the form. This prospective study describes the successful development of a tool for assessing the procedural competence of radiology trainees with high levels of construct validity in multiple domains. Implementation of the tool in the radiology residency curriculum is planned and can play an instrumental role in the transition to competency-based radiology training.

Building clinical networks: a developmental evaluation framework.

PubMed

Carswell, Peter; Manning, Benjamin; Long, Janet; Braithwaite, Jeffrey

2014-05-01

Clinical networks have been designed as a cross-organisational mechanism to plan and deliver health services. With recent concerns about the effectiveness of these structures, it is timely to consider an evidence-informed approach for how they can be developed and evaluated. To document an evaluation framework for clinical networks by drawing on the network evaluation literature and a 5-year study of clinical networks. We searched literature in three domains: network evaluation, factors that aid or inhibit network development, and on robust methods to measure network characteristics. This material was used to build a framework required for effective developmental evaluation. The framework's architecture identifies three stages of clinical network development; partner selection, network design and network management. Within each stage is evidence about factors that act as facilitators and barriers to network growth. These factors can be used to measure progress via appropriate methods and tools. The framework can provide for network growth and support informed decisions about progress. For the first time in one place a framework incorporating rigorous methods and tools can identify factors known to affect the development of clinical networks. The target user group is internal stakeholders who need to conduct developmental evaluation to inform key decisions along their network's developmental pathway.

Reflections on experiential learning in evaluation capacity building with a community organization, Dancing With Parkinson's.

PubMed

Nakaima, April; Sridharan, Sanjeev

2017-05-08

This paper discusses what was learned about evaluation capacity building with community organizations who deliver services to individuals with neurological disorders. Evaluation specialists engaged by the Ontario Brain Institute Evaluation Support Program were paired with community organizations, such as Dancing With Parkinson's. Some of the learning included: relationship building is key for this model of capacity building; community organizations often have had negative experiences with evaluation and the idea that evaluations can be friendly tools in implementing meaningful programs is one key mechanism by which such an initiative can work; community organizations often need evaluation most to be able to demonstrate their value; a strength of this initiative was that the focus was not just on creating products but mostly on developing a learning process in which capacities would remain; evaluation tools and skills that organizations found useful were developing a theory of change and the concept of heterogeneous mechanisms (informed by a realist evaluation lens). Copyright © 2017. Published by Elsevier Ltd.

OPTIMIZING BMP PLACEMENT AT WATERSHED-SCALE USING SUSTAIN

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate alternative plans for environmental quality restoration and protection needs in urban and developing areas. A watershed-scale decision-support system, based on cost optimization, provides an essential tool to suppo...

U.S. EPA's Watershed Management Research Activities

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate alternative plans for environmental quality restoration and protection needs in urban and developing areas. A watershed-scale decision-support system, based on cost optimization, provides an essential tool to suppo...

Intersection life cycle cost comparison tool user guide version 1.0.

DOT National Transportation Integrated Search

2016-05-01

The Intersection Life Cycle Cost Comparison Tool User Guide was developed as part of North : Carolina Department of Transportation Research Project No. 201411: Evaluation of Life Cycle : Impacts of Intersection Control Type Selection. : This sprea...

SMARTE: HELPING COMMUNITIES OVERCOME OBSTACLES TO REVITALIZATION (04/23/07)

EPA Science Inventory

Sustainable Management Approaches and Revitalization Tools - electronic (SMARTe), is an open-source, web-based, decision support system for developing and evaluating future reuse scenarios for potentially contaminated land. SMARTe contains information and analysis tools for all a...

New tools for sculpting cranial implants in a shared haptic augmented reality environment.

PubMed

Ai, Zhuming; Evenhouse, Ray; Leigh, Jason; Charbel, Fady; Rasmussen, Mary

2006-01-01

New volumetric tools were developed for the design and fabrication of high quality cranial implants from patient CT data. These virtual tools replace time consuming physical sculpting, mold making and casting steps. The implant is designed by medical professionals in tele-immersive collaboration. Virtual clay is added in the virtual defect area on the CT data using the adding tool. With force feedback the modeler can feel the edge of the defect and fill only the space where no bone is present. A carving tool and a smoothing tool are then used to sculpt and refine the implant. To make a physical evaluation, the skull with simulated defect and the implant are fabricated via stereolithography to allow neurosurgeons to evaluate the quality of the implant. Initial tests demonstrate a very high quality fit. These new haptic volumetric sculpting tools are a critical component of a comprehensive tele-immersive system.

Evaluation of Federal Social Programs: An Uncertain Impact. Occasional Paper 1992-2.

ERIC Educational Resources Information Center

Levitan, Sar A.

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

Tools for observational gait analysis in patients with stroke: a systematic review.

PubMed

Ferrarello, Francesco; Bianchi, Valeria Anna Maria; Baccini, Marco; Rubbieri, Gaia; Mossello, Enrico; Cavallini, Maria Chiara; Marchionni, Niccolò; Di Bari, Mauro

2013-12-01

Stroke severely affects walking ability, and assessment of gait kinematics is important in defining diagnosis, planning treatment, and evaluating interventions in stroke rehabilitation. Although observational gait analysis is the most common approach to evaluate gait kinematics, tools useful for this purpose have received little attention in the scientific literature and have not been thoroughly reviewed. The aims of this systematic review were to identify tools proposed to conduct observational gait analysis in adults with a stroke, to summarize evidence concerning their quality, and to assess their implementation in rehabilitation research and clinical practice. An extensive search was performed of original articles reporting on visual/observational tools developed to investigate gait kinematics in adults with a stroke. Two reviewers independently selected studies, extracted data, assessed quality of the included studies, and scored the metric properties and clinical utility of each tool. Rigor in reporting metric properties and dissemination of the tools also was evaluated. Five tools were identified, not all of which had been tested adequately for their metric properties. Evaluation of content validity was partially satisfactory. Reliability was poorly investigated in all but one tool. Concurrent validity and sensitivity to change were shown for 3 and 2 tools, respectively. Overall, adequate levels of quality were rarely reached. The dissemination of the tools was poor. Based on critical appraisal, the Gait Assessment and Intervention Tool shows a good level of quality, and its use in stroke rehabilitation is recommended. Rigorous studies are needed for the other tools in order to establish their usefulness.

LifeQuestionnaire. A new tool for the evaluation of quality of life in patients with hearing loss-using WhatsApp.

PubMed

Pérez Zaballos, M T; Ramos Macías, Á; Pérez Placencia, D; Borkoski Barreiro, S A; Ramos de Miguel, Á

2016-06-01

Develop an online application that sends questions at different times of the day over an interval set by the user. It consists of a web interface that sends out WhatsApp messages containing questions from already validated or customized questionnaires (previous license) and shows the evolution of each question and patient over time and their average. The Laboratory of Psychoacoustics developed a platform that allows patients to answer surveys from remote locations. Hence, the developed tool allows to: (1) answer a test repeatedly under different personal situations and (2) evaluate the patient remotely. Hence, obtaining a more reliable assessment of the patient's QoL. Preliminary results using 5 teenagers aged 12-18 that answered the KINDL questionnaire is used to evidence the value of this new tool. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

Portfolio: a prototype workstation for development and evaluation of tools for analysis and management of digital portal images.

PubMed

Boxwala, A A; Chaney, E L; Fritsch, D S; Friedman, C P; Rosenman, J G

1998-09-01

The purpose of this investigation was to design and implement a prototype physician workstation, called PortFolio, as a platform for developing and evaluating, by means of controlled observer studies, user interfaces and interactive tools for analyzing and managing digital portal images. The first observer study was designed to measure physician acceptance of workstation technology, as an alternative to a view box, for inspection and analysis of portal images for detection of treatment setup errors. The observer study was conducted in a controlled experimental setting to evaluate physician acceptance of the prototype workstation technology exemplified by PortFolio. PortFolio incorporates a windows user interface, a compact kit of carefully selected image analysis tools, and an object-oriented data base infrastructure. The kit evaluated in the observer study included tools for contrast enhancement, registration, and multimodal image visualization. Acceptance was measured in the context of performing portal image analysis in a structured protocol designed to simulate clinical practice. The acceptability and usage patterns were measured from semistructured questionnaires and logs of user interactions. Radiation oncologists, the subjects for this study, perceived the tools in PortFolio to be acceptable clinical aids. Concerns were expressed regarding user efficiency, particularly with respect to the image registration tools. The results of our observer study indicate that workstation technology is acceptable to radiation oncologists as an alternative to a view box for clinical detection of setup errors from digital portal images. Improvements in implementation, including more tools and a greater degree of automation in the image analysis tasks, are needed to make PortFolio more clinically practical.

Comparison of Data Development Tools for Populating Cognitive Models in Social Simulation

DTIC Science & Technology

2011-09-01

world surveys. STANLEY was evaluated by scoring sentiment in a document corpus and attempting to correlate those scores to a real world issue ...corpus and attempting to correlate those scores to a real world issue . Results of the study indicate that the survey data tool generated case files of...15 1. Issues with the Initial Version of the Tool .......................................21 2. The Tool Used in the Research

Evolution of a multilevel framework for health program evaluation.

PubMed

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Health system guidance appraisal--concept evaluation and usability testing.

PubMed

Ako-Arrey, Denis E; Brouwers, Melissa C; Lavis, John N; Giacomini, Mita K

2016-01-05

Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability. This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed. Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains. The final tool, named the Appraisal of Guidelines for Research and Evaluation for Health Systems (AGREE-HS) (version 1), defines expectations of HSG and facilitates informed decisions among policymakers on health system delivery, financial, and governance arrangements.

Education for Sustainable Development and Global Citizenship: An Evaluation of the Validity of the STAUNCH Auditing Tool

ERIC Educational Resources Information Center

Glover, Alison; Peters, Carl; Haslett, Simon K.

2011-01-01

Purpose: The purpose of this paper is to test the validity of the curriculum auditing tool Sustainability Tool for Auditing University Curricula in Higher Education (STAUNCH[C]), which was designed to audit the education for sustainability and global citizenship content of higher education curricula. The Welsh Assembly Government aspires to…

Simplified tools for evaluating domestic ventilation systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maansson, L.G.; Orme, M.

1999-07-01

Within an International Energy Agency (IEA) project, Annex 27, experts from 8 countries (Canada, France, Italy, Japan, The Netherlands, Sweden, UK and USA) have developed simplified tools for evaluating domestic ventilation systems during the heating season. Tools for building and user aspects, thermal comfort, noise, energy, life cycle cost, reliability and indoor air quality (IAQ) have been devised. The results can be used both for dwellings at the design stage and after construction. The tools lead to immediate answers and indications about the consequences of different choices that may arise during discussion with clients. This paper presents an introduction tomore » these tools. Examples applications of the indoor air quality and energy simplified tools are also provided. The IAQ tool accounts for constant emission sources, CO{sub 2}, cooking products, tobacco smoke, condensation risks, humidity levels (i.e., for judging the risk for mould and house dust mites), and pressure difference (for identifying the risk for radon or land fill spillage entering the dwelling or problems with indoor combustion appliances). An elaborated set of design parameters were worked out that resulted in about 17,000 combinations. By using multi-variate analysis it was possible to reduce this to 174 combinations for IAQ. In addition, a sensitivity analysis was made using 990 combinations. The results from all the runs were used to develop a simplified tool, as well as quantifying equations relying on the design parameters. A computerized energy tool has also been developed within this project, which takes into account air tightness, climate, window airing pattern, outdoor air flow rate and heat exchange efficiency.« less

Development and First Phase Evaluation of a Maternity Leave Educational Tool for Pregnant, Working Women in California.

PubMed

Kurtovich, Elaine; Guendelman, Sylvia; Neuhauser, Linda; Edelman, Dana; Georges, Maura; Mason-Marti, Peyton

2015-01-01

Despite the provision of maternity leave offered to mothers, many American women fail to take leave. We developed an evidence-based maternity leave educational tool for working women in California using participatory design. We tested its short-term efficacy with a randomized controlled trial of pregnant English-speakers (n=155). Among intervention participants exposed to the tool, 65% reported that they learned something new; 38% were motivated to seek more information; and 49% said it helped them plan their maternity leave. Among participants who delivered at ≥ 37 weeks gestation and said the tool helped them plan their leave, 89% took more than one week of prenatal leave, a significantly higher proportion than among controls who did not receive the tool (64%, p=0.049). Other findings favored trial participants, but were not statistically significant in this small sample. More intervention participants took some prenatal leave (80%) vs. controls (74%, p=0.44). Among participants who had returned to work when surveyed (n=50), mean postnatal leave uptake was on average 1 week longer for intervention participants vs. controls (13.3 vs. 12.2 weeks, p=0.54). The first-phase evaluation of this tool shows that it successfully informed women about maternity leave options, clarified complex regulations, encouraged women to seek further information and helped plan maternity leave. Compared to controls, trial participants who used the tool to plan their leave were far more likely to take prenatal leave close to term. Future evaluation of the tool when mediated by a health provider or employer is warranted.

A Comprehensive Look at Polypharmacy and Medication Screening Tools for the Older Cancer Patient

PubMed Central

DeGregory, Kathlene A.; Morris, Amy L.; Ramsdale, Erika E.

2016-01-01

Inappropriate medication use and polypharmacy are extremely common among older adults. Numerous studies have discussed the importance of a comprehensive medication assessment in the general geriatric population. However, only a handful of studies have evaluated inappropriate medication use in the geriatric oncology patient. Almost a dozen medication screening tools exist for the older adult. Each available tool has the potential to improve aspects of the care of older cancer patients, but no single tool has been developed for this population. We extensively reviewed the literature (MEDLINE, PubMed) to evaluate and summarize the most relevant medication screening tools for older patients with cancer. Findings of this review support the use of several screening tools concurrently for the elderly patient with cancer. A deprescribing tool should be developed and included in a comprehensive geriatric oncology assessment. Finally, prospective studies are needed to evaluate such a tool to determine its feasibility and impact in older patients with cancer. Implications for Practice: The prevalence of polypharmacy increases with advancing age. Older adults are more susceptible to adverse effects of medications. “Prescribing cascades” are common, whereas “deprescribing” remains uncommon; thus, older patients tend to accumulate medications over time. Older patients with cancer are at high risk for adverse drug events, in part because of the complexity and intensity of cancer treatment. Additionally, a cancer diagnosis often alters assessments of life expectancy, clinical status, and competing risk. Screening for polypharmacy and potentially inappropriate medications could reduce the risk for adverse drug events, enhance quality of life, and reduce health care spending for older cancer patients. PMID:27151653

Quantitative health impact assessment: taking stock and moving forward.

PubMed

Fehr, Rainer; Hurley, Fintan; Mekel, Odile Cecile; Mackenbach, Johan P

2012-12-01

Over the past years, application of health impact assessment has increased substantially, and there has been a strong growth of tools that allow quantification of health impacts for a range of health relevant policies. We review these developments, and conclude that further tool development is no longer a main priority, although several aspects need to be further developed, such as methods to assess impacts on health inequalities and to assess uncertainties. The main new challenges are, first, to conduct a comparative evaluation of different tools, and, second, to ensure the maintenance and continued availability of the toolkits including their data contents.

Applications of AN OO Methodology and Case to a Daq System

NASA Astrophysics Data System (ADS)

Bee, C. P.; Eshghi, S.; Jones, R.; Kolos, S.; Magherini, C.; Maidantchik, C.; Mapelli, L.; Mornacchi, G.; Niculescu, M.; Patel, A.; Prigent, D.; Spiwoks, R.; Soloviev, I.; Caprini, M.; Duval, P. Y.; Etienne, F.; Ferrato, D.; Le van Suu, A.; Qian, Z.; Gaponenko, I.; Merzliakov, Y.; Ambrosini, G.; Ferrari, R.; Fumagalli, G.; Polesello, G.

The RD13 project has evaluated the use of the Object Oriented Information Engineering (OOIE) method during the development of several software components connected to the DAQ system. The method is supported by a sophisticated commercial CASE tool (Object Management Workbench) and programming environment (Kappa) which covers the full life-cycle of the software including model simulation, code generation and application deployment. This paper gives an overview of the method, CASE tool, DAQ components which have been developed and we relate our experiences with the method and tool, its integration into our development environment and the spiral lifecycle it supports.

Hyper-X Stage Separation: Simulation Development and Results

NASA Technical Reports Server (NTRS)

Reubush, David E.; Martin, John G.; Robinson, Jeffrey S.; Bose, David M.; Strovers, Brian K.

2001-01-01

This paper provides an overview of stage separation simulation development and results for NASA's Hyper-X program; a focused hypersonic technology effort designed to move hypersonic, airbreathing vehicle technology from the laboratory environment to the flight environment. This paper presents an account of the development of the current 14 degree of freedom stage separation simulation tool (SepSim) and results from use of the tool in a Monte Carlo analysis to evaluate the risk of failure for the separation event. Results from use of the tool show that there is only a very small risk of failure in the separation event.

Development and use of mathematical models and software frameworks for integrated analysis of agricultural systems and associated water use impacts

USGS Publications Warehouse

Fowler, K. R.; Jenkins, E.W.; Parno, M.; Chrispell, J.C.; Colón, A. I.; Hanson, Randall T.

2016-01-01

The development of appropriate water management strategies requires, in part, a methodology for quantifying and evaluating the impact of water policy decisions on regional stakeholders. In this work, we describe the framework we are developing to enhance the body of resources available to policy makers, farmers, and other community members in their e orts to understand, quantify, and assess the often competing objectives water consumers have with respect to usage. The foundation for the framework is the construction of a simulation-based optimization software tool using two existing software packages. In particular, we couple a robust optimization software suite (DAKOTA) with the USGS MF-OWHM water management simulation tool to provide a flexible software environment that will enable the evaluation of one or multiple (possibly competing) user-defined (or stakeholder) objectives. We introduce the individual software components and outline the communication strategy we defined for the coupled development. We present numerical results for case studies related to crop portfolio management with several defined objectives. The objectives are not optimally satisfied for any single user class, demonstrating the capability of the software tool to aid in the evaluation of a variety of competing interests.

KNOW ESSENTIALS: a tool for informed decisions in the absence of formal HTA systems.

PubMed

Mathew, Joseph L

2011-04-01

Most developing countries and resource-limited settings lack robust health technology assessment (HTA) systems. Because the development of locally relevant HTA is not immediately viable, and the extrapolation of external HTA is inappropriate, a new model for evaluating health technologies is required. The aim of this study was to describe the development and application of KNOW ESSENTIALS, a tool facilitating evidence-based decisions on health technologies by stakeholders in settings lacking formal HTA systems. Current HTA methodology was examined through literature search. Additional issues relevant to resource-limited settings, but not adequately addressed in current methodology, were identified through further literature search, appraisal of contextually relevant issues, discussion with healthcare professionals familiar with the local context, and personal experience. A set of thirteen elements important for evidence-based decisions was identified, selected and combined into a tool with the mnemonic KNOW ESSENTIALS. Detailed definitions for each element, coding for the elements, and a system to evaluate a given health technology using the tool were developed. Developing countries and resource-limited settings face several challenges to informed decision making. Models that are relevant and applicable in high-income countries are unlikely in such settings. KNOW ESSENTIALS is an alternative that facilitates evidence-based decision making by stakeholders without formal expertise in HTA. The tool could be particularly useful, as an interim measure, in healthcare systems that are developing HTA capacity. It could also be useful anywhere when rapid evidence-based decisions on health technologies are required.

Development of a Planet Tool for an interactive School Atlas as eBook

NASA Astrophysics Data System (ADS)

Wondrak, Stephan

2018-05-01

The present thesis describes the development of a planet tool for an interactive school atlas using an eBook format. Especially the technical and cartographical capabilities of the open standard ePUB 3 are evaluated. An eBook application with interactive and dynamic 2-dimensional visualizations is developed especially to show whether the re-al-world dimensions and distances in the solar system can be mapped in a cartographical correct and for students easy understandable manner. In the first part of the work, the requirements of the planet tool are evaluated in co-operation with experts. The open standards PDF and ePUB 3 are investigated with regard to the requirements for the development of the planet tool. Another chapter describes in detail all significant steps of the development process for a prototype of the planet tool. A graphic file originally created for print production is prepared and enhanced with interactive features to generate one of the eBook pages. This serves to show a potential workflow for the generation of eBook pages in a cross-media atlas production. All sample pages of the prototype show different layouts and contain the entire spectrum of interactive features and multimedia content of modern eBooks. The sample pages are presented and discussed in an own chapter. The results of the present work aim at answering the question concerning the suitability of the open standard ePUB 3 for the development of a multimedia eBook for high school education.

Health system context and implementation of evidence-based practices-development and validation of the Context Assessment for Community Health (COACH) tool for low- and middle-income settings.

PubMed

Bergström, Anna; Skeen, Sarah; Duc, Duong M; Blandon, Elmer Zelaya; Estabrooks, Carole; Gustavsson, Petter; Hoa, Dinh Thi Phuong; Källestål, Carina; Målqvist, Mats; Nga, Nguyen Thu; Persson, Lars-Åke; Pervin, Jesmin; Peterson, Stefan; Rahman, Anisur; Selling, Katarina; Squires, Janet E; Tomlinson, Mark; Waiswa, Peter; Wallin, Lars

2015-08-15

The gap between what is known and what is practiced results in health service users not benefitting from advances in healthcare, and in unnecessary costs. A supportive context is considered a key element for successful implementation of evidence-based practices (EBP). There were no tools available for the systematic mapping of aspects of organizational context influencing the implementation of EBPs in low- and middle-income countries (LMICs). Thus, this project aimed to develop and psychometrically validate a tool for this purpose. The development of the Context Assessment for Community Health (COACH) tool was premised on the context dimension in the Promoting Action on Research Implementation in Health Services framework, and is a derivative product of the Alberta Context Tool. Its development was undertaken in Bangladesh, Vietnam, Uganda, South Africa and Nicaragua in six phases: (1) defining dimensions and draft tool development, (2) content validity amongst in-country expert panels, (3) content validity amongst international experts, (4) response process validity, (5) translation and (6) evaluation of psychometric properties amongst 690 health workers in the five countries. The tool was validated for use amongst physicians, nurse/midwives and community health workers. The six phases of development resulted in a good fit between the theoretical dimensions of the COACH tool and its psychometric properties. The tool has 49 items measuring eight aspects of context: Resources, Community engagement, Commitment to work, Informal payment, Leadership, Work culture, Monitoring services for action and Sources of knowledge. Aspects of organizational context that were identified as influencing the implementation of EBPs in high-income settings were also found to be relevant in LMICs. However, there were additional aspects of context of relevance in LMICs specifically Resources, Community engagement, Commitment to work and Informal payment. Use of the COACH tool will allow for systematic description of the local healthcare context prior implementing healthcare interventions to allow for tailoring implementation strategies or as part of the evaluation of implementing healthcare interventions and thus allow for deeper insights into the process of implementing EBPs in LMICs.

Assessing physiotherapists' communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool.

PubMed

Murray, Aileen; Hall, Amanda; Williams, Geoffrey C; McDonough, Suzanne M; Ntoumanis, Nikos; Taylor, Ian; Jackson, Ben; Copsey, Bethan; Hurley, Deirdre A; Matthews, James

2018-02-27

To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson's r correlations with a reference standard, the Health Care Climate Questionnaire. The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7-0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool. Implications for Rehabilitation Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy. This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings. This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase. The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Development and application of air quality models at the US ...

EPA Pesticide Factsheets

Overview of the development and application of air quality models at the U.S. EPA, particularly focused on the development and application of the Community Multiscale Air Quality (CMAQ) model developed within the Computation Exposure Division (CED) of the National Exposure Research Laboratory (NERL). This presentation will provide a simple overview of air quality model development and application geared toward a non-technical student audience. The National Exposure Research Laboratory (NERL) Computational Exposure Division (CED) develops and evaluates data, decision-support tools, and models to be applied to media-specific or receptor-specific problem areas. CED uses modeling-based approaches to characterize exposures, evaluate fate and transport, and support environmental diagnostics/forensics with input from multiple data sources. It also develops media- and receptor-specific models, process models, and decision support tools for use both within and outside of EPA.

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

PubMed

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

Methodolgy For Evaluation Of Technology Impacts In Space Electric Power Systems

NASA Technical Reports Server (NTRS)

Holda, Julie

2004-01-01

The Analysis and Management branch of the Power and Propulsion Office at NASA Glenn Research Center is responsible for performing complex analyses of the space power and In-Space propulsion products developed by GRC. This work quantifies the benefits of the advanced technologies to support on-going advocacy efforts. The Power and Propulsion Office is committed to understanding how the advancement in space technologies could benefit future NASA missions. They support many diverse projects and missions throughout NASA as well as industry and academia. The area of work that we are concentrating on is space technology investment strategies. Our goal is to develop a Monte-Carlo based tool to investigate technology impacts in space electric power systems. The framework is being developed at this stage, which will be used to set up a computer simulation of a space electric power system (EPS). The outcome is expected to be a probabilistic assessment of critical technologies and potential development issues. We are developing methods for integrating existing spreadsheet-based tools into the simulation tool. Also, work is being done on defining interface protocols to enable rapid integration of future tools. Monte Carlo-based simulation programs for statistical modeling of the EPS Model. I decided to learn and evaluate Palisade's @Risk and Risk Optimizer software, and utilize it's capabilities for the Electric Power System (EPS) model. I also looked at similar software packages (JMP, SPSS, Crystal Ball, VenSim, Analytica) available from other suppliers and evaluated them. The second task was to develop the framework for the tool, in which we had to define technology characteristics using weighing factors and probability distributions. Also we had to define the simulation space and add hard and soft constraints to the model. The third task is to incorporate (preliminary) cost factors into the model. A final task is developing a cross-platform solution of this framework.

Human Factors Evaluations of Two-Dimensional Spacecraft Conceptual Layouts

NASA Technical Reports Server (NTRS)

Kennedy, Kriss J.; Toups, Larry D.; Rudisill, Marianne

2010-01-01

Much of the human factors work done in support of the NASA Constellation lunar program has been with low fidelity mockups. These volumetric replicas of the future lunar spacecraft allow researchers to insert test subjects from the engineering and astronaut population and evaluate the vehicle design as the test subjects perform simulations of various operational tasks. However, lunar outpost designs must be evaluated without the use of mockups, creating a need for evaluation tools that can be performed on two-dimension conceptual spacecraft layouts, such as floor plans. A tool based on the Cooper- Harper scale was developed and applied to one lunar scenario, enabling engineers to select between two competing floor plan layouts. Keywords: Constellation, human factors, tools, processes, habitat, outpost, Net Habitable Volume, Cooper-Harper.

Development and formative evaluation of a visual e-tool to help decision makers navigate the evidence around health financing.

PubMed

Skordis-Worrall, Jolene; Pulkki-Brännström, Anni-Maria; Utley, Martin; Kembhavi, Gayatri; Bricki, Nouria; Dutoit, Xavier; Rosato, Mikey; Pagel, Christina

2012-12-21

There are calls for low and middle income countries to develop robust health financing policies to increase service coverage. However, existing evidence around financing options is complex and often difficult for policy makers to access. To summarize the evidence on the impact of financing health systems and develop an e-tool to help decision makers navigate the findings. After reviewing the literature, we used thematic analysis to summarize the impact of 7 common health financing mechanisms on 5 common health system goals. Information on the relevance of each study to a user's context was provided by 11 country indicators. A Web-based e-tool was then developed to assist users in navigating the literature review. This tool was evaluated using feedback from early users, collected using an online survey and in-depth interviews with key informants. The e-tool provides graphical summaries that allow a user to assess the following parameters with a single snapshot: the number of relevant studies available in the literature, the heterogeneity of evidence, where key evidence is lacking, and how closely the evidence matches their own context. Users particularly liked the visual display and found navigating the tool intuitive. However there was concern that a lack of evidence on positive impact might be construed as evidence against a financing option and that the tool might over-simplify the available financing options. Complex evidence can be made more easily accessible and potentially more understandable using basic Web-based technology and innovative graphical representations that match findings to the users' goals and context.

Automated benchmarking of peptide-MHC class I binding predictions.

PubMed

Trolle, Thomas; Metushi, Imir G; Greenbaum, Jason A; Kim, Yohan; Sidney, John; Lund, Ole; Sette, Alessandro; Peters, Bjoern; Nielsen, Morten

2015-07-01

Numerous in silico methods predicting peptide binding to major histocompatibility complex (MHC) class I molecules have been developed over the last decades. However, the multitude of available prediction tools makes it non-trivial for the end-user to select which tool to use for a given task. To provide a solid basis on which to compare different prediction tools, we here describe a framework for the automated benchmarking of peptide-MHC class I binding prediction tools. The framework runs weekly benchmarks on data that are newly entered into the Immune Epitope Database (IEDB), giving the public access to frequent, up-to-date performance evaluations of all participating tools. To overcome potential selection bias in the data included in the IEDB, a strategy was implemented that suggests a set of peptides for which different prediction methods give divergent predictions as to their binding capability. Upon experimental binding validation, these peptides entered the benchmark study. The benchmark has run for 15 weeks and includes evaluation of 44 datasets covering 17 MHC alleles and more than 4000 peptide-MHC binding measurements. Inspection of the results allows the end-user to make educated selections between participating tools. Of the four participating servers, NetMHCpan performed the best, followed by ANN, SMM and finally ARB. Up-to-date performance evaluations of each server can be found online at http://tools.iedb.org/auto_bench/mhci/weekly. All prediction tool developers are invited to participate in the benchmark. Sign-up instructions are available at http://tools.iedb.org/auto_bench/mhci/join. mniel@cbs.dtu.dk or bpeters@liai.org Supplementary data are available at Bioinformatics online. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Automated benchmarking of peptide-MHC class I binding predictions

PubMed Central

Trolle, Thomas; Metushi, Imir G.; Greenbaum, Jason A.; Kim, Yohan; Sidney, John; Lund, Ole; Sette, Alessandro; Peters, Bjoern; Nielsen, Morten

2015-01-01

Motivation: Numerous in silico methods predicting peptide binding to major histocompatibility complex (MHC) class I molecules have been developed over the last decades. However, the multitude of available prediction tools makes it non-trivial for the end-user to select which tool to use for a given task. To provide a solid basis on which to compare different prediction tools, we here describe a framework for the automated benchmarking of peptide-MHC class I binding prediction tools. The framework runs weekly benchmarks on data that are newly entered into the Immune Epitope Database (IEDB), giving the public access to frequent, up-to-date performance evaluations of all participating tools. To overcome potential selection bias in the data included in the IEDB, a strategy was implemented that suggests a set of peptides for which different prediction methods give divergent predictions as to their binding capability. Upon experimental binding validation, these peptides entered the benchmark study. Results: The benchmark has run for 15 weeks and includes evaluation of 44 datasets covering 17 MHC alleles and more than 4000 peptide-MHC binding measurements. Inspection of the results allows the end-user to make educated selections between participating tools. Of the four participating servers, NetMHCpan performed the best, followed by ANN, SMM and finally ARB. Availability and implementation: Up-to-date performance evaluations of each server can be found online at http://tools.iedb.org/auto_bench/mhci/weekly. All prediction tool developers are invited to participate in the benchmark. Sign-up instructions are available at http://tools.iedb.org/auto_bench/mhci/join. Contact: mniel@cbs.dtu.dk or bpeters@liai.org Supplementary information: Supplementary data are available at Bioinformatics online. PMID:25717196

Development of tools for evaluating integrated municipal waste management using life-cycle management

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thorneloe, S.; Weitz, K.; Nishtala, S.

1998-08-01

Municipal solid waste (MSW) management increasingly is based on integrated systems. The US initiated research in 1994 through funding by the US Environmental Protection Agency and the US Department of Energy to develop (1) a decision support tool; (2) a database; and (3) case studies. This paper provides an overview of the research that is in process.

Workstation-Based Simulation for Rapid Prototyping and Piloted Evaluation of Control System Designs

NASA Technical Reports Server (NTRS)

Mansur, M. Hossein; Colbourne, Jason D.; Chang, Yu-Kuang; Aiken, Edwin W. (Technical Monitor)

1998-01-01

The development and optimization of flight control systems for modem fixed- and rotary-. wing aircraft consume a significant portion of the overall time and cost of aircraft development. Substantial savings can be achieved if the time required to develop and flight test the control system, and the cost, is reduced. To bring about such reductions, software tools such as Matlab/Simulink are being used to readily implement block diagrams and rapidly evaluate the expected responses of the completed system. Moreover, tools such as CONDUIT (CONtrol Designer's Unified InTerface) have been developed that enable the controls engineers to optimize their control laws and ensure that all the relevant quantitative criteria are satisfied, all within a fully interactive, user friendly, unified software environment.

Tools to Promote Shared Decision Making in Serious Illness: A Systematic Review.

PubMed

Austin, C Adrian; Mohottige, Dinushika; Sudore, Rebecca L; Smith, Alexander K; Hanson, Laura C

2015-07-01

Serious illness impairs function and threatens survival. Patients facing serious illness value shared decision making, yet few decision aids address the needs of this population. To perform a systematic review of evidence about decision aids and other exportable tools that promote shared decision making in serious illness, thereby (1) identifying tools relevant to the treatment decisions of seriously ill patients and their caregivers, (2) evaluating the quality of evidence for these tools, and (3) summarizing their effect on outcomes and accessibility for clinicians. We searched PubMed, CINAHL, and PsychInfo from January 1, 1995, through October 31, 2014, and identified additional studies from reference lists and other systematic reviews. Clinical trials with random or nonrandom controls were included if they tested print, video, or web-based tools for advance care planning (ACP) or decision aids for serious illness. We extracted data on the study population, design, results, and risk for bias using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criteria. Each tool was evaluated for its effect on patient outcomes and accessibility. Seventeen randomized clinical trials tested decision tools in serious illness. Nearly all the trials were of moderate or high quality and showed that decision tools improve patient knowledge and awareness of treatment choices. The available tools address ACP, palliative care and goals of care communication, feeding options in dementia, lung transplant in cystic fibrosis, and truth telling in terminal cancer. Five randomized clinical trials provided further evidence that decision tools improve ACP documentation, clinical decisions, and treatment received. Clinicians can access and use evidence-based tools to engage seriously ill patients in shared decision making. This field of research is in an early stage; future research is needed to develop novel decision aids for other serious diagnoses and key decisions. Health care delivery organizations should prioritize the use of currently available tools that are evidence based and effective.

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

Development of Continuing Nursing Education Offerings for the World Wide Web.

ERIC Educational Resources Information Center

Billings, Diane M.; Rowles, Connie J.

2001-01-01

Describes steps for web-based continuing education courses in terms of planning (strategic plan, website development, resource team, marketing plan), implementing (course design, web-based tools, copyright and intellectual property), and evaluating (pilot test, formative/summative evaluation, continuous quality improvement). (Contains 16…

Using an evaluative tool to develop effective mathscasts

NASA Astrophysics Data System (ADS)

Galligan, Linda; Hobohm, Carola; Peake, Katherine

2017-09-01

This study is situated in a course designed for both on-campus and online pre-service and in-service teachers, where student-created mathscasts provide a way for university lecturers to assess students' quality of teaching, and understanding of mathematics. Teachers and pre-service teachers, in a university course with 90% online enrolment, were asked to create mathscasts to explain mathematics concepts at middle school level. This paper describes the process of developing and refining a tool for the creation and evaluation of quality student-produced mathscasts. The study then investigates the usefulness of the tool within the context of pedagogy and mathematical understanding. Despite an abundance of mathscasts already available on the web, there is merit in creating mathscasts, not only as a tool for teaching, but also as a means of learning by doing. The premise for creating student-produced mathscasts was to capture the creators' mathematical understanding and pedagogical approach to teaching a mathematical concept, which were then peer-assessed and graded. The analysis included surveys, practice mathscasts with peer- and self-reviews, and students' final assessed mathscasts. The results indicate that the use of the evaluative tool resulted in an improvement in quality of student-created mathscasts and critiques thereof. The paper concludes with a discussion on future directions of student-produced mathscasts.

SUSTAIN - A BMP PROCESS AND PLACEMENT TOOL FOR URBAN WATERSHEDS

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads (...

SUSTAIN - A BMP PROCESS AND PLACEMENT TOOL FOR URBAN WATERSHEDS

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads ...

WORKSHOP ON ENVIRONMENTALLY CONSCIOUS CHEMICAL PROCESS DESIGN

EPA Science Inventory

To encourage the consideration of environmental issues during chemical process design, the USEPA has developed techniques and software tools to evaluate the relative environmental impact of a chemical process. These techniques and tools aid in the risk management process by focus...

Evaluation of work zone enhancement software programs.

DOT National Transportation Integrated Search

2009-09-01

The Missouri Department of Transportation (MoDOT) is looking for software tools that can assist in : developing effective plans to manage and communicate work zone activities. QuickZone, CA4PRS, : VISSIM, and Spreadsheet models are the tools that MoD...

A simulation-optimization-based decision support tool for mitigating traffic congestion.

DOT National Transportation Integrated Search

2009-12-01

"Traffic congestion has grown considerably in the United States over the past twenty years. In this paper, we develop : a robust decision support tool based on simulation optimization to evaluate and recommend congestion-mitigation : strategies to tr...

AN EVALUATION AND COST-OPTIMIZATION TOOL FOR PLACEMENT OF BMPS

EPA Science Inventory

To assist stormwater management professionals in planning for best management practices (BMPs) implementation, the U.S. Environmental Protection Agency (USEPA) is developing a decision-support system for placement of BMPs at strategic locations in urban watersheds. This tool wil...

GET SMARTE: A DECISION SUPPORT SYSTEM TO REVITALIZE COMMUNITIES - CABERNET 2007

EPA Science Inventory

Sustainable Management Approaches and Revitalization Tools - electronic (SMARTe), is an open-source, web-based, decision support system for developing and evaluating future reuse scenarios for potentially contaminated land. SMARTe contains information and analysis tools for all a...

METAL FINISHING FACILITY POLLUTION PREVENTION TOOL (MFFPPT)

EPA Science Inventory

The Metal Finishing Facility Pollution Tool (MFFPPT) is being developed to allow the metal finishing industry an easy method to evaluate potential pollution prevention options. In order to reduce the quantity of pollutants generated by a process, the sources of pollutants within ...

Robotic tool positioning process using a multi-line off-axis laser triangulation sensor

NASA Astrophysics Data System (ADS)

Pinto, T. C.; Matos, G.

2018-03-01

Proper positioning of a friction stir welding head for pin insertion, driven by a closed chain robot, is important to ensure quality repair of cracks. A multi-line off-axis laser triangulation sensor was designed to be integrated to the robot, allowing relative measurements of the surface to be repaired. This work describes the sensor characteristics, its evaluation and the measurement process for tool positioning to a surface point of interest. The developed process uses a point of interest image and a measured point cloud to define the translation and rotation for tool positioning. Sensor evaluation and tests are described. Keywords: laser triangulation, 3D measurement, tool positioning, robotics.

Usability in Mobile Electronic Data Collection Tools: Form Developers' Views.

PubMed

Mugisha, Alice; Babic, Ankica; Wakholi, Peter; Nankabirwa, Victoria; Tylleskar, Thorkild

2017-01-01

Mobile Electronic Data Collection Tools (MEDCTs) are created by form developers to collect data. Usability being one of the top quality attributes is of great concern to developers of any interactive applications. However, little is known about the form developers' understanding of usability, how they measure usability and their limitations in designing for usability. We conducted an empirical study where we aimed at getting the developers' views on usability by interviewing 8 form developers. These are creators of forms used for data collection. We found that developers knew about usability, but it was not their main focus during form development. Challenges included constraining deadlines, software limitations and the insufficient communication with the field users to establish the usability needs. Furthermore, the methods used to evaluate the usability of created forms varied amongst developers and these included in-house evaluations and feedback from piloting sessions with end users.

Unit Testing for Command and Control Systems

NASA Technical Reports Server (NTRS)

Alexander, Joshua

2018-01-01

Unit tests were created to evaluate the functionality of a Data Generation and Publication tool for a command and control system. These unit tests are developed to constantly evaluate the tool and ensure it functions properly as the command and control system grows in size and scope. Unit tests are a crucial part of testing any software project and are especially instrumental in the development of a command and control system. They save resources, time and costs associated with testing, and catch issues before they become increasingly difficult and costly. The unit tests produced for the Data Generation and Publication tool to be used in a command and control system assure the users and stakeholders of its functionality and offer assurances which are vital in the launching of spacecraft safely.

Development of Experimental and Computational Aeroacoustic Tools for Advanced Liner Evaluation

NASA Technical Reports Server (NTRS)

Jones, Michael G.; Watson, Willie R.; Nark, Douglas N.; Parrott, Tony L.; Gerhold, Carl H.; Brown, Martha C.

2006-01-01

Acoustic liners in aircraft engine nacelles suppress radiated noise. Therefore, as air travel increases, increasingly sophisticated tools are needed to maximize noise suppression. During the last 30 years, NASA has invested significant effort in development of experimental and computational acoustic liner evaluation tools. The Curved Duct Test Rig is a 152-mm by 381- mm curved duct that supports liner evaluation at Mach numbers up to 0.3 and source SPLs up to 140 dB, in the presence of user-selected modes. The Grazing Flow Impedance Tube is a 51- mm by 63-mm duct currently being fabricated to operate at Mach numbers up to 0.6 with source SPLs up to at least 140 dB, and will replace the existing 51-mm by 51-mm duct. Together, these test rigs allow evaluation of advanced acoustic liners over a range of conditions representative of those observed in aircraft engine nacelles. Data acquired with these test ducts are processed using three aeroacoustic propagation codes. Two are based on finite element solutions to convected Helmholtz and linearized Euler equations. The third is based on a parabolic approximation to the convected Helmholtz equation. The current status of these computational tools and their associated usage with the Langley test rigs is provided.

Evaluating and Evolving Metadata in Multiple Dialects

NASA Astrophysics Data System (ADS)

Kozimor, J.; Habermann, T.; Powers, L. A.; Gordon, S.

2016-12-01

Despite many long-term homogenization efforts, communities continue to develop focused metadata standards along with related recommendations and (typically) XML representations (aka dialects) for sharing metadata content. Different representations easily become obstacles to sharing information because each representation generally requires a set of tools and skills that are designed, built, and maintained specifically for that representation. In contrast, community recommendations are generally described, at least initially, at a more conceptual level and are more easily shared. For example, most communities agree that dataset titles should be included in metadata records although they write the titles in different ways. This situation has led to the development of metadata repositories that can ingest and output metadata in multiple dialects. As an operational example, the NASA Common Metadata Repository (CMR) includes three different metadata dialects (DIF, ECHO, and ISO 19115-2). These systems raise a new question for metadata providers: if I have a choice of metadata dialects, which should I use and how do I make that decision? We have developed a collection of metadata evaluation tools that can be used to evaluate metadata records in many dialects for completeness with respect to recommendations from many organizations and communities. We have applied these tools to over 8000 collection and granule metadata records in four different dialects. This large collection of identical content in multiple dialects enables us to address questions about metadata and dialect evolution and to answer those questions quantitatively. We will describe those tools and results from evaluating the NASA CMR metadata collection.

Enroute flight planning: Evaluating design concepts for the development of cooperative problem-solving concepts

NASA Technical Reports Server (NTRS)

Smith, Philip J.; Mccoy, C. Elaine

1991-01-01

The goals of this research were to develop design concepts to support the task of enroute flight planning. And within this context, to explore and evaluate general design concepts and principles to guide the development of cooperative problem solving systems. A detailed model is to be developed of the cognitive processes involved in flight planning. Included in this model will be the identification of individual differences of subjects. Of particular interest will be differences between pilots and dispatchers. The effect will be studied of the effect on performance of tools that support planning at different levels of abstraction. In order to conduct this research, the Flight Planning Testbed (FPT) was developed, a fully functional testbed environment for studying advanced design concepts for tools to aid in flight planning.

Development of spatial-temporal ventilation heterogeneity and probability analysis tools for hyperpolarized 3He magnetic resonance imaging

NASA Astrophysics Data System (ADS)

Choy, S.; Ahmed, H.; Wheatley, A.; McCormack, D. G.; Parraga, G.

2010-03-01

We developed image analysis tools to evaluate spatial and temporal 3He magnetic resonance imaging (MRI) ventilation in asthma and cystic fibrosis. We also developed temporal ventilation probability maps to provide a way to describe and quantify ventilation heterogeneity over time, as a way to test respiratory exacerbations or treatment predictions and to provide a discrete probability measurement of 3He ventilation defect persistence.

Evaluation of automated decisionmaking methodologies and development of an integrated robotic system simulation. Volume 1: Study results

NASA Technical Reports Server (NTRS)

Lowrie, J. W.; Fermelia, A. J.; Haley, D. C.; Gremban, K. D.; Vanbaalen, J.; Walsh, R. W.

1982-01-01

A variety of artificial intelligence techniques which could be used with regard to NASA space applications and robotics were evaluated. The techniques studied were decision tree manipulators, problem solvers, rule based systems, logic programming languages, representation language languages, and expert systems. The overall structure of a robotic simulation tool was defined and a framework for that tool developed. Nonlinear and linearized dynamics equations were formulated for n link manipulator configurations. A framework for the robotic simulation was established which uses validated manipulator component models connected according to a user defined configuration.

A simulation study to quantify the impacts of exposure ...

EPA Pesticide Factsheets

A simulation study to quantify the impacts of exposure measurement error on air pollution health risk estimates in copollutant time-series models The National Exposure Research Laboratory (NERL) Computational Exposure Division (CED) develops and evaluates data, decision-support tools, and models to be applied to media-specific or receptor-specific problem areas. CED uses modeling-based approaches to characterize exposures, evaluate fate and transport, and support environmental diagnostics/forensics with input from multiple data sources. It also develops media- and receptor-specific models, process models, and decision support tools for use both within and outside of EPA.

Human Resources Development Policy. A Structured Approach to Its Definition, Analysis and Evaluation. Training Policies Discussion Paper No. 13.

ERIC Educational Resources Information Center

Bermant, M.; And Others

This study provides a tool for describing, analyzing, and evaluating the effectiveness of human resources development (HRD) systems and their components. It is intended for policy makers, planners, and senior officials from government, employers', and workers' organizations who have responsibilities in human resources development. The first part…

Variation simulation for compliant sheet metal assemblies with applications

NASA Astrophysics Data System (ADS)

Long, Yufeng

Sheet metals are widely used in discrete products, such as automobiles, aircraft, furniture and electronics appliances, due to their good manufacturability and low cost. A typical automotive body assembly consists of more than 300 parts welded together in more than 200 assembly fixture stations. Such an assembly system is usually quite complex, and takes a long time to develop. As the automotive customer demands products of increasing quality in a shorter time, engineers in automotive industry turn to computer-aided engineering (CAE) tools for help. Computers are an invaluable resource for engineers, not only to simplify and automate the design process, but also to share design specifications with manufacturing groups so that production systems can be tooled up quickly and efficiently. Therefore, it is beneficial to develop computerized simulation and evaluation tools for development of automotive body assembly systems. It is a well-known fact that assembly architectures (joints, fixtures, and assembly lines) have a profound impact on dimensional quality of compliant sheet metal assemblies. To evaluate sheet metal assembly architectures, a special dimensional analysis tool need be developed for predicting dimensional variation of the assembly. Then, the corresponding systematic tools can be established to help engineers select the assembly architectures. In this dissertation, a unified variation model is developed to predict variation in compliant sheet metal assemblies by considering fixture-induced rigid-body motion, deformation and springback. Based on the unified variation model, variation propagation models in multiple assembly stations with various configurations are established. To evaluate the dimensional capability of assembly architectures, quantitative indices are proposed based on the sensitivity matrix, which are independent of the variation level of the process. Examples are given to demonstrate their applications in selecting robust assembly architectures, and some useful guidelines for selection of assembly architectures are summarized. In addition, to enhance the fault diagnosis, a systematic methodology is proposed for selection of measurement configurations. Specifically, principles involved in selecting measurements are generalized first; then, the corresponding quantitative indices are developed to evaluate the measurement configurations, and finally, examples are present.

Value engineering on the designed operator work tools for brick and rings wells production

NASA Astrophysics Data System (ADS)

Ayu Bidiawati J., R.; Muchtiar, Yesmizarti; Wariza, Ragil Okta

2017-06-01

Operator working tools in making brick and ring wells were designed and made, and the value engineering was calculated to identify and develop the function of these tools in obtaining the balance between cost, reliability and appearance. This study focused on the value of functional components of the tools and attempted to increase the difference between the costs incurred by the generated values. The purpose of this study was to determine the alternatives of tools design and to determine the performance of each alternative. The technique was developed using FAST method that consisted of five stages: information, creative, analytical, development and presentation stage. The results of the analysis concluded that the designed tools have higher value and better function description. There were four alternative draft improvements for operator working tools. The best alternative was determined based on the rank by using matrix evaluation. Best performance was obtained by the alternative II, amounting to 98.92 with a value of 0.77.

An Ada programming support environment

NASA Technical Reports Server (NTRS)

Tyrrill, AL; Chan, A. David

1986-01-01

The toolset of an Ada Programming Support Environment (APSE) being developed at North American Aircraft Operations (NAAO) of Rockwell International, is described. The APSE is resident on three different hosts and must support developments for the hosts and for embedded targets. Tools and developed software must be freely portable between the hosts. The toolset includes the usual editors, compilers, linkers, debuggers, configuration magnagers, and documentation tools. Generally, these are being supplied by the host computer vendors. Other tools, for example, pretty printer, cross referencer, compilation order tool, and management tools were obtained from public-domain sources, are implemented in Ada and are being ported to the hosts. Several tools being implemented in-house are of interest, these include an Ada Design Language processor based on compilable Ada. A Standalone Test Environment Generator facilitates test tool construction and partially automates unit level testing. A Code Auditor/Static Analyzer permits the Ada programs to be evaluated against measures of quality. An Ada Comment Box Generator partially automates generation of header comment boxes.

Family history tools in primary care: does one size fit all?

PubMed

Wilson, B J; Carroll, J C; Allanson, J; Little, J; Etchegary, H; Avard, D; Potter, B K; Castle, D; Grimshaw, J M; Chakraborty, P

2012-01-01

Family health history (FHH) has potential value in many health care settings. This review discusses the potential uses of FHH information in primary care and the need for tools to be designed accordingly. We developed a framework in which the attributes of FHH tools are mapped against these different purposes. It contains 7 attributes mapped against 5 purposes. In considering different FHH tool purposes, it is apparent that different attributes become more or less important, and that tools for different purposes require different implementation and evaluation strategies. The context in which a tool is used is also relevant to its effectiveness. For FHH tools, it is unlikely that 'one size fits all', although appreciation of different purposes, users and contexts should facilitate the development of different applications from single FHH platforms. Copyright © 2012 S. Karger AG, Basel.

An overview of clinical tools used to assess neonatal abstinence syndrome.

PubMed

Orlando, Susan

2014-01-01

Several clinical tools have been developed to quantify the severity of withdrawal signs and symptoms exhibited by infants born to substance-using mothers. Scores from the systematic assessments are used to guide treatment of infants with moderate to severe clinical signs. This article provides an overview of published assessment tools developed for infants with neonatal abstinence syndrome. Nurses caring for infants at risk for neonatal abstinence syndrome should be knowledgeable about the tools used to evaluate these infants and guide their treatment. The ideal assessment tool should be published and include item definitions and a protocol for administering the tool. Nurses need education and training to achieve competency and interobserver reliability in the use of a selected tool. Tool-specific materials should be used to standardize training and improve accuracy in assessments. Competent and knowledgeable nurses play a critical role in improving outcomes for infants with neonatal abstinence syndrome.

SETs: stand evaluation tools: I. an individual-tree approach to making stand evaluations

Treesearch

Paul S. DeBald; Joseph J. Mendel

1976-01-01

The authors outline a stand-evaluation method that stresses individuality by (1) making on-the-ground projections of individual tree development; (2) summarizing stand values in terms of the individual trees in the stand and their potential development; and (3) tailoring several management possibilities to an individual stand so the owner can choose among them.

Perceived Importance of District Developed Teacher Evaluation Standards and Criteria as Measured by Teacher Values Survey

ERIC Educational Resources Information Center

Davis, Jan Ellen Pfeiffer

2011-01-01

In 2009, a PK-12 public school district board of education approved a teacher evaluation tool developed by a volunteer team of teachers and administrators. The Learning Based Teacher Evaluation (LBTE) was constructed with six broad standards and fifteen specific criteria. The standards and criteria were assumed important to professional practice,…

Launch Vehicle Propulsion Parameter Design Multiple Selection Criteria

NASA Technical Reports Server (NTRS)

Shelton, Joey Dewayne

2004-01-01

The optimization tool described herein addresses and emphasizes the use of computer tools to model a system and focuses on a concept development approach for a liquid hydrogen/liquid oxygen single-stage-to-orbit system, but more particularly the development of the optimized system using new techniques. This methodology uses new and innovative tools to run Monte Carlo simulations, genetic algorithm solvers, and statistical models in order to optimize a design concept. The concept launch vehicle and propulsion system were modeled and optimized to determine the best design for weight and cost by varying design and technology parameters. Uncertainty levels were applied using Monte Carlo Simulations and the model output was compared to the National Aeronautics and Space Administration Space Shuttle Main Engine. Several key conclusions are summarized here for the model results. First, the Gross Liftoff Weight and Dry Weight were 67% higher for the design case for minimization of Design, Development, Test and Evaluation cost when compared to the weights determined by the minimization of Gross Liftoff Weight case. In turn, the Design, Development, Test and Evaluation cost was 53% higher for optimized Gross Liftoff Weight case when compared to the cost determined by case for minimization of Design, Development, Test and Evaluation cost. Therefore, a 53% increase in Design, Development, Test and Evaluation cost results in a 67% reduction in Gross Liftoff Weight. Secondly, the tool outputs define the sensitivity of propulsion parameters, technology and cost factors and how these parameters differ when cost and weight are optimized separately. A key finding was that for a Space Shuttle Main Engine thrust level the oxidizer/fuel ratio of 6.6 resulted in the lowest Gross Liftoff Weight rather than at 5.2 for the maximum specific impulse, demonstrating the relationships between specific impulse, engine weight, tank volume and tank weight. Lastly, the optimum chamber pressure for Gross Liftoff Weight minimization was 2713 pounds per square inch as compared to 3162 for the Design, Development, Test and Evaluation cost optimization case. This chamber pressure range is close to 3000 pounds per square inch for the Space Shuttle Main Engine.

GLOBAL TRANSITION TO SUSTAINABLE DEVELOPMENT

EPA Science Inventory

Environmental accounting using emergy is a tool for evaluating development and determining what is sustainable. Global sustainable development means that all nations will become better places for their inhabitants to live. Development follows a cycle of change from rapid growth ...

EVALUATION TECHNIQUES AND TOOL DEVELOPMENT FOR FY 08 CMAQ RELEASE

EPA Science Inventory

In this task, research efforts are outlined that relate to the AMD Model Evaluation Program element and support CMAQ releases within the FY05-FY08 time period. Model evaluation serves dual purposes; evaluation is necessary to characterize the accuracy of model predictions, and e...

School District Evaluation: Database Warehouse Support.

ERIC Educational Resources Information Center

Adcock, Eugene P.; Haseltine, Reginald

The Prince George's County (Maryland) school system has developed a database warehouse system as an evaluation data support tool for fulfilling the system's information demands. This paper described the Research and Evaluation Assimilation Database (READ) warehouse support system and considers the requirements for data used in evaluation and how…

Software Tool Issues

NASA Astrophysics Data System (ADS)

Hennell, Michael

This chapter relies on experience with tool development gained over the last thirty years. It shows that there are a large number of techniques that contribute to any successful project, and that formality is always the key: a modern software test tool is based on a firm mathematical foundation. After a brief introduction, Section 2 recalls and extends the terminology of Chapter 1. Section 3 discusses the the design of different sorts of static and dynamic analysis tools. Nine important issues to be taken into consideration when evaluating such tools are presented in Section 4. Section 5 investigates the interplay between testing and proof. In Section 6, we call for developers to take their own medicine and verify their tools. Finally, we conclude in Section 7 with a summary of our main messages, emphasising the important role of testing.

Prevention and management of "do not return" notices: a quality improvement process for supplemental staffing nursing agencies.

PubMed

Ade-Oshifogun, Jochebed Bosede; Dufelmeier, Thaddeus

2012-01-01

This article describes a quality improvement process for "do not return" (DNR) notices for healthcare supplemental staffing agencies and healthcare facilities that use them. It is imperative that supplemental staffing agencies partner with healthcare facilities in assuring the quality of supplemental staff. Although supplemental staffing agencies attempt to ensure quality staffing, supplemental staff are sometimes subjectively evaluated by healthcare facilities as "DNR." The objective of this article is to describe a quality improvement process to prevent and manage "DNR" within healthcare organizations. We developed a curriculum and accompanying evaluation tool by adapting Rampersad's problem-solving discipline approach: (a) definition of area(s) for improvement; (b) identification of all possible causes; (c) development of an action plan; (d) implementation of the action plan; (e) evaluation for program improvement; and (f) standardization of the process. Face and content validity of the evaluation tool was ascertained by input from a panel of experienced supplemental staff and nursing faculty. This curriculum and its evaluation tool will have practical implications for supplemental staffing agencies and healthcare facilities in reducing "DNR" rates and in meeting certification/accreditation requirements. Further work is needed to translate this process into future research. © 2012 Wiley Periodicals, Inc.

WHAT ARE THE BEST MEANS TO ASSESS SITES AND MOVE TOWARD CLOSURE, USING APPROPRIATE SITE SPECIFIC RISK EVALUATIONS?

EPA Science Inventory

To facilitate evaluation of existing site characterization data, ORD has developed on-line tools and models that integrate data and models into innovative applications. Forty calculators have been developed in four groups: parameter estimators, models, scientific demos and unit ...

The Evolution of the Sustainability Assessment Tool SBToolPT: From Buildings to the Built Environment

PubMed Central

Bragança, Luís

2014-01-01

This paper analyses the current trends in sustainability assessment. After about 15 years from the launch of sustainability assessment tools, focused on buildings evaluation, the paradigm of sustainability assessment tools is changing from the building scale to the built environment scale. Currently European cities and cities around the world are concerned with sustainable development, as well as its evolution. Cities seek a way to adapt to contemporary changes, in order to meet the required needs and ensure population's well-being. Considering this, the new generations of sustainability assessment tools are being developed to be used to guide and help cities and urban areas to become more sustainable. Following the trend of the most important sustainability assessment tools, the sustainability assessment tool SBToolPT is also developing its version for assessing the sustainability of the built environment, namely, the urban planning projects and the urban regeneration projects, to be developed in Portugal, the SBToolPT-UP. The application of the methodology to three case studies will demonstrate its feasibility; at the same time this will identify the best practices which will serve as reference for new projects, thereby assisting the development of the tool. PMID:24592171

The evolution of the sustainability assessment tool SBToolPT: from buildings to the built environment.

PubMed

Castanheira, Guilherme; Bragança, Luís

2014-01-01

This paper analyses the current trends in sustainability assessment. After about 15 years from the launch of sustainability assessment tools, focused on buildings evaluation, the paradigm of sustainability assessment tools is changing from the building scale to the built environment scale. Currently European cities and cities around the world are concerned with sustainable development, as well as its evolution. Cities seek a way to adapt to contemporary changes, in order to meet the required needs and ensure population's well-being. Considering this, the new generations of sustainability assessment tools are being developed to be used to guide and help cities and urban areas to become more sustainable. Following the trend of the most important sustainability assessment tools, the sustainability assessment tool SBTool(PT) is also developing its version for assessing the sustainability of the built environment, namely, the urban planning projects and the urban regeneration projects, to be developed in Portugal, the SBTool(PT)-UP. The application of the methodology to three case studies will demonstrate its feasibility; at the same time this will identify the best practices which will serve as reference for new projects, thereby assisting the development of the tool.

Evaluating Causes of Ecological Impairments in the Estuaries of Ukraine

EPA Science Inventory

Ukrainian estuaries have not undergone a systematic evaluation of the causes of ecological impairments caused by anthropogenic contamination. The objective of this evaluation is to use recently developed diagnostic tools to determine the causes of benthic ecological impairments. ...

SUSTAIN - A USEPA BMP PROCESS AND PLACEMENT TOOL FOR URBAN WATERSHEDS

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads (...

Prototype road weather performance management (RW-PM) tool and Minnesota Department of Transportation (MnDOT) field evaluation.

DOT National Transportation Integrated Search

2017-01-01

FHWAs Road Weather Management Program developed a Prototype Road Weather Management (RW-PM) Tool to help DOTs maximize the effectiveness of their maintenance resources and efficiently adjust deployments dynamically, as road conditions and traffic ...

Evaluating and Refining High Throughput Tools for Toxicokinetics

EPA Science Inventory

This poster summarizes efforts of the Chemical Safety for Sustainability's Rapid Exposure and Dosimetry (RED) team to facilitate the development and refinement of toxicokinetics (TK) tools to be used in conjunction with the high throughput toxicity testing data generated as a par...

Evaluation of a simple method for the automatic assignment of MeSH descriptors to health resources in a French online catalogue.

PubMed

Névéol, Aurélie; Pereira, Suzanne; Kerdelhué, Gaetan; Dahamna, Badisse; Joubert, Michel; Darmoni, Stéfan J

2007-01-01

The growing number of resources to be indexed in the catalogue of online health resources in French (CISMeF) calls for curating strategies involving automatic indexing tools while maintaining the catalogue's high indexing quality standards. To develop a simple automatic tool that retrieves MeSH descriptors from documents titles. In parallel to research on advanced indexing methods, a bag-of-words tool was developed for timely inclusion in CISMeF's maintenance system. An evaluation was carried out on a corpus of 99 documents. The indexing sets retrieved by the automatic tool were compared to manual indexing based on the title and on the full text of resources. 58% of the major main headings were retrieved by the bag-of-words algorithm and the precision on main heading retrieval was 69%. Bag-of-words indexing has effectively been used on selected resources to be included in CISMeF since August 2006. Meanwhile, on going work aims at improving the current version of the tool.

Design and testing of classroom and clinical teaching evaluation tools for nursing education.

PubMed

Emerson, Roberta J; Records, Kathie

2007-01-01

Student evaluations of teaching provide administrators an overall picture of the effectiveness of personnel and contribute data for promotion and merit decisions. These evaluations must be assessed for their relevance, validity, and reliability. This paper describes the development process and psychometric testing for clinical (n = 149) and didactic (n = 148) student evaluation of teaching forms for undergraduate and graduate courses in one college of nursing. Validity and reliability results were quite strong for the instruments, both of which evidenced a one-factor solution with factor loadings ranging from .68-.88 and Cronbach's alphas of .96 (Classroom) and .95 (Clinical). The clinical and classroom evaluation tools are relatively short, decreasing the burden on students who need to complete the instruments for multiple instructors in any one semester. Initial testing of the psychometric properties of the tools supports their continued use in colleges of nursing.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education.

PubMed

Mulhearn, Tyler J; Watts, Logan L; Todd, E Michelle; Medeiros, Kelsey E; Connelly, Shane; Mumford, Michael D

2017-01-01

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

Reliability, Validity, and Factor Structure of the Current Assessment Practice Evaluation-Revised (CAPER) in a National Sample.

PubMed

Lyon, Aaron R; Pullmann, Michael D; Dorsey, Shannon; Martin, Prerna; Grigore, Alexandra A; Becker, Emily M; Jensen-Doss, Amanda

2018-05-11

Measurement-based care (MBC) is an increasingly popular, evidence-based practice, but there are no tools with established psychometrics to evaluate clinician use of MBC practices in mental health service delivery. The current study evaluated the reliability, validity, and factor structure of scores generated from a brief, standardized tool to measure MBC practices, the Current Assessment Practice Evaluation-Revised (CAPER). Survey data from a national sample of 479 mental health clinicians were used to conduct exploratory and confirmatory factor analyses, as well as reliability and validity analyses (e.g., relationships between CAPER subscales and clinician MBC attitudes). Analyses revealed competing two- and three-factor models. Regardless of the model used, scores from CAPER subscales demonstrated good reliability and convergent and divergent validity with MBC attitudes in the expected directions. The CAPER appears to be a psychometrically sound tool for assessing clinician MBC practices. Future directions for development and application of the tool are discussed.

Social sustainability in healthcare facilities: a rating tool for analysing and improving social aspects in environments of care.

PubMed

Capolongo, Stefano; Gola, Marco; di Noia, Michela; Nickolova, Maria; Nachiero, Dario; Rebecchi, Andrea; Settimo, Gaetano; Vittori, Gail; Buffoli, Maddalena

2016-01-01

Nowadays several rating systems exist for the evaluation of the sustainability of buildings, but often their focus is limited to environmental and efficiency aspects. Hospitals are complex constructions in which many variables affect hospital processes. Therefore, a research group has developed a tool for the evaluation of sustainability in healthcare facilities. The paper analyses social sustainability issues through a tool which evaluates users' perception from a the quality and well-being perspective. It presents a hierarchical structure composed of a criteria and indicators system which is organised through a weighing system calculated by using the Analytic Network Process. The output is the definition of a tool which evaluates how Humanisation, Comfort and Distribution criteria can affect the social sustainability of a building. Starting from its application, it is evident that the instrument enables the improvement of healthcare facilities through several design and organisational suggestions for achieving healing and sustainable architectures.

Prediction Of Abrasive And Diffusive Tool Wear Mechanisms In Machining

NASA Astrophysics Data System (ADS)

Rizzuti, S.; Umbrello, D.

2011-01-01

Tool wear prediction is regarded as very important task in order to maximize tool performance, minimize cutting costs and improve the quality of workpiece in cutting. In this research work, an experimental campaign was carried out at the varying of cutting conditions with the aim to measure both crater and flank tool wear, during machining of an AISI 1045 with an uncoated carbide tool P40. Parallel a FEM-based analysis was developed in order to study the tool wear mechanisms, taking also into account the influence of the cutting conditions and the temperature reached on the tool surfaces. The results show that, when the temperature of the tool rake surface is lower than the activation temperature of the diffusive phenomenon, the wear rate can be estimated applying an abrasive model. In contrast, in the tool area where the temperature is higher than the diffusive activation temperature, the wear rate can be evaluated applying a diffusive model. Finally, for a temperature ranges within the above cited values an adopted abrasive-diffusive wear model furnished the possibility to correctly evaluate the tool wear phenomena.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Patient-specific dosimetric endpoints based treatment plan quality control in radiotherapy.

PubMed

Song, Ting; Staub, David; Chen, Mingli; Lu, Weiguo; Tian, Zhen; Jia, Xun; Li, Yongbao; Zhou, Linghong; Jiang, Steve B; Gu, Xuejun

2015-11-07

In intensity modulated radiotherapy (IMRT), the optimal plan for each patient is specific due to unique patient anatomy. To achieve such a plan, patient-specific dosimetric goals reflecting each patient's unique anatomy should be defined and adopted in the treatment planning procedure for plan quality control. This study is to develop such a personalized treatment plan quality control tool by predicting patient-specific dosimetric endpoints (DEs). The incorporation of patient specific DEs is realized by a multi-OAR geometry-dosimetry model, capable of predicting optimal DEs based on the individual patient's geometry. The overall quality of a treatment plan is then judged with a numerical treatment plan quality indicator and characterized as optimal or suboptimal. Taking advantage of clinically available prostate volumetric modulated arc therapy (VMAT) treatment plans, we built and evaluated our proposed plan quality control tool. Using our developed tool, six of twenty evaluated plans were identified as sub-optimal plans. After plan re-optimization, these suboptimal plans achieved better OAR dose sparing without sacrificing the PTV coverage, and the dosimetric endpoints of the re-optimized plans agreed well with the model predicted values, which validate the predictability of the proposed tool. In conclusion, the developed tool is able to accurately predict optimally achievable DEs of multiple OARs, identify suboptimal plans, and guide plan optimization. It is a useful tool for achieving patient-specific treatment plan quality control.

Model Performance Evaluation and Scenario Analysis (MPESA)

EPA Pesticide Factsheets

Model Performance Evaluation and Scenario Analysis (MPESA) assesses the performance with which models predict time series data. The tool was developed Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM)

Challenges of NDE simulation tool validation, optimization, and utilization for composites

NASA Astrophysics Data System (ADS)

Leckey, Cara A. C.; Seebo, Jeffrey P.; Juarez, Peter

2016-02-01

Rapid, realistic nondestructive evaluation (NDE) simulation tools can aid in inspection optimization and prediction of inspectability for advanced aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, ultrasound modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation is still far from the goal of rapidly simulating damage detection techniques for large scale, complex geometry composite components/vehicles containing realistic damage types. Ongoing work at NASA Langley Research Center is focused on advanced ultrasonic simulation tool development. This paper discusses challenges of simulation tool validation, optimization, and utilization for composites. Ongoing simulation tool development work is described along with examples of simulation validation and optimization challenges that are more broadly applicable to all NDE simulation tools. The paper will also discuss examples of simulation tool utilization at NASA to develop new damage characterization methods for composites, and associated challenges in experimentally validating those methods.

A hand-ergonomics training kit: development and evaluation of a package to support improved awareness and critical thinking.

PubMed

Garmer, Karin; Sperling, Lena; Forsberg, Anette

2002-01-01

A need for a hand-ergonomics training kit has been identified to increase critical thinking concerning choice of hand tools. This study deals with the design, use and evaluation of a hand-ergonomics training kit for use in ergonomics training programmes. The effects on awareness of hand ergonomics among training course participants have been evaluated by means of a questionnaire and interviews at a car production plant in Sweden. The evaluation was carried out about one and a half years after training with the hand-ergonomics training kit. The training kit consists of a guide to practical exercises, equipment for measuring hand size and strength, examples of hand tools for use in practical exercises, equipment for testing and evaluating the hand tools and checklists and judgement forms for qualitative evaluation. In addition, the kit contains relevant scientifically based reference reports on hand ergonomics. The evaluation showed that the practical exercises with the hand-ergonomic training kit had, to a remarkable extent, increased individuals' awareness of anthropometric differences and of the importance of ergonomically well-designed hand tools. After the practical exercises with the training kit, communication within the plant when choosing hand tools seems to be based on objective criteria to a higher degree, however, the results indicate that this communication could be further improved.

Development and Validation of a Family Meeting Assessment Tool (FMAT).

PubMed

Hagiwara, Yuya; Healy, Jennifer; Lee, Shuko; Ross, Jeanette; Fischer, Dixie; Sanchez-Reilly, Sandra

2018-01-01

A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

[Blended-learning in psychosomatics and psychotherapy - Increasing the satisfaction and knowledge of students with a web-based e-learning tool].

PubMed

Ferber, Julia; Schneider, Gudrun; Havlik, Linda; Heuft, Gereon; Friederichs, Hendrik; Schrewe, Franz-Bernhard; Schulz-Steinel, Andrea; Burgmer, Markus

2014-01-01

To improve the synergy of established methods of teaching, the Department of Psychosomatics and Psychotherapy, University Hospital Münster, developed a web-based elearning tool using video clips of standardized patients. The effect of this blended-learning approach was evaluated. A multiple-choice test was performed by a naive (without the e-learning tool) and an experimental (with the tool) cohort of medical students to test the groups' expertise in psychosomatics. In addition, participants' satisfaction with the new tool was evaluated (numeric rating scale of 0-10). The experimental cohort was more satisfied with the curriculum and more interested in psychosomatics. Furthermore, the experimental cohort scored significantly better in the multiple-choice test. The new tool proved to be an important addition to the classical curriculum as a blended-learning approach which improves students' satisfaction and knowledge in psychosomatics.

Efficacy of teaching methods used to develop critical thinking in nursing and midwifery undergraduate students: A systematic review of the literature.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2016-05-01

The value and importance of incorporating strategies that promote critical thinking in nursing and midwifery undergraduate programmes are well documented. However, relatively little is known about the effectiveness of teaching strategies in promoting CT. Evaluating effectiveness is important to promote 'best practise' in teaching. To evaluate the efficacy of teaching methods used to develop critical thinking skills in nursing and midwifery undergraduate students. The following six databases; CINAHL, Ovid Medline, ERIC, Informit, PsycINFO and Scopus were searched and resulted in the retrieval of 1315 papers. After screening for inclusion, each paper was evaluated using the Critical Appraisal Skills Programme tool. Twenty-eight studies met the inclusion criteria and quality appraisal. Twelve different teaching interventions were tested in 8 countries. Results varied, with little consistency across studies using the same type of intervention or outcome tool. Sixteen tools were used to measure the efficacy of teaching in developing critical thinking. Seventeen studies identified a significant increase in critical thinking, while nine studies found no increases, and two found unexplained decreases in CT when using a similar educational intervention. Whilst this review aimed to identify effective teaching strategies that promote and develop critical thinking, flaws in methodology and outcome measures contributed to inconsistent findings. The continued use of generalised CT tools is unlikely to help identify appropriate teaching methods that will improve CT abilities of midwifery and nursing students and prepare them for practise. The review was limited to empirical studies published in English that used measures of critical thinking with midwifery and nursing students. Discipline specific strategies and tools that measure students' abilities to apply CT in practise are needed. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

Evaluation of the Level of Students with Visual Impairments in Turkey in Terms of the Concepts of Mobility Prerequisites (Body Plane/Traffic)

ERIC Educational Resources Information Center

Altunay Arslantekin, Banu

2017-01-01

Purpose: Visually impaired people are weak in terms of their learning words and concepts by hearing them and their experience of the world with their bodies. In addition to developing a standardized assessment tool in the Development of Orientation and Mobility Skill Assessment Tool (OMSAT/YOBDA) for Visually Impaired Students Project, supported…

Operationalization of Prediction, Hindcast, and Evaluation Systems using the Freie Univ Evaluation System Framework (Freva) incl. a Showcase in Decadal Climate Prediction

NASA Astrophysics Data System (ADS)

Kadow, Christopher; Illing, Sebastian; Schartner, Thomas; Ulbrich, Uwe; Cubasch, Ulrich

2017-04-01

Operationalization processes are important for Weather and Climate Services. Complex data and work flows need to be combined fast to fulfill the needs of service centers. Standards in data and software formats help in automatic solutions. In this study we show a software solution in between hindcasts, forecasts, and validation to be operationalized. Freva (see below) structures data and evaluation procedures and can easily be monitored. Especially in the development process of operationalized services, Freva supports scientists and project partners. The showcase of the decadal climate prediction project MiKlip (fona-miklip.de) shows such a complex development process. Different predictions, scientists input, tasks, and time evolving adjustments need to be combined to host precise climate informations in a web environment without losing track of its evolution. The Freie Univ Evaluation System Framework (Freva - freva.met.fu-berlin.de) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, including all features present in the shell and web environment. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). Freva indexes different data projects into one common search environment by storing the meta data information of the self-describing model, reanalysis and observational data sets in a database. This implemented meta data system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. The integrated webshell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gateto the research projects HPC. Plugins are able to integrate their e.g. post-processed results into the database ofthe user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a database. Configurations and results of the tools can be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, if configurations match while starting an evaluation plugin, the system suggests to use results already produced by other users - saving CPU/h, I/O, disk space and time. The efficient interaction between different technologies improves the Earth system modeling science framed by Freva.

Tool for Human-Systems Integration Assessment: HSI Scorecard

NASA Technical Reports Server (NTRS)

Whitmore, Nihriban; Sandor, Aniko; McGuire, Kerry M.; Berdich, Debbie

2009-01-01

This paper describes the development and rationale for a human-systems integration (HSI) scorecard that can be used in reviews of vehicle specification and design. This tool can be used to assess whether specific HSI related criteria have been met as part of a project milestone or critical event, such as technical reviews, crew station reviews, mockup evaluations, or even review of major plans or processes. Examples of HSI related criteria include Human Performance Capabilities, Health Management, Human System Interfaces, Anthropometry and Biomechanics, and Natural and Induced Environments. The tool is not intended to evaluate requirements compliance and verification, but to review how well the human related systems have been considered for the specific event and to identify gaps and vulnerabilities from an HSI perspective. The scorecard offers common basis, and criteria for discussions among system managers, evaluators, and design engineers. Furthermore, the scorecard items highlight the main areas of system development that need to be followed during system lifecycle. The ratings provide a repeatable quantitative measure to what has been often seen as only subjective commentary. Thus, the scorecard is anticipated to be a useful HSI tool to communicate review results to the institutional and the project office management.

Water flow algorithm decision support tool for travelling salesman problem

NASA Astrophysics Data System (ADS)

Kamarudin, Anis Aklima; Othman, Zulaiha Ali; Sarim, Hafiz Mohd

2016-08-01

This paper discuss about the role of Decision Support Tool in Travelling Salesman Problem (TSP) for helping the researchers who doing research in same area will get the better result from the proposed algorithm. A study has been conducted and Rapid Application Development (RAD) model has been use as a methodology which includes requirement planning, user design, construction and cutover. Water Flow Algorithm (WFA) with initialization technique improvement is used as the proposed algorithm in this study for evaluating effectiveness against TSP cases. For DST evaluation will go through usability testing conducted on system use, quality of information, quality of interface and overall satisfaction. Evaluation is needed for determine whether this tool can assists user in making a decision to solve TSP problems with the proposed algorithm or not. Some statistical result shown the ability of this tool in term of helping researchers to conduct the experiments on the WFA with improvements TSP initialization.

Assessing Army Values in New Soldiers: Development of a Behaviorally Anchored Peer Evaluation Form

DTIC Science & Technology

2015-02-03

evaluation has long been a valuable tool in school and workplace performance assessment, and has sparked military interest as a tool for leader...Values. Adhering to these values can affect Awards, promotions, selection to attend military schools , leadership positions, and desirable assignments (AR...by ratee and/or rater gender . Assessing the psychometric properties of AVBARS-PE The AVBARS-PE was administered to 50 BCT Soldiers (25 male and 25

Cockpit System Situational Awareness Modeling Tool

NASA Technical Reports Server (NTRS)

Keller, John; Lebiere, Christian; Shay, Rick; Latorella, Kara

2004-01-01

This project explored the possibility of predicting pilot situational awareness (SA) using human performance modeling techniques for the purpose of evaluating developing cockpit systems. The Improved Performance Research Integration Tool (IMPRINT) was combined with the Adaptive Control of Thought-Rational (ACT-R) cognitive modeling architecture to produce a tool that can model both the discrete tasks of pilots and the cognitive processes associated with SA. The techniques for using this tool to predict SA were demonstrated using the newly developed Aviation Weather Information (AWIN) system. By providing an SA prediction tool to cockpit system designers, cockpit concepts can be assessed early in the design process while providing a cost-effective complement to the traditional pilot-in-the-loop experiments and data collection techniques.

ATAMM enhancement and multiprocessor performance evaluation

NASA Technical Reports Server (NTRS)

Stoughton, John W.; Mielke, Roland R.; Som, Sukhamoy; Obando, Rodrigo; Malekpour, Mahyar R.; Jones, Robert L., III; Mandala, Brij Mohan V.

1991-01-01

ATAMM (Algorithm To Architecture Mapping Model) enhancement and multiprocessor performance evaluation is discussed. The following topics are included: the ATAMM model; ATAMM enhancement; ADM (Advanced Development Model) implementation of ATAMM; and ATAMM support tools.

System analysis tools for an ELT at ESO

NASA Astrophysics Data System (ADS)

Mueller, Michael; Koch, Franz

2006-06-01

Engineering of complex, large scale systems like the ELT designs currently investigated and developed in Europe and Northern America require powerful and sophisticated tools within specific technical disciplines such as mechanics, optics and control engineering. However, even analyzing a certain component of the telescope like the telescope structure necessitates a system approach to evaluate the structural effects onto the optical performance. This paper shows several software tools developed by the European Southern Observatory (ESO) which focus onto the system approach in the analyses: Using modal results of a finite element analysis the SMI-toolbox allows an easy generation of structural models with different sizes and levels of accuracy for the control design and closed-loop simulations. The optical modeling code BeamWarrior was developed by ESO and Astrium GmbH, Germany) especially for integrated modeling and interfering with a structural model. Within BeamWarrior displacements and deformations can be applied in an arbitrary coordinate system, and hence also in the global coordinates of the FE model avoiding error prone transformations. In addition to this, a sparse state space model object was developed for Matlab to gain in computational efficiency and reduced memory requirements due to the sparsity pattern of both the structural models and the control architecture. As one result these tools allow building an integrated model in order to reliably simulate interactions, cross-coupling effects, system responses, and to evaluate global performance. In order to evaluate disturbance effects on the optical performance in openloop more efficiently, an optical evaluation toolbox was built in the FE software ANSYS which performs Zernike decomposition and best-fit computation of the deformations directly in the FE analysis.

Human Factors Report: TMA Operational Evaluations 1996 and 1998

NASA Technical Reports Server (NTRS)

Lee, Katharine K.; Quinn, Cheryl M.; Hoang, Ty; Sanford, Beverly D.

2000-01-01

The Traffic Management Advisor (TMA) is a component of the Center-TRACON Automation System (CTAS), a suite of decision-support tools for the air traffic control (ATC) environment which is being developed at NASA Ames Research Center. TMA has been operational at the ATC facilities in Dallas/Fort Worth, Texas, since an operational field evaluation in 1996. The Operational Evaluation demonstrated significant benefits, including an approximately 5 percent increase in airport capacity. This report describes the human factors results from the 1996 Operational Evaluation and an investigation of TMA usage performed two years later, during the 1998 TMA Daily Use Field Survey. The results described are instructive for CTAS focused development, and provide valuable lessons for future research in ATC decision-support tools where it is critical to merge a well-defined, complex work environment with advanced automation.

Prototype app for voice therapy: a peer review.

PubMed

Lavaissiéri, Paula; Melo, Paulo Eduardo Damasceno

2017-03-09

Voice speech therapy promotes changes in patients' voice-related habits and rehabilitation. Speech-language therapists use a host of materials ranging from pictures to electronic resources and computer tools as aids in this process. Mobile technology is attractive, interactive and a nearly constant feature in the daily routine of a large part of the population and has a growing application in healthcare. To develop a prototype application for voice therapy, submit it to peer assessment, and to improve the initial prototype based on these assessments. a prototype of the Q-Voz application was developed based on Apple's Human Interface Guidelines. The prototype was analyzed by seven speech therapists who work in the voice area. Improvements to the product were made based on these assessments. all features of the application were considered satisfactory by most evaluators. All evaluators found the application very useful; evaluators reported that patients would find it easier to make changes in voice behavior with the application than without it; the evaluators stated they would use this application with their patients with dysphonia and in the process of rehabilitation and that the application offers useful tools for voice self-management. Based on the suggestions provided, six improvements were made to the prototype. the prototype Q-Voz Application was developed and evaluated by seven judges and subsequently improved. All evaluators stated they would use the application with their patients undergoing rehabilitation, indicating that the Q-Voz Application for mobile devices can be considered an auxiliary tool for voice speech therapy.

Doing Course Evaluation as if Learning Matters Most

ERIC Educational Resources Information Center

Edstrom, Kristina

2008-01-01

This paper investigates barriers for using course evaluation as a tool for improving student learning, through the analysis of course evaluation practices at The Royal Institute of Technology (KTH), a technical university in Stockholm. Although there is a policy on development-focused course evaluation at KTH, several stakeholders have expressed…

Tools for Formative Evaluation: Gathering the Information Necessary for Program Improvement

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2016-01-01

New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

Usage-Based Collection Evaluation with a Curricular Focus

ERIC Educational Resources Information Center

Kohn, Karen C.

2013-01-01

Systematic evaluation of a library's collection can be a useful tool for collection development. After reviewing three evaluation methods and their usefulness for our small academic library, I undertook a usage-based evaluation, focusing on narrow segments of our collection that served specific undergraduate courses. For each section, I collected…

Experimental evaluation of tool run-out in micro milling

NASA Astrophysics Data System (ADS)

Attanasio, Aldo; Ceretti, Elisabetta

2018-05-01

This paper deals with micro milling cutting process focusing the attention on tool run-out measurement. In fact, among the effects of the scale reduction from macro to micro (i.e., size effects) tool run-out plays an important role. This research is aimed at developing an easy and reliable method to measure tool run-out in micro milling based on experimental tests and an analytical model. From an Industry 4.0 perspective this measuring strategy can be integrated into an adaptive system for controlling cutting forces, with the objective of improving the production quality, the process stability, reducing at the same time the tool wear and the machining costs. The proposed procedure estimates the tool run-out parameters from the tool diameter, the channel width, and the phase angle between the cutting edges. The cutting edge phase measurement is based on the force signal analysis. The developed procedure has been tested on data coming from micro milling experimental tests performed on a Ti6Al4V sample. The results showed that the developed procedure can be successfully used for tool run-out estimation.

Development of Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Brief Review of Do's and Don'ts

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

Questionnaires are a useful and extensively used tool in clinical sleep medicine and in sleep research. The number of sleep questionnaires targeting the pediatric age range has tremendously increased in recent years, and with such explosion in the number of instruments, their heterogeneity has become all the more apparent. Here, we explore the theoretical and pragmatic processes required for instrument design and development, i.e., how any questionnaire, inventory, log, or diary should be created and evaluated, and also provide illustrative examples to further underline the potential pitfalls that are inherently embedded in every step of tool development. PMID:20952230

Development and First Phase Evaluation of a Maternity Leave Educational Tool for Pregnant, Working Women in California

PubMed Central

Kurtovich, Elaine; Guendelman, Sylvia; Neuhauser, Linda; Edelman, Dana; Georges, Maura; Mason-Marti, Peyton

2015-01-01

Background Despite the provision of maternity leave offered to mothers, many American women fail to take leave. Methods We developed an evidence-based maternity leave educational tool for working women in California using participatory design. We tested its short-term efficacy with a randomized controlled trial of pregnant English-speakers (n=155). Results Among intervention participants exposed to the tool, 65% reported that they learned something new; 38% were motivated to seek more information; and 49% said it helped them plan their maternity leave. Among participants who delivered at ≥ 37 weeks gestation and said the tool helped them plan their leave, 89% took more than one week of prenatal leave, a significantly higher proportion than among controls who did not receive the tool (64%, p=0.049). Other findings favored trial participants, but were not statistically significant in this small sample. More intervention participants took some prenatal leave (80%) vs. controls (74%, p=0.44). Among participants who had returned to work when surveyed (n=50), mean postnatal leave uptake was on average 1 week longer for intervention participants vs. controls (13.3 vs. 12.2 weeks, p=0.54). Conclusions The first-phase evaluation of this tool shows that it successfully informed women about maternity leave options, clarified complex regulations, encouraged women to seek further information and helped plan maternity leave. Compared to controls, trial participants who used the tool to plan their leave were far more likely to take prenatal leave close to term. Future evaluation of the tool when mediated by a health provider or employer is warranted. PMID:26107519

Electronic Health Record Tools to Care for At-Risk Older Drivers: A Quality Improvement Project.

PubMed

Casey, Colleen M; Salinas, Katherine; Eckstrom, Elizabeth

2015-06-01

Evaluating driving safety of older adults is an important health topic, but primary care providers (PCP) face multiple barriers in addressing this issue. The study's objectives were to develop an electronic health record (EHR)-based Driving Clinical Support Tool, train PCPs to perform driving assessments utilizing the tool, and systematize documentation of assessment and management of driving safety issues via the tool. The intervention included development of an evidence-based Driving Clinical Support Tool within the EHR, followed by training of internal medicine providers in the tool's content and use. Pre- and postintervention provider surveys and chart review of driving-related patient visits were conducted. Surveys included self-report of preparedness and knowledge to evaluate at-risk older drivers and were analyzed using paired t-test. A chart review of driving-related office visits compared documentation pre- and postintervention including: completeness of appropriate focused history and exam, identification of deficits, patient education, and reporting to appropriate authorities when indicated. Data from 86 providers were analyzed. Pre- and postintervention surveys showed significantly increased self-assessed preparedness (p < .001) and increased driving-related knowledge (p < .001). Postintervention charts showed improved documentation of correct cognitive testing, more referrals/consults, increased patient education about community resources, and appropriate regulatory reporting when deficits were identified. Focused training and an EHR-based clinical support tool improved provider self-reported preparedness and knowledge of how to evaluate at-risk older drivers. The tool improved documentation of driving-related issues and led to improved access to interdisciplinary care coordination. Published by Oxford University Press on behalf of the Gerontological Society of America 2015.

Evaluation and demonstration of commercialization potential of CCSI tools within gPROMS advanced simulation platform

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lawal, Adekola; Schmal, Pieter; Ramos, Alfredo

PSE, in the first phase of the CCSI commercialization project, set out to identify market opportunities for the CCSI tools combined with existing gPROMS platform capabilities and develop a clear technical plan for the proposed commercialization activities.

A GIS-BASED MODAL MODEL OF AUTOMOBILE EXHAUST EMISSIONS

EPA Science Inventory

The report presents progress toward the development of a computer tool called MEASURE, the Mobile Emission Assessment System for Urban and Regional Evaluation. The tool works toward a goal of providing researchers and planners with a way to assess new mobile emission mitigation s...

Surface Roughness Model Based on Force Sensors for the Prediction of the Tool Wear

PubMed Central

de Agustina, Beatriz; Rubio, Eva María; Sebastián, Miguel Ángel

2014-01-01

In this study, a methodology has been developed with the objective of evaluating the surface roughness obtained during turning processes by measuring the signals detected by a force sensor under the same cutting conditions. In this way, the surface quality achieved along the process is correlated to several parameters of the cutting forces (thrust forces, feed forces and cutting forces), so the effect that the tool wear causes on the surface roughness is evaluated. In a first step, the best cutting conditions (cutting parameters and radius of tool) for a certain quality surface requirement were found for pieces of UNS A97075. Next, with this selection a model of surface roughness based on the cutting forces was developed for different states of wear that simulate the behaviour of the tool throughout its life. The validation of this model reveals that it was effective for approximately 70% of the surface roughness values obtained. PMID:24714391

Benchmarking short sequence mapping tools

PubMed Central

2013-01-01

Background The development of next-generation sequencing instruments has led to the generation of millions of short sequences in a single run. The process of aligning these reads to a reference genome is time consuming and demands the development of fast and accurate alignment tools. However, the current proposed tools make different compromises between the accuracy and the speed of mapping. Moreover, many important aspects are overlooked while comparing the performance of a newly developed tool to the state of the art. Therefore, there is a need for an objective evaluation method that covers all the aspects. In this work, we introduce a benchmarking suite to extensively analyze sequencing tools with respect to various aspects and provide an objective comparison. Results We applied our benchmarking tests on 9 well known mapping tools, namely, Bowtie, Bowtie2, BWA, SOAP2, MAQ, RMAP, GSNAP, Novoalign, and mrsFAST (mrFAST) using synthetic data and real RNA-Seq data. MAQ and RMAP are based on building hash tables for the reads, whereas the remaining tools are based on indexing the reference genome. The benchmarking tests reveal the strengths and weaknesses of each tool. The results show that no single tool outperforms all others in all metrics. However, Bowtie maintained the best throughput for most of the tests while BWA performed better for longer read lengths. The benchmarking tests are not restricted to the mentioned tools and can be further applied to others. Conclusion The mapping process is still a hard problem that is affected by many factors. In this work, we provided a benchmarking suite that reveals and evaluates the different factors affecting the mapping process. Still, there is no tool that outperforms all of the others in all the tests. Therefore, the end user should clearly specify his needs in order to choose the tool that provides the best results. PMID:23758764

Development and Evaluation of an Educational E-Tool to Help Patients With Non-Hodgkin's Lymphoma Manage Their Personal Care Pathway.

PubMed

Stienen, Jozette Jc; Ottevanger, Petronella B; Wennekes, Lianne; Dekker, Helena M; van der Maazen, Richard Wm; Mandigers, Caroline Mpw; van Krieken, Johan Hjm; Blijlevens, Nicole Ma; Hermens, Rosella Pmg

2015-01-09

An overload of health-related information is available for patients on numerous websites, guidelines, and information leaflets. However, the increasing need for personalized health-related information is currently unmet. This study evaluates an educational e-tool for patients with non-Hodgkin's lymphoma (NHL) designed to meet patient needs with respect to personalized and complete health-related information provision. The e-tool aims to help NHL patients manage and understand their personal care pathway, by providing them with insight into their own care pathway, the possibility to keep a diary, and structured health-related information. Together with a multidisciplinary NHL expert panel, we developed an e-tool consisting of two sections: (1) a personal section for patients' own care pathway and their experiences, and (2) an informative section including information on NHL. We developed an ideal NHL care pathway based on the available (inter)national guidelines. The ideal care pathway, including date of first consultation, diagnosis, and therapy start, was used to set up the personal care pathway. The informative section was developed in collaboration with the patient association, Hematon. Regarding participants, 14 patients and 6 laymen were asked to evaluate the e-tool. The 24-item questionnaire used discussed issues concerning layout (6 questions), user convenience (3 questions), menu clarity (3 questions), information clarity (5 questions), and general impression (7 questions). In addition, the panel members were asked to give their feedback by email. A comprehensive overview of diagnostics, treatments, and aftercare can be established by patients completing the questions from the personal section. The informative section consisted of NHL information regarding NHL in general, diagnostics, therapy, aftercare, and waiting times. Regarding participants, 6 patients and 6 laymen completed the questionnaire. Overall, the feedback was positive, with at least 75% satisfaction on each feedback item. Important strengths mentioned were the use of a low health-literacy level, the opportunity to document the personal care pathway and experiences, and the clear overview of the information provided. The added value of the e-tool in general was pointed out as very useful for preparing the consultation with one's doctor and for providing all information on one website, including the opportunity for a personalized care pathway and diary. The majority of the revisions concerned wording and clarity. In addition, more explicit information on immunotherapy, experimental therapy, and psychosocial support was added. We have developed a personal care management e-tool for NHL patients. This tool contains a unique way to help patients manage their personal care pathway and give them insight into their NHL by providing health-related information and a personal diary. This evaluation showed that our e-tool meets patients' needs concerning personalized health-related information, which might serve as a good example for other oncologic diseases. Future research should focus on the possible impact of the e-tool on doctor-patient communication during consultations.

The Personal Mobility and Manipulation Appliance (PerMMA): a robotic wheelchair with advanced mobility and manipulation.

PubMed

Wang, Hongwu; Grindle, Garrett G; Candiotti, Jorge; Chung, Chengshiu; Shino, Motoki; Houston, Elaine; Cooper, Rory A

2012-01-01

The Personal Mobility and Manipulation Appliance (PerMMA) is a recently developed personal assistance robot developed to provide people with disabilities and older adults enhanced assistance in both mobility and manipulation, which are two fundamental components for independently activities of daily life performing, community participation, and quality of life. Technologies to assist with mobility and manipulation are among the most important tools for clinicians, end users and caregivers; however, there are currently few systems that provide practical and coordinated assistance with mobility and manipulation tasks. The PerMMA was not only developed and evaluated to provide users and caregivers enhanced mobility and manipulation options, but also as a clinical tool as well as research platform. The development and evaluation of PerMMA are presented in the paper.

The children's menu assessment: development, evaluation, and relevance of a tool for evaluating children's menus.

PubMed

Krukowski, Rebecca A; Eddings, Kenya; West, Delia Smith

2011-06-01

Restaurant foods represent a substantial portion of children's dietary intake, and consumption of foods away from home has been shown to contribute to excess adiposity. This descriptive study aimed to pilot-test and establish the reliability of a standardized and comprehensive assessment tool, the Children's Menu Assessment, for evaluating the restaurant food environment for children. The tool is an expansion of the Nutrition Environment Measures Survey-Restaurant. In 2009-2010, a randomly selected sample of 130 local and chain restaurants were chosen from within 20 miles of Little Rock, AR, to examine the availability of children's menus and to conduct initial calibration of the Children's Menu Assessment tool (final sample: n=46). Independent raters completed the Children's Menu Assessment in order to determine inter-rater reliability. Test-retest reliability was also examined. Inter-rater reliability was high: percent agreement was 97% and Spearman correlation was 0.90. Test-retest was also high: percent agreement was 91% and Spearman correlation was 0.96. Mean Children's Menu Assessment completion time was 14 minutes, 56 seconds ± 10 minutes, 21 seconds. Analysis of Children's Menu Assessment findings revealed that few healthier options were available on children's menus, and most menus did not provide parents with information for making healthy choices, including nutrition information or identification of healthier options. The Children's Menu Assessment tool allows for comprehensive, rapid measurement of the restaurant food environment for children with high inter-rater reliability. This tool has the potential to contribute to public health efforts to develop and evaluate targeted environmental interventions and/or policy changes regarding restaurant foods. Copyright © 2011 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Berman, Andrea; Chmielewski, Cynthia

1996-01-01

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

The live donor assessment tool: a psychosocial assessment tool for live organ donors.

PubMed

Iacoviello, Brian M; Shenoy, Akhil; Braoude, Jenna; Jennings, Tiane; Vaidya, Swapna; Brouwer, Julianna; Haydel, Brandy; Arroyo, Hansel; Thakur, Devendra; Leinwand, Joseph; Rudow, Dianne LaPointe

2015-01-01

Psychosocial evaluation is an important part of the live organ donor evaluation process, yet it is not standardized across institutions, and although tools exist for the psychosocial evaluation of organ recipients, none exist to assess donors. We set out to develop a semistructured psychosocial evaluation tool (the Live Donor Assessment Tool, LDAT) to assess potential live organ donors and to conduct preliminary analyses of the tool's reliability and validity. Review of the literature on the psychosocial variables associated with treatment adherence, quality of life, live organ donation outcome, and resilience, as well as review of the procedures for psychosocial evaluation at our center and other centers around the country, identified 9 domains to address; these domains were distilled into several items each, in collaboration with colleagues at transplant centers across the country, for a total of 29 items. Four raters were trained to use the LDAT, and they retrospectively scored 99 psychosocial evaluations conducted on live organ donor candidates. Reliability of the LDAT was assessed by calculating the internal consistency of the items in the scale and interrater reliability between raters; validity was estimated by comparing LDAT scores between those with a "positive" evaluation outcome and "negative" outcome. The LDAT was found to have good internal consistency, inter-rater reliability, and showed signs of validity: LDAT scores differentiated the positive vs. negative outcome groups. The LDAT demonstrated good reliability and validity, but future research on the LDAT and the ability to implement the LDAT prospectively is warranted. Copyright © 2015 The Academy of Psychosomatic Medicine. Published by Elsevier Inc. All rights reserved.

Development of a virtual lab for practical eLearning in eHealth.

PubMed

Herzog, Juliane; Forjan, Mathias; Sauermann, Stefan; Mense, Alexander; Urbauer, Philipp

2015-01-01

In recent years an ongoing development in educational offers for professionals working in the field of eHealth has been observed. This education is increasingly offered in the form of eLearning courses. Furthermore, it can be seen that simulations are a valuable part to support the knowledge transfer. Based on the knowledge profiles defined for eHealth courses a virtual lab should be developed. For this purpose, a subset of skills and a use case is determined. After searching and evaluating appropriate simulating and testing tools six tools were chosen to implement the use case practically. Within an UML use case diagram the interaction between the tools and the user is represented. Initially tests have shown good results of the tools' feasibility. After an extensive testing phase the tools should be integrated in the eHealth eLearning courses.

Process auditing in long term care facilities.

PubMed

Hewitt, S M; LeSage, J; Roberts, K L; Ellor, J R

1985-01-01

The ECC tool development and audit experiences indicated that there is promise in developing a process audit tool to monitor quality of care in nursing homes; moreover, the tool selected required only one hour per resident. Focusing on the care process and resident needs provided useful information for care providers at the unit level as well as for administrative personnel. Besides incorporating a more interdisciplinary focus, the revised tool needs to define support services most appropriate for nursing homes, includes items related to discharge planning and increases measurement of significant others' involvement in the care process. Future emphasis at the ECC will focus on developing intervention plans to maintain strengths and correct deficiencies identified in the audits. Various strategies to bring about desired changes in the quality of care will be evaluated through regular, periodic monitoring. Having a valid and reliable measure of quality of care as a tool will be an important step forward for LTC facilities.

A decision support tool to determine cost-to-benefit of a family-centered in-home program for at-risk adolescents.

PubMed

Wilson, Fernando A; Araz, Ozgur M; Thompson, Ronald W; Ringle, Jay L; Mason, W Alex; Stimpson, Jim P

2016-06-01

Family-centered program research has demonstrated its effectiveness in improving adolescent outcomes. However, given current fiscal constraints faced by governmental agencies, a recent report from the Institute of Medicine and National Research Council highlighted the need for cost-benefit analyses to inform decision making by policymakers. Furthermore, performance management tools such as balanced scorecards and dashboards do not generally include cost-benefit analyses. In this paper, we describe the development of an Excel-based decision support tool that can be used to evaluate a selected family-based program for at-risk children and adolescents relative to a comparison program or the status quo. This tool incorporates the use of an efficient, user-friendly interface with results provided in concise tabular and graphical formats that may be interpreted without need for substantial training in economic evaluation. To illustrate, we present an application of this tool to evaluate use of Boys Town's In-Home Family Services (IHFS) relative to detention and out-of-home placement in New York City. Use of the decision support tool can help mitigate the need for programs to contract experts in economic evaluation, especially when there are financial or time constraints. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation through research of a three-track career ladder program for registered nurses.

PubMed

Korman, Carol; Eliades, Aris Beoglos

2010-01-01

A descriptive study design was employed to survey registered nurse participants in a career ladder program comprising of three tracks: clinical, education, and management. Findings indicate that participation allows nurses of varying education preparation and roles to demonstrate professional development. Implications for staff development include efficacy of the online survey technique, provision of a reliable tool to evaluate a career ladder, and evaluation of a career ladder that includes the staff development educator.

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

PubMed

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p < 0.01). Its content validity was excellent (all-item content validity index = 0.79-1.00; scale validity index = 0.92). Evidence of its concurrent validity included strong correlation between the developed tool and Short Form 12 Health Survey (r = 0.734; p < 0.001), and participant scores on the developed tool explained ≈46.2% of the between-subject variation for the participant scores on Short Form 12 Health Survey (Nagelkerke R = 0.462). Confirming its construct validity, principal component analysis revealed that 2 factors explained 81.63% of the total variance found. Known-group analysis evidenced the ability of the questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

Evaluating models of healthcare delivery using the Model of Care Evaluation Tool (MCET).

PubMed

Hudspeth, Randall S; Vogt, Marjorie; Wysocki, Ken; Pittman, Oralea; Smith, Susan; Cooke, Cindy; Dello Stritto, Rita; Hoyt, Karen Sue; Merritt, T Jeanne

2016-08-01

Our aim was to provide the outcome of a structured Model of Care (MoC) Evaluation Tool (MCET), developed by an FAANP Best-practices Workgroup, that can be used to guide the evaluation of existing MoCs being considered for use in clinical practice. Multiple MoCs are available, but deciding which model of health care delivery to use can be confusing. This five-component tool provides a structured assessment approach to model selection and has universal application. A literature review using CINAHL, PubMed, Ovid, and EBSCO was conducted. The MCET evaluation process includes five sequential components with a feedback loop from component 5 back to component 3 for reevaluation of any refinements. The components are as follows: (1) Background, (2) Selection of an MoC, (3) Implementation, (4) Evaluation, and (5) Sustainability and Future Refinement. This practical resource considers an evidence-based approach to use in determining the best model to implement based on need, stakeholder considerations, and feasibility. ©2015 American Association of Nurse Practitioners.

The Textevaluator Tool: Helping Teachers and Test Developers Select Texts for Use in Instruction and Assessment

ERIC Educational Resources Information Center

Sheehan, Kathleen M.; Kostin, Irene; Napolitano, Diane; Flor, Michael

2014-01-01

This article describes TextEvaluator, a comprehensive text-analysis system designed to help teachers, textbook publishers, test developers, and literacy researchers select reading materials that are consistent with the text complexity goals outlined in the Common Core State Standards. Three particular aspects of the TextEvaluator measurement…

The Development, Implementation, and Evaluation of a Problem Solving Heuristic

ERIC Educational Resources Information Center

Lorenzo, Mercedes

2005-01-01

Problem-solving is one of the main goals in science teaching and is something many students find difficult. This research reports on the development, implementation and evaluation of a problem-solving heuristic. This heuristic intends to help students to understand the steps involved in problem solving (metacognitive tool), and to provide them…

A Bayesian approach to evaluating habitat for woodland caribou in north-central British Columbia.

Treesearch

R.S. McNay; B.G. Marcot; V. Brumovsky; R. Ellis

2006-01-01

Woodland caribou (Rangifer tarandus caribou) populations are in decline throughout much of their range. With increasing development of caribou habitat, tools are required to make management decisions to support effective conservation of caribou and their range. We developed a series of Bayesian belief networks to evaluate conservation policy...

Development of a smart timber bridge girder with fiber optic sensors

Treesearch

James Wacker; Ursula Deza; Brent M. Phares; Terry J. Wipf

2010-01-01

Past timber bridge evaluation and maintenance efforts in the USA have principally focused on the internal integrity of timber components using various non-destructive evaluation tools to supplement visual inspection data. This project is part of a comprehensive effort to develop smart structure concepts for improving the long-term performance, maintenance, and...

Transverse vibration techniques : logs to structural systems

Treesearch

Robert J. Ross

2008-01-01

Transverse vibration as a nondestructive testing and evaluation technique was first examined in the early 1960s. Initial research and development efforts focused on clear wood, lumber, and laminated products. Out of those efforts, tools were developed that are used today to assess lumber properties. Recently, use of this technique has been investigated for evaluating a...

Faculty Processes Used to Evaluate Self-Reflective Journals in an Online RN-BSN Program

ERIC Educational Resources Information Center

Polley-Payne, Kathleen E.

2017-01-01

Evaluation of student learning activities is part of the fabric of higher education. Expected by accrediting agencies within the health professions disciplines in curricula aimed at the development of reflective practitioners. Student self-reflecting journaling is a strategy frequently employed as a tool to develop reflective practitioners and…

More than a Conversation: Using Cogenerative Dialogues in the Professional Development of High School Chemistry Teachers

ERIC Educational Resources Information Center

Martin, Sonya N.; Scantlebury, Kathryn

2009-01-01

This paper focuses on content-based and pedagogical instructors' use of cogenerative dialogues to improve instructional practice and to evaluate program effectiveness in a professional development program for high school chemistry teachers. We share our research findings from using cogenerative dialogues as an evaluative tool for general…

Application of structured analysis to a telerobotic system

NASA Technical Reports Server (NTRS)

Dashman, Eric; Mclin, David; Harrison, F. W.; Soloway, Donald; Young, Steven

1990-01-01

The analysis and evaluation of a multiple arm telerobotic research and demonstration system developed by the NASA Intelligent Systems Research Laboratory (ISRL) is described. Structured analysis techniques were used to develop a detailed requirements model of an existing telerobotic testbed. Performance models generated during this process were used to further evaluate the total system. A commercial CASE tool called Teamwork was used to carry out the structured analysis and development of the functional requirements model. A structured analysis and design process using the ISRL telerobotic system as a model is described. Evaluation of this system focused on the identification of bottlenecks in this implementation. The results demonstrate that the use of structured methods and analysis tools can give useful performance information early in a design cycle. This information can be used to ensure that the proposed system meets its design requirements before it is built.

Preliminary Dynamic Feasibility and Analysis of a Spherical, Wind-Driven (Tumbleweed), Martian Rover

NASA Technical Reports Server (NTRS)

Flick, John J.; Toniolo, Matthew D.

2005-01-01

The process and findings are presented from a preliminary feasibility study examining the dynamics characteristics of a spherical wind-driven (or Tumbleweed) rover, which is intended for exploration of the Martian surface. The results of an initial feasibility study involving several worst-case mobility situations that a Tumbleweed rover might encounter on the surface of Mars are discussed. Additional topics include the evaluation of several commercially available analysis software packages that were examined as possible platforms for the development of a Monte Carlo Tumbleweed mission simulation tool. This evaluation lead to the development of the Mars Tumbleweed Monte Carlo Simulator (or Tumbleweed Simulator) using the Vortex physics software package from CM-Labs, Inc. Discussions regarding the development and evaluation of the Tumbleweed Simulator, as well as the results of a preliminary analysis using the tool are also presented. Finally, a brief conclusions section is presented.

Improving the Efficiency and Quality of the Value Assessment Process for Companion Diagnostic Tests: The Companion test Assessment Tool (CAT).

PubMed

Canestaro, William J; Pritchard, Daryl E; Garrison, Louis P; Dubois, Robert; Veenstra, David L

2015-08-01

Companion diagnostic tests (CDTs) have emerged as a vital technology in the effective use of an increasing number of targeted drug therapies. Although CDTs can offer a multitude of potential benefits, assessing their value within a health technology appraisal process can be challenging because of a complex array of factors that influence clinical and economic outcomes. To develop a user-friendly tool to assist managed care and other health care decision makers in screening companion tests and determining whether an intensive technology review is necessary and, if so, where the review should be focused to improve efficiency. First, we conducted a systematic literature review of CDT cost-effectiveness studies to identify value drivers. Second, we conducted key informant interviews with a diverse group of stakeholders to elicit feedback and solicit any additional value drivers and identify desirable attributes for an evidence review tool. A draft tool was developed based on this information that captured value drivers, usability features, and had a particular focus on practical use by nonexperts. Finally, the tool was pilot tested with test developers and managed care evidence evaluators to assess face-validity and usability. The tool was also evaluated using several diverse examples of existing companion diagnostics and refined accordingly. We identified 65 cost-effectiveness studies of companion diagnostic technologies. The following factors were most commonly identified as value drivers from our literature review: clinical validity of testing; efficacy, safety, and cost of baseline and alternative treatments; cost and mortality of health states; and biomarker prevalence and testing cost. Stakeholders identified the following additional factors that they believed influenced the overall value of a companion test: regulatory status, actionability, utility, and market penetration. These factors were used to maximize the efficiency of the evidence review process. Stakeholders also stated that a tool should be easy to use and time efficient. Cognitive interviews with stakeholders led to minor changes in the draft tool to improve usability and relevance. The final tool consisted of 4 sections: (1) eligibility for review (2 questions), (2) prioritization of review (3 questions), (3) clinical review (3 questions), and (4) economic review (5 questions). Although the evaluation of CDTs can be challenging because of limited evidence and the added complexity of incorporating a diagnostic test into drug treatment decisions, using a pragmatic tool to identify tests that do not need extensive evaluation may improve the efficiency and effectiveness of CDT value assessments.

Improved alignment evaluation and optimization : final report.

DOT National Transportation Integrated Search

2007-09-11

This report outlines the development of an enhanced highway alignment evaluation and optimization : model. A GIS-based software tool is prepared for alignment optimization that uses genetic algorithms for : optimal search. The software is capable of ...

Challenges of NDE Simulation Tool Challenges of NDE Simulation Tool

NASA Technical Reports Server (NTRS)

Leckey, Cara A. C.; Juarez, Peter D.; Seebo, Jeffrey P.; Frank, Ashley L.

2015-01-01

Realistic nondestructive evaluation (NDE) simulation tools enable inspection optimization and predictions of inspectability for new aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of advanced aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation cannot rapidly simulate damage detection techniques for large scale, complex geometry composite components/vehicles with realistic damage types. This paper discusses some of the challenges of model development and validation for composites, such as the level of realism and scale of simulation needed for NASA' applications. Ongoing model development work is described along with examples of model validation studies. The paper will also discuss examples of the use of simulation tools at NASA to develop new damage characterization methods, and associated challenges of validating those methods.

Laser/Optical Data Base Products: Evaluation and Selection.

ERIC Educational Resources Information Center

Nicholls, Paul Travis

1988-01-01

The practical advice for the evaluation of laser/optical data disk materials (e.g., CD-ROM) is based on a review of the relevant literature. An evaluation framework is outlined and collection development tools and sources of published reviews are identified. (34 references) (Author/CLB)

A software tool for ecosystem services assessments

NASA Astrophysics Data System (ADS)

Riegels, Niels; Klinting, Anders; Butts, Michael; Middelboe, Anne Lise; Mark, Ole

2017-04-01

The EU FP7 DESSIN project is developing methods and tools for assessment of ecosystem services (ESS) and associated economic values, with a focus on freshwater ESS in urban settings. Although the ESS approach has gained considerable visibility over the past ten years, operationalizing the approach remains a challenge. Therefore, DESSSIN is also supporting development of a free software tool to support users implementing the DESSIN ESS evaluation framework. The DESSIN ESS evaluation framework is a structured approach to measuring changes in ecosystem services. The main purpose of the framework is to facilitate the application of the ESS approach in the appraisal of projects that have impacts on freshwater ecosystems and their services. The DESSIN framework helps users evaluate changes in ESS by linking biophysical, economic, and sustainability assessments sequentially. It was developed using the Common International Classification of Ecosystem Services (CICES) and the DPSIR (Drivers, Pressures, States, Impacts, Responses) adaptive management cycle. The former is a standardized system for the classification of ESS developed by the European Union to enhance the consistency and comparability of ESS assessments. The latter is a well-known concept to disentangle the biophysical and social aspects of a system under study. As part of its analytical component, the DESSIN framework also integrates elements of the Final Ecosystem Goods and Services-Classification System (FEGS-CS) of the US Environmental Protection Agency (USEPA). As implemented in the software tool, the DESSIN framework consists of five parts: • In part I of the evaluation, the ecosystem is defined and described and the local stakeholders are identified. In addition, administrative details and objectives of the assessment are defined. • In part II, drivers and pressures are identified. Once these first two elements of the DPSIR scheme have been characterized, the claimed/expected capabilities of a proposed project can be estimated to determine whether the project affects drivers, pressures, states or a combination of these. • In part III, information about impacts on drivers, pressures, and states is used to identify ESS impacted by a proposed project. Potential beneficiaries of impacted ESS are also identified. • In part IV, changes in ESS are estimated. These estimates include changes in the provision of ESS, the use of ESS, and the value of ESS. • A sustainability assessment in Part V estimates the broader impact of a proposed project according to social, environmental, governance and other criteria. The ESS evaluation software tool is designed to assist an evaluation or study leader carrying out an ESS assessment. The tool helps users move through the logic of the ESS evaluation and make sense of relationships between elements of the DPSIR framework, the CICES classification scheme, and the FEGS approach. The tool also provides links to useful indicators and assessment methods in order to help users quantify changes in ESS and ESS values. The software tool is developed in collaboration with the DESSIN user group, who will use the software to estimate changes in ESS resulting from the implementation of green technologies addressing water quality and water scarcity issues. Although the software is targeted to this user group, it will be made available for free to the public after the conclusion of the project.

Smart roadside initiative macro benefit analysis : user’s guide for the benefit-cost analysis tool.

DOT National Transportation Integrated Search

2015-03-01

Through the Smart Roadside Initiative (SRI), a Benefit-Cost Analysis (BCA) tool was developed for the evaluation of various new transportation technologies at a State level and to provide results that could support technology adoption by a State Depa...

Automating Expertise in Collaborative Learning Environments

ERIC Educational Resources Information Center

LaVoie, Noelle; Streeter, Lynn; Lochbaum, Karen; Wroblewski, David; Boyce, Lisa; Krupnick, Charles; Psotka, Joseph

2010-01-01

We have developed a set of tools for improving online collaborative learning including an automated expert that monitors and moderates discussions, and additional tools to evaluate contributions, semantically search all posted comments, access a library of hundreds of digital books and provide reports to instructors. The technology behind these…

Design and Operational Evaluation of the Traffic Management Advisor at the Fort Worth Air Route Traffic Control Center

DOT National Transportation Integrated Search

1997-06-19

NASA and the Federal Aviation Administration (FAA) have designed and developed an automation tool known as the Traffic Management Advisor (TMA). The TMA is a time-based strategic planning tool that provides Traffic Management Coordinators (TMCs) and ...

Tools for Creating Mobile Applications for Extension

ERIC Educational Resources Information Center

Drill, Sabrina L.

2012-01-01

Considerations and tools for developing mobile applications for Extension include evaluating the topic, purpose, and audience. Different computing platforms may be used, and apps designed as modified Web pages or implicitly programmed for a particular platform. User privacy is another important consideration, especially for data collection apps.…

Using Online Compound Interest Tools to Improve Financial Literacy

ERIC Educational Resources Information Center

Hubbard, Edward; Matthews, Percival; Samek, Anya

2016-01-01

The widespread use of personal computing presents the opportunity to design educational materials that can be delivered online, potentially addressing low financial literacy. The authors developed and evaluated three different educational tools focusing on interest compounding. In the authors' laboratory experiment, individuals were randomized to…

Structured Analysis and the Data Flow Diagram: Tools for Library Analysis.

ERIC Educational Resources Information Center

Carlson, David H.

1986-01-01

This article discusses tools developed to aid the systems analysis process (program evaluation and review technique, Gantt charts, organizational charts, decision tables, flowcharts, hierarchy plus input-process-output). Similarities and differences among techniques, library applications of analysis, structured systems analysis, and the data flow…

Geographic Information System Tools for Conservation Planning: User's Manual

USGS Publications Warehouse

Fox, Timothy J.; Rohweder, Jason J.; Kenow, K.P.; Korschgen, C.E.; DeHaan, H.C.

2003-01-01

Public and private land managers desire better ways to incorporate landscape, species, and habitat relations into their conservation planning processes. We present three tools, developed for the Environmental Systems Research Institute?s ArcView 3.x platform, applicable to many types of wildlife conservation management and planning efforts. These tools provide managers and planners with the ability to rapidly assess landscape attributes and link these attributes with species-habitat information. To use the tools, the user provides a detailed land cover spatial database and develops a matrix to identify species-habitat relations for the landscape of interest. The tools are applicable to any taxa or suite of taxa for which the required data are available. The user also has the ability to interactively make polygon-specific changes to the landscape and re-examine species-habitat relations. The development of these tools has given resource managers the means to evaluate the merits of proposed landscape management scenarios and to choose the scenario that best fits the goals of the managed area.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mills, Evan

There exist hundreds of building energy software tools, both web- and disk-based. These tools exhibit considerable range in approach and creativity, with some being highly specialized and others able to consider the building as a whole. However, users are faced with a dizzying array of choices and, often, conflicting results. The fragmentation of development and deployment efforts has hampered tool quality and market penetration. The purpose of this review is to provide information for defining the desired characteristics of residential energy tools, and to encourage future tool development that improves on current practice. This project entails (1) creating a frameworkmore » for describing possible technical and functional characteristics of such tools, (2) mapping existing tools onto this framework, (3) exploring issues of tool accuracy, and (4) identifying ''best practice'' and strategic opportunities for tool design. evaluated 50 web-based residential calculators, 21 of which we regard as ''whole-house'' tools(i.e., covering a range of end uses). Of the whole-house tools, 13 provide open-ended energy calculations, 5 normalize the results to actual costs (a.k.a ''bill-disaggregation tools''), and 3 provide both options. Across the whole-house tools, we found a range of 5 to 58 house-descriptive features (out of 68 identified in our framework) and 2 to 41 analytical and decision-support features (55 possible). We also evaluated 15 disk-based residential calculators, six of which are whole-house tools. Of these tools, 11 provide open-ended calculations, 1 normalizes the results to actual costs, and 3 provide both options. These tools offered ranges of 18 to 58 technical features (70 possible) and 10 to 40 user- and decision-support features (56 possible). The comparison shows that such tools can employ many approaches and levels of detail. Some tools require a relatively small number of well-considered inputs while others ask a myriad of questions and still miss key issues. The value of detail has a lot to do with the type of question(s) being asked by the user (e.g., the availability of dozens of miscellaneous appliances is immaterial for a user attempting to evaluate the potential for space-heating savings by installing a new furnace). More detail does not, according to our evaluation, automatically translate into a ''better'' or ''more accurate'' tool. Efforts to quantify and compare the ''accuracy'' of these tools are difficult at best, and prior tool-comparison studies have not undertaken this in a meaningful way. The ability to evaluate accuracy is inherently limited by the availability of measured data. Furthermore, certain tool outputs can only be measured against ''actual'' values that are themselves calculated (e.g., HVAC sizing), while others are rarely if ever available (e.g., measured energy use or savings for specific measures). Similarly challenging is to understand the sources of inaccuracies. There are many ways in which quantitative errors can occur in tools, ranging from programming errors to problems inherent in a tool's design. Due to hidden assumptions and non-variable ''defaults'', most tools cannot be fully tested across the desirable range of building configurations, operating conditions, weather locations, etc. Many factors conspire to confound performance comparisons among tools. Differences in inputs can range from weather city, to types of HVAC systems, to appliance characteristics, to occupant-driven effects such as thermostat management. Differences in results would thus no doubt emerge from an extensive comparative exercise, but the sources or implications of these differences for the purposes of accuracy evaluation or tool development would remain largely unidentifiable (especially given the paucity of technical documentation available for most tools). For the tools that we tested, the predicted energy bills for a single test building ranged widely (by nearly a factor of three), and far more so at the end-use level. Most tools over-predicted energy bills and all over-predicted consumption. Variability was lower among disk-based tools,but they more significantly over-predicted actual use. The deviations (over-predictions) we observed from actual bills corresponded to up to $1400 per year (approx. 250 percent of the actual bills). For bill-disaggregation tools, wherein the results are forced to equal actual bills, the accuracy issue shifts to whether or not the total is properly attributed to the various end uses and to whether savings calculations are done accurately (a challenge that demands relatively rare end-use data). Here, too, we observed a number of dubious results. Energy savings estimates automatically generated by the web-based tools varied from $46/year (5 percent of predicted use) to $625/year (52 percent of predicted use).« less

Using GeoRePORT to report socio-economic potential for geothermal development

DOE Office of Scientific and Technical Information (OSTI.GOV)

Young, Katherine R.; Levine, Aaron

The Geothermal Resource Portfolio Optimization and Reporting Tool (GeoRePORT, http://en.openei.org/wiki/GeoRePORT) was developed for reporting resource grades and project readiness levels, providing the U.S. Department of Energy a consistent and comprehensible means of evaluating projects. The tool helps funding organizations (1) quantitatively identify barriers, (2) develop measureable goals, (3) objectively evaluate proposals, including contribution to goals, (4) monitor progress, and (5) report portfolio performance. GeoRePORT assesses three categories: geological, technical, and socio-economic. Here, we describe GeoRePORT, then focus on the socio-economic assessment and its applications for assessing deployment potential in the U.S. Socio-economic attributes include land access, permitting, transmission, and market.